2023-05-16T13:36:19.604 INFO:root:teuthology version: 0.0.1.dev98+g69caab8 2023-05-16T13:36:19.605 DEBUG:teuthology.run:Teuthology command: teuthology --name rishabh-2023-05-16_10:39:13-fs-wip-rishabh-2023May15-1524-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-05-16_10:39:13-fs-wip-rishabh-2023May15-1524-testing-default-smithi/7275621 --verbose -- /home/teuthworker/archive/rishabh-2023-05-16_10:39:13-fs-wip-rishabh-2023May15-1524-testing-default-smithi/7275621/orig.config.yaml 2023-05-16T13:36:19.647 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-05-16T13:36:19.756 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-05-16_10:39:13-fs-wip-rishabh-2023May15-1524-testing-default-smithi/7275621 branch: wip-rishabh-2023May15-1524 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} email: null first_in_suite: false job_id: '7275621' kernel: flavor: default kdb: true sha1: 7312ab6f53ec3dd1c2d90b6652327feae750728b ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-05-16_10:39:13-fs-wip-rishabh-2023May15-1524-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-rishabh-2023May15-1524 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 27be51263d3d0c721b6d1ca9f42550bf0ab3c97b ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 27be51263d3d0c721b6d1ca9f42550bf0ab3c97b thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-2023May15-1524 sha1: 27be51263d3d0c721b6d1ca9f42550bf0ab3c97b owner: scheduled_rishabh@teuthology priority: 100 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 sha1: 27be51263d3d0c721b6d1ca9f42550bf0ab3c97b sleep_before_teardown: 0 suite: fs suite_branch: wip-rishabh-2023May15-1524 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 27be51263d3d0c721b6d1ca9f42550bf0ab3c97b syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi039.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPLgaZCgHHMb7615CwV1jD6tdN818YQl793IoebK306r65ouKS05wr9CGi5q+T8SHPYD6DCXssZMoQdJs8hVxQw= smithi118.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNwSPNtYBXgfmoEnZDpfFy9ahqSbLJN34KRcKWt5KPl3RPB/pOqJOzsI6h9wTqbMMlWECXlVZ1Byj88v2kZ5fHk= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - ceph-fuse: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 69caab8ec6f44c61c991ae693e8e7b8cd859a896 timestamp: 2023-05-16_10:39:13 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23459 2023-05-16T13:36:19.757 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/qa; will attempt to use it 2023-05-16T13:36:19.758 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/qa/tasks 2023-05-16T13:36:19.758 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-05-16T13:36:19.760 INFO:teuthology.task.internal:Checking packages... 2023-05-16T13:36:19.787 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '27be51263d3d0c721b6d1ca9f42550bf0ab3c97b' 2023-05-16T13:36:19.788 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-05-16T13:36:19.788 INFO:teuthology.packaging:ref: None 2023-05-16T13:36:19.788 INFO:teuthology.packaging:tag: None 2023-05-16T13:36:19.789 INFO:teuthology.packaging:branch: wip-rishabh-2023May15-1524 2023-05-16T13:36:19.789 INFO:teuthology.packaging:sha1: 27be51263d3d0c721b6d1ca9f42550bf0ab3c97b 2023-05-16T13:36:19.789 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-rishabh-2023May15-1524 2023-05-16T13:36:19.927 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-3926-g27be5126-1jammy 2023-05-16T13:36:19.927 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-05-16T13:36:19.940 INFO:teuthology.task.internal:no buildpackages task found 2023-05-16T13:36:19.941 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-05-16T13:36:19.952 INFO:teuthology.task.internal:Saving configuration 2023-05-16T13:36:19.967 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-05-16T13:36:19.974 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-05-16T13:36:20.003 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi039.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-05-16_10:39:13-fs-wip-rishabh-2023May15-1524-testing-default-smithi/7275621', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-05-16 13:29:39.389022', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIPPRkxiw0MqKV0FxVmvjbSPiVaOtVm0Vegwgf4B3mIvE'} 2023-05-16T13:36:20.028 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi118.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-05-16_10:39:13-fs-wip-rishabh-2023May15-1524-testing-default-smithi/7275621', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-05-16 13:29:39.387345', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGq7ZhaBzy/spTtkONv1YQOO9tR8M4cFtXNJovTG20Ew'} 2023-05-16T13:36:20.029 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-05-16T13:36:20.034 INFO:teuthology.task.internal:roles: ubuntu@smithi039.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-05-16T13:36:20.035 INFO:teuthology.task.internal:roles: ubuntu@smithi118.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-05-16T13:36:20.035 INFO:teuthology.run_tasks:Running task console_log... 2023-05-16T13:36:20.117 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5eda5b2f70>, signals=[15]) 2023-05-16T13:36:20.119 INFO:teuthology.run_tasks:Running task internal.connect... 2023-05-16T13:36:20.124 INFO:teuthology.task.internal:Opening connections... 2023-05-16T13:36:20.125 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi039.front.sepia.ceph.com 2023-05-16T13:36:20.127 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-16T13:36:20.201 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi118.front.sepia.ceph.com 2023-05-16T13:36:20.202 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-16T13:36:20.279 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-05-16T13:36:20.286 DEBUG:teuthology.orchestra.run.smithi039:> uname -m 2023-05-16T13:36:20.291 INFO:teuthology.orchestra.run.smithi039.stdout:x86_64 2023-05-16T13:36:20.291 DEBUG:teuthology.orchestra.run.smithi039:> cat /etc/os-release 2023-05-16T13:36:20.335 INFO:teuthology.orchestra.run.smithi039.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-05-16T13:36:20.336 INFO:teuthology.orchestra.run.smithi039.stdout:NAME="Ubuntu" 2023-05-16T13:36:20.336 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION_ID="22.04" 2023-05-16T13:36:20.336 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-05-16T13:36:20.336 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION_CODENAME=jammy 2023-05-16T13:36:20.336 INFO:teuthology.orchestra.run.smithi039.stdout:ID=ubuntu 2023-05-16T13:36:20.337 INFO:teuthology.orchestra.run.smithi039.stdout:ID_LIKE=debian 2023-05-16T13:36:20.337 INFO:teuthology.orchestra.run.smithi039.stdout:HOME_URL="https://www.ubuntu.com/" 2023-05-16T13:36:20.337 INFO:teuthology.orchestra.run.smithi039.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-05-16T13:36:20.337 INFO:teuthology.orchestra.run.smithi039.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-05-16T13:36:20.337 INFO:teuthology.orchestra.run.smithi039.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-05-16T13:36:20.337 INFO:teuthology.orchestra.run.smithi039.stdout:UBUNTU_CODENAME=jammy 2023-05-16T13:36:20.338 INFO:teuthology.lock.ops:Updating smithi039.front.sepia.ceph.com on lock server 2023-05-16T13:36:20.371 DEBUG:teuthology.orchestra.run.smithi118:> uname -m 2023-05-16T13:36:20.376 INFO:teuthology.orchestra.run.smithi118.stdout:x86_64 2023-05-16T13:36:20.377 DEBUG:teuthology.orchestra.run.smithi118:> cat /etc/os-release 2023-05-16T13:36:20.423 INFO:teuthology.orchestra.run.smithi118.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-05-16T13:36:20.423 INFO:teuthology.orchestra.run.smithi118.stdout:NAME="Ubuntu" 2023-05-16T13:36:20.423 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_ID="22.04" 2023-05-16T13:36:20.423 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-05-16T13:36:20.424 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_CODENAME=jammy 2023-05-16T13:36:20.424 INFO:teuthology.orchestra.run.smithi118.stdout:ID=ubuntu 2023-05-16T13:36:20.424 INFO:teuthology.orchestra.run.smithi118.stdout:ID_LIKE=debian 2023-05-16T13:36:20.424 INFO:teuthology.orchestra.run.smithi118.stdout:HOME_URL="https://www.ubuntu.com/" 2023-05-16T13:36:20.424 INFO:teuthology.orchestra.run.smithi118.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-05-16T13:36:20.424 INFO:teuthology.orchestra.run.smithi118.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-05-16T13:36:20.424 INFO:teuthology.orchestra.run.smithi118.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-05-16T13:36:20.425 INFO:teuthology.orchestra.run.smithi118.stdout:UBUNTU_CODENAME=jammy 2023-05-16T13:36:20.425 INFO:teuthology.lock.ops:Updating smithi118.front.sepia.ceph.com on lock server 2023-05-16T13:36:20.446 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-05-16T13:36:20.462 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-05-16T13:36:20.468 INFO:teuthology.task.internal:Checking for old test directory... 2023-05-16T13:36:20.469 DEBUG:teuthology.orchestra.run.smithi039:> test '!' -e /home/ubuntu/cephtest 2023-05-16T13:36:20.471 DEBUG:teuthology.orchestra.run.smithi118:> test '!' -e /home/ubuntu/cephtest 2023-05-16T13:36:20.475 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-05-16T13:36:20.480 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-05-16T13:36:20.481 DEBUG:teuthology.orchestra.run.smithi039:> test -z $(ls -A /var/lib/ceph) 2023-05-16T13:36:20.517 DEBUG:teuthology.orchestra.run.smithi118:> test -z $(ls -A /var/lib/ceph) 2023-05-16T13:36:20.537 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-05-16T13:36:20.599 INFO:teuthology.run_tasks:Running task kernel... 2023-05-16T13:36:20.616 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': '7312ab6f53ec3dd1c2d90b6652327feae750728b'} 2023-05-16T13:36:20.616 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': '7312ab6f53ec3dd1c2d90b6652327feae750728b'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': '7312ab6f53ec3dd1c2d90b6652327feae750728b'}}, timeout 300 2023-05-16T13:36:20.617 DEBUG:teuthology.orchestra.run.smithi039:> test -f /run/.containerenv -o -f /.dockerenv 2023-05-16T13:36:20.618 DEBUG:teuthology.orchestra.run.smithi118:> test -f /run/.containerenv -o -f /.dockerenv 2023-05-16T13:36:20.621 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-16T13:36:20.622 DEBUG:teuthology.task.kernel:sha1 for mon.a is 7312ab6f53ec3dd1c2d90b6652327feae750728b 2023-05-16T13:36:20.622 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "7312ab6f53ec3dd1c2d90b6652327feae750728b"... 2023-05-16T13:36:20.622 DEBUG:teuthology.orchestra.run.smithi039:> uname -r 2023-05-16T13:36:20.623 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-16T13:36:20.623 DEBUG:teuthology.task.kernel:sha1 for mon.b is 7312ab6f53ec3dd1c2d90b6652327feae750728b 2023-05-16T13:36:20.623 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "7312ab6f53ec3dd1c2d90b6652327feae750728b"... 2023-05-16T13:36:20.624 DEBUG:teuthology.orchestra.run.smithi118:> uname -r 2023-05-16T13:36:20.668 INFO:teuthology.orchestra.run.smithi039.stdout:5.15.0-56-generic 2023-05-16T13:36:20.669 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 7312ab6f53ec3dd1c2d90b6652327feae750728b 2023-05-16T13:36:20.669 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-05-16T13:36:20.669 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7312ab6f53ec3dd1c2d90b6652327feae750728b 2023-05-16T13:36:20.673 INFO:teuthology.orchestra.run.smithi118.stdout:5.15.0-56-generic 2023-05-16T13:36:20.673 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 7312ab6f53ec3dd1c2d90b6652327feae750728b 2023-05-16T13:36:20.673 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-05-16T13:36:20.673 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7312ab6f53ec3dd1c2d90b6652327feae750728b 2023-05-16T13:36:20.816 INFO:teuthology.task.kernel:Installing linux-firmware on mon.a... 2023-05-16T13:36:20.817 DEBUG:teuthology.orchestra.run.smithi039:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-05-16T13:36:20.828 INFO:teuthology.task.kernel:Installing linux-firmware on mon.b... 2023-05-16T13:36:20.829 DEBUG:teuthology.orchestra.run.smithi118:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-05-16T13:36:20.831 INFO:teuthology.orchestra.run.smithi039.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-05-16T13:36:20.865 INFO:teuthology.orchestra.run.smithi118.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-05-16T13:36:20.982 INFO:teuthology.orchestra.run.smithi039.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-05-16T13:36:20.983 INFO:teuthology.orchestra.run.smithi039.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-05-16T13:36:20.983 INFO:teuthology.orchestra.run.smithi039.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-05-16T13:36:20.983 INFO:teuthology.orchestra.run.smithi039.stderr:hint: 2023-05-16T13:36:20.983 INFO:teuthology.orchestra.run.smithi039.stderr:hint: git config --global init.defaultBranch 2023-05-16T13:36:20.984 INFO:teuthology.orchestra.run.smithi039.stderr:hint: 2023-05-16T13:36:20.984 INFO:teuthology.orchestra.run.smithi039.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-05-16T13:36:20.984 INFO:teuthology.orchestra.run.smithi039.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-05-16T13:36:20.984 INFO:teuthology.orchestra.run.smithi039.stderr:hint: 2023-05-16T13:36:20.984 INFO:teuthology.orchestra.run.smithi039.stderr:hint: git branch -m 2023-05-16T13:36:20.985 INFO:teuthology.orchestra.run.smithi039.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-05-16T13:36:20.986 DEBUG:teuthology.orchestra.run.smithi039:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-05-16T13:36:21.009 INFO:teuthology.orchestra.run.smithi118.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-05-16T13:36:21.009 INFO:teuthology.orchestra.run.smithi118.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-05-16T13:36:21.010 INFO:teuthology.orchestra.run.smithi118.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-05-16T13:36:21.010 INFO:teuthology.orchestra.run.smithi118.stderr:hint: 2023-05-16T13:36:21.010 INFO:teuthology.orchestra.run.smithi118.stderr:hint: git config --global init.defaultBranch 2023-05-16T13:36:21.010 INFO:teuthology.orchestra.run.smithi118.stderr:hint: 2023-05-16T13:36:21.010 INFO:teuthology.orchestra.run.smithi118.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-05-16T13:36:21.011 INFO:teuthology.orchestra.run.smithi118.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-05-16T13:36:21.011 INFO:teuthology.orchestra.run.smithi118.stderr:hint: 2023-05-16T13:36:21.011 INFO:teuthology.orchestra.run.smithi118.stderr:hint: git branch -m 2023-05-16T13:36:21.012 INFO:teuthology.orchestra.run.smithi118.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-05-16T13:36:21.013 DEBUG:teuthology.orchestra.run.smithi118:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-05-16T13:36:21.051 DEBUG:teuthology.orchestra.run.smithi039:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-05-16T13:36:21.080 DEBUG:teuthology.orchestra.run.smithi118:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-05-16T13:36:21.106 DEBUG:teuthology.orchestra.run.smithi039:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-05-16T13:36:21.137 DEBUG:teuthology.orchestra.run.smithi118:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-05-16T13:37:09.047 INFO:teuthology.orchestra.run.smithi118.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-05-16T13:37:09.048 INFO:teuthology.orchestra.run.smithi118.stderr: * [new branch] main -> origin/main 2023-05-16T13:37:09.048 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20230515 -> 20230515 2023-05-16T13:37:09.075 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20190312 -> 20190312 2023-05-16T13:37:09.075 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20190416 -> 20190416 2023-05-16T13:37:09.075 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20190514 -> 20190514 2023-05-16T13:37:09.075 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20190618 -> 20190618 2023-05-16T13:37:09.076 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20190717 -> 20190717 2023-05-16T13:37:09.076 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20190815 -> 20190815 2023-05-16T13:37:09.076 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20190923 -> 20190923 2023-05-16T13:37:09.077 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20191022 -> 20191022 2023-05-16T13:37:09.077 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20191215 -> 20191215 2023-05-16T13:37:09.077 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20200122 -> 20200122 2023-05-16T13:37:09.077 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20200316 -> 20200316 2023-05-16T13:37:09.077 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20200421 -> 20200421 2023-05-16T13:37:09.077 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20200519 -> 20200519 2023-05-16T13:37:09.079 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20200619 -> 20200619 2023-05-16T13:37:09.079 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20200721 -> 20200721 2023-05-16T13:37:09.079 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20200817 -> 20200817 2023-05-16T13:37:09.079 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20200918 -> 20200918 2023-05-16T13:37:09.079 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20201022 -> 20201022 2023-05-16T13:37:09.079 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20201118 -> 20201118 2023-05-16T13:37:09.080 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20201218 -> 20201218 2023-05-16T13:37:09.080 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20210208 -> 20210208 2023-05-16T13:37:09.080 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20210315 -> 20210315 2023-05-16T13:37:09.080 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20210511 -> 20210511 2023-05-16T13:37:09.080 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20210716 -> 20210716 2023-05-16T13:37:09.080 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20210818 -> 20210818 2023-05-16T13:37:09.080 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20210919 -> 20210919 2023-05-16T13:37:09.081 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20211027 -> 20211027 2023-05-16T13:37:09.081 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20211216 -> 20211216 2023-05-16T13:37:09.081 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20220209 -> 20220209 2023-05-16T13:37:09.081 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20220310 -> 20220310 2023-05-16T13:37:09.081 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20220411 -> 20220411 2023-05-16T13:37:09.082 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20220509 -> 20220509 2023-05-16T13:37:09.082 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20220610 -> 20220610 2023-05-16T13:37:09.082 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20220708 -> 20220708 2023-05-16T13:37:09.083 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20220815 -> 20220815 2023-05-16T13:37:09.083 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20220913 -> 20220913 2023-05-16T13:37:09.083 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20221012 -> 20221012 2023-05-16T13:37:09.083 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20221109 -> 20221109 2023-05-16T13:37:09.083 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20221214 -> 20221214 2023-05-16T13:37:09.083 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20230117 -> 20230117 2023-05-16T13:37:09.083 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20230210 -> 20230210 2023-05-16T13:37:09.084 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20230310 -> 20230310 2023-05-16T13:37:09.084 INFO:teuthology.orchestra.run.smithi118.stderr: * [new tag] 20230404 -> 20230404 2023-05-16T13:37:11.259 INFO:teuthology.orchestra.run.smithi039.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-05-16T13:37:11.259 INFO:teuthology.orchestra.run.smithi039.stderr: * [new branch] main -> origin/main 2023-05-16T13:37:11.260 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20230515 -> 20230515 2023-05-16T13:37:11.285 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20190312 -> 20190312 2023-05-16T13:37:11.285 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20190416 -> 20190416 2023-05-16T13:37:11.285 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20190514 -> 20190514 2023-05-16T13:37:11.285 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20190618 -> 20190618 2023-05-16T13:37:11.285 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20190717 -> 20190717 2023-05-16T13:37:11.285 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20190815 -> 20190815 2023-05-16T13:37:11.286 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20190923 -> 20190923 2023-05-16T13:37:11.286 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20191022 -> 20191022 2023-05-16T13:37:11.286 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20191215 -> 20191215 2023-05-16T13:37:11.286 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20200122 -> 20200122 2023-05-16T13:37:11.288 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20200316 -> 20200316 2023-05-16T13:37:11.289 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20200421 -> 20200421 2023-05-16T13:37:11.289 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20200519 -> 20200519 2023-05-16T13:37:11.289 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20200619 -> 20200619 2023-05-16T13:37:11.289 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20200721 -> 20200721 2023-05-16T13:37:11.289 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20200817 -> 20200817 2023-05-16T13:37:11.289 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20200918 -> 20200918 2023-05-16T13:37:11.289 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20201022 -> 20201022 2023-05-16T13:37:11.289 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20201118 -> 20201118 2023-05-16T13:37:11.290 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20201218 -> 20201218 2023-05-16T13:37:11.290 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20210208 -> 20210208 2023-05-16T13:37:11.290 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20210315 -> 20210315 2023-05-16T13:37:11.290 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20210511 -> 20210511 2023-05-16T13:37:11.290 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20210716 -> 20210716 2023-05-16T13:37:11.290 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20210818 -> 20210818 2023-05-16T13:37:11.290 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20210919 -> 20210919 2023-05-16T13:37:11.291 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20211027 -> 20211027 2023-05-16T13:37:11.291 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20211216 -> 20211216 2023-05-16T13:37:11.291 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20220209 -> 20220209 2023-05-16T13:37:11.291 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20220310 -> 20220310 2023-05-16T13:37:11.291 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20220411 -> 20220411 2023-05-16T13:37:11.291 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20220509 -> 20220509 2023-05-16T13:37:11.291 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20220610 -> 20220610 2023-05-16T13:37:11.291 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20220708 -> 20220708 2023-05-16T13:37:11.292 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20220815 -> 20220815 2023-05-16T13:37:11.292 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20220913 -> 20220913 2023-05-16T13:37:11.292 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20221012 -> 20221012 2023-05-16T13:37:11.292 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20221109 -> 20221109 2023-05-16T13:37:11.292 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20221214 -> 20221214 2023-05-16T13:37:11.292 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20230117 -> 20230117 2023-05-16T13:37:11.292 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20230210 -> 20230210 2023-05-16T13:37:11.293 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20230310 -> 20230310 2023-05-16T13:37:11.293 INFO:teuthology.orchestra.run.smithi039.stderr: * [new tag] 20230404 -> 20230404 2023-05-16T13:37:12.269 INFO:teuthology.orchestra.run.smithi118.stderr:Updating files: 50% (1465/2929) Updating files: 51% (1494/2929) Updating files: 52% (1524/2929) Updating files: 53% (1553/2929) Updating files: 54% (1582/2929) Updating files: 55% (1611/2929) Updating files: 56% (1641/2929) Updating files: 57% (1670/2929) Updating files: 58% (1699/2929) Updating files: 59% (1729/2929) Updating files: 60% (1758/2929) Updating files: 61% (1787/2929) Updating files: 62% (1816/2929) Updating files: 63% (1846/2929) Updating files: 64% (1875/2929) Updating files: 65% (1904/2929) Updating files: 65% (1913/2929) Updating files: 66% (1934/2929) Updating files: 67% (1963/2929) Updating files: 68% (1992/2929) Updating files: 69% (2022/2929) Updating files: 70% (2051/2929) Updating files: 71% (2080/2929) Updating files: 72% (2109/2929) Updating files: 73% (2139/2929) Updating files: 74% (2168/2929) Updating files: 75% (2197/2929) Updating files: 76% (2227/2929) Updating files: 77% (2256/2929) Updating files: 78% (2285/2929) Updating files: 79% (2314/2929) Updating files: 80% (2344/2929) Updating files: 81% (2373/2929) Updating files: 82% (2402/2929) Updating files: 83% (2432/2929) Updating files: 83% (2442/2929) Updating files: 84% (2461/2929) Updating files: 85% (2490/2929) Updating files: 86% (2519/2929) Updating files: 87% (2549/2929) Updating files: 88% (2578/2929) Updating files: 89% (2607/2929) Updating files: 90% (2637/2929) Updating files: 91% (2666/2929) Updating files: 92% (2695/2929) Updating files: 93% (2724/2929) Updating files: 94% (2754/2929) Updating files: 95% (2783/2929) Updating files: 96% (2812/2929) Updating files: 97% (2842/2929) Updating files: 98% (2871/2929) Updating files: 99% (2900/2929) Updating files: 100% (2929/2929) Updating files: 100% (2929/2929), done. 2023-05-16T13:37:12.273 INFO:teuthology.orchestra.run.smithi118.stdout:HEAD is now at 51290942 Merge branch 'main' of https://github.com/CirrusLogic/linux-firmware 2023-05-16T13:37:12.291 INFO:teuthology.task.kernel:Downloading kernel 7312ab6f53ec3dd1c2d90b6652327feae750728b on mon.b... 2023-05-16T13:37:12.292 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7312ab6f53ec3dd1c2d90b6652327feae750728b 2023-05-16T13:37:12.441 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/7312ab6f53ec3dd1c2d90b6652327feae750728b/ubuntu/jammy/flavors/default/pool/main/l/linux-6.3.0-g7312ab6f53ec/ 2023-05-16T13:37:12.441 DEBUG:teuthology.orchestra.run.smithi118:> rm -f /tmp/linux-image.deb && echo linux-image-6.3.0-g7312ab6f53ec_6.3.0-g7312ab6f53ec-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://3.chacra.ceph.com/r/kernel/testing/7312ab6f53ec3dd1c2d90b6652327feae750728b/ubuntu/jammy/flavors/default/pool/main/l/linux-6.3.0-g7312ab6f53ec/ --input-file=- 2023-05-16T13:37:12.444 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi118.front.sepia.ceph.com to complete... 2023-05-16T13:37:14.074 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16 13:37:14 URL:https://3.chacra.ceph.com/r/kernel/testing/7312ab6f53ec3dd1c2d90b6652327feae750728b/ubuntu/jammy/flavors/default/pool/main/l/linux-6.3.0-g7312ab6f53ec/linux-image-6.3.0-g7312ab6f53ec_6.3.0-g7312ab6f53ec-1_amd64.deb [38545358/38545358] -> "/tmp/linux-image.deb" [1] 2023-05-16T13:37:14.074 INFO:teuthology.orchestra.run.smithi118.stderr:FINISHED --2023-05-16 13:37:14-- 2023-05-16T13:37:14.074 INFO:teuthology.orchestra.run.smithi118.stderr:Total wall clock time: 1.6s 2023-05-16T13:37:14.074 INFO:teuthology.orchestra.run.smithi118.stderr:Downloaded: 1 files, 37M in 1.5s (24.8 MB/s) 2023-05-16T13:37:14.077 INFO:teuthology.task.kernel:Installing kernel 7312ab6f53ec3dd1c2d90b6652327feae750728b on mon.b... 2023-05-16T13:37:14.077 DEBUG:teuthology.orchestra.run.smithi118:> sudo dpkg -i /tmp/linux-image.deb 2023-05-16T13:37:14.416 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package linux-image-6.3.0-g7312ab6f53ec. 2023-05-16T13:37:14.666 INFO:teuthology.orchestra.run.smithi039.stderr:Updating files: 46% (1373/2929) Updating files: 47% (1377/2929) Updating files: 48% (1406/2929) Updating files: 49% (1436/2929) Updating files: 50% (1465/2929) Updating files: 51% (1494/2929) Updating files: 52% (1524/2929) Updating files: 53% (1553/2929) Updating files: 54% (1582/2929) Updating files: 55% (1611/2929) Updating files: 56% (1641/2929) Updating files: 57% (1670/2929) Updating files: 58% (1699/2929) Updating files: 59% (1729/2929) Updating files: 60% (1758/2929) Updating files: 61% (1787/2929) Updating files: 62% (1816/2929) Updating files: 63% (1846/2929) Updating files: 64% (1875/2929) Updating files: 65% (1904/2929) Updating files: 65% (1911/2929) Updating files: 66% (1934/2929) Updating files: 67% (1963/2929) Updating files: 68% (1992/2929) Updating files: 69% (2022/2929) Updating files: 70% (2051/2929) Updating files: 71% (2080/2929) Updating files: 72% (2109/2929) Updating files: 73% (2139/2929) Updating files: 74% (2168/2929) Updating files: 75% (2197/2929) Updating files: 76% (2227/2929) Updating files: 77% (2256/2929) Updating files: 78% (2285/2929) Updating files: 79% (2314/2929) Updating files: 80% (2344/2929) Updating files: 81% (2373/2929) Updating files: 81% (2383/2929) Updating files: 82% (2402/2929) Updating files: 83% (2432/2929) Updating files: 84% (2461/2929) Updating files: 85% (2490/2929) Updating files: 86% (2519/2929) Updating files: 87% (2549/2929) Updating files: 88% (2578/2929) Updating files: 89% (2607/2929) Updating files: 90% (2637/2929) Updating files: 91% (2666/2929) Updating files: 92% (2695/2929) Updating files: 93% (2724/2929) Updating files: 94% (2754/2929) Updating files: 95% (2783/2929) Updating files: 96% (2812/2929) Updating files: 97% (2842/2929) Updating files: 98% (2871/2929) Updating files: 99% (2900/2929) Updating files: 100% (2929/2929) Updating files: 100% (2929/2929), done. 2023-05-16T13:37:14.671 INFO:teuthology.orchestra.run.smithi039.stdout:HEAD is now at 51290942 Merge branch 'main' of https://github.com/CirrusLogic/linux-firmware 2023-05-16T13:37:14.690 INFO:teuthology.task.kernel:Downloading kernel 7312ab6f53ec3dd1c2d90b6652327feae750728b on mon.a... 2023-05-16T13:37:14.690 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7312ab6f53ec3dd1c2d90b6652327feae750728b 2023-05-16T13:37:14.837 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/7312ab6f53ec3dd1c2d90b6652327feae750728b/ubuntu/jammy/flavors/default/pool/main/l/linux-6.3.0-g7312ab6f53ec/ 2023-05-16T13:37:14.837 DEBUG:teuthology.orchestra.run.smithi039:> rm -f /tmp/linux-image.deb && echo linux-image-6.3.0-g7312ab6f53ec_6.3.0-g7312ab6f53ec-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://3.chacra.ceph.com/r/kernel/testing/7312ab6f53ec3dd1c2d90b6652327feae750728b/ubuntu/jammy/flavors/default/pool/main/l/linux-6.3.0-g7312ab6f53ec/ --input-file=- 2023-05-16T13:37:14.839 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi039.front.sepia.ceph.com to complete... 2023-05-16T13:37:16.319 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16 13:37:15 URL:https://3.chacra.ceph.com/r/kernel/testing/7312ab6f53ec3dd1c2d90b6652327feae750728b/ubuntu/jammy/flavors/default/pool/main/l/linux-6.3.0-g7312ab6f53ec/linux-image-6.3.0-g7312ab6f53ec_6.3.0-g7312ab6f53ec-1_amd64.deb [38545358/38545358] -> "/tmp/linux-image.deb" [1] 2023-05-16T13:37:16.319 INFO:teuthology.orchestra.run.smithi039.stderr:FINISHED --2023-05-16 13:37:15-- 2023-05-16T13:37:16.319 INFO:teuthology.orchestra.run.smithi039.stderr:Total wall clock time: 1.5s 2023-05-16T13:37:16.319 INFO:teuthology.orchestra.run.smithi039.stderr:Downloaded: 1 files, 37M in 1.3s (27.5 MB/s) 2023-05-16T13:37:16.322 INFO:teuthology.task.kernel:Installing kernel 7312ab6f53ec3dd1c2d90b6652327feae750728b on mon.a... 2023-05-16T13:37:16.322 DEBUG:teuthology.orchestra.run.smithi039:> sudo dpkg -i /tmp/linux-image.deb 2023-05-16T13:37:16.429 INFO:teuthology.orchestra.run.smithi118.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-05-16T13:37:16.433 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-05-16T13:37:16.606 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking linux-image-6.3.0-g7312ab6f53ec (6.3.0-g7312ab6f53ec-1) ... 2023-05-16T13:37:16.612 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package linux-image-6.3.0-g7312ab6f53ec. 2023-05-16T13:37:18.562 INFO:teuthology.orchestra.run.smithi039.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-05-16T13:37:18.566 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-05-16T13:37:18.688 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking linux-image-6.3.0-g7312ab6f53ec (6.3.0-g7312ab6f53ec-1) ... 2023-05-16T13:37:20.323 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up linux-image-6.3.0-g7312ab6f53ec (6.3.0-g7312ab6f53ec-1) ... 2023-05-16T13:37:20.417 INFO:teuthology.orchestra.run.smithi118.stderr:update-initramfs: Generating /boot/initrd.img-6.3.0-g7312ab6f53ec 2023-05-16T13:37:21.861 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up linux-image-6.3.0-g7312ab6f53ec (6.3.0-g7312ab6f53ec-1) ... 2023-05-16T13:37:21.961 INFO:teuthology.orchestra.run.smithi039.stderr:update-initramfs: Generating /boot/initrd.img-6.3.0-g7312ab6f53ec 2023-05-16T13:37:39.677 INFO:teuthology.orchestra.run.smithi118.stderr:Sourcing file `/etc/default/grub' 2023-05-16T13:37:39.691 INFO:teuthology.orchestra.run.smithi118.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-05-16T13:37:39.716 INFO:teuthology.orchestra.run.smithi118.stderr:Generating grub configuration file ... 2023-05-16T13:37:40.041 INFO:teuthology.orchestra.run.smithi118.stderr:Found linux image: /boot/vmlinuz-6.3.0-g7312ab6f53ec 2023-05-16T13:37:40.061 INFO:teuthology.orchestra.run.smithi118.stderr:Found initrd image: /boot/initrd.img-6.3.0-g7312ab6f53ec 2023-05-16T13:37:40.351 INFO:teuthology.orchestra.run.smithi118.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-05-16T13:37:40.367 INFO:teuthology.orchestra.run.smithi118.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-05-16T13:37:40.421 INFO:teuthology.orchestra.run.smithi118.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-05-16T13:37:40.425 INFO:teuthology.orchestra.run.smithi118.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-05-16T13:37:40.594 INFO:teuthology.orchestra.run.smithi118.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-05-16T13:37:40.594 INFO:teuthology.orchestra.run.smithi118.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-05-16T13:37:40.595 INFO:teuthology.orchestra.run.smithi118.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-05-16T13:37:40.634 INFO:teuthology.orchestra.run.smithi118.stderr:done 2023-05-16T13:37:40.698 INFO:teuthology.orchestra.run.smithi039.stderr:Sourcing file `/etc/default/grub' 2023-05-16T13:37:40.712 INFO:teuthology.orchestra.run.smithi039.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-05-16T13:37:40.739 INFO:teuthology.orchestra.run.smithi039.stderr:Generating grub configuration file ... 2023-05-16T13:37:40.861 DEBUG:teuthology.orchestra.run.smithi118:> dpkg-deb -c /tmp/linux-image.deb 2023-05-16T13:37:40.868 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./ 2023-05-16T13:37:40.868 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./boot/ 2023-05-16T13:37:40.869 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 4289818 2023-05-15 02:23 ./boot/System.map-6.3.0-g7312ab6f53ec 2023-05-16T13:37:40.879 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 166933 2023-05-15 02:23 ./boot/config-6.3.0-g7312ab6f53ec 2023-05-16T13:37:40.879 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11175904 2023-05-15 02:23 ./boot/vmlinuz-6.3.0-g7312ab6f53ec 2023-05-16T13:37:40.898 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./etc/ 2023-05-16T13:37:40.899 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./etc/kernel/ 2023-05-16T13:37:40.899 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./etc/kernel/postinst.d/ 2023-05-16T13:37:40.899 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./etc/kernel/postrm.d/ 2023-05-16T13:37:40.899 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./etc/kernel/preinst.d/ 2023-05-16T13:37:40.899 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./etc/kernel/prerm.d/ 2023-05-16T13:37:40.899 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/ 2023-05-16T13:37:40.900 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/ 2023-05-16T13:37:40.900 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/ 2023-05-16T13:37:40.900 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/ 2023-05-16T13:37:40.900 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/ 2023-05-16T13:37:40.900 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/ 2023-05-16T13:37:40.900 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/crypto/ 2023-05-16T13:37:40.900 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 527241 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/crypto/aesni-intel.ko 2023-05-16T13:37:40.902 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24905 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-05-16T13:37:40.902 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 28241 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-05-16T13:37:40.903 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 29425 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-05-16T13:37:40.903 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 88441 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-05-16T13:37:40.903 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 100081 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-05-16T13:37:40.903 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 142185 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-05-16T13:37:40.903 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12249 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-05-16T13:37:40.903 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13281 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-05-16T13:37:40.903 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 78905 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-05-16T13:37:40.904 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18113 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-05-16T13:37:40.904 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 46321 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-05-16T13:37:40.904 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 46777 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/crypto/serpent-avx2.ko 2023-05-16T13:37:40.904 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 51305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-05-16T13:37:40.904 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 38593 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-05-16T13:37:40.904 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 40457 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-05-16T13:37:40.905 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 58273 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-05-16T13:37:40.905 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 50009 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-05-16T13:37:40.905 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 31153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-05-16T13:37:40.905 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12825 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-05-16T13:37:40.906 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/kernel/ 2023-05-16T13:37:40.906 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/kernel/cpu/ 2023-05-16T13:37:40.906 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/kernel/cpu/mce/ 2023-05-16T13:37:40.906 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 39689 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-05-16T13:37:40.906 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12937 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/kernel/cpuid.ko 2023-05-16T13:37:40.906 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17513 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/kernel/msr.ko 2023-05-16T13:37:40.906 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/kvm/ 2023-05-16T13:37:40.907 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 342897 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/kvm/kvm-amd.ko 2023-05-16T13:37:40.907 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 971009 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/kvm/kvm-intel.ko 2023-05-16T13:37:40.907 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 2208345 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/kvm/kvm.ko 2023-05-16T13:37:40.911 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/ 2023-05-16T13:37:40.911 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 55889 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/af_alg.ko 2023-05-16T13:37:40.911 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24713 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/algif_hash.ko 2023-05-16T13:37:40.911 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20585 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/algif_skcipher.ko 2023-05-16T13:37:40.911 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16777 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/ansi_cprng.ko 2023-05-16T13:37:40.911 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19209 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/anubis.ko 2023-05-16T13:37:40.912 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9657 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/arc4.ko 2023-05-16T13:37:40.912 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/asymmetric_keys/ 2023-05-16T13:37:40.912 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9753 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-05-16T13:37:40.912 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/async_tx/ 2023-05-16T13:37:40.912 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10529 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/async_tx/async_memcpy.ko 2023-05-16T13:37:40.912 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18665 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/async_tx/async_pq.ko 2023-05-16T13:37:40.912 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20737 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/async_tx/async_raid6_recov.ko 2023-05-16T13:37:40.913 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12849 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/async_tx/async_tx.ko 2023-05-16T13:37:40.913 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16721 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/async_tx/async_xor.ko 2023-05-16T13:37:40.913 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17489 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/async_tx/raid6test.ko 2023-05-16T13:37:40.913 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19753 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/authenc.ko 2023-05-16T13:37:40.913 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 22153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/authencesn.ko 2023-05-16T13:37:40.913 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21081 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/blake2b_generic.ko 2023-05-16T13:37:40.913 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12009 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/blowfish_common.ko 2023-05-16T13:37:40.913 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10033 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/blowfish_generic.ko 2023-05-16T13:37:40.914 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 38377 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/camellia_generic.ko 2023-05-16T13:37:40.914 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 26377 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/cast5_generic.ko 2023-05-16T13:37:40.914 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16785 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/cast6_generic.ko 2023-05-16T13:37:40.914 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9537 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/cast_common.ko 2023-05-16T13:37:40.914 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 34665 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/ccm.ko 2023-05-16T13:37:40.914 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13897 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/cmac.ko 2023-05-16T13:37:40.914 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9089 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/crc32_generic.ko 2023-05-16T13:37:40.914 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 44633 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/cryptd.ko 2023-05-16T13:37:40.915 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 22985 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/crypto_engine.ko 2023-05-16T13:37:40.915 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 25313 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/crypto_simd.ko 2023-05-16T13:37:40.915 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/crypto_user.ko 2023-05-16T13:37:40.915 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17233 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/cts.ko 2023-05-16T13:37:40.915 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10417 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/des_generic.ko 2023-05-16T13:37:40.915 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14785 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/dh_generic.ko 2023-05-16T13:37:40.915 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10569 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/echainiv.ko 2023-05-16T13:37:40.916 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24825 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/essiv.ko 2023-05-16T13:37:40.916 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17553 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/fcrypt.ko 2023-05-16T13:37:40.916 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 26393 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/khazad.ko 2023-05-16T13:37:40.916 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15217 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/lrw.ko 2023-05-16T13:37:40.916 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11009 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/lz4.ko 2023-05-16T13:37:40.916 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11089 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/lz4hc.ko 2023-05-16T13:37:40.916 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11257 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/md4.ko 2023-05-16T13:37:40.916 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9233 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/michael_mic.ko 2023-05-16T13:37:40.917 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10241 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/pcbc.ko 2023-05-16T13:37:40.917 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18321 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/pcrypt.ko 2023-05-16T13:37:40.917 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15553 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/rmd160.ko 2023-05-16T13:37:40.917 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 28953 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/seed.ko 2023-05-16T13:37:40.917 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 26049 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/serpent_generic.ko 2023-05-16T13:37:40.917 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 148761 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/tcrypt.ko 2023-05-16T13:37:40.917 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10377 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/tea.ko 2023-05-16T13:37:40.917 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 27969 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/twofish_common.ko 2023-05-16T13:37:40.918 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12729 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/twofish_generic.ko 2023-05-16T13:37:40.918 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16897 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/vmac.ko 2023-05-16T13:37:40.918 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 35689 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/wp512.ko 2023-05-16T13:37:40.918 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13673 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/xcbc.ko 2023-05-16T13:37:40.918 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 25945 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/xor.ko 2023-05-16T13:37:40.918 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18193 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/xts.ko 2023-05-16T13:37:40.918 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9049 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/xxhash_generic.ko 2023-05-16T13:37:40.918 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ 2023-05-16T13:37:40.919 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/acpi/ 2023-05-16T13:37:40.919 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17809 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/acpi/acpi_extlog.ko 2023-05-16T13:37:40.919 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 26537 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/acpi/acpi_ipmi.ko 2023-05-16T13:37:40.919 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 28297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/acpi/acpi_pad.ko 2023-05-16T13:37:40.919 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/acpi/apei/ 2023-05-16T13:37:40.919 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 30209 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/acpi/apei/einj.ko 2023-05-16T13:37:40.919 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12377 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/acpi/ec_sys.ko 2023-05-16T13:37:40.919 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13961 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/acpi/platform_profile.ko 2023-05-16T13:37:40.920 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24217 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/acpi/sbs.ko 2023-05-16T13:37:40.920 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18465 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/acpi/sbshc.ko 2023-05-16T13:37:40.920 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 101617 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/acpi/video.ko 2023-05-16T13:37:40.920 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/ 2023-05-16T13:37:40.920 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21033 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/acard-ahci.ko 2023-05-16T13:37:40.920 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 88185 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/ahci.ko 2023-05-16T13:37:40.920 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13681 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/ahci_platform.ko 2023-05-16T13:37:40.921 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 84753 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/libahci.ko 2023-05-16T13:37:40.946 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 32369 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/libahci_platform.ko 2023-05-16T13:37:40.946 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16577 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_acpi.ko 2023-05-16T13:37:40.946 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 30057 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_ali.ko 2023-05-16T13:37:40.946 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 33193 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_amd.ko 2023-05-16T13:37:40.946 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20705 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_artop.ko 2023-05-16T13:37:40.946 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20561 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_atiixp.ko 2023-05-16T13:37:40.947 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24369 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_atp867x.ko 2023-05-16T13:37:40.947 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17089 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_cmd640.ko 2023-05-16T13:37:40.947 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24745 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_cmd64x.ko 2023-05-16T13:37:40.947 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14345 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_cypress.ko 2023-05-16T13:37:40.947 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17289 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_efar.ko 2023-05-16T13:37:40.947 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21385 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_hpt366.ko 2023-05-16T13:37:40.947 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 33545 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_hpt37x.ko 2023-05-16T13:37:40.947 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 22569 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_hpt3x2n.ko 2023-05-16T13:37:40.948 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16361 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_hpt3x3.ko 2023-05-16T13:37:40.948 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16433 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_it8213.ko 2023-05-16T13:37:40.948 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 34745 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_it821x.ko 2023-05-16T13:37:40.948 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12329 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_jmicron.ko 2023-05-16T13:37:40.948 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 51241 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_legacy.ko 2023-05-16T13:37:40.948 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14625 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_marvell.ko 2023-05-16T13:37:40.949 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15585 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_mpiix.ko 2023-05-16T13:37:40.949 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12273 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_netcell.ko 2023-05-16T13:37:40.949 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16185 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_ninja32.ko 2023-05-16T13:37:40.949 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14473 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_ns87410.ko 2023-05-16T13:37:40.949 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16737 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_ns87415.ko 2023-05-16T13:37:40.949 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15945 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_oldpiix.ko 2023-05-16T13:37:40.949 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14817 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_opti.ko 2023-05-16T13:37:40.949 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20177 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_optidma.ko 2023-05-16T13:37:40.950 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 32017 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_pcmcia.ko 2023-05-16T13:37:40.950 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 37225 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_pdc2027x.ko 2023-05-16T13:37:40.950 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19993 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-05-16T13:37:40.950 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13601 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_piccolo.ko 2023-05-16T13:37:40.950 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14889 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_radisys.ko 2023-05-16T13:37:40.951 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18953 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_rdc.ko 2023-05-16T13:37:40.951 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14761 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_rz1000.ko 2023-05-16T13:37:40.951 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13377 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_sch.ko 2023-05-16T13:37:40.951 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 22513 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_serverworks.ko 2023-05-16T13:37:40.951 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 22889 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_sil680.ko 2023-05-16T13:37:40.951 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19129 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_sl82c105.ko 2023-05-16T13:37:40.951 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15449 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_triflex.ko 2023-05-16T13:37:40.951 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 29929 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_via.ko 2023-05-16T13:37:40.952 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 22225 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pdc_adma.ko 2023-05-16T13:37:40.952 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 28561 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/sata_inic162x.ko 2023-05-16T13:37:40.952 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 82793 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/sata_mv.ko 2023-05-16T13:37:40.952 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 70033 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/sata_nv.ko 2023-05-16T13:37:40.952 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 36937 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/sata_promise.ko 2023-05-16T13:37:40.952 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 22545 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/sata_qstor.ko 2023-05-16T13:37:40.952 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 28705 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/sata_sil.ko 2023-05-16T13:37:40.953 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 37769 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/sata_sil24.ko 2023-05-16T13:37:40.953 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17313 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/sata_sis.ko 2023-05-16T13:37:40.953 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19881 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/sata_svw.ko 2023-05-16T13:37:40.953 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 44225 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/sata_sx4.ko 2023-05-16T13:37:40.953 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15041 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/sata_uli.ko 2023-05-16T13:37:40.953 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 34625 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/sata_via.ko 2023-05-16T13:37:40.953 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19497 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/sata_vsc.ko 2023-05-16T13:37:40.953 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/auxdisplay/ 2023-05-16T13:37:40.954 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15017 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/auxdisplay/ks0108.ko 2023-05-16T13:37:40.954 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/bcma/ 2023-05-16T13:37:40.954 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 121249 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/bcma/bcma.ko 2023-05-16T13:37:40.954 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/block/ 2023-05-16T13:37:40.954 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/block/aoe/ 2023-05-16T13:37:40.954 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 113145 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/block/aoe/aoe.ko 2023-05-16T13:37:40.954 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/block/drbd/ 2023-05-16T13:37:40.954 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 963089 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/block/drbd/drbd.ko 2023-05-16T13:37:40.955 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 172809 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/block/floppy.ko 2023-05-16T13:37:40.955 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/block/mtip32xx/ 2023-05-16T13:37:40.955 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 93865 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-05-16T13:37:40.955 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 113657 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/block/nbd.ko 2023-05-16T13:37:40.955 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/block/null_blk/ 2023-05-16T13:37:40.955 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 110513 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/block/null_blk/null_blk.ko 2023-05-16T13:37:40.955 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 81753 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/block/pktcdvd.ko 2023-05-16T13:37:40.956 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 253977 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/block/rbd.ko 2023-05-16T13:37:40.956 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/block/xen-blkback/ 2023-05-16T13:37:40.956 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 97705 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-05-16T13:37:40.956 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/block/zram/ 2023-05-16T13:37:40.956 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 59209 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/block/zram/zram.ko 2023-05-16T13:37:40.956 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/ 2023-05-16T13:37:40.956 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 30417 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/applicom.ko 2023-05-16T13:37:40.957 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11569 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/hangcheck-timer.ko 2023-05-16T13:37:40.957 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/hw_random/ 2023-05-16T13:37:40.957 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13393 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/hw_random/amd-rng.ko 2023-05-16T13:37:40.957 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/hw_random/intel-rng.ko 2023-05-16T13:37:40.957 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12897 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-05-16T13:37:40.957 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10241 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/hw_random/via-rng.ko 2023-05-16T13:37:40.957 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15089 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/hw_random/virtio-rng.ko 2023-05-16T13:37:40.957 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/ipmi/ 2023-05-16T13:37:40.958 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 30505 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-05-16T13:37:40.958 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 147745 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-05-16T13:37:40.958 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 26457 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-05-16T13:37:40.958 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 138561 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/ipmi/ipmi_si.ko 2023-05-16T13:37:40.958 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 70353 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-05-16T13:37:40.958 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 53105 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-05-16T13:37:40.958 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 35833 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/lp.ko 2023-05-16T13:37:40.958 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/mwave/ 2023-05-16T13:37:40.959 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 83625 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/mwave/mwave.ko 2023-05-16T13:37:40.959 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 25153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/nvram.ko 2023-05-16T13:37:40.959 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/pcmcia/ 2023-05-16T13:37:40.959 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 102457 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/pcmcia/cm4000_cs.ko 2023-05-16T13:37:40.959 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 50969 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/pcmcia/cm4040_cs.ko 2023-05-16T13:37:40.959 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 83625 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/pcmcia/synclink_cs.ko 2023-05-16T13:37:40.959 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 31689 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/ppdev.ko 2023-05-16T13:37:40.959 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 50681 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/tlclk.ko 2023-05-16T13:37:40.960 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/tpm/ 2023-05-16T13:37:40.960 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15897 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/tpm/tpm_atmel.ko 2023-05-16T13:37:40.960 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15449 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-05-16T13:37:40.960 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23033 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-05-16T13:37:40.960 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 32481 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-05-16T13:37:40.961 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 29681 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/tpm/tpm_infineon.ko 2023-05-16T13:37:40.961 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 22257 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/tpm/tpm_nsc.ko 2023-05-16T13:37:40.961 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23137 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-05-16T13:37:40.961 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/xillybus/ 2023-05-16T13:37:40.961 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16121 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/xillybus/xillybus_class.ko 2023-05-16T13:37:40.961 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 49865 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/xillybus/xillybus_core.ko 2023-05-16T13:37:40.961 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11905 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-05-16T13:37:40.962 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/clk/ 2023-05-16T13:37:40.962 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12057 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/clk/clk-palmas.ko 2023-05-16T13:37:40.962 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 47593 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/clk/clk-si5351.ko 2023-05-16T13:37:40.962 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10961 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/clk/clk-twl6040.ko 2023-05-16T13:37:40.962 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18665 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/clk/clk-wm831x.ko 2023-05-16T13:37:40.962 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/cpufreq/ 2023-05-16T13:37:40.962 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9665 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-05-16T13:37:40.962 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16337 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/cpufreq/p4-clockmod.ko 2023-05-16T13:37:40.963 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24385 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/cpufreq/speedstep-lib.ko 2023-05-16T13:37:40.963 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/crypto/ 2023-05-16T13:37:40.963 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/crypto/ccp/ 2023-05-16T13:37:40.963 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 70289 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-05-16T13:37:40.963 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 223113 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/crypto/ccp/ccp.ko 2023-05-16T13:37:40.963 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19505 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/crypto/padlock-aes.ko 2023-05-16T13:37:40.963 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20985 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/crypto/padlock-sha.ko 2023-05-16T13:37:40.963 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/crypto/qat/ 2023-05-16T13:37:40.964 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/crypto/qat/qat_common/ 2023-05-16T13:37:40.964 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 397793 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/crypto/qat/qat_common/intel_qat.ko 2023-05-16T13:37:40.964 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/crypto/qat/qat_dh895xcc/ 2023-05-16T13:37:40.964 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24289 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/crypto/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-05-16T13:37:40.964 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/crypto/virtio/ 2023-05-16T13:37:40.964 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 68121 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-05-16T13:37:40.964 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/dca/ 2023-05-16T13:37:40.965 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 28273 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/dca/dca.ko 2023-05-16T13:37:40.965 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/dma/ 2023-05-16T13:37:40.965 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/dma/dw/ 2023-05-16T13:37:40.965 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15417 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/dma/dw/dw_dmac.ko 2023-05-16T13:37:40.965 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/dma/ioat/ 2023-05-16T13:37:40.965 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 122841 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/dma/ioat/ioatdma.ko 2023-05-16T13:37:40.965 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/edac/ 2023-05-16T13:37:40.965 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 73761 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/edac/amd64_edac.ko 2023-05-16T13:37:40.966 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 35329 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/edac/e752x_edac.ko 2023-05-16T13:37:40.966 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 62633 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/edac/edac_mce_amd.ko 2023-05-16T13:37:40.966 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17673 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/edac/i3000_edac.ko 2023-05-16T13:37:40.966 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17577 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/edac/i3200_edac.ko 2023-05-16T13:37:40.966 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 22105 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/edac/i5100_edac.ko 2023-05-16T13:37:40.966 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 25161 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/edac/i5400_edac.ko 2023-05-16T13:37:40.966 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24425 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/edac/i7300_edac.ko 2023-05-16T13:37:40.967 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 51585 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/edac/i7core_edac.ko 2023-05-16T13:37:40.967 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17937 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/edac/i82975x_edac.ko 2023-05-16T13:37:40.967 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19521 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/edac/ie31200_edac.ko 2023-05-16T13:37:40.967 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 56369 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/edac/sb_edac.ko 2023-05-16T13:37:40.967 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17097 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/edac/x38_edac.ko 2023-05-16T13:37:40.967 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/extcon/ 2023-05-16T13:37:40.967 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12145 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/extcon/extcon-gpio.ko 2023-05-16T13:37:40.967 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 26673 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/extcon/extcon-max14577.ko 2023-05-16T13:37:40.968 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 29113 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/extcon/extcon-max77693.ko 2023-05-16T13:37:40.968 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24225 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/extcon/extcon-max8997.ko 2023-05-16T13:37:40.968 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 26009 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/extcon/extcon-palmas.ko 2023-05-16T13:37:40.968 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23281 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/extcon/extcon-rt8973a.ko 2023-05-16T13:37:40.968 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 27353 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/extcon/extcon-sm5502.ko 2023-05-16T13:37:40.968 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/firmware/ 2023-05-16T13:37:40.968 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 34457 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/firmware/dmi-sysfs.ko 2023-05-16T13:37:40.968 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/firmware/efi/ 2023-05-16T13:37:40.969 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15033 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/firmware/efi/efi-pstore.ko 2023-05-16T13:37:40.969 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20385 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/firmware/iscsi_ibft.ko 2023-05-16T13:37:40.969 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/ 2023-05-16T13:37:40.969 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11881 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-adp5520.ko 2023-05-16T13:37:40.969 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19729 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-amd8111.ko 2023-05-16T13:37:40.969 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14561 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-arizona.ko 2023-05-16T13:37:40.969 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13417 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-da9052.ko 2023-05-16T13:37:40.970 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11433 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-da9055.ko 2023-05-16T13:37:40.970 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21625 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-dln2.ko 2023-05-16T13:37:40.970 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 77929 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-f7188x.ko 2023-05-16T13:37:40.970 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 27929 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-generic.ko 2023-05-16T13:37:40.970 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19505 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-ich.ko 2023-05-16T13:37:40.970 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11481 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-05-16T13:37:40.970 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13689 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-kempld.ko 2023-05-16T13:37:40.970 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12249 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-lp3943.ko 2023-05-16T13:37:40.971 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9017 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-max7300.ko 2023-05-16T13:37:40.971 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11161 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-max730x.ko 2023-05-16T13:37:40.971 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18145 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-max732x.ko 2023-05-16T13:37:40.971 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24649 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-05-16T13:37:40.971 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 46321 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-pca953x.ko 2023-05-16T13:37:40.971 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 26345 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-pcf857x.ko 2023-05-16T13:37:40.972 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13889 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-rdc321x.ko 2023-05-16T13:37:40.972 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20065 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-sch.ko 2023-05-16T13:37:40.972 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19649 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-sch311x.ko 2023-05-16T13:37:40.972 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11657 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-tps65912.ko 2023-05-16T13:37:40.972 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21553 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-twl4030.ko 2023-05-16T13:37:40.973 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10993 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-twl6040.ko 2023-05-16T13:37:40.973 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20105 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-viperboard.ko 2023-05-16T13:37:40.973 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15025 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-vx855.ko 2023-05-16T13:37:40.973 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15849 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-wm831x.ko 2023-05-16T13:37:40.974 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11185 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-wm8350.ko 2023-05-16T13:37:40.974 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16257 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-wm8994.ko 2023-05-16T13:37:40.974 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/ 2023-05-16T13:37:40.974 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-a4tech.ko 2023-05-16T13:37:40.975 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 38489 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-apple.ko 2023-05-16T13:37:40.975 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14057 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-appleir.ko 2023-05-16T13:37:40.975 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 7865 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-aureal.ko 2023-05-16T13:37:40.976 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14681 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-axff.ko 2023-05-16T13:37:40.976 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10625 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-belkin.ko 2023-05-16T13:37:40.976 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9825 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-cherry.ko 2023-05-16T13:37:40.976 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15617 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-chicony.ko 2023-05-16T13:37:40.977 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 58641 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-cp2112.ko 2023-05-16T13:37:40.977 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10617 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-cypress.ko 2023-05-16T13:37:40.977 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15961 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-dr.ko 2023-05-16T13:37:40.977 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10273 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-elecom.ko 2023-05-16T13:37:40.978 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17169 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-elo.ko 2023-05-16T13:37:40.978 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12961 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-emsff.ko 2023-05-16T13:37:40.978 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9609 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-ezkey.ko 2023-05-16T13:37:40.978 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13809 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-gaff.ko 2023-05-16T13:37:40.979 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 8793 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-generic.ko 2023-05-16T13:37:40.979 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16049 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-gt683r.ko 2023-05-16T13:37:40.979 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12257 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-gyration.ko 2023-05-16T13:37:40.979 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9385 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-holtek-kbd.ko 2023-05-16T13:37:40.979 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10033 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-holtek-mouse.ko 2023-05-16T13:37:40.979 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14017 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-holtekff.ko 2023-05-16T13:37:40.979 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18617 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-hyperv.ko 2023-05-16T13:37:40.980 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10001 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-icade.ko 2023-05-16T13:37:40.980 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 8817 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-kensington.ko 2023-05-16T13:37:40.980 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 8057 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-keytouch.ko 2023-05-16T13:37:40.980 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13985 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-kye.ko 2023-05-16T13:37:40.980 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10321 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-lcpower.ko 2023-05-16T13:37:40.980 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19993 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-led.ko 2023-05-16T13:37:40.980 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 41793 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-lenovo.ko 2023-05-16T13:37:40.981 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 30097 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-lg-g15.ko 2023-05-16T13:37:40.981 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 57369 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-logitech-dj.ko 2023-05-16T13:37:40.981 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 94481 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-05-16T13:37:40.981 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 80569 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-logitech.ko 2023-05-16T13:37:40.981 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 30361 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-magicmouse.ko 2023-05-16T13:37:40.982 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21105 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-microsoft.ko 2023-05-16T13:37:40.982 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9937 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-monterey.ko 2023-05-16T13:37:40.982 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 49657 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-multitouch.ko 2023-05-16T13:37:40.982 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 32153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-ntrig.ko 2023-05-16T13:37:40.982 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 8433 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-ortek.ko 2023-05-16T13:37:40.982 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 8689 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-penmount.ko 2023-05-16T13:37:40.982 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11865 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-petalynx.ko 2023-05-16T13:37:40.982 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 72497 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-picolcd.ko 2023-05-16T13:37:40.983 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13801 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-pl.ko 2023-05-16T13:37:40.983 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14609 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-plantronics.ko 2023-05-16T13:37:40.983 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 7929 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-primax.ko 2023-05-16T13:37:40.983 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 34937 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-rmi.ko 2023-05-16T13:37:40.983 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20409 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-roccat-arvo.ko 2023-05-16T13:37:40.983 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12809 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-roccat-common.ko 2023-05-16T13:37:40.983 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 30945 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-roccat-isku.ko 2023-05-16T13:37:40.984 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 29305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-roccat-kone.ko 2023-05-16T13:37:40.984 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 30713 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-05-16T13:37:40.984 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20745 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-roccat-konepure.ko 2023-05-16T13:37:40.984 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 29065 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-05-16T13:37:40.984 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12873 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-roccat-lua.ko 2023-05-16T13:37:40.984 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 28889 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-roccat-pyra.ko 2023-05-16T13:37:40.984 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 27473 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-roccat-ryos.ko 2023-05-16T13:37:40.985 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19057 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-roccat-savu.ko 2023-05-16T13:37:40.985 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 22441 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-roccat.ko 2023-05-16T13:37:40.985 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13257 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-saitek.ko 2023-05-16T13:37:40.985 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14705 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-samsung.ko 2023-05-16T13:37:40.985 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 35137 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-sensor-hub.ko 2023-05-16T13:37:40.985 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13113 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-sjoy.ko 2023-05-16T13:37:40.985 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 50705 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-sony.ko 2023-05-16T13:37:40.986 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 7817 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-speedlink.ko 2023-05-16T13:37:40.986 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14449 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-steelseries.ko 2023-05-16T13:37:40.986 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9393 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-sunplus.ko 2023-05-16T13:37:40.986 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16489 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-thrustmaster.ko 2023-05-16T13:37:40.986 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10105 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-tivo.ko 2023-05-16T13:37:40.986 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14593 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-tmff.ko 2023-05-16T13:37:40.986 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13897 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-topseed.ko 2023-05-16T13:37:40.986 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15977 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-twinhan.ko 2023-05-16T13:37:40.987 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 71017 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-uclogic.ko 2023-05-16T13:37:40.987 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10433 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-waltop.ko 2023-05-16T13:37:40.987 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 143097 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-wiimote.ko 2023-05-16T13:37:40.987 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 7721 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-xinmo.ko 2023-05-16T13:37:40.987 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12825 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-zpff.ko 2023-05-16T13:37:40.987 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16169 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-zydacron.ko 2023-05-16T13:37:40.987 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 260737 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid.ko 2023-05-16T13:37:40.987 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 31889 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/uhid.ko 2023-05-16T13:37:40.988 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/usbhid/ 2023-05-16T13:37:40.988 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 124897 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/usbhid/usbhid.ko 2023-05-16T13:37:40.988 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18593 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/usbhid/usbkbd.ko 2023-05-16T13:37:40.988 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14529 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/usbhid/usbmouse.ko 2023-05-16T13:37:40.988 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 215033 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/wacom.ko 2023-05-16T13:37:40.988 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hv/ 2023-05-16T13:37:40.988 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 62833 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hv/hv_balloon.ko 2023-05-16T13:37:40.989 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 89177 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hv/hv_utils.ko 2023-05-16T13:37:40.989 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 296369 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hv/hv_vmbus.ko 2023-05-16T13:37:40.989 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/ 2023-05-16T13:37:40.989 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 66169 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/abituguru.ko 2023-05-16T13:37:40.989 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 60969 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/abituguru3.ko 2023-05-16T13:37:40.989 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 34305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/acpi_power_meter.ko 2023-05-16T13:37:40.989 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17065 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/ad7414.ko 2023-05-16T13:37:40.990 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18817 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/ad7418.ko 2023-05-16T13:37:40.990 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24769 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/adc128d818.ko 2023-05-16T13:37:40.990 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 31233 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/adm1025.ko 2023-05-16T13:37:40.990 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 97537 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/adm1026.ko 2023-05-16T13:37:40.990 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19313 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/adm1029.ko 2023-05-16T13:37:40.990 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 45057 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/adm1031.ko 2023-05-16T13:37:40.990 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 25857 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/adm9240.ko 2023-05-16T13:37:40.990 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14337 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/ads7828.ko 2023-05-16T13:37:40.991 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10337 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/adt7410.ko 2023-05-16T13:37:40.991 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21553 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/adt7411.ko 2023-05-16T13:37:40.991 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 74009 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/adt7462.ko 2023-05-16T13:37:40.991 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 39153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/adt7470.ko 2023-05-16T13:37:40.991 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 64393 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/adt7475.ko 2023-05-16T13:37:40.991 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18729 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/adt7x10.ko 2023-05-16T13:37:40.991 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 38633 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/amc6821.ko 2023-05-16T13:37:40.992 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 54705 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/applesmc.ko 2023-05-16T13:37:40.992 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 49417 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/asb100.ko 2023-05-16T13:37:40.992 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 58113 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/asc7621.ko 2023-05-16T13:37:40.992 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 40377 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/asus_atk0110.ko 2023-05-16T13:37:40.992 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16785 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/atxp1.ko 2023-05-16T13:37:40.992 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 28585 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/coretemp.ko 2023-05-16T13:37:40.993 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24169 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/da9052-hwmon.ko 2023-05-16T13:37:40.993 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16761 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/da9055-hwmon.ko 2023-05-16T13:37:40.993 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 43977 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-05-16T13:37:40.993 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 99161 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/dme1737.ko 2023-05-16T13:37:40.993 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19049 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/ds1621.ko 2023-05-16T13:37:40.993 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14833 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/ds620.ko 2023-05-16T13:37:40.993 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 29273 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/emc1403.ko 2023-05-16T13:37:40.993 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 32681 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/emc2103.ko 2023-05-16T13:37:40.994 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 29889 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/emc6w201.ko 2023-05-16T13:37:40.994 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 66481 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/f71805f.ko 2023-05-16T13:37:40.994 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 94153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/f71882fg.ko 2023-05-16T13:37:40.994 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 40969 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/f75375s.ko 2023-05-16T13:37:40.994 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20881 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/fam15h_power.ko 2023-05-16T13:37:40.994 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 54929 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/fschmd.ko 2023-05-16T13:37:40.994 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13993 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/g760a.ko 2023-05-16T13:37:40.995 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23593 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/g762.ko 2023-05-16T13:37:40.995 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 46369 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/gl518sm.ko 2023-05-16T13:37:40.995 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 45025 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/gl520sm.ko 2023-05-16T13:37:40.995 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12777 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/hih6130.ko 2023-05-16T13:37:40.995 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 8945 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/hwmon-vid.ko 2023-05-16T13:37:40.995 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11057 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/i5500_temp.ko 2023-05-16T13:37:40.995 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 22097 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/i5k_amb.ko 2023-05-16T13:37:40.995 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 34073 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/ibmaem.ko 2023-05-16T13:37:40.996 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20801 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/ibmpex.ko 2023-05-16T13:37:40.996 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24377 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/ina209.ko 2023-05-16T13:37:40.996 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 27361 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/ina2xx.ko 2023-05-16T13:37:40.996 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 125729 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/it87.ko 2023-05-16T13:37:40.996 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18345 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/jc42.ko 2023-05-16T13:37:40.996 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23281 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/k10temp.ko 2023-05-16T13:37:40.996 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13121 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/k8temp.ko 2023-05-16T13:37:40.996 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18497 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/lineage-pem.ko 2023-05-16T13:37:40.997 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 48097 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/lm63.ko 2023-05-16T13:37:40.997 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16265 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/lm73.ko 2023-05-16T13:37:40.997 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 36161 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/lm75.ko 2023-05-16T13:37:40.997 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19049 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/lm77.ko 2023-05-16T13:37:40.997 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 34153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/lm78.ko 2023-05-16T13:37:40.997 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 31241 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/lm80.ko 2023-05-16T13:37:40.997 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16393 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/lm83.ko 2023-05-16T13:37:40.998 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 72337 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/lm85.ko 2023-05-16T13:37:40.998 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 45633 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/lm87.ko 2023-05-16T13:37:40.998 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 37409 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/lm90.ko 2023-05-16T13:37:40.998 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19249 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/lm92.ko 2023-05-16T13:37:40.998 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 108401 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/lm93.ko 2023-05-16T13:37:40.998 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 32961 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/lm95234.ko 2023-05-16T13:37:40.998 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15769 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/lm95241.ko 2023-05-16T13:37:40.998 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17673 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/lm95245.ko 2023-05-16T13:37:40.999 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23521 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/ltc2945.ko 2023-05-16T13:37:40.999 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13369 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/ltc4151.ko 2023-05-16T13:37:40.999 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14761 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/ltc4215.ko 2023-05-16T13:37:40.999 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14449 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/ltc4222.ko 2023-05-16T13:37:40.999 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14401 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/ltc4245.ko 2023-05-16T13:37:40.999 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12809 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/ltc4260.ko 2023-05-16T13:37:40.999 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14497 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/ltc4261.ko 2023-05-16T13:37:40.999 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 33057 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/max16065.ko 2023-05-16T13:37:41.000 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17929 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/max1619.ko 2023-05-16T13:37:41.000 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23913 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/max1668.ko 2023-05-16T13:37:41.000 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19545 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/max197.ko 2023-05-16T13:37:41.000 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 26185 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/max6639.ko 2023-05-16T13:37:41.000 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 22881 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/max6650.ko 2023-05-16T13:37:41.001 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 35273 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/max6697.ko 2023-05-16T13:37:41.001 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18145 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/mc13783-adc.ko 2023-05-16T13:37:41.001 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/mcp3021.ko 2023-05-16T13:37:41.001 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15433 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-05-16T13:37:41.002 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 43657 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/nct6683.ko 2023-05-16T13:37:41.002 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 114257 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/nct6775-core.ko 2023-05-16T13:37:41.002 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 45817 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/nct6775.ko 2023-05-16T13:37:41.003 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 59233 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/nct7802.ko 2023-05-16T13:37:41.003 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 81849 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/pc87360.ko 2023-05-16T13:37:41.003 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 54001 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/pc87427.ko 2023-05-16T13:37:41.003 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17969 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/pcf8591.ko 2023-05-16T13:37:41.004 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/pmbus/ 2023-05-16T13:37:41.004 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20489 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-05-16T13:37:41.004 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16569 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-05-16T13:37:41.004 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 27833 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-05-16T13:37:41.005 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9081 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/pmbus/max16064.ko 2023-05-16T13:37:41.005 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17233 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/pmbus/max34440.ko 2023-05-16T13:37:41.005 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9681 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/pmbus/max8688.ko 2023-05-16T13:37:41.005 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15081 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-05-16T13:37:41.006 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 71425 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-05-16T13:37:41.006 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 8241 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-05-16T13:37:41.006 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 30297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-05-16T13:37:41.006 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14577 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-05-16T13:37:41.007 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20249 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-05-16T13:37:41.007 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12593 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/powr1220.ko 2023-05-16T13:37:41.007 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18201 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/sch5627.ko 2023-05-16T13:37:41.007 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 28313 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/sch5636.ko 2023-05-16T13:37:41.007 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 26049 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/sch56xx-common.ko 2023-05-16T13:37:41.007 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 31697 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/sht15.ko 2023-05-16T13:37:41.007 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13065 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/sht21.ko 2023-05-16T13:37:41.007 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16337 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/shtc1.ko 2023-05-16T13:37:41.008 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 39617 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/sis5595.ko 2023-05-16T13:37:41.008 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 31497 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/smm665.ko 2023-05-16T13:37:41.008 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19081 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/smsc47b397.ko 2023-05-16T13:37:41.008 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 38697 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/smsc47m1.ko 2023-05-16T13:37:41.008 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 36953 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/smsc47m192.ko 2023-05-16T13:37:41.008 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 26057 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/thmc50.ko 2023-05-16T13:37:41.008 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16529 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/tmp102.ko 2023-05-16T13:37:41.009 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13665 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/tmp103.ko 2023-05-16T13:37:41.009 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20817 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/tmp401.ko 2023-05-16T13:37:41.009 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19041 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/tmp421.ko 2023-05-16T13:37:41.009 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19201 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/via-cputemp.ko 2023-05-16T13:37:41.009 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 41513 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/via686a.ko 2023-05-16T13:37:41.009 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 51953 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/vt1211.ko 2023-05-16T13:37:41.009 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 51121 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/vt8231.ko 2023-05-16T13:37:41.009 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 57025 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/w83627ehf.ko 2023-05-16T13:37:41.010 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 78441 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/w83627hf.ko 2023-05-16T13:37:41.010 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 70849 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/w83781d.ko 2023-05-16T13:37:41.010 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 62793 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/w83791d.ko 2023-05-16T13:37:41.010 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 70825 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/w83792d.ko 2023-05-16T13:37:41.010 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 100953 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/w83793.ko 2023-05-16T13:37:41.010 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 119009 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/w83795.ko 2023-05-16T13:37:41.010 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16825 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/w83l785ts.ko 2023-05-16T13:37:41.011 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 35185 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/w83l786ng.ko 2023-05-16T13:37:41.011 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13393 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-05-16T13:37:41.011 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10201 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-05-16T13:37:41.011 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/ 2023-05-16T13:37:41.011 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/algos/ 2023-05-16T13:37:41.011 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19097 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-05-16T13:37:41.011 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18529 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-05-16T13:37:41.011 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/ 2023-05-16T13:37:41.012 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 27529 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-05-16T13:37:41.012 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 28305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-05-16T13:37:41.012 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 27281 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-05-16T13:37:41.012 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17505 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-05-16T13:37:41.012 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 25537 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-05-16T13:37:41.012 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15697 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-05-16T13:37:41.013 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14721 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-05-16T13:37:41.013 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 6201 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-05-16T13:37:41.013 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13465 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-05-16T13:37:41.013 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 46025 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-05-16T13:37:41.013 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23193 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-05-16T13:37:41.013 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19097 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-05-16T13:37:41.013 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16841 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-05-16T13:37:41.014 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11889 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-05-16T13:37:41.014 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-05-16T13:37:41.014 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 62017 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-i801.ko 2023-05-16T13:37:41.014 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21937 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-isch.ko 2023-05-16T13:37:41.014 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 47465 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-05-16T13:37:41.014 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16865 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-05-16T13:37:41.014 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17449 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-05-16T13:37:41.014 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21617 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-05-16T13:37:41.015 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 25993 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-05-16T13:37:41.015 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24625 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-parport.ko 2023-05-16T13:37:41.015 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16073 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-05-16T13:37:41.015 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 46817 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-05-16T13:37:41.015 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14793 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-05-16T13:37:41.015 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18217 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-05-16T13:37:41.015 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11385 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-05-16T13:37:41.016 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21873 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-05-16T13:37:41.016 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 28865 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-05-16T13:37:41.016 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19897 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-05-16T13:37:41.016 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18737 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-05-16T13:37:41.016 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19417 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-05-16T13:37:41.017 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13369 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-via.ko 2023-05-16T13:37:41.017 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 25649 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-05-16T13:37:41.017 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18609 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-05-16T13:37:41.018 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 48361 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-05-16T13:37:41.018 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21409 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/i2c-mux.ko 2023-05-16T13:37:41.018 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18017 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/i2c-smbus.ko 2023-05-16T13:37:41.018 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 26625 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/i2c-stub.ko 2023-05-16T13:37:41.019 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/muxes/ 2023-05-16T13:37:41.019 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-05-16T13:37:41.019 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12969 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-05-16T13:37:41.020 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 26425 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-05-16T13:37:41.020 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/ 2023-05-16T13:37:41.020 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/core/ 2023-05-16T13:37:41.020 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 264089 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/core/ib_cm.ko 2023-05-16T13:37:41.021 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 848969 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/core/ib_core.ko 2023-05-16T13:37:41.021 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 68233 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/core/ib_umad.ko 2023-05-16T13:37:41.021 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 321625 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-05-16T13:37:41.021 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 96473 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/core/iw_cm.ko 2023-05-16T13:37:41.021 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 271713 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/core/rdma_cm.ko 2023-05-16T13:37:41.022 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 65753 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-05-16T13:37:41.022 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/hw/ 2023-05-16T13:37:41.022 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/hw/cxgb4/ 2023-05-16T13:37:41.023 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 492057 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-05-16T13:37:41.023 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/hw/mlx4/ 2023-05-16T13:37:41.023 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 418801 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-05-16T13:37:41.049 INFO:teuthology.orchestra.run.smithi039.stderr:Found linux image: /boot/vmlinuz-6.3.0-g7312ab6f53ec 2023-05-16T13:37:41.075 INFO:teuthology.orchestra.run.smithi039.stderr:Found initrd image: /boot/initrd.img-6.3.0-g7312ab6f53ec 2023-05-16T13:37:41.098 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/hw/mlx5/ 2023-05-16T13:37:41.099 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 732713 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-05-16T13:37:41.099 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/hw/mthca/ 2023-05-16T13:37:41.099 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 296153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-05-16T13:37:41.099 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/hw/ocrdma/ 2023-05-16T13:37:41.099 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 153177 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-05-16T13:37:41.099 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/hw/usnic/ 2023-05-16T13:37:41.099 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 168513 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-05-16T13:37:41.100 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/ulp/ 2023-05-16T13:37:41.100 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/ulp/ipoib/ 2023-05-16T13:37:41.100 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 262729 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-05-16T13:37:41.100 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/ulp/iser/ 2023-05-16T13:37:41.100 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 99721 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-05-16T13:37:41.100 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/ulp/isert/ 2023-05-16T13:37:41.100 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 110705 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-05-16T13:37:41.101 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/ulp/srp/ 2023-05-16T13:37:41.101 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 128705 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-05-16T13:37:41.101 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/ulp/srpt/ 2023-05-16T13:37:41.101 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 130009 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-05-16T13:37:41.101 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/ 2023-05-16T13:37:41.101 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10257 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/evbug.ko 2023-05-16T13:37:41.101 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23393 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/ff-memless.ko 2023-05-16T13:37:41.101 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/gameport/ 2023-05-16T13:37:41.102 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11457 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-05-16T13:37:41.102 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11657 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/gameport/fm801-gp.ko 2023-05-16T13:37:41.102 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 39185 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/gameport/gameport.ko 2023-05-16T13:37:41.102 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12065 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/gameport/lightning.ko 2023-05-16T13:37:41.102 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17033 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/gameport/ns558.ko 2023-05-16T13:37:41.102 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 41393 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/joydev.ko 2023-05-16T13:37:41.102 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/ 2023-05-16T13:37:41.102 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12889 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-05-16T13:37:41.103 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 29889 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-05-16T13:37:41.103 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 26313 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-05-16T13:37:41.103 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24257 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-05-16T13:37:41.103 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 36001 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/gpio_keys.ko 2023-05-16T13:37:41.103 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17777 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-05-16T13:37:41.103 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20825 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/lkkbd.ko 2023-05-16T13:37:41.103 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 27617 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/lm8323.ko 2023-05-16T13:37:41.104 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14617 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/lm8333.ko 2023-05-16T13:37:41.104 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23825 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-05-16T13:37:41.104 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17713 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-05-16T13:37:41.104 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15465 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-05-16T13:37:41.104 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15961 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-05-16T13:37:41.104 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/newtonkbd.ko 2023-05-16T13:37:41.104 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10577 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-05-16T13:37:41.104 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14705 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/qt1070.ko 2023-05-16T13:37:41.105 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20633 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/qt2160.ko 2023-05-16T13:37:41.105 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23313 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-05-16T13:37:41.105 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11057 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/stowaway.ko 2023-05-16T13:37:41.105 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17857 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/sunkbd.ko 2023-05-16T13:37:41.105 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20233 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-05-16T13:37:41.105 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15689 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-05-16T13:37:41.105 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-05-16T13:37:41.105 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11257 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/xtkbd.ko 2023-05-16T13:37:41.106 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10641 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/matrix-keymap.ko 2023-05-16T13:37:41.106 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/mouse/ 2023-05-16T13:37:41.106 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 33889 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/mouse/appletouch.ko 2023-05-16T13:37:41.106 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 33681 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/mouse/bcm5974.ko 2023-05-16T13:37:41.106 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 122977 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/mouse/cyapatp.ko 2023-05-16T13:37:41.106 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 88929 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/mouse/elan_i2c.ko 2023-05-16T13:37:41.106 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13529 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/mouse/gpio_mouse.ko 2023-05-16T13:37:41.106 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 334073 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/mouse/psmouse.ko 2023-05-16T13:37:41.107 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14177 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/mouse/sermouse.ko 2023-05-16T13:37:41.107 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23377 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-05-16T13:37:41.107 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 22145 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/mouse/synaptics_usb.ko 2023-05-16T13:37:41.107 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15169 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/mouse/vsxxxaa.ko 2023-05-16T13:37:41.107 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/rmi4/ 2023-05-16T13:37:41.107 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 107777 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/rmi4/rmi_core.ko 2023-05-16T13:37:41.107 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/serio/ 2023-05-16T13:37:41.108 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11233 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/serio/altera_ps2.ko 2023-05-16T13:37:41.108 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15793 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/serio/arc_ps2.ko 2023-05-16T13:37:41.108 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15937 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/serio/ct82c710.ko 2023-05-16T13:37:41.108 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16465 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-05-16T13:37:41.108 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15401 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/serio/parkbd.ko 2023-05-16T13:37:41.108 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12785 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/serio/pcips2.ko 2023-05-16T13:37:41.108 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19665 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/serio/ps2mult.ko 2023-05-16T13:37:41.109 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23697 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/serio/serio_raw.ko 2023-05-16T13:37:41.109 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17489 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/serio/serport.ko 2023-05-16T13:37:41.109 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12169 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/sparse-keymap.ko 2023-05-16T13:37:41.109 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/iommu/ 2023-05-16T13:37:41.109 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/iommu/amd/ 2023-05-16T13:37:41.109 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 37617 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/iommu/amd/iommu_v2.ko 2023-05-16T13:37:41.109 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/ 2023-05-16T13:37:41.109 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13321 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/leds-88pm860x.ko 2023-05-16T13:37:41.110 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10889 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/leds-adp5520.ko 2023-05-16T13:37:41.110 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 59249 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/leds-bd2802.ko 2023-05-16T13:37:41.110 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24353 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/leds-blinkm.ko 2023-05-16T13:37:41.110 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9985 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/leds-da903x.ko 2023-05-16T13:37:41.110 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11817 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/leds-da9052.ko 2023-05-16T13:37:41.110 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15161 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/leds-gpio.ko 2023-05-16T13:37:41.110 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15361 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/leds-lm3530.ko 2023-05-16T13:37:41.110 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 30065 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/leds-lm3533.ko 2023-05-16T13:37:41.111 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18849 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/leds-lm355x.ko 2023-05-16T13:37:41.111 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19457 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/leds-lm3642.ko 2023-05-16T13:37:41.111 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15817 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/leds-lp3944.ko 2023-05-16T13:37:41.111 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10809 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/leds-lp8788.ko 2023-05-16T13:37:41.111 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14497 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/leds-max8997.ko 2023-05-16T13:37:41.111 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12073 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/leds-mc13783.ko 2023-05-16T13:37:41.111 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12705 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/leds-menf21bmc.ko 2023-05-16T13:37:41.111 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20289 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/leds-pca9532.ko 2023-05-16T13:37:41.112 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19985 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/leds-pca955x.ko 2023-05-16T13:37:41.112 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17361 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/leds-pca963x.ko 2023-05-16T13:37:41.112 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 33353 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/leds-ss4200.ko 2023-05-16T13:37:41.112 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24369 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/leds-tca6507.ko 2023-05-16T13:37:41.112 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15169 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/leds-wm831x-status.ko 2023-05-16T13:37:41.112 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11409 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/leds-wm8350.ko 2023-05-16T13:37:41.112 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/trigger/ 2023-05-16T13:37:41.113 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9177 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-05-16T13:37:41.113 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10377 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-05-16T13:37:41.113 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 8273 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-05-16T13:37:41.113 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 7121 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-05-16T13:37:41.113 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14593 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2023-05-16T13:37:41.113 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13825 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-05-16T13:37:41.113 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13577 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-05-16T13:37:41.113 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11385 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-05-16T13:37:41.114 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13585 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-05-16T13:37:41.114 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/ 2023-05-16T13:37:41.114 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/bcache/ 2023-05-16T13:37:41.114 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 631593 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/bcache/bcache.ko 2023-05-16T13:37:41.114 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 34585 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/dm-bio-prison.ko 2023-05-16T13:37:41.114 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 79553 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/dm-bufio.ko 2023-05-16T13:37:41.114 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 47033 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/dm-cache-smq.ko 2023-05-16T13:37:41.114 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 153889 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/dm-cache.ko 2023-05-16T13:37:41.115 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 105505 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/dm-crypt.ko 2023-05-16T13:37:41.115 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/dm-delay.ko 2023-05-16T13:37:41.115 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 53649 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/dm-era.ko 2023-05-16T13:37:41.115 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20425 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/dm-flakey.ko 2023-05-16T13:37:41.115 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 41105 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/dm-log-userspace.ko 2023-05-16T13:37:41.115 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 31721 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/dm-log.ko 2023-05-16T13:37:41.115 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 49057 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/dm-mirror.ko 2023-05-16T13:37:41.115 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 77297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/dm-multipath.ko 2023-05-16T13:37:41.116 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16025 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/dm-queue-length.ko 2023-05-16T13:37:41.116 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 70585 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/dm-raid.ko 2023-05-16T13:37:41.116 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 33561 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/dm-region-hash.ko 2023-05-16T13:37:41.116 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15361 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/dm-round-robin.ko 2023-05-16T13:37:41.116 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16289 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/dm-service-time.ko 2023-05-16T13:37:41.116 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 108817 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/dm-snapshot.ko 2023-05-16T13:37:41.116 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19201 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/dm-switch.ko 2023-05-16T13:37:41.117 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 181193 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/dm-thin-pool.ko 2023-05-16T13:37:41.117 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 51553 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/dm-verity.ko 2023-05-16T13:37:41.117 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 8177 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/dm-zero.ko 2023-05-16T13:37:41.117 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14601 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/faulty.ko 2023-05-16T13:37:41.117 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18673 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/linear.ko 2023-05-16T13:37:41.117 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 31801 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/multipath.ko 2023-05-16T13:37:41.117 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/persistent-data/ 2023-05-16T13:37:41.117 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 192417 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-05-16T13:37:41.118 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 36385 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/raid0.ko 2023-05-16T13:37:41.118 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 111041 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/raid1.ko 2023-05-16T13:37:41.118 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 158385 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/raid10.ko 2023-05-16T13:37:41.118 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 391777 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/raid456.ko 2023-05-16T13:37:41.118 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/message/ 2023-05-16T13:37:41.118 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/message/fusion/ 2023-05-16T13:37:41.118 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 174009 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/message/fusion/mptbase.ko 2023-05-16T13:37:41.118 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 62953 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/message/fusion/mptctl.ko 2023-05-16T13:37:41.119 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 44209 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/message/fusion/mptfc.ko 2023-05-16T13:37:41.119 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 36537 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/message/fusion/mptlan.ko 2023-05-16T13:37:41.119 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 122801 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/message/fusion/mptsas.ko 2023-05-16T13:37:41.119 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 75937 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/message/fusion/mptscsih.ko 2023-05-16T13:37:41.119 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 52449 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/message/fusion/mptspi.ko 2023-05-16T13:37:41.119 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/ 2023-05-16T13:37:41.119 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17001 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/88pm800.ko 2023-05-16T13:37:41.119 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12393 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/88pm805.ko 2023-05-16T13:37:41.120 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10169 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/88pm80x.ko 2023-05-16T13:37:41.120 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11377 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/arizona-i2c.ko 2023-05-16T13:37:41.120 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 121913 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/arizona.ko 2023-05-16T13:37:41.120 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11529 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/bcm590xx.ko 2023-05-16T13:37:41.120 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17457 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/cros_ec_dev.ko 2023-05-16T13:37:41.120 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 34201 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/dln2.ko 2023-05-16T13:37:41.120 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16257 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/janz-cmodio.ko 2023-05-16T13:37:41.120 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 52177 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/kempld-core.ko 2023-05-16T13:37:41.121 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 26977 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/lm3533-core.ko 2023-05-16T13:37:41.121 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13649 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-05-16T13:37:41.121 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12113 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/lp3943.ko 2023-05-16T13:37:41.121 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 54321 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/lpc_ich.ko 2023-05-16T13:37:41.121 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11617 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/lpc_sch.ko 2023-05-16T13:37:41.121 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17097 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/max8907.ko 2023-05-16T13:37:41.121 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 27545 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/mc13xxx-core.ko 2023-05-16T13:37:41.121 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11369 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-05-16T13:37:41.122 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11233 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/menf21bmc.ko 2023-05-16T13:37:41.122 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16577 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/pcf50633-adc.ko 2023-05-16T13:37:41.122 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 8009 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/pcf50633-gpio.ko 2023-05-16T13:37:41.122 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 33097 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/pcf50633.ko 2023-05-16T13:37:41.122 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9681 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-05-16T13:37:41.122 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19625 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/retu-mfd.ko 2023-05-16T13:37:41.122 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 76113 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/si476x-core.ko 2023-05-16T13:37:41.122 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 47329 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/sm501.ko 2023-05-16T13:37:41.123 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18841 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-05-16T13:37:41.123 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 50185 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/tps65010.ko 2023-05-16T13:37:41.123 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9993 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/tps6507x.ko 2023-05-16T13:37:41.123 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12961 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/viperboard.ko 2023-05-16T13:37:41.123 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10097 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/vx855.ko 2023-05-16T13:37:41.123 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17553 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/wl1273-core.ko 2023-05-16T13:37:41.123 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 43329 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/wm8994.ko 2023-05-16T13:37:41.123 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/ 2023-05-16T13:37:41.124 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13401 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-05-16T13:37:41.124 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 47689 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/ad525x_dpot.ko 2023-05-16T13:37:41.124 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/altera-stapl/ 2023-05-16T13:37:41.124 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 45865 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-05-16T13:37:41.124 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17897 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/apds9802als.ko 2023-05-16T13:37:41.124 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 36305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/apds990x.ko 2023-05-16T13:37:41.124 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 45153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/bh1770glc.ko 2023-05-16T13:37:41.125 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/c2port/ 2023-05-16T13:37:41.125 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10649 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-05-16T13:37:41.125 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 34569 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/c2port/core.ko 2023-05-16T13:37:41.125 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/cb710/ 2023-05-16T13:37:41.125 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24145 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/cb710/cb710.ko 2023-05-16T13:37:41.125 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/ds1682.ko 2023-05-16T13:37:41.125 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 8457 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/dummy-irq.ko 2023-05-16T13:37:41.125 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/echo/ 2023-05-16T13:37:41.126 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12409 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/echo/echo.ko 2023-05-16T13:37:41.126 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/eeprom/ 2023-05-16T13:37:41.126 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 37201 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/eeprom/at24.ko 2023-05-16T13:37:41.126 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13825 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/eeprom/eeprom.ko 2023-05-16T13:37:41.126 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13561 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-05-16T13:37:41.126 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13113 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/eeprom/max6875.ko 2023-05-16T13:37:41.126 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 31673 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/enclosure.ko 2023-05-16T13:37:41.126 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/genwqe/ 2023-05-16T13:37:41.127 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 151777 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-05-16T13:37:41.127 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13697 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/hmc6352.ko 2023-05-16T13:37:41.127 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 30841 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/hpilo.ko 2023-05-16T13:37:41.127 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/ibmasm/ 2023-05-16T13:37:41.127 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 72113 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-05-16T13:37:41.127 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19353 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/ics932s401.ko 2023-05-16T13:37:41.127 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21249 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/isl29003.ko 2023-05-16T13:37:41.127 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15249 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/isl29020.ko 2023-05-16T13:37:41.128 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/lis3lv02d/ 2023-05-16T13:37:41.128 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 41145 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-05-16T13:37:41.128 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13425 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-05-16T13:37:41.128 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/mei/ 2023-05-16T13:37:41.128 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 123577 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/mei/mei-me.ko 2023-05-16T13:37:41.128 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 56017 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/mei/mei-txe.ko 2023-05-16T13:37:41.128 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 304113 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/mei/mei.ko 2023-05-16T13:37:41.128 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 30921 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/phantom.ko 2023-05-16T13:37:41.129 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/ti-st/ 2023-05-16T13:37:41.129 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 74113 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/ti-st/st_drv.ko 2023-05-16T13:37:41.129 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23873 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/tifm_7xx1.ko 2023-05-16T13:37:41.129 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 27041 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/tifm_core.ko 2023-05-16T13:37:41.129 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/tsl2550.ko 2023-05-16T13:37:41.129 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 48249 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/vmw_balloon.ko 2023-05-16T13:37:41.129 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/vmw_vmci/ 2023-05-16T13:37:41.129 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 180377 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-05-16T13:37:41.130 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ 2023-05-16T13:37:41.130 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/bonding/ 2023-05-16T13:37:41.130 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 484433 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/bonding/bonding.ko 2023-05-16T13:37:41.130 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/dsa/ 2023-05-16T13:37:41.130 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/dsa/b53/ 2023-05-16T13:37:41.130 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 98553 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/dsa/b53/b53_common.ko 2023-05-16T13:37:41.130 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 39777 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/dsa/bcm-sf2.ko 2023-05-16T13:37:41.130 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14193 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/dsa/mv88e6060.ko 2023-05-16T13:37:41.131 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/dsa/mv88e6xxx/ 2023-05-16T13:37:41.131 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 447025 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-05-16T13:37:41.131 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16433 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/dummy.ko 2023-05-16T13:37:41.131 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17449 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/eql.ko 2023-05-16T13:37:41.131 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/ 2023-05-16T13:37:41.131 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/3com/ 2023-05-16T13:37:41.131 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 45289 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-05-16T13:37:41.131 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 41585 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-05-16T13:37:41.132 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 130081 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-05-16T13:37:41.132 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 68353 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-05-16T13:37:41.132 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/8390/ 2023-05-16T13:37:41.132 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 35961 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/8390/8390.ko 2023-05-16T13:37:41.132 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 59193 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-05-16T13:37:41.132 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 26697 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-05-16T13:37:41.132 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 98561 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-05-16T13:37:41.133 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/adaptec/ 2023-05-16T13:37:41.133 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 54017 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-05-16T13:37:41.133 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/agere/ 2023-05-16T13:37:41.133 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 68713 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/agere/et131x.ko 2023-05-16T13:37:41.133 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/alteon/ 2023-05-16T13:37:41.133 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 59081 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-05-16T13:37:41.133 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/altera/ 2023-05-16T13:37:41.133 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 40329 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-05-16T13:37:41.134 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/amd/ 2023-05-16T13:37:41.134 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 54113 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-05-16T13:37:41.134 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 48785 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-05-16T13:37:41.134 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 86849 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-05-16T13:37:41.134 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/atheros/ 2023-05-16T13:37:41.134 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/atheros/alx/ 2023-05-16T13:37:41.134 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 97153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-05-16T13:37:41.134 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-05-16T13:37:41.135 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 104297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-05-16T13:37:41.135 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-05-16T13:37:41.135 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 89745 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-05-16T13:37:41.135 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/atheros/atlx/ 2023-05-16T13:37:41.135 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 80993 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-05-16T13:37:41.135 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 69273 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-05-16T13:37:41.135 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/broadcom/ 2023-05-16T13:37:41.135 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 77881 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-05-16T13:37:41.136 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 176761 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-05-16T13:37:41.136 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-05-16T13:37:41.136 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 1422217 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-05-16T13:37:41.136 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 127561 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-05-16T13:37:41.136 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/broadcom/genet/ 2023-05-16T13:37:41.136 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 130553 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-05-16T13:37:41.136 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 311593 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-05-16T13:37:41.136 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/brocade/ 2023-05-16T13:37:41.137 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/brocade/bna/ 2023-05-16T13:37:41.137 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 323097 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-05-16T13:37:41.137 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/chelsio/ 2023-05-16T13:37:41.137 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-05-16T13:37:41.137 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 193001 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-05-16T13:37:41.137 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-05-16T13:37:41.137 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 345433 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-05-16T13:37:41.137 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-05-16T13:37:41.138 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 1038537 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-05-16T13:37:41.138 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-05-16T13:37:41.138 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 165945 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-05-16T13:37:41.138 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-05-16T13:37:41.138 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 33361 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-05-16T13:37:41.138 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/cisco/ 2023-05-16T13:37:41.138 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/cisco/enic/ 2023-05-16T13:37:41.138 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 203169 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-05-16T13:37:41.139 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/dec/ 2023-05-16T13:37:41.139 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/dec/tulip/ 2023-05-16T13:37:41.139 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 68953 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-05-16T13:37:41.139 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 60993 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-05-16T13:37:41.139 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 140721 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-05-16T13:37:41.139 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 51001 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-05-16T13:37:41.139 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 62361 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-05-16T13:37:41.139 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 30873 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-05-16T13:37:41.140 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/dlink/ 2023-05-16T13:37:41.140 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 60369 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-05-16T13:37:41.140 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 62393 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-05-16T13:37:41.140 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 45289 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/dnet.ko 2023-05-16T13:37:41.140 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24953 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/ec_bhf.ko 2023-05-16T13:37:41.140 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/emulex/ 2023-05-16T13:37:41.140 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/emulex/benet/ 2023-05-16T13:37:41.140 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 280937 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-05-16T13:37:41.141 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 49001 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/ethoc.ko 2023-05-16T13:37:41.141 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 51297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/fealnx.ko 2023-05-16T13:37:41.141 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/fujitsu/ 2023-05-16T13:37:41.141 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 44841 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-05-16T13:37:41.141 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/intel/ 2023-05-16T13:37:41.141 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 89969 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/intel/e100.ko 2023-05-16T13:37:41.141 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/intel/e1000/ 2023-05-16T13:37:41.141 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 295217 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-05-16T13:37:41.142 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/intel/e1000e/ 2023-05-16T13:37:41.142 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 583489 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-05-16T13:37:41.142 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/intel/fm10k/ 2023-05-16T13:37:41.142 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 245881 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-05-16T13:37:41.142 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/intel/i40e/ 2023-05-16T13:37:41.142 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 918521 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-05-16T13:37:41.142 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/intel/iavf/ 2023-05-16T13:37:41.143 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 301361 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-05-16T13:37:41.143 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/intel/igb/ 2023-05-16T13:37:41.143 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 513657 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-05-16T13:37:41.143 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/intel/igbvf/ 2023-05-16T13:37:41.143 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 92241 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-05-16T13:37:41.143 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/intel/ixgb/ 2023-05-16T13:37:41.143 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 124121 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/intel/ixgb/ixgb.ko 2023-05-16T13:37:41.143 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-05-16T13:37:41.144 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 733809 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-05-16T13:37:41.144 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-05-16T13:37:41.144 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 151361 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-05-16T13:37:41.144 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 86417 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/jme.ko 2023-05-16T13:37:41.144 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/marvell/ 2023-05-16T13:37:41.144 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20537 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-05-16T13:37:41.144 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 101889 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/marvell/skge.ko 2023-05-16T13:37:41.144 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 122185 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-05-16T13:37:41.145 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/mellanox/ 2023-05-16T13:37:41.145 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-05-16T13:37:41.145 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 709977 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-05-16T13:37:41.145 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 280081 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-05-16T13:37:41.145 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-05-16T13:37:41.145 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-05-16T13:37:41.145 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 1034761 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-05-16T13:37:41.145 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/micrel/ 2023-05-16T13:37:41.146 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 52545 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-05-16T13:37:41.146 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 39961 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-05-16T13:37:41.146 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19129 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-05-16T13:37:41.146 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 95169 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-05-16T13:37:41.146 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/myricom/ 2023-05-16T13:37:41.146 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-05-16T13:37:41.146 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 108305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-05-16T13:37:41.146 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/natsemi/ 2023-05-16T13:37:41.147 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 72945 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-05-16T13:37:41.147 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 47281 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-05-16T13:37:41.147 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/neterion/ 2023-05-16T13:37:41.147 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 150401 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-05-16T13:37:41.147 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/nvidia/ 2023-05-16T13:37:41.147 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 136281 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-05-16T13:37:41.147 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/packetengines/ 2023-05-16T13:37:41.147 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 49985 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-05-16T13:37:41.148 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 42649 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-05-16T13:37:41.148 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/qlogic/ 2023-05-16T13:37:41.148 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-05-16T13:37:41.148 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 227049 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-05-16T13:37:41.148 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 86585 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-05-16T13:37:41.148 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-05-16T13:37:41.148 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 671353 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-05-16T13:37:41.148 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/rdc/ 2023-05-16T13:37:41.149 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 42529 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-05-16T13:37:41.149 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/realtek/ 2023-05-16T13:37:41.149 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 66881 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-05-16T13:37:41.149 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 83481 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-05-16T13:37:41.149 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 28833 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/realtek/atp.ko 2023-05-16T13:37:41.149 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 183041 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-05-16T13:37:41.149 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/samsung/ 2023-05-16T13:37:41.150 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-05-16T13:37:41.150 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 103713 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-05-16T13:37:41.150 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/sfc/ 2023-05-16T13:37:41.150 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 862657 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-05-16T13:37:41.150 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/silan/ 2023-05-16T13:37:41.150 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 46737 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-05-16T13:37:41.150 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/sis/ 2023-05-16T13:37:41.150 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 54305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/sis/sis190.ko 2023-05-16T13:37:41.151 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 62841 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/sis/sis900.ko 2023-05-16T13:37:41.151 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/smsc/ 2023-05-16T13:37:41.151 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 61041 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-05-16T13:37:41.151 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 66689 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-05-16T13:37:41.151 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 72905 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-05-16T13:37:41.151 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 67777 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-05-16T13:37:41.151 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/stmicro/ 2023-05-16T13:37:41.151 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-05-16T13:37:41.152 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12961 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-05-16T13:37:41.152 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 39641 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-05-16T13:37:41.152 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13457 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-05-16T13:37:41.152 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 474905 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-05-16T13:37:41.152 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/sun/ 2023-05-16T13:37:41.152 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 102945 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/sun/cassini.ko 2023-05-16T13:37:41.152 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 165841 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/sun/niu.ko 2023-05-16T13:37:41.152 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 65977 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/sun/sungem.ko 2023-05-16T13:37:41.153 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 83257 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-05-16T13:37:41.153 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/tehuti/ 2023-05-16T13:37:41.153 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 49577 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-05-16T13:37:41.153 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/ti/ 2023-05-16T13:37:41.153 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 86025 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/ti/tlan.ko 2023-05-16T13:37:41.153 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/via/ 2023-05-16T13:37:41.153 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 79761 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-05-16T13:37:41.153 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 83169 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-05-16T13:37:41.154 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/wiznet/ 2023-05-16T13:37:41.154 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 45289 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-05-16T13:37:41.154 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 30345 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-05-16T13:37:41.154 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/xircom/ 2023-05-16T13:37:41.154 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 59545 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-05-16T13:37:41.154 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/fddi/ 2023-05-16T13:37:41.154 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 40569 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/fddi/defxx.ko 2023-05-16T13:37:41.154 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/fddi/skfp/ 2023-05-16T13:37:41.155 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 216481 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/fddi/skfp/skfp.ko 2023-05-16T13:37:41.155 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 76673 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/geneve.ko 2023-05-16T13:37:41.155 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/hyperv/ 2023-05-16T13:37:41.155 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 234841 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-05-16T13:37:41.155 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ieee802154/ 2023-05-16T13:37:41.155 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17817 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ieee802154/fakelb.ko 2023-05-16T13:37:41.155 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24649 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ifb.ko 2023-05-16T13:37:41.155 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ipvlan/ 2023-05-16T13:37:41.156 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 82705 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ipvlan/ipvlan.ko 2023-05-16T13:37:41.156 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 60233 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/macvlan.ko 2023-05-16T13:37:41.156 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15521 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/macvtap.ko 2023-05-16T13:37:41.156 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/mdio/ 2023-05-16T13:37:41.156 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19377 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-05-16T13:37:41.156 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12993 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-05-16T13:37:41.156 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13257 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/mdio/mdio-gpio.ko 2023-05-16T13:37:41.157 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14729 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/mdio.ko 2023-05-16T13:37:41.157 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18905 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/mii.ko 2023-05-16T13:37:41.157 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 41265 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/netconsole.ko 2023-05-16T13:37:41.157 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12649 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/nlmon.ko 2023-05-16T13:37:41.157 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/pcs/ 2023-05-16T13:37:41.157 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9097 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/pcs/pcs-altera-tse.ko 2023-05-16T13:37:41.157 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 29393 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-05-16T13:37:41.157 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/phy/ 2023-05-16T13:37:41.158 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9241 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/phy/amd.ko 2023-05-16T13:37:41.158 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 40009 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-05-16T13:37:41.158 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 44265 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/phy/bcm7xxx.ko 2023-05-16T13:37:41.158 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11033 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/phy/bcm87xx.ko 2023-05-16T13:37:41.158 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 37281 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/phy/broadcom.ko 2023-05-16T13:37:41.158 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10073 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/phy/cicada.ko 2023-05-16T13:37:41.158 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12409 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/phy/davicom.ko 2023-05-16T13:37:41.158 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 8953 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/phy/et1011c.ko 2023-05-16T13:37:41.159 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24345 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/phy/icplus.ko 2023-05-16T13:37:41.159 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15225 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/phy/lxt.ko 2023-05-16T13:37:41.159 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 75673 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/phy/marvell.ko 2023-05-16T13:37:41.159 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 74585 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/phy/micrel.ko 2023-05-16T13:37:41.159 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11545 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/phy/national.ko 2023-05-16T13:37:41.159 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 91833 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/phy/phylink.ko 2023-05-16T13:37:41.159 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9505 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/phy/qsemi.ko 2023-05-16T13:37:41.159 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 46865 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/phy/realtek.ko 2023-05-16T13:37:41.160 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20585 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/phy/smsc.ko 2023-05-16T13:37:41.160 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/phy/ste10Xp.ko 2023-05-16T13:37:41.160 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23353 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/phy/vitesse.ko 2023-05-16T13:37:41.160 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/plip/ 2023-05-16T13:37:41.160 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 43073 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/plip/plip.ko 2023-05-16T13:37:41.160 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ppp/ 2023-05-16T13:37:41.160 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15433 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ppp/bsd_comp.ko 2023-05-16T13:37:41.160 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 29425 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ppp/ppp_async.ko 2023-05-16T13:37:41.161 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17169 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ppp/ppp_deflate.ko 2023-05-16T13:37:41.161 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18193 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ppp/ppp_mppe.ko 2023-05-16T13:37:41.161 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 28449 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ppp/ppp_synctty.ko 2023-05-16T13:37:41.161 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 42105 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ppp/pppoe.ko 2023-05-16T13:37:41.161 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12313 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ppp/pppox.ko 2023-05-16T13:37:41.161 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 31337 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ppp/pptp.ko 2023-05-16T13:37:41.161 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 27785 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/sb1000.ko 2023-05-16T13:37:41.161 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/slip/ 2023-05-16T13:37:41.162 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 42009 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/slip/slip.ko 2023-05-16T13:37:41.162 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 26209 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/sungem_phy.ko 2023-05-16T13:37:41.162 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 63113 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/tap.ko 2023-05-16T13:37:41.162 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/team/ 2023-05-16T13:37:41.162 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 104289 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/team/team.ko 2023-05-16T13:37:41.162 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12985 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/team/team_mode_activebackup.ko 2023-05-16T13:37:41.162 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9721 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/team/team_mode_broadcast.ko 2023-05-16T13:37:41.162 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 28497 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-05-16T13:37:41.163 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9209 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/team/team_mode_random.ko 2023-05-16T13:37:41.163 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 8825 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-05-16T13:37:41.163 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 87345 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/veth.ko 2023-05-16T13:37:41.163 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/vmxnet3/ 2023-05-16T13:37:41.163 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 120049 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-05-16T13:37:41.163 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/vxlan/ 2023-05-16T13:37:41.163 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 238977 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/vxlan/vxlan.ko 2023-05-16T13:37:41.163 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/xen-netback/ 2023-05-16T13:37:41.164 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 143305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/xen-netback/xen-netback.ko 2023-05-16T13:37:41.164 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ntb/ 2023-05-16T13:37:41.164 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19105 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ntb/ntb.ko 2023-05-16T13:37:41.164 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/nvme/ 2023-05-16T13:37:41.164 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/nvme/host/ 2023-05-16T13:37:41.164 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 257665 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/nvme/host/nvme-core.ko 2023-05-16T13:37:41.164 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 101393 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/nvme/host/nvme.ko 2023-05-16T13:37:41.164 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/parport/ 2023-05-16T13:37:41.165 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 128697 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/parport/parport.ko 2023-05-16T13:37:41.165 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14121 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/parport/parport_cs.ko 2023-05-16T13:37:41.165 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 83385 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/parport/parport_pc.ko 2023-05-16T13:37:41.165 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 25625 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/parport/parport_serial.ko 2023-05-16T13:37:41.165 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/pci/ 2023-05-16T13:37:41.165 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/pci/hotplug/ 2023-05-16T13:37:41.165 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24505 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-05-16T13:37:41.165 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17361 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-05-16T13:37:41.166 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19633 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-05-16T13:37:41.166 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11361 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/pci/pci-stub.ko 2023-05-16T13:37:41.166 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 46945 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/pci/xen-pcifront.ko 2023-05-16T13:37:41.166 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/pcmcia/ 2023-05-16T13:37:41.166 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 26305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/pcmcia/i82092.ko 2023-05-16T13:37:41.166 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 143273 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/pcmcia/pcmcia.ko 2023-05-16T13:37:41.166 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 60265 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/pcmcia/pcmcia_core.ko 2023-05-16T13:37:41.166 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 33441 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-05-16T13:37:41.167 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 33761 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/pcmcia/pd6729.ko 2023-05-16T13:37:41.167 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 112481 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/pcmcia/yenta_socket.ko 2023-05-16T13:37:41.167 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/phy/ 2023-05-16T13:37:41.167 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/phy/broadcom/ 2023-05-16T13:37:41.167 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10353 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-05-16T13:37:41.167 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/phy/samsung/ 2023-05-16T13:37:41.167 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 7953 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-05-16T13:37:41.167 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/pinctrl/ 2023-05-16T13:37:41.168 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/pinctrl/intel/ 2023-05-16T13:37:41.168 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 70569 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-05-16T13:37:41.168 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/ 2023-05-16T13:37:41.168 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/chrome/ 2023-05-16T13:37:41.168 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 49257 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-05-16T13:37:41.168 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19737 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/chrome/cros_ec.ko 2023-05-16T13:37:41.168 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20913 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-05-16T13:37:41.169 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24481 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-05-16T13:37:41.169 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 25729 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-05-16T13:37:41.169 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17769 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-05-16T13:37:41.169 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16601 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-05-16T13:37:41.169 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/ 2023-05-16T13:37:41.169 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 66617 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/acer-wmi.ko 2023-05-16T13:37:41.169 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 39857 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/acerhdf.ko 2023-05-16T13:37:41.169 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 25993 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/apple-gmux.ko 2023-05-16T13:37:41.170 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 59225 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/asus-laptop.ko 2023-05-16T13:37:41.170 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 30209 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-05-16T13:37:41.170 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 105897 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/asus-wmi.ko 2023-05-16T13:37:41.170 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 36425 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/classmate-laptop.ko 2023-05-16T13:37:41.170 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 48625 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-05-16T13:37:41.170 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13521 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-05-16T13:37:41.170 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 39769 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-05-16T13:37:41.170 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 22097 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-05-16T13:37:41.171 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 36153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/hdaps.ko 2023-05-16T13:37:41.171 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18769 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/ibm_rtl.ko 2023-05-16T13:37:41.171 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/intel/ 2023-05-16T13:37:41.171 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11585 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-05-16T13:37:41.171 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 8553 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-05-16T13:37:41.171 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 42849 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/intel_ips.ko 2023-05-16T13:37:41.171 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19769 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/msi-wmi.ko 2023-05-16T13:37:41.171 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9425 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/mxm-wmi.ko 2023-05-16T13:37:41.172 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 34297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-05-16T13:37:41.172 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 41825 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/samsung-laptop.ko 2023-05-16T13:37:41.172 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13673 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/samsung-q10.ko 2023-05-16T13:37:41.172 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16817 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/topstar-laptop.ko 2023-05-16T13:37:41.172 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13225 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-05-16T13:37:41.172 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16577 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/toshiba_haps.ko 2023-05-16T13:37:41.172 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9729 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/wmi-bmof.ko 2023-05-16T13:37:41.172 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 54449 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/wmi.ko 2023-05-16T13:37:41.173 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/ 2023-05-16T13:37:41.173 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/ 2023-05-16T13:37:41.173 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 29841 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/88pm860x_battery.ko 2023-05-16T13:37:41.173 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 33553 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/88pm860x_charger.ko 2023-05-16T13:37:41.173 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 54625 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/bq2415x_charger.ko 2023-05-16T13:37:41.173 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 53529 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/bq24190_charger.ko 2023-05-16T13:37:41.173 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21033 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/bq24735-charger.ko 2023-05-16T13:37:41.173 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16009 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-05-16T13:37:41.174 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19105 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/da9030_battery.ko 2023-05-16T13:37:41.174 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19345 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/da9052-battery.ko 2023-05-16T13:37:41.174 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 28849 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/ds2760_battery.ko 2023-05-16T13:37:41.174 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 22777 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/ds2780_battery.ko 2023-05-16T13:37:41.174 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 22921 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/ds2781_battery.ko 2023-05-16T13:37:41.174 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/ds2782_battery.ko 2023-05-16T13:37:41.174 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19857 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/gpio-charger.ko 2023-05-16T13:37:41.174 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17553 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/isp1704_charger.ko 2023-05-16T13:37:41.175 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19777 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/lp8727_charger.ko 2023-05-16T13:37:41.175 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/max14577_charger.ko 2023-05-16T13:37:41.175 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 25433 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/max17040_battery.ko 2023-05-16T13:37:41.175 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 30009 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/max17042_battery.ko 2023-05-16T13:37:41.175 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18097 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/max8903_charger.ko 2023-05-16T13:37:41.175 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/max8925_power.ko 2023-05-16T13:37:41.175 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20737 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/pcf50633-charger.ko 2023-05-16T13:37:41.175 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 37481 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/sbs-battery.ko 2023-05-16T13:37:41.176 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 27889 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/test_power.ko 2023-05-16T13:37:41.176 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18369 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/tps65090-charger.ko 2023-05-16T13:37:41.176 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11545 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/wm831x_backup.ko 2023-05-16T13:37:41.176 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24025 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/wm831x_power.ko 2023-05-16T13:37:41.176 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21913 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/wm8350_power.ko 2023-05-16T13:37:41.176 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/powercap/ 2023-05-16T13:37:41.176 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 53721 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/powercap/intel_rapl_common.ko 2023-05-16T13:37:41.176 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16873 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/powercap/intel_rapl_msr.ko 2023-05-16T13:37:41.177 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/pps/ 2023-05-16T13:37:41.177 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/pps/clients/ 2023-05-16T13:37:41.177 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15033 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/pps/clients/pps-gpio.ko 2023-05-16T13:37:41.177 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12761 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/pps/clients/pps-ldisc.ko 2023-05-16T13:37:41.177 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15425 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/pps/clients/pps_parport.ko 2023-05-16T13:37:41.177 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 41033 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/pps/pps_core.ko 2023-05-16T13:37:41.177 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ptp/ 2023-05-16T13:37:41.177 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 64265 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ptp/ptp.ko 2023-05-16T13:37:41.178 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15761 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ptp/ptp_kvm.ko 2023-05-16T13:37:41.178 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/ 2023-05-16T13:37:41.178 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 22953 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-88pm80x.ko 2023-05-16T13:37:41.178 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24137 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-88pm860x.ko 2023-05-16T13:37:41.178 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14953 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-bq32k.ko 2023-05-16T13:37:41.178 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12465 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-bq4802.ko 2023-05-16T13:37:41.178 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19673 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-da9052.ko 2023-05-16T13:37:41.178 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18073 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-da9055.ko 2023-05-16T13:37:41.179 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19745 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-da9063.ko 2023-05-16T13:37:41.179 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16017 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-ds1286.ko 2023-05-16T13:37:41.179 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 68081 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-ds1307.ko 2023-05-16T13:37:41.179 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20385 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-ds1374.ko 2023-05-16T13:37:41.179 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17721 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-ds1511.ko 2023-05-16T13:37:41.179 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16241 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-ds1553.ko 2023-05-16T13:37:41.179 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13513 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-ds1672.ko 2023-05-16T13:37:41.179 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12945 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-ds1742.ko 2023-05-16T13:37:41.180 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16785 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-ds2404.ko 2023-05-16T13:37:41.180 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23209 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-ds3232.ko 2023-05-16T13:37:41.180 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10593 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-em3027.ko 2023-05-16T13:37:41.180 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23897 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-fm3130.ko 2023-05-16T13:37:41.180 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17273 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-isl12022.ko 2023-05-16T13:37:41.180 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 34769 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-isl1208.ko 2023-05-16T13:37:41.180 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14241 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-lp8788.ko 2023-05-16T13:37:41.181 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 37657 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-m41t80.ko 2023-05-16T13:37:41.181 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11601 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-m48t35.ko 2023-05-16T13:37:41.181 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 25441 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-m48t59.ko 2023-05-16T13:37:41.181 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13745 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-m48t86.ko 2023-05-16T13:37:41.181 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11145 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-max6900.ko 2023-05-16T13:37:41.181 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14233 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-max8907.ko 2023-05-16T13:37:41.181 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14905 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-max8925.ko 2023-05-16T13:37:41.181 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 25313 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-max8997.ko 2023-05-16T13:37:41.182 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16249 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-max8998.ko 2023-05-16T13:37:41.182 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18025 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-05-16T13:37:41.182 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10969 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-msm6242.ko 2023-05-16T13:37:41.182 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19193 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-palmas.ko 2023-05-16T13:37:41.182 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 39625 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-pcf2127.ko 2023-05-16T13:37:41.182 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17545 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-pcf50633.ko 2023-05-16T13:37:41.182 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 26313 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-pcf85063.ko 2023-05-16T13:37:41.182 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21393 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-pcf8523.ko 2023-05-16T13:37:41.183 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 29385 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-pcf8563.ko 2023-05-16T13:37:41.183 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12001 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-pcf8583.ko 2023-05-16T13:37:41.183 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17529 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-rc5t583.ko 2023-05-16T13:37:41.183 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12625 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-rp5c01.ko 2023-05-16T13:37:41.183 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 33313 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-rs5c372.ko 2023-05-16T13:37:41.183 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 27329 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-05-16T13:37:41.183 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24833 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-rx8025.ko 2023-05-16T13:37:41.183 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19609 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-rx8581.ko 2023-05-16T13:37:41.184 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21177 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-s35390a.ko 2023-05-16T13:37:41.184 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16337 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-05-16T13:37:41.184 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17393 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-tps6586x.ko 2023-05-16T13:37:41.184 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21105 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-tps65910.ko 2023-05-16T13:37:41.184 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20049 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-wm831x.ko 2023-05-16T13:37:41.184 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20849 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-wm8350.ko 2023-05-16T13:37:41.184 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 27377 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-x1205.ko 2023-05-16T13:37:41.184 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/ 2023-05-16T13:37:41.185 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 77209 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/3w-9xxx.ko 2023-05-16T13:37:41.185 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 57169 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/3w-sas.ko 2023-05-16T13:37:41.185 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 54681 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/3w-xxxx.ko 2023-05-16T13:37:41.185 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 134673 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/BusLogic.ko 2023-05-16T13:37:41.185 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 26001 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/a100u2w.ko 2023-05-16T13:37:41.185 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/aacraid/ 2023-05-16T13:37:41.185 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 271161 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/aacraid/aacraid.ko 2023-05-16T13:37:41.185 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 100129 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/advansys.ko 2023-05-16T13:37:41.186 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/aic7xxx/ 2023-05-16T13:37:41.186 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 355761 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-05-16T13:37:41.186 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 295313 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-05-16T13:37:41.186 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/aic94xx/ 2023-05-16T13:37:41.186 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 188825 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-05-16T13:37:41.186 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23569 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/am53c974.ko 2023-05-16T13:37:41.186 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/arcmsr/ 2023-05-16T13:37:41.186 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 106065 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-05-16T13:37:41.187 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 37617 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/atp870u.ko 2023-05-16T13:37:41.187 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/be2iscsi/ 2023-05-16T13:37:41.187 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 246913 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-05-16T13:37:41.187 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/bfa/ 2023-05-16T13:37:41.187 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 1172201 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/bfa/bfa.ko 2023-05-16T13:37:41.187 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/bnx2fc/ 2023-05-16T13:37:41.187 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 236737 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-05-16T13:37:41.187 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/bnx2i/ 2023-05-16T13:37:41.188 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 114969 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-05-16T13:37:41.188 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 40193 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/ch.ko 2023-05-16T13:37:41.188 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/csiostor/ 2023-05-16T13:37:41.188 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 308401 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/csiostor/csiostor.ko 2023-05-16T13:37:41.188 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/cxgbi/ 2023-05-16T13:37:41.188 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-05-16T13:37:41.188 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 75689 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-05-16T13:37:41.188 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-05-16T13:37:41.189 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 101017 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-05-16T13:37:41.189 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 141417 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-05-16T13:37:41.189 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 75105 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/dc395x.ko 2023-05-16T13:37:41.189 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 37553 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/dmx3191d.ko 2023-05-16T13:37:41.189 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/esas2r/ 2023-05-16T13:37:41.189 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 211977 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/esas2r/esas2r.ko 2023-05-16T13:37:41.189 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 59441 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/esp_scsi.ko 2023-05-16T13:37:41.189 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/fcoe/ 2023-05-16T13:37:41.190 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 77713 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/fcoe/fcoe.ko 2023-05-16T13:37:41.190 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 154601 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-05-16T13:37:41.190 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18233 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/fdomain.ko 2023-05-16T13:37:41.190 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/fnic/ 2023-05-16T13:37:41.190 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 262025 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/fnic/fnic.ko 2023-05-16T13:37:41.190 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 201305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/hpsa.ko 2023-05-16T13:37:41.190 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 50657 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/hptiop.ko 2023-05-16T13:37:41.190 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 48721 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/hv_storvsc.ko 2023-05-16T13:37:41.191 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 34881 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/imm.ko 2023-05-16T13:37:41.191 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 43561 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/initio.ko 2023-05-16T13:37:41.191 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 285985 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/ipr.ko 2023-05-16T13:37:41.191 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 101449 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/ips.ko 2023-05-16T13:37:41.191 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/isci/ 2023-05-16T13:37:41.191 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 316817 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/isci/isci.ko 2023-05-16T13:37:41.191 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 25025 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-05-16T13:37:41.191 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 52201 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/iscsi_tcp.ko 2023-05-16T13:37:41.192 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/libfc/ 2023-05-16T13:37:41.192 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 307873 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/libfc/libfc.ko 2023-05-16T13:37:41.192 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 139737 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/libiscsi.ko 2023-05-16T13:37:41.192 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 51257 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/libiscsi_tcp.ko 2023-05-16T13:37:41.192 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/libsas/ 2023-05-16T13:37:41.192 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 212217 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/libsas/libsas.ko 2023-05-16T13:37:41.192 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/lpfc/ 2023-05-16T13:37:41.192 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 2194601 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/lpfc/lpfc.ko 2023-05-16T13:37:41.193 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/megaraid/ 2023-05-16T13:37:41.193 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 73113 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-05-16T13:37:41.193 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 32593 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-05-16T13:37:41.193 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 310241 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-05-16T13:37:41.193 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 84289 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/megaraid.ko 2023-05-16T13:37:41.193 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/mpt3sas/ 2023-05-16T13:37:41.193 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 659569 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-05-16T13:37:41.193 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/mvsas/ 2023-05-16T13:37:41.194 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 119425 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/mvsas/mvsas.ko 2023-05-16T13:37:41.194 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 77665 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/mvumi.ko 2023-05-16T13:37:41.194 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/pcmcia/ 2023-05-16T13:37:41.194 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 81113 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-05-16T13:37:41.194 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11281 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-05-16T13:37:41.194 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20369 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-05-16T13:37:41.194 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23361 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-05-16T13:37:41.194 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/pm8001/ 2023-05-16T13:37:41.195 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 360881 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-05-16T13:37:41.195 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 123073 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/pmcraid.ko 2023-05-16T13:37:41.195 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 33177 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/ppa.ko 2023-05-16T13:37:41.195 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 54841 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/qla1280.ko 2023-05-16T13:37:41.195 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/qla2xxx/ 2023-05-16T13:37:41.195 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 1850553 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-05-16T13:37:41.195 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 85353 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-05-16T13:37:41.195 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/qla4xxx/ 2023-05-16T13:37:41.196 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 558737 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-05-16T13:37:41.196 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17393 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/qlogicfas408.ko 2023-05-16T13:37:41.196 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18073 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/raid_class.ko 2023-05-16T13:37:41.196 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 242441 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/scsi_debug.ko 2023-05-16T13:37:41.196 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 171561 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/scsi_transport_fc.ko 2023-05-16T13:37:41.196 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 270153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-05-16T13:37:41.196 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 94049 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/scsi_transport_sas.ko 2023-05-16T13:37:41.197 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 72321 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/scsi_transport_spi.ko 2023-05-16T13:37:41.197 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 43169 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/scsi_transport_srp.ko 2023-05-16T13:37:41.197 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 25761 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/ses.ko 2023-05-16T13:37:41.197 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 115409 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/st.ko 2023-05-16T13:37:41.197 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 46329 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/stex.ko 2023-05-16T13:37:41.197 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/sym53c8xx_2/ 2023-05-16T13:37:41.197 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 161697 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-05-16T13:37:41.197 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 41793 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/virtio_scsi.ko 2023-05-16T13:37:41.198 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 49873 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/vmw_pvscsi.ko 2023-05-16T13:37:41.198 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 39513 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/wd719x.ko 2023-05-16T13:37:41.198 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 49529 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/xen-scsifront.ko 2023-05-16T13:37:41.198 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ssb/ 2023-05-16T13:37:41.198 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 126593 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ssb/ssb.ko 2023-05-16T13:37:41.198 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/target/ 2023-05-16T13:37:41.198 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/target/iscsi/ 2023-05-16T13:37:41.198 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 730161 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-05-16T13:37:41.199 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/target/loopback/ 2023-05-16T13:37:41.199 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 50857 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/target/loopback/tcm_loop.ko 2023-05-16T13:37:41.199 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 39145 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/target/target_core_file.ko 2023-05-16T13:37:41.199 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 37961 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/target/target_core_iblock.ko 2023-05-16T13:37:41.199 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 913305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/target/target_core_mod.ko 2023-05-16T13:37:41.199 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 43833 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/target/target_core_pscsi.ko 2023-05-16T13:37:41.199 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 121793 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/target/target_core_user.ko 2023-05-16T13:37:41.199 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/target/tcm_fc/ 2023-05-16T13:37:41.200 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 75905 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-05-16T13:37:41.200 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/thermal/ 2023-05-16T13:37:41.200 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/thermal/intel/ 2023-05-16T13:37:41.200 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/thermal/intel/int340x_thermal/ 2023-05-16T13:37:41.200 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18609 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-05-16T13:37:41.200 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 28377 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-05-16T13:37:41.200 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9521 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-05-16T13:37:41.200 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9761 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-05-16T13:37:41.201 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14585 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-05-16T13:37:41.201 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15345 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-05-16T13:37:41.201 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 25657 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-05-16T13:37:41.201 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19681 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-05-16T13:37:41.201 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14425 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-05-16T13:37:41.201 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-05-16T13:37:41.201 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12097 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-05-16T13:37:41.201 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 27369 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-05-16T13:37:41.202 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21745 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/thermal/intel/intel_menlow.ko 2023-05-16T13:37:41.202 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 30193 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-05-16T13:37:41.202 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20321 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-05-16T13:37:41.202 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11497 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-05-16T13:37:41.202 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 25825 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-05-16T13:37:41.202 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/tty/ 2023-05-16T13:37:41.202 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/tty/ipwireless/ 2023-05-16T13:37:41.202 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 77649 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-05-16T13:37:41.203 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 57377 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/tty/moxa.ko 2023-05-16T13:37:41.203 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 50361 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/tty/mxser.ko 2023-05-16T13:37:41.203 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 104345 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/tty/n_gsm.ko 2023-05-16T13:37:41.203 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 31513 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/tty/n_hdlc.ko 2023-05-16T13:37:41.203 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 67641 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/tty/nozomi.ko 2023-05-16T13:37:41.203 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/tty/serial/ 2023-05-16T13:37:41.203 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/tty/serial/8250/ 2023-05-16T13:37:41.203 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 35105 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-05-16T13:37:41.204 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 59065 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-05-16T13:37:41.204 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17785 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-05-16T13:37:41.204 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21961 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/tty/serial/altera_uart.ko 2023-05-16T13:37:41.204 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9001 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/tty/serial/arc_uart.ko 2023-05-16T13:37:41.204 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 69793 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-05-16T13:37:41.204 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/tty/serial/jsm/ 2023-05-16T13:37:41.204 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 102521 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/tty/serial/jsm/jsm.ko 2023-05-16T13:37:41.205 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 28353 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/tty/serial/rp2.ko 2023-05-16T13:37:41.205 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 51705 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/tty/serial/sc16is7xx.ko 2023-05-16T13:37:41.205 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 99985 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/tty/synclink_gt.ko 2023-05-16T13:37:41.205 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ufs/ 2023-05-16T13:37:41.205 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ufs/core/ 2023-05-16T13:37:41.205 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 518025 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ufs/core/ufshcd-core.ko 2023-05-16T13:37:41.205 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ufs/host/ 2023-05-16T13:37:41.205 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 27969 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-05-16T13:37:41.206 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14121 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-05-16T13:37:41.206 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/uio/ 2023-05-16T13:37:41.206 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 43353 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/uio/uio.ko 2023-05-16T13:37:41.206 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11809 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/uio/uio_aec.ko 2023-05-16T13:37:41.206 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10785 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/uio/uio_cif.ko 2023-05-16T13:37:41.206 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17809 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/uio/uio_dmem_genirq.ko 2023-05-16T13:37:41.206 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12505 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/uio/uio_mf624.ko 2023-05-16T13:37:41.206 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11681 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/uio/uio_netx.ko 2023-05-16T13:37:41.207 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10177 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/uio/uio_pci_generic.ko 2023-05-16T13:37:41.207 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15529 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-05-16T13:37:41.207 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13209 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/uio/uio_sercos3.ko 2023-05-16T13:37:41.207 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/ 2023-05-16T13:37:41.207 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/c67x00/ 2023-05-16T13:37:41.207 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 72777 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/c67x00/c67x00.ko 2023-05-16T13:37:41.207 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/chipidea/ 2023-05-16T13:37:41.207 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 144897 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-05-16T13:37:41.208 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18001 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-05-16T13:37:41.208 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12209 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-05-16T13:37:41.208 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12513 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-05-16T13:37:41.208 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/class/ 2023-05-16T13:37:41.208 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 85025 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/class/cdc-acm.ko 2023-05-16T13:37:41.208 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 50681 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/class/cdc-wdm.ko 2023-05-16T13:37:41.208 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 46969 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/class/usblp.ko 2023-05-16T13:37:41.208 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 89409 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/class/usbtmc.ko 2023-05-16T13:37:41.209 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/common/ 2023-05-16T13:37:41.209 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21825 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/common/ulpi.ko 2023-05-16T13:37:41.209 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/dwc2/ 2023-05-16T13:37:41.209 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11385 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-05-16T13:37:41.209 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/dwc3/ 2023-05-16T13:37:41.209 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11657 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-05-16T13:37:41.209 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 29433 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-05-16T13:37:41.209 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 433729 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/dwc3/dwc3.ko 2023-05-16T13:37:41.210 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/ 2023-05-16T13:37:41.210 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/function/ 2023-05-16T13:37:41.210 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 54585 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/function/u_ether.ko 2023-05-16T13:37:41.210 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 49873 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/function/u_serial.ko 2023-05-16T13:37:41.210 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 28609 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-05-16T13:37:41.210 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 40209 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-05-16T13:37:41.210 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 27657 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-05-16T13:37:41.210 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 36145 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-05-16T13:37:41.211 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 90825 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-05-16T13:37:41.211 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 50657 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-05-16T13:37:41.211 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 117593 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-05-16T13:37:41.211 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 57425 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-05-16T13:37:41.211 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21913 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-05-16T13:37:41.211 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 30761 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-05-16T13:37:41.211 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 57521 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-05-16T13:37:41.212 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 83697 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-05-16T13:37:41.212 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19017 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-05-16T13:37:41.212 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 58001 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-05-16T13:37:41.212 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 67913 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-05-16T13:37:41.212 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/legacy/ 2023-05-16T13:37:41.212 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20761 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-05-16T13:37:41.212 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17625 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-05-16T13:37:41.212 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18041 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-05-16T13:37:41.213 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-05-16T13:37:41.213 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 27969 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-05-16T13:37:41.213 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18489 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-05-16T13:37:41.213 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19913 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-05-16T13:37:41.213 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16537 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-05-16T13:37:41.213 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 31641 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-05-16T13:37:41.213 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16289 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-05-16T13:37:41.213 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18961 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-05-16T13:37:41.214 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 26697 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-05-16T13:37:41.214 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 61665 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-05-16T13:37:41.214 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14713 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-05-16T13:37:41.214 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 154617 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/libcomposite.ko 2023-05-16T13:37:41.214 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/udc/ 2023-05-16T13:37:41.214 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16641 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-05-16T13:37:41.214 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/udc/bdc/ 2023-05-16T13:37:41.214 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 157161 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-05-16T13:37:41.215 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 35569 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-05-16T13:37:41.215 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 52441 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-05-16T13:37:41.215 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 69193 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-05-16T13:37:41.215 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 55473 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-05-16T13:37:41.215 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 75545 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/udc/net2272.ko 2023-05-16T13:37:41.215 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 74529 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/udc/net2280.ko 2023-05-16T13:37:41.215 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 72745 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-05-16T13:37:41.215 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 65297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-05-16T13:37:41.216 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 65585 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-05-16T13:37:41.216 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 79913 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-05-16T13:37:41.216 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 139729 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-05-16T13:37:41.216 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/host/ 2023-05-16T13:37:41.216 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11089 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/host/bcma-hcd.ko 2023-05-16T13:37:41.216 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 79529 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/host/isp116x-hcd.ko 2023-05-16T13:37:41.216 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 87185 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-05-16T13:37:41.216 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 78425 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-05-16T13:37:41.217 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 50649 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/host/sl811-hcd.ko 2023-05-16T13:37:41.217 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15169 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/host/sl811_cs.ko 2023-05-16T13:37:41.217 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12817 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/host/ssb-hcd.ko 2023-05-16T13:37:41.217 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 92241 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/host/u132-hcd.ko 2023-05-16T13:37:41.217 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24377 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-05-16T13:37:41.217 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/image/ 2023-05-16T13:37:41.217 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 34097 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/image/mdc800.ko 2023-05-16T13:37:41.217 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20545 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/image/microtek.ko 2023-05-16T13:37:41.218 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/ 2023-05-16T13:37:41.218 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 41345 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/adutux.ko 2023-05-16T13:37:41.218 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20281 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/appledisplay.ko 2023-05-16T13:37:41.218 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17289 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-05-16T13:37:41.218 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 22609 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/cytherm.ko 2023-05-16T13:37:41.218 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/ehset.ko 2023-05-16T13:37:41.218 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14625 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/emi26.ko 2023-05-16T13:37:41.218 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15561 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/emi62.ko 2023-05-16T13:37:41.219 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10545 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/ezusb.ko 2023-05-16T13:37:41.219 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 73217 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/ftdi-elan.ko 2023-05-16T13:37:41.219 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18793 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/idmouse.ko 2023-05-16T13:37:41.219 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 36121 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/iowarrior.ko 2023-05-16T13:37:41.219 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11097 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/isight_firmware.ko 2023-05-16T13:37:41.219 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 36065 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/ldusb.ko 2023-05-16T13:37:41.219 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 35745 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/legousbtower.ko 2023-05-16T13:37:41.219 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 27353 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/lvstest.ko 2023-05-16T13:37:41.220 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/sisusbvga/ 2023-05-16T13:37:41.220 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 64033 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-05-16T13:37:41.220 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12441 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/trancevibrator.ko 2023-05-16T13:37:41.220 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19905 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/usb3503.ko 2023-05-16T13:37:41.220 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24721 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/usblcd.ko 2023-05-16T13:37:41.220 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 22249 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/usbsevseg.ko 2023-05-16T13:37:41.220 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 70313 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/usbtest.ko 2023-05-16T13:37:41.221 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 41457 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/uss720.ko 2023-05-16T13:37:41.221 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 27193 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/yurex.ko 2023-05-16T13:37:41.221 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/mon/ 2023-05-16T13:37:41.221 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 72321 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/mon/usbmon.ko 2023-05-16T13:37:41.221 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/musb/ 2023-05-16T13:37:41.221 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 294641 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/musb/musb_hdrc.ko 2023-05-16T13:37:41.221 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/phy/ 2023-05-16T13:37:41.221 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19961 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/phy/phy-generic.ko 2023-05-16T13:37:41.222 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19745 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-05-16T13:37:41.222 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11529 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/phy/phy-isp1301.ko 2023-05-16T13:37:41.222 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/phy/phy-tahvo.ko 2023-05-16T13:37:41.222 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/ 2023-05-16T13:37:41.222 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12817 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/aircable.ko 2023-05-16T13:37:41.222 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 32929 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/ark3116.ko 2023-05-16T13:37:41.222 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 26049 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/belkin_sa.ko 2023-05-16T13:37:41.222 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 37761 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/ch341.ko 2023-05-16T13:37:41.223 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 69601 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/cp210x.ko 2023-05-16T13:37:41.223 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 30737 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/cyberjack.ko 2023-05-16T13:37:41.223 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 57497 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/cypress_m8.ko 2023-05-16T13:37:41.223 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 49257 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/digi_acceleport.ko 2023-05-16T13:37:41.223 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9121 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/empeg.ko 2023-05-16T13:37:41.223 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 43457 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/f81232.ko 2023-05-16T13:37:41.223 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 174409 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/ftdi_sio.ko 2023-05-16T13:37:41.223 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 52273 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/garmin_gps.ko 2023-05-16T13:37:41.224 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 136441 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/io_edgeport.ko 2023-05-16T13:37:41.224 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 123961 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/io_ti.ko 2023-05-16T13:37:41.224 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 67329 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/ipaq.ko 2023-05-16T13:37:41.224 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18657 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/ipw.ko 2023-05-16T13:37:41.224 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 26169 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/ir-usb.ko 2023-05-16T13:37:41.224 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 57505 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-05-16T13:37:41.224 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 106985 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/keyspan.ko 2023-05-16T13:37:41.224 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 34833 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/keyspan_pda.ko 2023-05-16T13:37:41.225 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 25009 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/kl5kusb105.ko 2023-05-16T13:37:41.225 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 33025 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/kobil_sct.ko 2023-05-16T13:37:41.225 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 32553 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/mct_u232.ko 2023-05-16T13:37:41.225 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21497 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/metro-usb.ko 2023-05-16T13:37:41.225 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 65801 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/mos7720.ko 2023-05-16T13:37:41.225 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 77673 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/mos7840.ko 2023-05-16T13:37:41.225 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 55569 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/mxuport.ko 2023-05-16T13:37:41.225 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13337 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/navman.ko 2023-05-16T13:37:41.226 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11121 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/omninet.ko 2023-05-16T13:37:41.226 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23785 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/opticon.ko 2023-05-16T13:37:41.226 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 187217 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/option.ko 2023-05-16T13:37:41.226 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 38409 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/oti6858.ko 2023-05-16T13:37:41.226 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 53633 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/pl2303.ko 2023-05-16T13:37:41.226 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/qcaux.ko 2023-05-16T13:37:41.226 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 37393 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/qcserial.ko 2023-05-16T13:37:41.226 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 33993 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/quatech2.ko 2023-05-16T13:37:41.227 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14313 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/safe_serial.ko 2023-05-16T13:37:41.227 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 50865 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/sierra.ko 2023-05-16T13:37:41.227 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21241 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/spcp8x5.ko 2023-05-16T13:37:41.227 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 29417 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/ssu100.ko 2023-05-16T13:37:41.227 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16417 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/symbolserial.ko 2023-05-16T13:37:41.227 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 60513 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-05-16T13:37:41.227 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 22241 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-05-16T13:37:41.227 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9817 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/usb_debug.ko 2023-05-16T13:37:41.228 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 31561 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/usb_wwan.ko 2023-05-16T13:37:41.228 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 122417 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/usbserial.ko 2023-05-16T13:37:41.228 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 28257 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/visor.ko 2023-05-16T13:37:41.228 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 36905 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/whiteheat.ko 2023-05-16T13:37:41.228 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10033 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/wishbone-serial.ko 2023-05-16T13:37:41.228 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 8857 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/xsens_mt.ko 2023-05-16T13:37:41.228 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/storage/ 2023-05-16T13:37:41.228 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 52345 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/storage/uas.ko 2023-05-16T13:37:41.229 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 25657 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/storage/ums-alauda.ko 2023-05-16T13:37:41.229 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12553 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/storage/ums-cypress.ko 2023-05-16T13:37:41.229 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21561 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/storage/ums-datafab.ko 2023-05-16T13:37:41.229 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 33057 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-05-16T13:37:41.229 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13313 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/storage/ums-freecom.ko 2023-05-16T13:37:41.229 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19345 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/storage/ums-isd200.ko 2023-05-16T13:37:41.229 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18873 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-05-16T13:37:41.229 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13217 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/storage/ums-karma.ko 2023-05-16T13:37:41.230 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17409 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/storage/ums-onetouch.ko 2023-05-16T13:37:41.230 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 28001 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/storage/ums-realtek.ko 2023-05-16T13:37:41.230 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 28473 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/storage/ums-sddr09.ko 2023-05-16T13:37:41.230 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19097 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/storage/ums-sddr55.ko 2023-05-16T13:37:41.230 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 34913 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/storage/ums-usbat.ko 2023-05-16T13:37:41.230 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 176329 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/storage/usb-storage.ko 2023-05-16T13:37:41.230 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/usbip/ 2023-05-16T13:37:41.230 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 65265 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/usbip/usbip-core.ko 2023-05-16T13:37:41.231 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 71009 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/usbip/usbip-host.ko 2023-05-16T13:37:41.231 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 104905 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-05-16T13:37:41.231 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/vfio/ 2023-05-16T13:37:41.231 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/vfio/pci/ 2023-05-16T13:37:41.231 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 145057 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-05-16T13:37:41.231 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 29041 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/vfio/pci/vfio-pci.ko 2023-05-16T13:37:41.231 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 97561 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/vfio/vfio.ko 2023-05-16T13:37:41.231 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 71257 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-05-16T13:37:41.232 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/vhost/ 2023-05-16T13:37:41.232 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 98209 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/vhost/vhost.ko 2023-05-16T13:37:41.232 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15369 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/vhost/vhost_iotlb.ko 2023-05-16T13:37:41.232 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 57665 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/vhost/vhost_net.ko 2023-05-16T13:37:41.232 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 86785 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/vhost/vhost_scsi.ko 2023-05-16T13:37:41.232 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/video/ 2023-05-16T13:37:41.232 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/video/backlight/ 2023-05-16T13:37:41.232 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14977 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-05-16T13:37:41.233 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11889 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/video/backlight/aat2870_bl.ko 2023-05-16T13:37:41.233 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 22881 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/video/backlight/adp5520_bl.ko 2023-05-16T13:37:41.233 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 32113 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/video/backlight/adp8860_bl.ko 2023-05-16T13:37:41.233 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 39553 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/video/backlight/adp8870_bl.ko 2023-05-16T13:37:41.233 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17881 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/video/backlight/apple_bl.ko 2023-05-16T13:37:41.233 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16281 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/video/backlight/as3711_bl.ko 2023-05-16T13:37:41.233 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11593 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/video/backlight/bd6107.ko 2023-05-16T13:37:41.234 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10977 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/video/backlight/da903x_bl.ko 2023-05-16T13:37:41.234 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10785 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/video/backlight/da9052_bl.ko 2023-05-16T13:37:41.234 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11449 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/video/backlight/gpio_backlight.ko 2023-05-16T13:37:41.234 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14337 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/video/backlight/kb3886_bl.ko 2023-05-16T13:37:41.234 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21041 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/video/backlight/lcd.ko 2023-05-16T13:37:41.234 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/video/backlight/lm3533_bl.ko 2023-05-16T13:37:41.234 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18841 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/video/backlight/lm3639_bl.ko 2023-05-16T13:37:41.234 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10993 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/video/backlight/lv5207lp.ko 2023-05-16T13:37:41.235 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13849 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/video/backlight/max8925_bl.ko 2023-05-16T13:37:41.235 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10817 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/video/backlight/pandora_bl.ko 2023-05-16T13:37:41.235 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10425 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-05-16T13:37:41.235 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10473 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/video/backlight/platform_lcd.ko 2023-05-16T13:37:41.235 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12289 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/video/backlight/wm831x_bl.ko 2023-05-16T13:37:41.235 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/w1/ 2023-05-16T13:37:41.235 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/w1/masters/ 2023-05-16T13:37:41.235 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18241 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/w1/masters/ds2482.ko 2023-05-16T13:37:41.236 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 38537 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/w1/masters/ds2490.ko 2023-05-16T13:37:41.236 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10969 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/w1/masters/matrox_w1.ko 2023-05-16T13:37:41.236 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12033 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/w1/masters/w1-gpio.ko 2023-05-16T13:37:41.236 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/w1/slaves/ 2023-05-16T13:37:41.236 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11609 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-05-16T13:37:41.236 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 22305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-05-16T13:37:41.236 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14609 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-05-16T13:37:41.236 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10329 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-05-16T13:37:41.237 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13649 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-05-16T13:37:41.237 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11497 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-05-16T13:37:41.237 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-05-16T13:37:41.237 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13241 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-05-16T13:37:41.237 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17481 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-05-16T13:37:41.237 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 6889 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/w1/slaves/w1_smem.ko 2023-05-16T13:37:41.237 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 55993 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/w1/slaves/w1_therm.ko 2023-05-16T13:37:41.238 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 101081 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/w1/wire.ko 2023-05-16T13:37:41.238 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/ 2023-05-16T13:37:41.238 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18257 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/acquirewdt.ko 2023-05-16T13:37:41.238 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19441 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/advantechwdt.ko 2023-05-16T13:37:41.238 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18065 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/alim1535_wdt.ko 2023-05-16T13:37:41.238 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 22537 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/alim7101_wdt.ko 2023-05-16T13:37:41.238 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18673 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/cpu5wdt.ko 2023-05-16T13:37:41.239 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13121 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/da9052_wdt.ko 2023-05-16T13:37:41.239 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12345 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/da9055_wdt.ko 2023-05-16T13:37:41.239 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16905 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/da9063_wdt.ko 2023-05-16T13:37:41.239 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20369 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/dw_wdt.ko 2023-05-16T13:37:41.239 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19833 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/eurotechwdt.ko 2023-05-16T13:37:41.239 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23369 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/f71808e_wdt.ko 2023-05-16T13:37:41.239 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 26969 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/hpwdt.ko 2023-05-16T13:37:41.239 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15073 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/i6300esb.ko 2023-05-16T13:37:41.240 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9777 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-05-16T13:37:41.240 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21481 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/iTCO_wdt.ko 2023-05-16T13:37:41.240 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18817 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/ib700wdt.ko 2023-05-16T13:37:41.240 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18249 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/ibmasr.ko 2023-05-16T13:37:41.240 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19281 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-05-16T13:37:41.240 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20721 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/it8712f_wdt.ko 2023-05-16T13:37:41.240 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13345 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/it87_wdt.ko 2023-05-16T13:37:41.240 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20993 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/kempld_wdt.ko 2023-05-16T13:37:41.241 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18185 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/machzwd.ko 2023-05-16T13:37:41.241 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14281 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/mena21_wdt.ko 2023-05-16T13:37:41.241 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12713 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-05-16T13:37:41.241 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24177 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/nv_tco.ko 2023-05-16T13:37:41.241 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-05-16T13:37:41.241 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21841 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/pc87413_wdt.ko 2023-05-16T13:37:41.241 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 38169 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/pcwd_pci.ko 2023-05-16T13:37:41.241 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 31385 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/pcwd_usb.ko 2023-05-16T13:37:41.242 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12545 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/retu_wdt.ko 2023-05-16T13:37:41.242 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19961 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-05-16T13:37:41.242 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13633 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-05-16T13:37:41.242 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16825 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-05-16T13:37:41.242 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23321 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/sc1200wdt.ko 2023-05-16T13:37:41.242 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 22841 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/sch311x_wdt.ko 2023-05-16T13:37:41.242 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21137 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-05-16T13:37:41.242 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16777 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/softdog.ko 2023-05-16T13:37:41.243 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21537 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/sp5100_tco.ko 2023-05-16T13:37:41.243 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12321 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/twl4030_wdt.ko 2023-05-16T13:37:41.243 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17145 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/via_wdt.ko 2023-05-16T13:37:41.243 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18665 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-05-16T13:37:41.243 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20249 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/w83877f_wdt.ko 2023-05-16T13:37:41.243 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24913 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/w83977f_wdt.ko 2023-05-16T13:37:41.243 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18009 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/wafer5823wdt.ko 2023-05-16T13:37:41.243 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 27585 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/wdt_pci.ko 2023-05-16T13:37:41.244 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15753 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/wm831x_wdt.ko 2023-05-16T13:37:41.244 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13577 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/wm8350_wdt.ko 2023-05-16T13:37:41.244 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15201 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/xen_wdt.ko 2023-05-16T13:37:41.244 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/xen/ 2023-05-16T13:37:41.244 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24057 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/xen/xen-evtchn.ko 2023-05-16T13:37:41.244 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 25937 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/xen/xen-gntalloc.ko 2023-05-16T13:37:41.244 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 46905 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/xen/xen-gntdev.ko 2023-05-16T13:37:41.244 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/xen/xen-pciback/ 2023-05-16T13:37:41.245 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 176105 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-05-16T13:37:41.245 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 39161 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/xen/xen-privcmd.ko 2023-05-16T13:37:41.245 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 71449 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/xen/xen-scsiback.ko 2023-05-16T13:37:41.245 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/xen/xenfs/ 2023-05-16T13:37:41.245 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18993 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/xen/xenfs/xenfs.ko 2023-05-16T13:37:41.245 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/ 2023-05-16T13:37:41.245 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/9p/ 2023-05-16T13:37:41.245 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 171305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/9p/9p.ko 2023-05-16T13:37:41.246 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/adfs/ 2023-05-16T13:37:41.246 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 60449 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/adfs/adfs.ko 2023-05-16T13:37:41.246 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/affs/ 2023-05-16T13:37:41.246 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 162241 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/affs/affs.ko 2023-05-16T13:37:41.246 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/afs/ 2023-05-16T13:37:41.246 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 924521 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/afs/kafs.ko 2023-05-16T13:37:41.246 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/autofs/ 2023-05-16T13:37:41.246 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 100321 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/autofs/autofs4.ko 2023-05-16T13:37:41.247 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/befs/ 2023-05-16T13:37:41.247 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 63977 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/befs/befs.ko 2023-05-16T13:37:41.247 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/bfs/ 2023-05-16T13:37:41.247 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 40585 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/bfs/bfs.ko 2023-05-16T13:37:41.247 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 34081 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/binfmt_misc.ko 2023-05-16T13:37:41.247 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/btrfs/ 2023-05-16T13:37:41.247 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 3475873 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/btrfs/btrfs.ko 2023-05-16T13:37:41.247 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/cachefiles/ 2023-05-16T13:37:41.248 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 299529 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/cachefiles/cachefiles.ko 2023-05-16T13:37:41.248 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/ceph/ 2023-05-16T13:37:41.248 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 1228449 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/ceph/ceph.ko 2023-05-16T13:37:41.248 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/cifs/ 2023-05-16T13:37:41.248 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 2614625 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/cifs/cifs.ko 2023-05-16T13:37:41.248 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/coda/ 2023-05-16T13:37:41.248 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 99153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/coda/coda.ko 2023-05-16T13:37:41.248 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/configfs/ 2023-05-16T13:37:41.249 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 105385 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/configfs/configfs.ko 2023-05-16T13:37:41.249 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/cramfs/ 2023-05-16T13:37:41.249 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 28841 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/cramfs/cramfs.ko 2023-05-16T13:37:41.249 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/dlm/ 2023-05-16T13:37:41.249 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 624153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/dlm/dlm.ko 2023-05-16T13:37:41.249 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/efs/ 2023-05-16T13:37:41.249 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 36145 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/efs/efs.ko 2023-05-16T13:37:41.249 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/f2fs/ 2023-05-16T13:37:41.250 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 1470857 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/f2fs/f2fs.ko 2023-05-16T13:37:41.250 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/fat/ 2023-05-16T13:37:41.250 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 27361 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/fat/msdos.ko 2023-05-16T13:37:41.250 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/freevxfs/ 2023-05-16T13:37:41.250 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 41961 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/freevxfs/freevxfs.ko 2023-05-16T13:37:41.250 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/fscache/ 2023-05-16T13:37:41.250 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 218289 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/fscache/fscache.ko 2023-05-16T13:37:41.250 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/fuse/ 2023-05-16T13:37:41.251 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24169 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/fuse/cuse.ko 2023-05-16T13:37:41.251 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/gfs2/ 2023-05-16T13:37:41.251 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 1222241 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/gfs2/gfs2.ko 2023-05-16T13:37:41.251 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/hfs/ 2023-05-16T13:37:41.251 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 140857 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/hfs/hfs.ko 2023-05-16T13:37:41.251 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/hfsplus/ 2023-05-16T13:37:41.251 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 220953 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/hfsplus/hfsplus.ko 2023-05-16T13:37:41.251 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/hpfs/ 2023-05-16T13:37:41.252 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 193145 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/hpfs/hpfs.ko 2023-05-16T13:37:41.252 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/isofs/ 2023-05-16T13:37:41.252 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 73961 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/isofs/isofs.ko 2023-05-16T13:37:41.252 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/jfs/ 2023-05-16T13:37:41.252 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 418945 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/jfs/jfs.ko 2023-05-16T13:37:41.252 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/lockd/ 2023-05-16T13:37:41.252 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 254633 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/lockd/lockd.ko 2023-05-16T13:37:41.252 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/minix/ 2023-05-16T13:37:41.253 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 87417 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/minix/minix.ko 2023-05-16T13:37:41.253 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/netfs/ 2023-05-16T13:37:41.253 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 128313 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/netfs/netfs.ko 2023-05-16T13:37:41.253 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nfs/ 2023-05-16T13:37:41.253 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nfs/blocklayout/ 2023-05-16T13:37:41.253 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 81025 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-05-16T13:37:41.253 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nfs/filelayout/ 2023-05-16T13:37:41.253 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 58929 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-05-16T13:37:41.254 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nfs/flexfilelayout/ 2023-05-16T13:37:41.254 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 117209 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-05-16T13:37:41.254 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 1016665 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nfs/nfs.ko 2023-05-16T13:37:41.254 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 65665 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nfs/nfsv2.ko 2023-05-16T13:37:41.254 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 119217 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nfs/nfsv3.ko 2023-05-16T13:37:41.254 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 2003553 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nfs/nfsv4.ko 2023-05-16T13:37:41.254 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nfs_common/ 2023-05-16T13:37:41.254 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15905 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nfs_common/grace.ko 2023-05-16T13:37:41.255 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15177 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nfs_common/nfs_acl.ko 2023-05-16T13:37:41.255 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nfsd/ 2023-05-16T13:37:41.255 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 1400409 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nfsd/nfsd.ko 2023-05-16T13:37:41.284 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nilfs2/ 2023-05-16T13:37:41.284 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 587089 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nilfs2/nilfs2.ko 2023-05-16T13:37:41.284 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/ 2023-05-16T13:37:41.285 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/mac-celtic.ko 2023-05-16T13:37:41.285 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12681 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/mac-centeuro.ko 2023-05-16T13:37:41.285 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/mac-croatian.ko 2023-05-16T13:37:41.285 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12369 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/mac-cyrillic.ko 2023-05-16T13:37:41.285 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12985 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/mac-gaelic.ko 2023-05-16T13:37:41.285 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12361 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/mac-greek.ko 2023-05-16T13:37:41.285 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/mac-iceland.ko 2023-05-16T13:37:41.286 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12673 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/mac-inuit.ko 2023-05-16T13:37:41.286 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13609 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/mac-roman.ko 2023-05-16T13:37:41.286 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/mac-romanian.ko 2023-05-16T13:37:41.286 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/mac-turkish.ko 2023-05-16T13:37:41.286 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10801 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_ascii.ko 2023-05-16T13:37:41.286 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12049 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_cp1250.ko 2023-05-16T13:37:41.286 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11737 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_cp1251.ko 2023-05-16T13:37:41.286 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12489 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_cp1255.ko 2023-05-16T13:37:41.287 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12049 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_cp737.ko 2023-05-16T13:37:41.287 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12049 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_cp775.ko 2023-05-16T13:37:41.287 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11737 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_cp850.ko 2023-05-16T13:37:41.287 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11737 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_cp852.ko 2023-05-16T13:37:41.287 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11737 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_cp855.ko 2023-05-16T13:37:41.287 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11425 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_cp857.ko 2023-05-16T13:37:41.287 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12361 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_cp860.ko 2023-05-16T13:37:41.287 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12665 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_cp861.ko 2023-05-16T13:37:41.288 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12977 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_cp862.ko 2023-05-16T13:37:41.288 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12665 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_cp863.ko 2023-05-16T13:37:41.288 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12361 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_cp864.ko 2023-05-16T13:37:41.288 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12665 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_cp865.ko 2023-05-16T13:37:41.288 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12049 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_cp866.ko 2023-05-16T13:37:41.288 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11737 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_cp869.ko 2023-05-16T13:37:41.288 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11561 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_cp874.ko 2023-05-16T13:37:41.288 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 93649 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_cp932.ko 2023-05-16T13:37:41.289 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 142185 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_cp936.ko 2023-05-16T13:37:41.289 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 165257 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_cp949.ko 2023-05-16T13:37:41.289 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 117625 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_cp950.ko 2023-05-16T13:37:41.289 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11969 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_euc-jp.ko 2023-05-16T13:37:41.289 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10809 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_iso8859-1.ko 2023-05-16T13:37:41.289 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11433 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_iso8859-13.ko 2023-05-16T13:37:41.289 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11433 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_iso8859-14.ko 2023-05-16T13:37:41.289 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11433 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_iso8859-15.ko 2023-05-16T13:37:41.290 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11433 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_iso8859-2.ko 2023-05-16T13:37:41.290 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11433 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_iso8859-3.ko 2023-05-16T13:37:41.290 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11433 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_iso8859-4.ko 2023-05-16T13:37:41.290 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11433 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_iso8859-5.ko 2023-05-16T13:37:41.290 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11121 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_iso8859-6.ko 2023-05-16T13:37:41.290 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11745 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_iso8859-7.ko 2023-05-16T13:37:41.290 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11121 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_iso8859-9.ko 2023-05-16T13:37:41.290 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12049 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_koi8-r.ko 2023-05-16T13:37:41.291 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 7593 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_koi8-ru.ko 2023-05-16T13:37:41.291 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12049 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_koi8-u.ko 2023-05-16T13:37:41.291 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 7849 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_utf8.ko 2023-05-16T13:37:41.291 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/ntfs/ 2023-05-16T13:37:41.291 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 218585 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/ntfs/ntfs.ko 2023-05-16T13:37:41.291 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/ocfs2/ 2023-05-16T13:37:41.291 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/ocfs2/cluster/ 2023-05-16T13:37:41.291 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 240737 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-05-16T13:37:41.292 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/ocfs2/dlm/ 2023-05-16T13:37:41.292 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 439201 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-05-16T13:37:41.292 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/ocfs2/dlmfs/ 2023-05-16T13:37:41.292 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 53377 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-05-16T13:37:41.292 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 2510441 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/ocfs2/ocfs2.ko 2023-05-16T13:37:41.292 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17473 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-05-16T13:37:41.292 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 31153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-05-16T13:37:41.293 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 33577 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-05-16T13:37:41.293 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/omfs/ 2023-05-16T13:37:41.293 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 52145 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/omfs/omfs.ko 2023-05-16T13:37:41.293 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/overlayfs/ 2023-05-16T13:37:41.293 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 320649 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/overlayfs/overlay.ko 2023-05-16T13:37:41.293 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/pstore/ 2023-05-16T13:37:41.293 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 54121 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/pstore/ramoops.ko 2023-05-16T13:37:41.293 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/qnx4/ 2023-05-16T13:37:41.294 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 26361 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/qnx4/qnx4.ko 2023-05-16T13:37:41.294 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/qnx6/ 2023-05-16T13:37:41.294 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 46217 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/qnx6/qnx6.ko 2023-05-16T13:37:41.294 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/quota/ 2023-05-16T13:37:41.294 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 29673 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/quota/quota_tree.ko 2023-05-16T13:37:41.294 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13857 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/quota/quota_v1.ko 2023-05-16T13:37:41.294 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21521 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/quota/quota_v2.ko 2023-05-16T13:37:41.294 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/reiserfs/ 2023-05-16T13:37:41.295 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 527801 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/reiserfs/reiserfs.ko 2023-05-16T13:37:41.295 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/romfs/ 2023-05-16T13:37:41.295 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 28009 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/romfs/romfs.ko 2023-05-16T13:37:41.295 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/smbfs_common/ 2023-05-16T13:37:41.295 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 6361 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/smbfs_common/cifs_arc4.ko 2023-05-16T13:37:41.295 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10313 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/smbfs_common/cifs_md4.ko 2023-05-16T13:37:41.295 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/squashfs/ 2023-05-16T13:37:41.295 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 131193 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/squashfs/squashfs.ko 2023-05-16T13:37:41.296 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/sysv/ 2023-05-16T13:37:41.296 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 88441 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/sysv/sysv.ko 2023-05-16T13:37:41.296 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/udf/ 2023-05-16T13:37:41.296 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 247873 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/udf/udf.ko 2023-05-16T13:37:41.296 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/ufs/ 2023-05-16T13:37:41.296 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 160129 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/ufs/ufs.ko 2023-05-16T13:37:41.296 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/xfs/ 2023-05-16T13:37:41.296 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 3829249 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/xfs/xfs.ko 2023-05-16T13:37:41.297 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/kernel/ 2023-05-16T13:37:41.297 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/kernel/locking/ 2023-05-16T13:37:41.297 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 65265 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/kernel/locking/locktorture.ko 2023-05-16T13:37:41.297 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/kernel/time/ 2023-05-16T13:37:41.297 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13249 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/kernel/time/test_udelay.ko 2023-05-16T13:37:41.297 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 55009 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/kernel/torture.ko 2023-05-16T13:37:41.297 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/ 2023-05-16T13:37:41.297 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 6033 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/crc-itu-t.ko 2023-05-16T13:37:41.298 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 5729 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/crc7.ko 2023-05-16T13:37:41.298 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 6081 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/crc8.ko 2023-05-16T13:37:41.298 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/crypto/ 2023-05-16T13:37:41.298 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 6305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/crypto/libarc4.ko 2023-05-16T13:37:41.298 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 35897 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/crypto/libdes.ko 2023-05-16T13:37:41.298 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12889 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/interval_tree_test.ko 2023-05-16T13:37:41.298 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 8121 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/libcrc32c.ko 2023-05-16T13:37:41.298 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 22953 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/lru_cache.ko 2023-05-16T13:37:41.299 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/lz4/ 2023-05-16T13:37:41.299 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 32593 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/lz4/lz4_compress.ko 2023-05-16T13:37:41.299 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21593 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/lz4/lz4hc_compress.ko 2023-05-16T13:37:41.299 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/math/ 2023-05-16T13:37:41.299 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 5897 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/math/cordic.ko 2023-05-16T13:37:41.299 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 7793 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/memory-notifier-error-inject.ko 2023-05-16T13:37:41.299 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10105 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/notifier-error-inject.ko 2023-05-16T13:37:41.299 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13593 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/percpu_test.ko 2023-05-16T13:37:41.300 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 7801 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/pm-notifier-error-inject.ko 2023-05-16T13:37:41.300 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/raid6/ 2023-05-16T13:37:41.300 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 141873 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/raid6/raid6_pq.ko 2023-05-16T13:37:41.300 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20673 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/rbtree_test.ko 2023-05-16T13:37:41.300 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/reed_solomon/ 2023-05-16T13:37:41.300 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17641 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/reed_solomon/reed_solomon.ko 2023-05-16T13:37:41.300 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 38401 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/test-kstrtox.ko 2023-05-16T13:37:41.300 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 25889 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/test-string_helpers.ko 2023-05-16T13:37:41.301 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 4760329 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/test_bpf.ko 2023-05-16T13:37:41.301 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 48057 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/test_firmware.ko 2023-05-16T13:37:41.301 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 5873 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/test_module.ko 2023-05-16T13:37:41.301 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21177 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/test_user_copy.ko 2023-05-16T13:37:41.301 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9161 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/ts_bm.ko 2023-05-16T13:37:41.301 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10625 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/ts_fsm.ko 2023-05-16T13:37:41.301 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9201 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/ts_kmp.ko 2023-05-16T13:37:41.302 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/xz/ 2023-05-16T13:37:41.302 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13105 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/xz/xz_dec_test.ko 2023-05-16T13:37:41.302 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/mm/ 2023-05-16T13:37:41.302 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15001 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/mm/hwpoison-inject.ko 2023-05-16T13:37:41.302 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ 2023-05-16T13:37:41.302 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/6lowpan/ 2023-05-16T13:37:41.302 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 54273 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/6lowpan/6lowpan.ko 2023-05-16T13:37:41.302 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 6553 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/6lowpan/nhc_dest.ko 2023-05-16T13:37:41.303 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 6577 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/6lowpan/nhc_fragment.ko 2023-05-16T13:37:41.303 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 6553 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/6lowpan/nhc_hop.ko 2023-05-16T13:37:41.303 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 6553 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/6lowpan/nhc_ipv6.ko 2023-05-16T13:37:41.303 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 6577 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/6lowpan/nhc_mobility.ko 2023-05-16T13:37:41.303 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 6577 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/6lowpan/nhc_routing.ko 2023-05-16T13:37:41.303 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14833 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/6lowpan/nhc_udp.ko 2023-05-16T13:37:41.303 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/802/ 2023-05-16T13:37:41.303 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 29225 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/802/garp.ko 2023-05-16T13:37:41.304 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 33657 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/802/mrp.ko 2023-05-16T13:37:41.304 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 7729 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/802/p8022.ko 2023-05-16T13:37:41.304 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15025 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/802/psnap.ko 2023-05-16T13:37:41.304 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10721 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/802/stp.ko 2023-05-16T13:37:41.304 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/8021q/ 2023-05-16T13:37:41.304 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 80641 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/8021q/8021q.ko 2023-05-16T13:37:41.304 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/9p/ 2023-05-16T13:37:41.304 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 191305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/9p/9pnet.ko 2023-05-16T13:37:41.305 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 35457 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/9p/9pnet_fd.ko 2023-05-16T13:37:41.305 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 25905 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/9p/9pnet_rdma.ko 2023-05-16T13:37:41.305 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 31825 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/9p/9pnet_virtio.ko 2023-05-16T13:37:41.305 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/batman-adv/ 2023-05-16T13:37:41.305 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 652281 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/batman-adv/batman-adv.ko 2023-05-16T13:37:41.305 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/ 2023-05-16T13:37:41.305 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 63505 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/br_netfilter.ko 2023-05-16T13:37:41.305 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 772145 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/bridge.ko 2023-05-16T13:37:41.306 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/ 2023-05-16T13:37:41.306 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 7233 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-05-16T13:37:41.306 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11897 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/ebt_among.ko 2023-05-16T13:37:41.306 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 8673 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/ebt_arp.ko 2023-05-16T13:37:41.306 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 8649 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-05-16T13:37:41.306 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9193 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-05-16T13:37:41.306 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 8249 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/ebt_ip.ko 2023-05-16T13:37:41.306 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 8649 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-05-16T13:37:41.307 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9401 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/ebt_limit.ko 2023-05-16T13:37:41.307 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12793 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/ebt_log.ko 2023-05-16T13:37:41.307 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 8505 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/ebt_mark.ko 2023-05-16T13:37:41.307 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 8761 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-05-16T13:37:41.307 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 7897 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-05-16T13:37:41.307 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 7113 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-05-16T13:37:41.307 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-05-16T13:37:41.307 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 8225 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/ebt_snat.ko 2023-05-16T13:37:41.308 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 8393 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/ebt_stp.ko 2023-05-16T13:37:41.308 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11961 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-05-16T13:37:41.308 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11025 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-05-16T13:37:41.308 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9393 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-05-16T13:37:41.308 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9369 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-05-16T13:37:41.308 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 73961 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/ebtables.ko 2023-05-16T13:37:41.308 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12497 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-05-16T13:37:41.309 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13449 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-05-16T13:37:41.309 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ceph/ 2023-05-16T13:37:41.309 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 1029801 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ceph/libceph.ko 2023-05-16T13:37:41.309 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/core/ 2023-05-16T13:37:41.309 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 124297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/core/pktgen.ko 2023-05-16T13:37:41.309 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/dccp/ 2023-05-16T13:37:41.309 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 188577 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/dccp/dccp.ko 2023-05-16T13:37:41.309 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 8225 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/dccp/dccp_diag.ko 2023-05-16T13:37:41.310 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 55633 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/dccp/dccp_ipv4.ko 2023-05-16T13:37:41.310 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 58905 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/dccp/dccp_ipv6.ko 2023-05-16T13:37:41.310 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/dsa/ 2023-05-16T13:37:41.310 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 274753 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/dsa/dsa_core.ko 2023-05-16T13:37:41.310 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12841 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/dsa/tag_brcm.ko 2023-05-16T13:37:41.310 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12145 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/dsa/tag_dsa.ko 2023-05-16T13:37:41.310 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 7289 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/dsa/tag_none.ko 2023-05-16T13:37:41.310 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 8465 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/dsa/tag_trailer.ko 2023-05-16T13:37:41.311 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/hsr/ 2023-05-16T13:37:41.311 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 99385 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/hsr/hsr.ko 2023-05-16T13:37:41.311 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ieee802154/ 2023-05-16T13:37:41.311 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ieee802154/6lowpan/ 2023-05-16T13:37:41.311 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 44745 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-05-16T13:37:41.311 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 245489 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ieee802154/ieee802154.ko 2023-05-16T13:37:41.311 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 47073 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ieee802154/ieee802154_socket.ko 2023-05-16T13:37:41.311 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/ 2023-05-16T13:37:41.312 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/ah4.ko 2023-05-16T13:37:41.312 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 37977 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/esp4.ko 2023-05-16T13:37:41.312 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 44425 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/fou.ko 2023-05-16T13:37:41.312 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17353 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/gre.ko 2023-05-16T13:37:41.312 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 46985 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/inet_diag.ko 2023-05-16T13:37:41.312 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 59737 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/ip_gre.ko 2023-05-16T13:37:41.312 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 57265 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/ip_tunnel.ko 2023-05-16T13:37:41.312 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 33737 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/ip_vti.ko 2023-05-16T13:37:41.313 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13577 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/ipcomp.ko 2023-05-16T13:37:41.313 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 28265 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/ipip.ko 2023-05-16T13:37:41.313 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/ 2023-05-16T13:37:41.313 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 46769 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/arp_tables.ko 2023-05-16T13:37:41.313 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 8385 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-05-16T13:37:41.313 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9913 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-05-16T13:37:41.313 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 53921 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/ip_tables.ko 2023-05-16T13:37:41.313 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9561 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-05-16T13:37:41.314 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9185 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-05-16T13:37:41.314 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13713 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-05-16T13:37:41.314 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10681 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-05-16T13:37:41.314 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14505 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-05-16T13:37:41.314 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10817 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-05-16T13:37:41.314 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-05-16T13:37:41.314 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14505 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-05-16T13:37:41.315 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11105 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-05-16T13:37:41.315 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9985 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/iptable_security.ko 2023-05-16T13:37:41.315 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11281 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-05-16T13:37:41.315 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 8097 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-05-16T13:37:41.315 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 27193 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-05-16T13:37:41.315 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17729 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-05-16T13:37:41.315 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12913 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-05-16T13:37:41.315 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19257 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-05-16T13:37:41.316 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 8665 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-05-16T13:37:41.316 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14321 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-05-16T13:37:41.316 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9465 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-05-16T13:37:41.316 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16353 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-05-16T13:37:41.316 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 8569 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-05-16T13:37:41.316 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12641 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/tcp_bic.ko 2023-05-16T13:37:41.316 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13241 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/tcp_dctcp.ko 2023-05-16T13:37:41.316 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14689 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/tcp_diag.ko 2023-05-16T13:37:41.317 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9105 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/tcp_highspeed.ko 2023-05-16T13:37:41.317 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11961 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/tcp_htcp.ko 2023-05-16T13:37:41.317 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9953 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/tcp_hybla.ko 2023-05-16T13:37:41.317 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10977 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/tcp_illinois.ko 2023-05-16T13:37:41.317 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9993 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/tcp_lp.ko 2023-05-16T13:37:41.317 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 7905 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/tcp_scalable.ko 2023-05-16T13:37:41.317 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/tcp_vegas.ko 2023-05-16T13:37:41.317 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9665 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/tcp_veno.ko 2023-05-16T13:37:41.318 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10529 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/tcp_westwood.ko 2023-05-16T13:37:41.318 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9753 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/tcp_yeah.ko 2023-05-16T13:37:41.318 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21785 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/tunnel4.ko 2023-05-16T13:37:41.318 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15921 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/udp_diag.ko 2023-05-16T13:37:41.318 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 40017 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/udp_tunnel.ko 2023-05-16T13:37:41.318 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10929 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/xfrm4_tunnel.ko 2023-05-16T13:37:41.318 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/ 2023-05-16T13:37:41.318 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 25945 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/ah6.ko 2023-05-16T13:37:41.319 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 38649 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/esp6.ko 2023-05-16T13:37:41.319 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13993 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/fou6.ko 2023-05-16T13:37:41.319 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 80297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/ip6_gre.ko 2023-05-16T13:37:41.319 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 90857 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/ip6_tunnel.ko 2023-05-16T13:37:41.319 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9801 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-05-16T13:37:41.319 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 53369 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/ip6_vti.ko 2023-05-16T13:37:41.319 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13361 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/ipcomp6.ko 2023-05-16T13:37:41.319 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18593 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/mip6.ko 2023-05-16T13:37:41.320 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/ 2023-05-16T13:37:41.320 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 54497 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-05-16T13:37:41.320 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11329 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-05-16T13:37:41.320 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9257 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-05-16T13:37:41.320 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13721 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-05-16T13:37:41.320 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13833 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-05-16T13:37:41.320 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 7369 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-05-16T13:37:41.320 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15777 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-05-16T13:37:41.321 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15601 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-05-16T13:37:41.321 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 8481 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-05-16T13:37:41.321 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9457 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-05-16T13:37:41.321 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10441 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-05-16T13:37:41.321 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10465 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-05-16T13:37:41.321 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10825 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-05-16T13:37:41.321 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10633 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-05-16T13:37:41.322 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14537 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-05-16T13:37:41.322 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11121 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-05-16T13:37:41.322 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10001 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-05-16T13:37:41.322 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 37929 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-05-16T13:37:41.322 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 7729 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-05-16T13:37:41.322 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24681 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-05-16T13:37:41.322 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9137 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-05-16T13:37:41.322 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14537 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-05-16T13:37:41.323 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9201 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-05-16T13:37:41.323 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15217 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-05-16T13:37:41.323 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 8577 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-05-16T13:37:41.323 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 72545 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/sit.ko 2023-05-16T13:37:41.323 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23377 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/tunnel6.ko 2023-05-16T13:37:41.323 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 22481 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/xfrm6_tunnel.ko 2023-05-16T13:37:41.323 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/key/ 2023-05-16T13:37:41.323 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 82505 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/key/af_key.ko 2023-05-16T13:37:41.324 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/l2tp/ 2023-05-16T13:37:41.324 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 120265 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/l2tp/l2tp_core.ko 2023-05-16T13:37:41.324 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19841 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/l2tp/l2tp_debugfs.ko 2023-05-16T13:37:41.324 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 25209 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/l2tp/l2tp_eth.ko 2023-05-16T13:37:41.324 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 34969 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/l2tp/l2tp_ip.ko 2023-05-16T13:37:41.324 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 36649 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/l2tp/l2tp_ip6.ko 2023-05-16T13:37:41.324 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 32185 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/l2tp/l2tp_netlink.ko 2023-05-16T13:37:41.324 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 53057 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/l2tp/l2tp_ppp.ko 2023-05-16T13:37:41.325 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/lapb/ 2023-05-16T13:37:41.325 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 46641 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/lapb/lapb.ko 2023-05-16T13:37:41.325 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/llc/ 2023-05-16T13:37:41.325 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21849 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/llc/llc.ko 2023-05-16T13:37:41.325 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 266497 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/llc/llc2.ko 2023-05-16T13:37:41.325 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/mac802154/ 2023-05-16T13:37:41.325 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 279905 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/mac802154/mac802154.ko 2023-05-16T13:37:41.325 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/mpls/ 2023-05-16T13:37:41.326 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 8897 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/mpls/mpls_gso.ko 2023-05-16T13:37:41.326 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ 2023-05-16T13:37:41.326 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipset/ 2023-05-16T13:37:41.326 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 116641 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipset/ip_set.ko 2023-05-16T13:37:41.326 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 28017 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-05-16T13:37:41.326 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 26593 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-05-16T13:37:41.326 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 26025 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-05-16T13:37:41.326 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 101537 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-05-16T13:37:41.327 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 102681 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-05-16T13:37:41.327 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 104097 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-05-16T13:37:41.327 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 104697 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-05-16T13:37:41.327 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 113953 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-05-16T13:37:41.327 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 60665 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-05-16T13:37:41.327 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 110721 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-05-16T13:37:41.327 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 114241 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-05-16T13:37:41.327 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 113889 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-05-16T13:37:41.328 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 112713 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-05-16T13:37:41.328 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 115777 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-05-16T13:37:41.328 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 29713 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-05-16T13:37:41.328 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipvs/ 2023-05-16T13:37:41.328 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 410073 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipvs/ip_vs.ko 2023-05-16T13:37:41.328 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11473 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-05-16T13:37:41.328 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 7193 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-05-16T13:37:41.329 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17225 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-05-16T13:37:41.329 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17409 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-05-16T13:37:41.329 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20225 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-05-16T13:37:41.329 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 7193 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-05-16T13:37:41.329 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 7257 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-05-16T13:37:41.329 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10185 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-05-16T13:37:41.329 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 8801 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-05-16T13:37:41.329 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 7209 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-05-16T13:37:41.330 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13089 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-05-16T13:37:41.330 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 7273 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-05-16T13:37:41.330 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10497 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-05-16T13:37:41.330 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 47601 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_conncount.ko 2023-05-16T13:37:41.330 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 396769 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_conntrack.ko 2023-05-16T13:37:41.330 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15321 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-05-16T13:37:41.330 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9441 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-05-16T13:37:41.330 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 33033 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-05-16T13:37:41.331 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 117313 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_conntrack_h323.ko 2023-05-16T13:37:41.331 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21457 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_conntrack_irc.ko 2023-05-16T13:37:41.331 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 8377 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-05-16T13:37:41.331 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 107825 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-05-16T13:37:41.331 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 32833 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-05-16T13:37:41.331 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16961 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_conntrack_sane.ko 2023-05-16T13:37:41.331 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 65305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_conntrack_sip.ko 2023-05-16T13:37:41.331 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10513 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-05-16T13:37:41.332 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18521 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-05-16T13:37:41.332 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9209 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_dup_netdev.ko 2023-05-16T13:37:41.332 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 86233 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_flow_table.ko 2023-05-16T13:37:41.332 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9161 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_flow_table_inet.ko 2023-05-16T13:37:41.332 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 36705 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_log_syslog.ko 2023-05-16T13:37:41.332 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 91201 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_nat.ko 2023-05-16T13:37:41.332 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9625 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_nat_amanda.ko 2023-05-16T13:37:41.332 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12129 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_nat_ftp.ko 2023-05-16T13:37:41.333 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11361 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_nat_irc.ko 2023-05-16T13:37:41.333 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 28497 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_nat_sip.ko 2023-05-16T13:37:41.333 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 8305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_nat_tftp.ko 2023-05-16T13:37:41.333 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 42105 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_synproxy_core.ko 2023-05-16T13:37:41.333 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 575513 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_tables.ko 2023-05-16T13:37:41.333 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 42137 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nfnetlink.ko 2023-05-16T13:37:41.333 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 29241 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nfnetlink_acct.ko 2023-05-16T13:37:41.333 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 30121 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-05-16T13:37:41.334 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 40225 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nfnetlink_log.ko 2023-05-16T13:37:41.334 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 21729 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nfnetlink_osf.ko 2023-05-16T13:37:41.334 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 49001 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nfnetlink_queue.ko 2023-05-16T13:37:41.334 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9961 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nft_chain_nat.ko 2023-05-16T13:37:41.334 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 32753 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nft_compat.ko 2023-05-16T13:37:41.334 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 40217 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nft_ct.ko 2023-05-16T13:37:41.334 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9169 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nft_dup_netdev.ko 2023-05-16T13:37:41.334 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10161 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nft_fib.ko 2023-05-16T13:37:41.335 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13385 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nft_fwd_netdev.ko 2023-05-16T13:37:41.335 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13681 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nft_hash.ko 2023-05-16T13:37:41.335 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19569 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nft_limit.ko 2023-05-16T13:37:41.335 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14905 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nft_log.ko 2023-05-16T13:37:41.335 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14985 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nft_masq.ko 2023-05-16T13:37:41.335 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13937 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nft_nat.ko 2023-05-16T13:37:41.335 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13241 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nft_numgen.ko 2023-05-16T13:37:41.335 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11289 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nft_osf.ko 2023-05-16T13:37:41.336 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13641 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nft_queue.ko 2023-05-16T13:37:41.336 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14417 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nft_redir.ko 2023-05-16T13:37:41.336 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9289 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nft_reject.ko 2023-05-16T13:37:41.336 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9585 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nft_reject_inet.ko 2023-05-16T13:37:41.336 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nft_socket.ko 2023-05-16T13:37:41.336 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19905 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nft_synproxy.ko 2023-05-16T13:37:41.336 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14417 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nft_tproxy.ko 2023-05-16T13:37:41.337 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 98833 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/x_tables.ko 2023-05-16T13:37:41.337 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11665 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_AUDIT.ko 2023-05-16T13:37:41.337 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9193 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_CHECKSUM.ko 2023-05-16T13:37:41.337 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 7305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_CLASSIFY.ko 2023-05-16T13:37:41.337 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11033 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-05-16T13:37:41.337 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 17809 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_CT.ko 2023-05-16T13:37:41.337 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10137 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_DSCP.ko 2023-05-16T13:37:41.337 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9041 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_HL.ko 2023-05-16T13:37:41.338 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12937 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_HMARK.ko 2023-05-16T13:37:41.338 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 38513 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_IDLETIMER.ko 2023-05-16T13:37:41.338 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13521 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_LED.ko 2023-05-16T13:37:41.338 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11121 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_LOG.ko 2023-05-16T13:37:41.338 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11313 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_MASQUERADE.ko 2023-05-16T13:37:41.338 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_NETMAP.ko 2023-05-16T13:37:41.338 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9041 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_NFLOG.ko 2023-05-16T13:37:41.338 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12929 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_NFQUEUE.ko 2023-05-16T13:37:41.339 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18889 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_RATEEST.ko 2023-05-16T13:37:41.339 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10313 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_REDIRECT.ko 2023-05-16T13:37:41.339 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13913 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_SECMARK.ko 2023-05-16T13:37:41.339 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15633 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_TCPMSS.ko 2023-05-16T13:37:41.339 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10001 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-05-16T13:37:41.339 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16937 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_TEE.ko 2023-05-16T13:37:41.339 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16417 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_TPROXY.ko 2023-05-16T13:37:41.339 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 7833 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_TRACE.ko 2023-05-16T13:37:41.340 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13465 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_addrtype.ko 2023-05-16T13:37:41.340 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13457 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_bpf.ko 2023-05-16T13:37:41.340 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15209 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_cgroup.ko 2023-05-16T13:37:41.340 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10713 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_cluster.ko 2023-05-16T13:37:41.340 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 7073 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_comment.ko 2023-05-16T13:37:41.340 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10033 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_connbytes.ko 2023-05-16T13:37:41.340 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10649 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_connlabel.ko 2023-05-16T13:37:41.340 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 8913 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_connlimit.ko 2023-05-16T13:37:41.341 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12697 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_connmark.ko 2023-05-16T13:37:41.341 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12033 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_conntrack.ko 2023-05-16T13:37:41.341 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 7329 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_cpu.ko 2023-05-16T13:37:41.341 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10545 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_dccp.ko 2023-05-16T13:37:41.341 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 7433 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_devgroup.ko 2023-05-16T13:37:41.341 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 8433 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_dscp.ko 2023-05-16T13:37:41.341 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10233 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_ecn.ko 2023-05-16T13:37:41.341 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11041 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_esp.ko 2023-05-16T13:37:41.342 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 43025 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_hashlimit.ko 2023-05-16T13:37:41.342 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10889 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_helper.ko 2023-05-16T13:37:41.342 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 7433 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_hl.ko 2023-05-16T13:37:41.342 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11553 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_ipcomp.ko 2023-05-16T13:37:41.342 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11033 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_iprange.ko 2023-05-16T13:37:41.342 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11289 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_ipvs.ko 2023-05-16T13:37:41.342 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15609 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_l2tp.ko 2023-05-16T13:37:41.342 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 7569 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_length.ko 2023-05-16T13:37:41.343 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10929 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_limit.ko 2023-05-16T13:37:41.343 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 7113 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_mac.ko 2023-05-16T13:37:41.343 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 8153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_mark.ko 2023-05-16T13:37:41.343 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11393 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_multiport.ko 2023-05-16T13:37:41.343 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13513 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_nat.ko 2023-05-16T13:37:41.343 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9681 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_nfacct.ko 2023-05-16T13:37:41.343 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 7913 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_osf.ko 2023-05-16T13:37:41.343 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9121 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_owner.ko 2023-05-16T13:37:41.344 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_physdev.ko 2023-05-16T13:37:41.344 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 7137 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_pkttype.ko 2023-05-16T13:37:41.344 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11561 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_policy.ko 2023-05-16T13:37:41.344 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9049 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_quota.ko 2023-05-16T13:37:41.344 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9913 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_rateest.ko 2023-05-16T13:37:41.344 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 7761 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_realm.ko 2023-05-16T13:37:41.344 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 36065 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_recent.ko 2023-05-16T13:37:41.344 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12897 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_sctp.ko 2023-05-16T13:37:41.345 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 29985 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_set.ko 2023-05-16T13:37:41.345 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15849 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_socket.ko 2023-05-16T13:37:41.345 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9009 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_state.ko 2023-05-16T13:37:41.345 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 8985 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_statistic.ko 2023-05-16T13:37:41.345 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 8313 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_string.ko 2023-05-16T13:37:41.345 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 8129 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_tcpmss.ko 2023-05-16T13:37:41.345 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_tcpudp.ko 2023-05-16T13:37:41.345 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10641 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_time.ko 2023-05-16T13:37:41.346 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 8681 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_u32.ko 2023-05-16T13:37:41.346 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netlink/ 2023-05-16T13:37:41.346 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 13417 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netlink/netlink_diag.ko 2023-05-16T13:37:41.346 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/nsh/ 2023-05-16T13:37:41.346 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11753 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/nsh/nsh.ko 2023-05-16T13:37:41.346 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/openvswitch/ 2023-05-16T13:37:41.346 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 377353 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/openvswitch/openvswitch.ko 2023-05-16T13:37:41.346 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9825 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/openvswitch/vport-geneve.ko 2023-05-16T13:37:41.347 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 8953 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/openvswitch/vport-gre.ko 2023-05-16T13:37:41.347 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 11297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/openvswitch/vport-vxlan.ko 2023-05-16T13:37:41.347 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/packet/ 2023-05-16T13:37:41.347 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12561 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/packet/af_packet_diag.ko 2023-05-16T13:37:41.347 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/phonet/ 2023-05-16T13:37:41.347 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 109633 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/phonet/phonet.ko 2023-05-16T13:37:41.347 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 54353 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/phonet/pn_pep.ko 2023-05-16T13:37:41.347 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/rds/ 2023-05-16T13:37:41.348 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 248545 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/rds/rds.ko 2023-05-16T13:37:41.348 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 164641 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/rds/rds_rdma.ko 2023-05-16T13:37:41.348 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 66441 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/rds/rds_tcp.ko 2023-05-16T13:37:41.348 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/rxrpc/ 2023-05-16T13:37:41.348 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 805849 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/rxrpc/rxrpc.ko 2023-05-16T13:37:41.348 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/ 2023-05-16T13:37:41.348 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 31817 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/act_csum.ko 2023-05-16T13:37:41.349 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23105 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/act_gact.ko 2023-05-16T13:37:41.349 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 25185 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/act_ipt.ko 2023-05-16T13:37:41.349 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 33569 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/act_mirred.ko 2023-05-16T13:37:41.349 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 22929 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/act_nat.ko 2023-05-16T13:37:41.349 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 39593 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/act_pedit.ko 2023-05-16T13:37:41.349 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 31561 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/act_police.ko 2023-05-16T13:37:41.349 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19817 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/act_simple.ko 2023-05-16T13:37:41.349 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 35921 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/act_skbedit.ko 2023-05-16T13:37:41.350 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 35625 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/act_vlan.ko 2023-05-16T13:37:41.350 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24953 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/cls_basic.ko 2023-05-16T13:37:41.350 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 32409 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/cls_bpf.ko 2023-05-16T13:37:41.350 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18729 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/cls_cgroup.ko 2023-05-16T13:37:41.350 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 30953 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/cls_flow.ko 2023-05-16T13:37:41.350 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 29809 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/cls_fw.ko 2023-05-16T13:37:41.350 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 36793 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/cls_route.ko 2023-05-16T13:37:41.350 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 57985 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/cls_u32.ko 2023-05-16T13:37:41.351 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 6945 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/em_cmp.ko 2023-05-16T13:37:41.351 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 12969 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/em_ipset.ko 2023-05-16T13:37:41.351 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 32833 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/em_meta.ko 2023-05-16T13:37:41.351 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 7393 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/em_nbyte.ko 2023-05-16T13:37:41.351 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10193 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/em_text.ko 2023-05-16T13:37:41.351 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 6753 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/em_u32.ko 2023-05-16T13:37:41.351 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19609 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/sch_choke.ko 2023-05-16T13:37:41.351 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19201 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/sch_codel.ko 2023-05-16T13:37:41.352 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 30441 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/sch_drr.ko 2023-05-16T13:37:41.352 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 29913 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/sch_fq.ko 2023-05-16T13:37:41.352 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 28953 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/sch_fq_codel.ko 2023-05-16T13:37:41.352 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 32145 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/sch_gred.ko 2023-05-16T13:37:41.352 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 44345 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/sch_hfsc.ko 2023-05-16T13:37:41.352 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20369 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/sch_hhf.ko 2023-05-16T13:37:41.352 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 63001 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/sch_htb.ko 2023-05-16T13:37:41.352 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15249 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/sch_ingress.ko 2023-05-16T13:37:41.353 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23329 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/sch_mqprio.ko 2023-05-16T13:37:41.353 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9353 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/sch_mqprio_lib.ko 2023-05-16T13:37:41.353 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23441 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/sch_multiq.ko 2023-05-16T13:37:41.353 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 33329 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/sch_netem.ko 2023-05-16T13:37:41.353 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 23497 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/sch_pie.ko 2023-05-16T13:37:41.353 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9833 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/sch_plug.ko 2023-05-16T13:37:41.353 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 22817 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/sch_prio.ko 2023-05-16T13:37:41.353 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 43969 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/sch_qfq.ko 2023-05-16T13:37:41.354 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 28697 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/sch_red.ko 2023-05-16T13:37:41.354 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 24881 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/sch_sfb.ko 2023-05-16T13:37:41.354 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 27985 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/sch_sfq.ko 2023-05-16T13:37:41.354 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 26905 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/sch_tbf.ko 2023-05-16T13:37:41.354 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 26857 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/sch_teql.ko 2023-05-16T13:37:41.354 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sctp/ 2023-05-16T13:37:41.354 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 920945 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sctp/sctp.ko 2023-05-16T13:37:41.354 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 18601 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sctp/sctp_diag.ko 2023-05-16T13:37:41.355 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sunrpc/ 2023-05-16T13:37:41.355 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sunrpc/auth_gss/ 2023-05-16T13:37:41.355 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 327521 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-05-16T13:37:41.355 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 61329 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-05-16T13:37:41.355 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 1405641 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sunrpc/sunrpc.ko 2023-05-16T13:37:41.355 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sunrpc/xprtrdma/ 2023-05-16T13:37:41.355 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 681905 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-05-16T13:37:41.355 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/tipc/ 2023-05-16T13:37:41.356 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 9593 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/tipc/diag.ko 2023-05-16T13:37:41.356 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 853201 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/tipc/tipc.ko 2023-05-16T13:37:41.356 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/unix/ 2023-05-16T13:37:41.356 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 15233 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/unix/unix_diag.ko 2023-05-16T13:37:41.356 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/vmw_vsock/ 2023-05-16T13:37:41.356 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 78425 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-05-16T13:37:41.356 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 67537 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-05-16T13:37:41.356 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 82401 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/vmw_vsock/vsock.ko 2023-05-16T13:37:41.357 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10273 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/vmw_vsock/vsock_diag.ko 2023-05-16T13:37:41.357 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 16713 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/vmw_vsock/vsock_loopback.ko 2023-05-16T13:37:41.357 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/x25/ 2023-05-16T13:37:41.357 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 124593 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/x25/x25.ko 2023-05-16T13:37:41.357 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/xfrm/ 2023-05-16T13:37:41.357 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 20793 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/xfrm/xfrm_algo.ko 2023-05-16T13:37:41.357 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 19745 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/xfrm/xfrm_ipcomp.ko 2023-05-16T13:37:41.357 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 101145 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/xfrm/xfrm_user.ko 2023-05-16T13:37:41.358 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/virt/ 2023-05-16T13:37:41.358 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/virt/lib/ 2023-05-16T13:37:41.358 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 14433 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/virt/lib/irqbypass.ko 2023-05-16T13:37:41.358 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 636465 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/modules.alias 2023-05-16T13:37:41.358 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 622282 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/modules.alias.bin 2023-05-16T13:37:41.358 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 8260 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/modules.builtin 2023-05-16T13:37:41.358 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 22530 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/modules.builtin.alias.bin 2023-05-16T13:37:41.358 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 10532 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/modules.builtin.bin 2023-05-16T13:37:41.359 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 70097 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/modules.builtin.modinfo 2023-05-16T13:37:41.359 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 146789 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/modules.dep 2023-05-16T13:37:41.359 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 233606 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/modules.dep.bin 2023-05-16T13:37:41.359 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 210 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/modules.devname 2023-05-16T13:37:41.359 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 73038 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/modules.order 2023-05-16T13:37:41.359 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 879 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/modules.softdep 2023-05-16T13:37:41.359 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 251751 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/modules.symbols 2023-05-16T13:37:41.359 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 306320 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/modules.symbols.bin 2023-05-16T13:37:41.360 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./usr/ 2023-05-16T13:37:41.360 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./usr/share/ 2023-05-16T13:37:41.360 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./usr/share/doc/ 2023-05-16T13:37:41.360 INFO:teuthology.orchestra.run.smithi118.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./usr/share/doc/linux-image-6.3.0-g7312ab6f53ec/ 2023-05-16T13:37:41.360 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 169 2023-05-15 02:23 ./usr/share/doc/linux-image-6.3.0-g7312ab6f53ec/changelog.Debian.gz 2023-05-16T13:37:41.360 INFO:teuthology.orchestra.run.smithi118.stdout:-rw-r--r-- root/root 691 2023-05-15 02:23 ./usr/share/doc/linux-image-6.3.0-g7312ab6f53ec/copyright 2023-05-16T13:37:41.361 DEBUG:teuthology.task.kernel:get_image_version: 6.3.0-g7312ab6f53ec 2023-05-16T13:37:41.362 INFO:teuthology.task.kernel:searching for kernel 6.3.0-g7312ab6f53ec 2023-05-16T13:37:41.362 DEBUG:teuthology.orchestra.run.smithi118:> egrep '(submenu|menuentry.*6.3.0-g7312ab6f53ec).*{' /boot/grub/grub.cfg 2023-05-16T13:37:41.363 INFO:teuthology.orchestra.run.smithi039.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-05-16T13:37:41.363 INFO:teuthology.orchestra.run.smithi039.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-05-16T13:37:41.368 INFO:teuthology.orchestra.run.smithi118.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-05-16T13:37:41.368 INFO:teuthology.orchestra.run.smithi118.stdout: menuentry 'Ubuntu, with Linux 6.3.0-g7312ab6f53ec' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.3.0-g7312ab6f53ec-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-05-16T13:37:41.368 INFO:teuthology.orchestra.run.smithi118.stdout: menuentry 'Ubuntu, with Linux 6.3.0-g7312ab6f53ec (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.3.0-g7312ab6f53ec-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-05-16T13:37:41.369 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-05-16T13:37:41.369 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.3.0-g7312ab6f53ec 2023-05-16T13:37:41.369 DEBUG:teuthology.orchestra.run.smithi118:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-05-16T13:37:41.412 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi118.front.sepia.ceph.com to complete... 2023-05-16T13:37:41.415 INFO:teuthology.orchestra.run.smithi039.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-05-16T13:37:41.421 INFO:teuthology.orchestra.run.smithi039.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-05-16T13:37:41.572 INFO:teuthology.orchestra.run.smithi039.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-05-16T13:37:41.572 INFO:teuthology.orchestra.run.smithi039.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-05-16T13:37:41.572 INFO:teuthology.orchestra.run.smithi039.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-05-16T13:37:41.611 INFO:teuthology.orchestra.run.smithi039.stderr:done 2023-05-16T13:37:41.766 DEBUG:teuthology.orchestra.run.smithi039:> dpkg-deb -c /tmp/linux-image.deb 2023-05-16T13:37:41.774 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./ 2023-05-16T13:37:41.775 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./boot/ 2023-05-16T13:37:41.775 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 4289818 2023-05-15 02:23 ./boot/System.map-6.3.0-g7312ab6f53ec 2023-05-16T13:37:41.784 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 166933 2023-05-15 02:23 ./boot/config-6.3.0-g7312ab6f53ec 2023-05-16T13:37:41.784 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11175904 2023-05-15 02:23 ./boot/vmlinuz-6.3.0-g7312ab6f53ec 2023-05-16T13:37:41.801 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./etc/ 2023-05-16T13:37:41.801 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./etc/kernel/ 2023-05-16T13:37:41.802 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./etc/kernel/postinst.d/ 2023-05-16T13:37:41.802 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./etc/kernel/postrm.d/ 2023-05-16T13:37:41.802 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./etc/kernel/preinst.d/ 2023-05-16T13:37:41.802 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./etc/kernel/prerm.d/ 2023-05-16T13:37:41.802 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/ 2023-05-16T13:37:41.802 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/ 2023-05-16T13:37:41.803 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/ 2023-05-16T13:37:41.803 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/ 2023-05-16T13:37:41.803 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/ 2023-05-16T13:37:41.803 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/ 2023-05-16T13:37:41.803 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/crypto/ 2023-05-16T13:37:41.804 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 527241 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/crypto/aesni-intel.ko 2023-05-16T13:37:41.806 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24905 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-05-16T13:37:41.806 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28241 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-05-16T13:37:41.806 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29425 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-05-16T13:37:41.806 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 88441 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-05-16T13:37:41.806 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 100081 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-05-16T13:37:41.806 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 142185 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-05-16T13:37:41.807 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12249 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-05-16T13:37:41.807 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13281 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-05-16T13:37:41.807 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 78905 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-05-16T13:37:41.807 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18113 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-05-16T13:37:41.807 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 46321 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-05-16T13:37:41.808 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 46777 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/crypto/serpent-avx2.ko 2023-05-16T13:37:41.808 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 51305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-05-16T13:37:41.808 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 38593 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-05-16T13:37:41.808 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 40457 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-05-16T13:37:41.808 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 58273 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-05-16T13:37:41.808 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 50009 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-05-16T13:37:41.809 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 31153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-05-16T13:37:41.809 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12825 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-05-16T13:37:41.809 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/kernel/ 2023-05-16T13:37:41.809 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/kernel/cpu/ 2023-05-16T13:37:41.809 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/kernel/cpu/mce/ 2023-05-16T13:37:41.809 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 39689 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-05-16T13:37:41.809 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12937 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/kernel/cpuid.ko 2023-05-16T13:37:41.810 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17513 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/kernel/msr.ko 2023-05-16T13:37:41.810 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/kvm/ 2023-05-16T13:37:41.810 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 342897 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/kvm/kvm-amd.ko 2023-05-16T13:37:41.810 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 971009 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/kvm/kvm-intel.ko 2023-05-16T13:37:41.810 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 2208345 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/kvm/kvm.ko 2023-05-16T13:37:41.822 INFO:teuthology.orchestra.run.smithi118.stderr:Sourcing file `/etc/default/grub' 2023-05-16T13:37:41.822 INFO:teuthology.orchestra.run.smithi118.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-05-16T13:37:41.849 INFO:teuthology.orchestra.run.smithi118.stderr:Generating grub configuration file ... 2023-05-16T13:37:41.850 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/ 2023-05-16T13:37:41.850 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 55889 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/af_alg.ko 2023-05-16T13:37:41.850 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24713 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/algif_hash.ko 2023-05-16T13:37:41.850 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20585 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/algif_skcipher.ko 2023-05-16T13:37:41.851 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16777 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/ansi_cprng.ko 2023-05-16T13:37:41.851 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19209 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/anubis.ko 2023-05-16T13:37:41.851 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9657 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/arc4.ko 2023-05-16T13:37:41.851 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/asymmetric_keys/ 2023-05-16T13:37:41.852 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9753 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-05-16T13:37:41.852 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/async_tx/ 2023-05-16T13:37:41.852 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10529 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/async_tx/async_memcpy.ko 2023-05-16T13:37:41.852 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18665 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/async_tx/async_pq.ko 2023-05-16T13:37:41.852 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20737 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/async_tx/async_raid6_recov.ko 2023-05-16T13:37:41.852 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12849 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/async_tx/async_tx.ko 2023-05-16T13:37:41.853 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16721 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/async_tx/async_xor.ko 2023-05-16T13:37:41.853 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17489 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/async_tx/raid6test.ko 2023-05-16T13:37:41.853 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19753 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/authenc.ko 2023-05-16T13:37:41.853 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/authencesn.ko 2023-05-16T13:37:41.854 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21081 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/blake2b_generic.ko 2023-05-16T13:37:41.854 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12009 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/blowfish_common.ko 2023-05-16T13:37:41.854 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10033 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/blowfish_generic.ko 2023-05-16T13:37:41.855 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 38377 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/camellia_generic.ko 2023-05-16T13:37:41.855 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26377 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/cast5_generic.ko 2023-05-16T13:37:41.855 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16785 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/cast6_generic.ko 2023-05-16T13:37:41.856 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9537 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/cast_common.ko 2023-05-16T13:37:41.856 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 34665 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/ccm.ko 2023-05-16T13:37:41.856 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13897 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/cmac.ko 2023-05-16T13:37:41.857 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9089 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/crc32_generic.ko 2023-05-16T13:37:41.857 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 44633 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/cryptd.ko 2023-05-16T13:37:41.857 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22985 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/crypto_engine.ko 2023-05-16T13:37:41.857 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25313 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/crypto_simd.ko 2023-05-16T13:37:41.858 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/crypto_user.ko 2023-05-16T13:37:41.858 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17233 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/cts.ko 2023-05-16T13:37:41.858 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10417 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/des_generic.ko 2023-05-16T13:37:41.858 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14785 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/dh_generic.ko 2023-05-16T13:37:41.859 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10569 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/echainiv.ko 2023-05-16T13:37:41.859 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24825 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/essiv.ko 2023-05-16T13:37:41.859 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17553 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/fcrypt.ko 2023-05-16T13:37:41.860 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26393 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/khazad.ko 2023-05-16T13:37:41.860 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15217 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/lrw.ko 2023-05-16T13:37:41.860 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11009 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/lz4.ko 2023-05-16T13:37:41.860 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11089 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/lz4hc.ko 2023-05-16T13:37:41.860 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11257 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/md4.ko 2023-05-16T13:37:41.860 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9233 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/michael_mic.ko 2023-05-16T13:37:41.860 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10241 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/pcbc.ko 2023-05-16T13:37:41.861 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18321 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/pcrypt.ko 2023-05-16T13:37:41.861 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15553 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/rmd160.ko 2023-05-16T13:37:41.861 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28953 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/seed.ko 2023-05-16T13:37:41.861 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26049 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/serpent_generic.ko 2023-05-16T13:37:41.861 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 148761 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/tcrypt.ko 2023-05-16T13:37:41.861 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10377 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/tea.ko 2023-05-16T13:37:41.861 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 27969 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/twofish_common.ko 2023-05-16T13:37:41.862 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12729 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/twofish_generic.ko 2023-05-16T13:37:41.862 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16897 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/vmac.ko 2023-05-16T13:37:41.862 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 35689 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/wp512.ko 2023-05-16T13:37:41.862 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13673 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/xcbc.ko 2023-05-16T13:37:41.862 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25945 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/xor.ko 2023-05-16T13:37:41.862 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18193 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/xts.ko 2023-05-16T13:37:41.862 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9049 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/xxhash_generic.ko 2023-05-16T13:37:41.863 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ 2023-05-16T13:37:41.863 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/acpi/ 2023-05-16T13:37:41.863 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17809 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/acpi/acpi_extlog.ko 2023-05-16T13:37:41.863 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26537 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/acpi/acpi_ipmi.ko 2023-05-16T13:37:41.863 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/acpi/acpi_pad.ko 2023-05-16T13:37:41.863 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/acpi/apei/ 2023-05-16T13:37:41.863 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 30209 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/acpi/apei/einj.ko 2023-05-16T13:37:41.864 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12377 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/acpi/ec_sys.ko 2023-05-16T13:37:41.864 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13961 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/acpi/platform_profile.ko 2023-05-16T13:37:41.864 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24217 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/acpi/sbs.ko 2023-05-16T13:37:41.864 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18465 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/acpi/sbshc.ko 2023-05-16T13:37:41.864 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 101617 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/acpi/video.ko 2023-05-16T13:37:41.864 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/ 2023-05-16T13:37:41.864 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21033 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/acard-ahci.ko 2023-05-16T13:37:41.865 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 88185 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/ahci.ko 2023-05-16T13:37:41.865 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13681 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/ahci_platform.ko 2023-05-16T13:37:41.865 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 84753 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/libahci.ko 2023-05-16T13:37:41.865 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 32369 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/libahci_platform.ko 2023-05-16T13:37:41.865 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16577 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_acpi.ko 2023-05-16T13:37:41.865 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 30057 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_ali.ko 2023-05-16T13:37:41.866 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 33193 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_amd.ko 2023-05-16T13:37:41.866 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20705 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_artop.ko 2023-05-16T13:37:41.866 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20561 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_atiixp.ko 2023-05-16T13:37:41.866 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24369 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_atp867x.ko 2023-05-16T13:37:41.866 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17089 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_cmd640.ko 2023-05-16T13:37:41.866 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24745 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_cmd64x.ko 2023-05-16T13:37:41.867 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14345 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_cypress.ko 2023-05-16T13:37:41.867 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17289 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_efar.ko 2023-05-16T13:37:41.867 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21385 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_hpt366.ko 2023-05-16T13:37:41.867 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 33545 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_hpt37x.ko 2023-05-16T13:37:41.867 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22569 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_hpt3x2n.ko 2023-05-16T13:37:41.867 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16361 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_hpt3x3.ko 2023-05-16T13:37:41.868 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16433 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_it8213.ko 2023-05-16T13:37:41.868 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 34745 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_it821x.ko 2023-05-16T13:37:41.868 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12329 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_jmicron.ko 2023-05-16T13:37:41.868 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 51241 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_legacy.ko 2023-05-16T13:37:41.868 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14625 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_marvell.ko 2023-05-16T13:37:41.868 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15585 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_mpiix.ko 2023-05-16T13:37:41.869 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12273 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_netcell.ko 2023-05-16T13:37:41.869 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16185 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_ninja32.ko 2023-05-16T13:37:41.869 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14473 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_ns87410.ko 2023-05-16T13:37:41.869 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16737 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_ns87415.ko 2023-05-16T13:37:41.869 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15945 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_oldpiix.ko 2023-05-16T13:37:41.869 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14817 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_opti.ko 2023-05-16T13:37:41.869 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20177 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_optidma.ko 2023-05-16T13:37:41.870 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 32017 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_pcmcia.ko 2023-05-16T13:37:41.870 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 37225 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_pdc2027x.ko 2023-05-16T13:37:41.870 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19993 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-05-16T13:37:41.870 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13601 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_piccolo.ko 2023-05-16T13:37:41.870 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14889 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_radisys.ko 2023-05-16T13:37:41.870 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18953 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_rdc.ko 2023-05-16T13:37:41.871 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14761 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_rz1000.ko 2023-05-16T13:37:41.871 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13377 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_sch.ko 2023-05-16T13:37:41.871 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22513 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_serverworks.ko 2023-05-16T13:37:41.871 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22889 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_sil680.ko 2023-05-16T13:37:41.871 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19129 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_sl82c105.ko 2023-05-16T13:37:41.871 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15449 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_triflex.ko 2023-05-16T13:37:41.872 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29929 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_via.ko 2023-05-16T13:37:41.872 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22225 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pdc_adma.ko 2023-05-16T13:37:41.872 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28561 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/sata_inic162x.ko 2023-05-16T13:37:41.872 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 82793 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/sata_mv.ko 2023-05-16T13:37:41.872 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 70033 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/sata_nv.ko 2023-05-16T13:37:41.872 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 36937 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/sata_promise.ko 2023-05-16T13:37:41.873 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22545 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/sata_qstor.ko 2023-05-16T13:37:41.873 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28705 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/sata_sil.ko 2023-05-16T13:37:41.873 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 37769 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/sata_sil24.ko 2023-05-16T13:37:41.873 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17313 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/sata_sis.ko 2023-05-16T13:37:41.873 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19881 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/sata_svw.ko 2023-05-16T13:37:41.873 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 44225 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/sata_sx4.ko 2023-05-16T13:37:41.874 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15041 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/sata_uli.ko 2023-05-16T13:37:41.874 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 34625 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/sata_via.ko 2023-05-16T13:37:41.874 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19497 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/sata_vsc.ko 2023-05-16T13:37:41.874 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/auxdisplay/ 2023-05-16T13:37:41.874 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15017 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/auxdisplay/ks0108.ko 2023-05-16T13:37:41.874 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/bcma/ 2023-05-16T13:37:41.875 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 121249 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/bcma/bcma.ko 2023-05-16T13:37:41.875 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/block/ 2023-05-16T13:37:41.875 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/block/aoe/ 2023-05-16T13:37:41.875 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 113145 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/block/aoe/aoe.ko 2023-05-16T13:37:41.875 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/block/drbd/ 2023-05-16T13:37:41.875 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 963089 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/block/drbd/drbd.ko 2023-05-16T13:37:41.875 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 172809 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/block/floppy.ko 2023-05-16T13:37:41.875 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/block/mtip32xx/ 2023-05-16T13:37:41.876 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 93865 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-05-16T13:37:41.876 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 113657 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/block/nbd.ko 2023-05-16T13:37:41.876 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/block/null_blk/ 2023-05-16T13:37:41.876 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 110513 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/block/null_blk/null_blk.ko 2023-05-16T13:37:41.876 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 81753 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/block/pktcdvd.ko 2023-05-16T13:37:41.876 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 253977 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/block/rbd.ko 2023-05-16T13:37:41.877 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/block/xen-blkback/ 2023-05-16T13:37:41.877 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 97705 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-05-16T13:37:41.877 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/block/zram/ 2023-05-16T13:37:41.877 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 59209 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/block/zram/zram.ko 2023-05-16T13:37:41.877 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/ 2023-05-16T13:37:41.877 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 30417 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/applicom.ko 2023-05-16T13:37:41.877 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11569 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/hangcheck-timer.ko 2023-05-16T13:37:41.878 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/hw_random/ 2023-05-16T13:37:41.878 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13393 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/hw_random/amd-rng.ko 2023-05-16T13:37:41.878 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/hw_random/intel-rng.ko 2023-05-16T13:37:41.878 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12897 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-05-16T13:37:41.878 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10241 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/hw_random/via-rng.ko 2023-05-16T13:37:41.878 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15089 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/hw_random/virtio-rng.ko 2023-05-16T13:37:41.878 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/ipmi/ 2023-05-16T13:37:41.879 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 30505 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-05-16T13:37:41.879 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 147745 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-05-16T13:37:41.879 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26457 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-05-16T13:37:41.879 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 138561 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/ipmi/ipmi_si.ko 2023-05-16T13:37:41.879 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 70353 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-05-16T13:37:41.879 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 53105 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-05-16T13:37:41.879 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 35833 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/lp.ko 2023-05-16T13:37:41.880 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/mwave/ 2023-05-16T13:37:41.880 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 83625 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/mwave/mwave.ko 2023-05-16T13:37:41.880 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/nvram.ko 2023-05-16T13:37:41.880 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/pcmcia/ 2023-05-16T13:37:41.880 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 102457 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/pcmcia/cm4000_cs.ko 2023-05-16T13:37:41.880 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 50969 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/pcmcia/cm4040_cs.ko 2023-05-16T13:37:41.881 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 83625 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/pcmcia/synclink_cs.ko 2023-05-16T13:37:41.881 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 31689 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/ppdev.ko 2023-05-16T13:37:41.881 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 50681 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/tlclk.ko 2023-05-16T13:37:41.881 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/tpm/ 2023-05-16T13:37:41.881 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15897 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/tpm/tpm_atmel.ko 2023-05-16T13:37:41.881 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15449 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-05-16T13:37:41.881 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23033 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-05-16T13:37:41.882 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 32481 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-05-16T13:37:41.882 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29681 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/tpm/tpm_infineon.ko 2023-05-16T13:37:41.882 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22257 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/tpm/tpm_nsc.ko 2023-05-16T13:37:41.882 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23137 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-05-16T13:37:41.882 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/xillybus/ 2023-05-16T13:37:41.882 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16121 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/xillybus/xillybus_class.ko 2023-05-16T13:37:41.883 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 49865 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/xillybus/xillybus_core.ko 2023-05-16T13:37:41.883 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11905 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-05-16T13:37:41.883 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/clk/ 2023-05-16T13:37:41.883 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12057 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/clk/clk-palmas.ko 2023-05-16T13:37:41.883 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 47593 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/clk/clk-si5351.ko 2023-05-16T13:37:41.883 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10961 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/clk/clk-twl6040.ko 2023-05-16T13:37:41.884 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18665 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/clk/clk-wm831x.ko 2023-05-16T13:37:41.884 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/cpufreq/ 2023-05-16T13:37:41.884 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9665 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-05-16T13:37:41.884 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16337 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/cpufreq/p4-clockmod.ko 2023-05-16T13:37:41.884 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24385 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/cpufreq/speedstep-lib.ko 2023-05-16T13:37:41.885 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/crypto/ 2023-05-16T13:37:41.885 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/crypto/ccp/ 2023-05-16T13:37:41.885 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 70289 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-05-16T13:37:41.885 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 223113 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/crypto/ccp/ccp.ko 2023-05-16T13:37:41.885 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19505 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/crypto/padlock-aes.ko 2023-05-16T13:37:41.885 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20985 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/crypto/padlock-sha.ko 2023-05-16T13:37:41.885 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/crypto/qat/ 2023-05-16T13:37:41.886 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/crypto/qat/qat_common/ 2023-05-16T13:37:41.886 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 397793 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/crypto/qat/qat_common/intel_qat.ko 2023-05-16T13:37:41.886 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/crypto/qat/qat_dh895xcc/ 2023-05-16T13:37:41.886 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24289 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/crypto/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-05-16T13:37:41.886 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/crypto/virtio/ 2023-05-16T13:37:41.886 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 68121 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-05-16T13:37:41.886 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/dca/ 2023-05-16T13:37:41.887 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28273 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/dca/dca.ko 2023-05-16T13:37:41.887 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/dma/ 2023-05-16T13:37:41.887 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/dma/dw/ 2023-05-16T13:37:41.887 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15417 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/dma/dw/dw_dmac.ko 2023-05-16T13:37:41.887 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/dma/ioat/ 2023-05-16T13:37:41.888 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 122841 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/dma/ioat/ioatdma.ko 2023-05-16T13:37:41.888 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/edac/ 2023-05-16T13:37:41.888 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 73761 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/edac/amd64_edac.ko 2023-05-16T13:37:41.888 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 35329 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/edac/e752x_edac.ko 2023-05-16T13:37:41.888 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 62633 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/edac/edac_mce_amd.ko 2023-05-16T13:37:41.889 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17673 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/edac/i3000_edac.ko 2023-05-16T13:37:41.889 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17577 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/edac/i3200_edac.ko 2023-05-16T13:37:41.889 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22105 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/edac/i5100_edac.ko 2023-05-16T13:37:41.889 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25161 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/edac/i5400_edac.ko 2023-05-16T13:37:41.889 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24425 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/edac/i7300_edac.ko 2023-05-16T13:37:41.889 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 51585 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/edac/i7core_edac.ko 2023-05-16T13:37:41.890 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17937 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/edac/i82975x_edac.ko 2023-05-16T13:37:41.890 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19521 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/edac/ie31200_edac.ko 2023-05-16T13:37:41.890 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 56369 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/edac/sb_edac.ko 2023-05-16T13:37:41.890 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17097 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/edac/x38_edac.ko 2023-05-16T13:37:41.890 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/extcon/ 2023-05-16T13:37:41.890 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12145 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/extcon/extcon-gpio.ko 2023-05-16T13:37:41.891 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26673 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/extcon/extcon-max14577.ko 2023-05-16T13:37:41.891 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29113 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/extcon/extcon-max77693.ko 2023-05-16T13:37:41.891 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24225 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/extcon/extcon-max8997.ko 2023-05-16T13:37:41.891 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26009 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/extcon/extcon-palmas.ko 2023-05-16T13:37:41.891 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23281 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/extcon/extcon-rt8973a.ko 2023-05-16T13:37:41.891 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 27353 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/extcon/extcon-sm5502.ko 2023-05-16T13:37:41.891 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/firmware/ 2023-05-16T13:37:41.892 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 34457 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/firmware/dmi-sysfs.ko 2023-05-16T13:37:41.892 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/firmware/efi/ 2023-05-16T13:37:41.892 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15033 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/firmware/efi/efi-pstore.ko 2023-05-16T13:37:41.892 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20385 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/firmware/iscsi_ibft.ko 2023-05-16T13:37:41.892 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/ 2023-05-16T13:37:41.892 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11881 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-adp5520.ko 2023-05-16T13:37:41.893 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19729 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-amd8111.ko 2023-05-16T13:37:41.893 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14561 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-arizona.ko 2023-05-16T13:37:41.893 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13417 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-da9052.ko 2023-05-16T13:37:41.893 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11433 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-da9055.ko 2023-05-16T13:37:41.893 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21625 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-dln2.ko 2023-05-16T13:37:41.893 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 77929 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-f7188x.ko 2023-05-16T13:37:41.893 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 27929 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-generic.ko 2023-05-16T13:37:41.894 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19505 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-ich.ko 2023-05-16T13:37:41.894 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11481 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-05-16T13:37:41.894 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13689 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-kempld.ko 2023-05-16T13:37:41.894 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12249 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-lp3943.ko 2023-05-16T13:37:41.894 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9017 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-max7300.ko 2023-05-16T13:37:41.894 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11161 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-max730x.ko 2023-05-16T13:37:41.895 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18145 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-max732x.ko 2023-05-16T13:37:41.895 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24649 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-05-16T13:37:41.895 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 46321 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-pca953x.ko 2023-05-16T13:37:41.895 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26345 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-pcf857x.ko 2023-05-16T13:37:41.895 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13889 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-rdc321x.ko 2023-05-16T13:37:41.895 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20065 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-sch.ko 2023-05-16T13:37:41.895 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19649 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-sch311x.ko 2023-05-16T13:37:41.896 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11657 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-tps65912.ko 2023-05-16T13:37:41.896 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21553 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-twl4030.ko 2023-05-16T13:37:41.896 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10993 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-twl6040.ko 2023-05-16T13:37:41.896 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20105 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-viperboard.ko 2023-05-16T13:37:41.896 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15025 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-vx855.ko 2023-05-16T13:37:41.896 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15849 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-wm831x.ko 2023-05-16T13:37:41.897 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11185 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-wm8350.ko 2023-05-16T13:37:41.897 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16257 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-wm8994.ko 2023-05-16T13:37:41.897 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/ 2023-05-16T13:37:41.897 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-a4tech.ko 2023-05-16T13:37:41.897 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 38489 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-apple.ko 2023-05-16T13:37:41.897 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14057 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-appleir.ko 2023-05-16T13:37:41.897 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7865 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-aureal.ko 2023-05-16T13:37:41.898 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14681 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-axff.ko 2023-05-16T13:37:41.898 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10625 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-belkin.ko 2023-05-16T13:37:41.898 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9825 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-cherry.ko 2023-05-16T13:37:41.898 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15617 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-chicony.ko 2023-05-16T13:37:41.898 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 58641 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-cp2112.ko 2023-05-16T13:37:41.898 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10617 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-cypress.ko 2023-05-16T13:37:41.898 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15961 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-dr.ko 2023-05-16T13:37:41.899 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10273 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-elecom.ko 2023-05-16T13:37:41.899 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17169 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-elo.ko 2023-05-16T13:37:41.899 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12961 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-emsff.ko 2023-05-16T13:37:41.899 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9609 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-ezkey.ko 2023-05-16T13:37:41.899 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13809 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-gaff.ko 2023-05-16T13:37:41.899 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8793 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-generic.ko 2023-05-16T13:37:41.899 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16049 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-gt683r.ko 2023-05-16T13:37:41.900 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12257 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-gyration.ko 2023-05-16T13:37:41.900 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9385 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-holtek-kbd.ko 2023-05-16T13:37:41.900 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10033 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-holtek-mouse.ko 2023-05-16T13:37:41.900 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14017 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-holtekff.ko 2023-05-16T13:37:41.900 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18617 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-hyperv.ko 2023-05-16T13:37:41.900 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10001 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-icade.ko 2023-05-16T13:37:41.901 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8817 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-kensington.ko 2023-05-16T13:37:41.901 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8057 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-keytouch.ko 2023-05-16T13:37:41.901 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13985 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-kye.ko 2023-05-16T13:37:41.901 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10321 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-lcpower.ko 2023-05-16T13:37:41.901 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19993 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-led.ko 2023-05-16T13:37:41.901 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 41793 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-lenovo.ko 2023-05-16T13:37:41.901 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 30097 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-lg-g15.ko 2023-05-16T13:37:41.901 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 57369 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-logitech-dj.ko 2023-05-16T13:37:41.902 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 94481 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-05-16T13:37:41.902 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 80569 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-logitech.ko 2023-05-16T13:37:41.902 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 30361 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-magicmouse.ko 2023-05-16T13:37:41.902 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21105 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-microsoft.ko 2023-05-16T13:37:41.902 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9937 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-monterey.ko 2023-05-16T13:37:41.902 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 49657 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-multitouch.ko 2023-05-16T13:37:41.902 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 32153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-ntrig.ko 2023-05-16T13:37:41.903 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8433 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-ortek.ko 2023-05-16T13:37:41.903 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8689 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-penmount.ko 2023-05-16T13:37:41.903 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11865 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-petalynx.ko 2023-05-16T13:37:41.903 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 72497 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-picolcd.ko 2023-05-16T13:37:41.903 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13801 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-pl.ko 2023-05-16T13:37:41.903 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14609 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-plantronics.ko 2023-05-16T13:37:41.903 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7929 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-primax.ko 2023-05-16T13:37:41.904 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 34937 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-rmi.ko 2023-05-16T13:37:41.904 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20409 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-roccat-arvo.ko 2023-05-16T13:37:41.904 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12809 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-roccat-common.ko 2023-05-16T13:37:41.904 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 30945 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-roccat-isku.ko 2023-05-16T13:37:41.904 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-roccat-kone.ko 2023-05-16T13:37:41.904 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 30713 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-05-16T13:37:41.904 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20745 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-roccat-konepure.ko 2023-05-16T13:37:41.905 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29065 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-05-16T13:37:41.905 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12873 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-roccat-lua.ko 2023-05-16T13:37:41.905 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28889 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-roccat-pyra.ko 2023-05-16T13:37:41.906 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 27473 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-roccat-ryos.ko 2023-05-16T13:37:41.906 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19057 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-roccat-savu.ko 2023-05-16T13:37:41.906 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22441 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-roccat.ko 2023-05-16T13:37:41.906 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13257 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-saitek.ko 2023-05-16T13:37:41.906 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14705 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-samsung.ko 2023-05-16T13:37:41.907 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 35137 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-sensor-hub.ko 2023-05-16T13:37:41.907 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13113 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-sjoy.ko 2023-05-16T13:37:41.907 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 50705 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-sony.ko 2023-05-16T13:37:41.907 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7817 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-speedlink.ko 2023-05-16T13:37:41.907 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14449 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-steelseries.ko 2023-05-16T13:37:41.907 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9393 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-sunplus.ko 2023-05-16T13:37:41.908 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16489 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-thrustmaster.ko 2023-05-16T13:37:41.908 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10105 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-tivo.ko 2023-05-16T13:37:41.908 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14593 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-tmff.ko 2023-05-16T13:37:41.908 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13897 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-topseed.ko 2023-05-16T13:37:41.908 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15977 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-twinhan.ko 2023-05-16T13:37:41.908 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 71017 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-uclogic.ko 2023-05-16T13:37:41.908 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10433 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-waltop.ko 2023-05-16T13:37:41.909 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 143097 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-wiimote.ko 2023-05-16T13:37:41.909 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7721 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-xinmo.ko 2023-05-16T13:37:41.909 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12825 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-zpff.ko 2023-05-16T13:37:41.909 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16169 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-zydacron.ko 2023-05-16T13:37:41.909 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 260737 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid.ko 2023-05-16T13:37:41.909 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 31889 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/uhid.ko 2023-05-16T13:37:41.909 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/usbhid/ 2023-05-16T13:37:41.910 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 124897 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/usbhid/usbhid.ko 2023-05-16T13:37:41.910 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18593 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/usbhid/usbkbd.ko 2023-05-16T13:37:41.910 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14529 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/usbhid/usbmouse.ko 2023-05-16T13:37:41.910 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 215033 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/wacom.ko 2023-05-16T13:37:41.910 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hv/ 2023-05-16T13:37:41.910 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 62833 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hv/hv_balloon.ko 2023-05-16T13:37:41.910 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 89177 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hv/hv_utils.ko 2023-05-16T13:37:41.911 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 296369 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hv/hv_vmbus.ko 2023-05-16T13:37:41.911 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/ 2023-05-16T13:37:41.911 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 66169 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/abituguru.ko 2023-05-16T13:37:41.911 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 60969 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/abituguru3.ko 2023-05-16T13:37:41.911 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 34305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/acpi_power_meter.ko 2023-05-16T13:37:41.912 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17065 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/ad7414.ko 2023-05-16T13:37:41.912 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18817 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/ad7418.ko 2023-05-16T13:37:41.912 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24769 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/adc128d818.ko 2023-05-16T13:37:41.912 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 31233 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/adm1025.ko 2023-05-16T13:37:41.912 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 97537 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/adm1026.ko 2023-05-16T13:37:41.912 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19313 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/adm1029.ko 2023-05-16T13:37:41.913 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 45057 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/adm1031.ko 2023-05-16T13:37:41.913 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25857 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/adm9240.ko 2023-05-16T13:37:41.913 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14337 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/ads7828.ko 2023-05-16T13:37:41.913 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10337 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/adt7410.ko 2023-05-16T13:37:41.913 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21553 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/adt7411.ko 2023-05-16T13:37:41.913 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 74009 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/adt7462.ko 2023-05-16T13:37:41.913 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 39153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/adt7470.ko 2023-05-16T13:37:41.914 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 64393 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/adt7475.ko 2023-05-16T13:37:41.914 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18729 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/adt7x10.ko 2023-05-16T13:37:41.914 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 38633 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/amc6821.ko 2023-05-16T13:37:41.914 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 54705 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/applesmc.ko 2023-05-16T13:37:41.914 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 49417 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/asb100.ko 2023-05-16T13:37:41.914 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 58113 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/asc7621.ko 2023-05-16T13:37:41.914 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 40377 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/asus_atk0110.ko 2023-05-16T13:37:41.915 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16785 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/atxp1.ko 2023-05-16T13:37:41.915 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28585 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/coretemp.ko 2023-05-16T13:37:41.915 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24169 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/da9052-hwmon.ko 2023-05-16T13:37:41.915 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16761 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/da9055-hwmon.ko 2023-05-16T13:37:41.915 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 43977 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-05-16T13:37:41.915 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 99161 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/dme1737.ko 2023-05-16T13:37:41.916 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19049 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/ds1621.ko 2023-05-16T13:37:41.916 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14833 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/ds620.ko 2023-05-16T13:37:41.916 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29273 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/emc1403.ko 2023-05-16T13:37:41.916 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 32681 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/emc2103.ko 2023-05-16T13:37:41.916 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29889 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/emc6w201.ko 2023-05-16T13:37:41.916 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 66481 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/f71805f.ko 2023-05-16T13:37:41.916 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 94153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/f71882fg.ko 2023-05-16T13:37:41.917 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 40969 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/f75375s.ko 2023-05-16T13:37:41.917 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20881 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/fam15h_power.ko 2023-05-16T13:37:41.917 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 54929 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/fschmd.ko 2023-05-16T13:37:41.917 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13993 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/g760a.ko 2023-05-16T13:37:41.917 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23593 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/g762.ko 2023-05-16T13:37:41.917 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 46369 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/gl518sm.ko 2023-05-16T13:37:41.918 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 45025 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/gl520sm.ko 2023-05-16T13:37:41.918 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12777 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/hih6130.ko 2023-05-16T13:37:41.918 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8945 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/hwmon-vid.ko 2023-05-16T13:37:41.918 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11057 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/i5500_temp.ko 2023-05-16T13:37:41.919 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22097 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/i5k_amb.ko 2023-05-16T13:37:41.919 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 34073 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/ibmaem.ko 2023-05-16T13:37:41.919 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20801 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/ibmpex.ko 2023-05-16T13:37:41.919 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24377 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/ina209.ko 2023-05-16T13:37:41.919 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 27361 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/ina2xx.ko 2023-05-16T13:37:41.919 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 125729 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/it87.ko 2023-05-16T13:37:41.919 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18345 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/jc42.ko 2023-05-16T13:37:41.920 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23281 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/k10temp.ko 2023-05-16T13:37:41.920 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13121 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/k8temp.ko 2023-05-16T13:37:41.920 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18497 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/lineage-pem.ko 2023-05-16T13:37:41.920 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 48097 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/lm63.ko 2023-05-16T13:37:41.920 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16265 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/lm73.ko 2023-05-16T13:37:41.920 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 36161 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/lm75.ko 2023-05-16T13:37:41.921 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19049 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/lm77.ko 2023-05-16T13:37:41.921 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 34153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/lm78.ko 2023-05-16T13:37:41.921 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 31241 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/lm80.ko 2023-05-16T13:37:41.921 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16393 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/lm83.ko 2023-05-16T13:37:41.922 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 72337 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/lm85.ko 2023-05-16T13:37:41.922 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 45633 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/lm87.ko 2023-05-16T13:37:41.922 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 37409 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/lm90.ko 2023-05-16T13:37:41.922 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19249 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/lm92.ko 2023-05-16T13:37:41.923 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 108401 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/lm93.ko 2023-05-16T13:37:41.923 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 32961 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/lm95234.ko 2023-05-16T13:37:41.923 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15769 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/lm95241.ko 2023-05-16T13:37:41.924 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17673 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/lm95245.ko 2023-05-16T13:37:41.924 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23521 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/ltc2945.ko 2023-05-16T13:37:41.924 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13369 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/ltc4151.ko 2023-05-16T13:37:41.924 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14761 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/ltc4215.ko 2023-05-16T13:37:41.925 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14449 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/ltc4222.ko 2023-05-16T13:37:41.925 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14401 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/ltc4245.ko 2023-05-16T13:37:41.925 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12809 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/ltc4260.ko 2023-05-16T13:37:41.925 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14497 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/ltc4261.ko 2023-05-16T13:37:41.926 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 33057 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/max16065.ko 2023-05-16T13:37:41.926 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17929 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/max1619.ko 2023-05-16T13:37:41.926 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23913 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/max1668.ko 2023-05-16T13:37:41.927 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19545 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/max197.ko 2023-05-16T13:37:41.927 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26185 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/max6639.ko 2023-05-16T13:37:41.927 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22881 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/max6650.ko 2023-05-16T13:37:41.927 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 35273 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/max6697.ko 2023-05-16T13:37:41.927 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18145 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/mc13783-adc.ko 2023-05-16T13:37:41.927 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/mcp3021.ko 2023-05-16T13:37:41.928 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15433 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-05-16T13:37:41.928 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 43657 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/nct6683.ko 2023-05-16T13:37:41.928 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 114257 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/nct6775-core.ko 2023-05-16T13:37:41.928 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 45817 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/nct6775.ko 2023-05-16T13:37:41.928 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 59233 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/nct7802.ko 2023-05-16T13:37:41.928 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 81849 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/pc87360.ko 2023-05-16T13:37:41.928 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 54001 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/pc87427.ko 2023-05-16T13:37:41.929 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17969 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/pcf8591.ko 2023-05-16T13:37:41.929 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/pmbus/ 2023-05-16T13:37:41.929 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20489 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-05-16T13:37:41.929 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16569 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-05-16T13:37:41.929 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 27833 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-05-16T13:37:41.929 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9081 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/pmbus/max16064.ko 2023-05-16T13:37:41.929 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17233 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/pmbus/max34440.ko 2023-05-16T13:37:41.930 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9681 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/pmbus/max8688.ko 2023-05-16T13:37:41.930 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15081 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-05-16T13:37:41.930 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 71425 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-05-16T13:37:41.930 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8241 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-05-16T13:37:41.930 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 30297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-05-16T13:37:41.930 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14577 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-05-16T13:37:41.930 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20249 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-05-16T13:37:41.931 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12593 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/powr1220.ko 2023-05-16T13:37:41.931 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18201 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/sch5627.ko 2023-05-16T13:37:41.931 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28313 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/sch5636.ko 2023-05-16T13:37:41.931 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26049 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/sch56xx-common.ko 2023-05-16T13:37:41.931 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 31697 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/sht15.ko 2023-05-16T13:37:41.931 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13065 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/sht21.ko 2023-05-16T13:37:41.931 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16337 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/shtc1.ko 2023-05-16T13:37:41.932 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 39617 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/sis5595.ko 2023-05-16T13:37:41.932 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 31497 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/smm665.ko 2023-05-16T13:37:41.932 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19081 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/smsc47b397.ko 2023-05-16T13:37:41.932 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 38697 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/smsc47m1.ko 2023-05-16T13:37:41.932 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 36953 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/smsc47m192.ko 2023-05-16T13:37:41.932 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26057 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/thmc50.ko 2023-05-16T13:37:41.932 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16529 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/tmp102.ko 2023-05-16T13:37:41.933 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13665 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/tmp103.ko 2023-05-16T13:37:41.933 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20817 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/tmp401.ko 2023-05-16T13:37:41.933 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19041 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/tmp421.ko 2023-05-16T13:37:41.933 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19201 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/via-cputemp.ko 2023-05-16T13:37:41.933 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 41513 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/via686a.ko 2023-05-16T13:37:41.934 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 51953 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/vt1211.ko 2023-05-16T13:37:41.934 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 51121 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/vt8231.ko 2023-05-16T13:37:41.934 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 57025 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/w83627ehf.ko 2023-05-16T13:37:41.934 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 78441 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/w83627hf.ko 2023-05-16T13:37:41.934 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 70849 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/w83781d.ko 2023-05-16T13:37:41.934 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 62793 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/w83791d.ko 2023-05-16T13:37:41.935 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 70825 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/w83792d.ko 2023-05-16T13:37:41.935 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 100953 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/w83793.ko 2023-05-16T13:37:41.935 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 119009 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/w83795.ko 2023-05-16T13:37:41.935 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16825 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/w83l785ts.ko 2023-05-16T13:37:41.935 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 35185 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/w83l786ng.ko 2023-05-16T13:37:41.935 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13393 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-05-16T13:37:41.936 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10201 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-05-16T13:37:41.936 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/ 2023-05-16T13:37:41.936 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/algos/ 2023-05-16T13:37:41.936 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19097 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-05-16T13:37:41.936 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18529 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-05-16T13:37:41.936 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/ 2023-05-16T13:37:41.936 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 27529 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-05-16T13:37:41.937 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-05-16T13:37:41.937 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 27281 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-05-16T13:37:41.937 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17505 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-05-16T13:37:41.937 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25537 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-05-16T13:37:41.937 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15697 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-05-16T13:37:41.937 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14721 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-05-16T13:37:41.937 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 6201 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-05-16T13:37:41.938 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13465 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-05-16T13:37:41.938 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 46025 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-05-16T13:37:41.938 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23193 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-05-16T13:37:41.938 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19097 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-05-16T13:37:41.938 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16841 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-05-16T13:37:41.938 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11889 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-05-16T13:37:41.938 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-05-16T13:37:41.938 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 62017 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-i801.ko 2023-05-16T13:37:41.939 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21937 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-isch.ko 2023-05-16T13:37:41.939 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 47465 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-05-16T13:37:41.939 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16865 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-05-16T13:37:41.939 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17449 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-05-16T13:37:41.939 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21617 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-05-16T13:37:41.939 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25993 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-05-16T13:37:41.939 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24625 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-parport.ko 2023-05-16T13:37:41.940 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16073 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-05-16T13:37:41.940 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 46817 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-05-16T13:37:41.940 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14793 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-05-16T13:37:41.940 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18217 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-05-16T13:37:41.940 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11385 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-05-16T13:37:41.940 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21873 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-05-16T13:37:41.940 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28865 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-05-16T13:37:41.941 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19897 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-05-16T13:37:41.941 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18737 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-05-16T13:37:41.941 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19417 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-05-16T13:37:41.941 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13369 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-via.ko 2023-05-16T13:37:41.941 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25649 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-05-16T13:37:41.941 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18609 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-05-16T13:37:41.941 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 48361 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-05-16T13:37:41.942 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21409 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/i2c-mux.ko 2023-05-16T13:37:41.942 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18017 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/i2c-smbus.ko 2023-05-16T13:37:41.942 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26625 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/i2c-stub.ko 2023-05-16T13:37:41.942 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/muxes/ 2023-05-16T13:37:41.942 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-05-16T13:37:41.942 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12969 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-05-16T13:37:41.942 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26425 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-05-16T13:37:41.943 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/ 2023-05-16T13:37:41.943 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/core/ 2023-05-16T13:37:41.943 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 264089 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/core/ib_cm.ko 2023-05-16T13:37:41.943 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 848969 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/core/ib_core.ko 2023-05-16T13:37:41.943 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 68233 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/core/ib_umad.ko 2023-05-16T13:37:41.943 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 321625 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-05-16T13:37:41.943 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 96473 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/core/iw_cm.ko 2023-05-16T13:37:41.943 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 271713 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/core/rdma_cm.ko 2023-05-16T13:37:41.944 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 65753 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-05-16T13:37:41.944 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/hw/ 2023-05-16T13:37:41.944 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/hw/cxgb4/ 2023-05-16T13:37:41.944 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 492057 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-05-16T13:37:41.944 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/hw/mlx4/ 2023-05-16T13:37:41.944 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 418801 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-05-16T13:37:41.945 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/hw/mlx5/ 2023-05-16T13:37:41.945 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 732713 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-05-16T13:37:42.065 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/hw/mthca/ 2023-05-16T13:37:42.066 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 296153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-05-16T13:37:42.066 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/hw/ocrdma/ 2023-05-16T13:37:42.066 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 153177 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-05-16T13:37:42.066 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/hw/usnic/ 2023-05-16T13:37:42.066 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 168513 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-05-16T13:37:42.066 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/ulp/ 2023-05-16T13:37:42.067 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/ulp/ipoib/ 2023-05-16T13:37:42.067 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 262729 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-05-16T13:37:42.067 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/ulp/iser/ 2023-05-16T13:37:42.067 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 99721 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-05-16T13:37:42.067 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/ulp/isert/ 2023-05-16T13:37:42.067 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 110705 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-05-16T13:37:42.067 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/ulp/srp/ 2023-05-16T13:37:42.068 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 128705 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-05-16T13:37:42.068 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/ulp/srpt/ 2023-05-16T13:37:42.068 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 130009 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-05-16T13:37:42.068 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/ 2023-05-16T13:37:42.068 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10257 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/evbug.ko 2023-05-16T13:37:42.068 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23393 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/ff-memless.ko 2023-05-16T13:37:42.069 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/gameport/ 2023-05-16T13:37:42.069 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11457 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-05-16T13:37:42.069 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11657 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/gameport/fm801-gp.ko 2023-05-16T13:37:42.069 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 39185 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/gameport/gameport.ko 2023-05-16T13:37:42.069 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12065 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/gameport/lightning.ko 2023-05-16T13:37:42.069 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17033 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/gameport/ns558.ko 2023-05-16T13:37:42.069 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 41393 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/joydev.ko 2023-05-16T13:37:42.070 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/ 2023-05-16T13:37:42.070 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12889 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-05-16T13:37:42.070 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29889 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-05-16T13:37:42.070 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26313 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-05-16T13:37:42.070 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24257 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-05-16T13:37:42.070 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 36001 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/gpio_keys.ko 2023-05-16T13:37:42.071 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17777 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-05-16T13:37:42.071 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20825 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/lkkbd.ko 2023-05-16T13:37:42.071 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 27617 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/lm8323.ko 2023-05-16T13:37:42.071 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14617 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/lm8333.ko 2023-05-16T13:37:42.071 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23825 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-05-16T13:37:42.071 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17713 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-05-16T13:37:42.071 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15465 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-05-16T13:37:42.072 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15961 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-05-16T13:37:42.072 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/newtonkbd.ko 2023-05-16T13:37:42.072 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10577 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-05-16T13:37:42.072 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14705 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/qt1070.ko 2023-05-16T13:37:42.072 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20633 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/qt2160.ko 2023-05-16T13:37:42.072 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23313 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-05-16T13:37:42.073 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11057 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/stowaway.ko 2023-05-16T13:37:42.073 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17857 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/sunkbd.ko 2023-05-16T13:37:42.073 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20233 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-05-16T13:37:42.073 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15689 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-05-16T13:37:42.073 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-05-16T13:37:42.073 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11257 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/xtkbd.ko 2023-05-16T13:37:42.073 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10641 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/matrix-keymap.ko 2023-05-16T13:37:42.073 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/mouse/ 2023-05-16T13:37:42.074 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 33889 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/mouse/appletouch.ko 2023-05-16T13:37:42.074 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 33681 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/mouse/bcm5974.ko 2023-05-16T13:37:42.074 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 122977 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/mouse/cyapatp.ko 2023-05-16T13:37:42.074 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 88929 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/mouse/elan_i2c.ko 2023-05-16T13:37:42.074 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13529 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/mouse/gpio_mouse.ko 2023-05-16T13:37:42.074 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 334073 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/mouse/psmouse.ko 2023-05-16T13:37:42.075 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14177 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/mouse/sermouse.ko 2023-05-16T13:37:42.075 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23377 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-05-16T13:37:42.075 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22145 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/mouse/synaptics_usb.ko 2023-05-16T13:37:42.075 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15169 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/mouse/vsxxxaa.ko 2023-05-16T13:37:42.075 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/rmi4/ 2023-05-16T13:37:42.075 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 107777 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/rmi4/rmi_core.ko 2023-05-16T13:37:42.075 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/serio/ 2023-05-16T13:37:42.076 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11233 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/serio/altera_ps2.ko 2023-05-16T13:37:42.076 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15793 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/serio/arc_ps2.ko 2023-05-16T13:37:42.076 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15937 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/serio/ct82c710.ko 2023-05-16T13:37:42.076 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16465 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-05-16T13:37:42.076 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15401 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/serio/parkbd.ko 2023-05-16T13:37:42.076 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12785 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/serio/pcips2.ko 2023-05-16T13:37:42.077 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19665 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/serio/ps2mult.ko 2023-05-16T13:37:42.077 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23697 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/serio/serio_raw.ko 2023-05-16T13:37:42.077 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17489 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/serio/serport.ko 2023-05-16T13:37:42.077 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12169 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/sparse-keymap.ko 2023-05-16T13:37:42.077 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/iommu/ 2023-05-16T13:37:42.077 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/iommu/amd/ 2023-05-16T13:37:42.077 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 37617 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/iommu/amd/iommu_v2.ko 2023-05-16T13:37:42.078 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/ 2023-05-16T13:37:42.078 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13321 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/leds-88pm860x.ko 2023-05-16T13:37:42.078 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10889 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/leds-adp5520.ko 2023-05-16T13:37:42.078 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 59249 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/leds-bd2802.ko 2023-05-16T13:37:42.078 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24353 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/leds-blinkm.ko 2023-05-16T13:37:42.078 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9985 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/leds-da903x.ko 2023-05-16T13:37:42.078 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11817 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/leds-da9052.ko 2023-05-16T13:37:42.079 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15161 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/leds-gpio.ko 2023-05-16T13:37:42.079 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15361 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/leds-lm3530.ko 2023-05-16T13:37:42.079 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 30065 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/leds-lm3533.ko 2023-05-16T13:37:42.079 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18849 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/leds-lm355x.ko 2023-05-16T13:37:42.079 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19457 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/leds-lm3642.ko 2023-05-16T13:37:42.079 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15817 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/leds-lp3944.ko 2023-05-16T13:37:42.079 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10809 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/leds-lp8788.ko 2023-05-16T13:37:42.080 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14497 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/leds-max8997.ko 2023-05-16T13:37:42.080 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12073 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/leds-mc13783.ko 2023-05-16T13:37:42.080 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12705 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/leds-menf21bmc.ko 2023-05-16T13:37:42.080 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20289 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/leds-pca9532.ko 2023-05-16T13:37:42.080 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19985 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/leds-pca955x.ko 2023-05-16T13:37:42.080 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17361 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/leds-pca963x.ko 2023-05-16T13:37:42.080 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 33353 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/leds-ss4200.ko 2023-05-16T13:37:42.081 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24369 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/leds-tca6507.ko 2023-05-16T13:37:42.081 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15169 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/leds-wm831x-status.ko 2023-05-16T13:37:42.081 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11409 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/leds-wm8350.ko 2023-05-16T13:37:42.081 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/trigger/ 2023-05-16T13:37:42.081 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9177 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-05-16T13:37:42.081 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10377 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-05-16T13:37:42.081 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8273 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-05-16T13:37:42.082 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7121 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-05-16T13:37:42.082 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14593 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2023-05-16T13:37:42.082 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13825 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-05-16T13:37:42.082 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13577 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-05-16T13:37:42.082 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11385 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-05-16T13:37:42.082 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13585 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-05-16T13:37:42.082 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/ 2023-05-16T13:37:42.083 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/bcache/ 2023-05-16T13:37:42.083 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 631593 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/bcache/bcache.ko 2023-05-16T13:37:42.083 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 34585 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/dm-bio-prison.ko 2023-05-16T13:37:42.083 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 79553 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/dm-bufio.ko 2023-05-16T13:37:42.083 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 47033 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/dm-cache-smq.ko 2023-05-16T13:37:42.083 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 153889 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/dm-cache.ko 2023-05-16T13:37:42.083 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 105505 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/dm-crypt.ko 2023-05-16T13:37:42.084 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/dm-delay.ko 2023-05-16T13:37:42.084 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 53649 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/dm-era.ko 2023-05-16T13:37:42.084 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20425 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/dm-flakey.ko 2023-05-16T13:37:42.084 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 41105 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/dm-log-userspace.ko 2023-05-16T13:37:42.084 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 31721 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/dm-log.ko 2023-05-16T13:37:42.084 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 49057 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/dm-mirror.ko 2023-05-16T13:37:42.084 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 77297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/dm-multipath.ko 2023-05-16T13:37:42.085 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16025 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/dm-queue-length.ko 2023-05-16T13:37:42.085 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 70585 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/dm-raid.ko 2023-05-16T13:37:42.085 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 33561 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/dm-region-hash.ko 2023-05-16T13:37:42.085 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15361 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/dm-round-robin.ko 2023-05-16T13:37:42.085 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16289 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/dm-service-time.ko 2023-05-16T13:37:42.085 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 108817 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/dm-snapshot.ko 2023-05-16T13:37:42.085 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19201 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/dm-switch.ko 2023-05-16T13:37:42.086 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 181193 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/dm-thin-pool.ko 2023-05-16T13:37:42.086 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 51553 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/dm-verity.ko 2023-05-16T13:37:42.086 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8177 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/dm-zero.ko 2023-05-16T13:37:42.086 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14601 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/faulty.ko 2023-05-16T13:37:42.086 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18673 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/linear.ko 2023-05-16T13:37:42.086 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 31801 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/multipath.ko 2023-05-16T13:37:42.086 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/persistent-data/ 2023-05-16T13:37:42.087 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 192417 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-05-16T13:37:42.087 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 36385 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/raid0.ko 2023-05-16T13:37:42.087 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 111041 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/raid1.ko 2023-05-16T13:37:42.087 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 158385 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/raid10.ko 2023-05-16T13:37:42.087 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 391777 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/raid456.ko 2023-05-16T13:37:42.087 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/message/ 2023-05-16T13:37:42.087 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/message/fusion/ 2023-05-16T13:37:42.088 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 174009 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/message/fusion/mptbase.ko 2023-05-16T13:37:42.088 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 62953 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/message/fusion/mptctl.ko 2023-05-16T13:37:42.088 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 44209 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/message/fusion/mptfc.ko 2023-05-16T13:37:42.088 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 36537 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/message/fusion/mptlan.ko 2023-05-16T13:37:42.088 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 122801 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/message/fusion/mptsas.ko 2023-05-16T13:37:42.088 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 75937 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/message/fusion/mptscsih.ko 2023-05-16T13:37:42.088 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 52449 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/message/fusion/mptspi.ko 2023-05-16T13:37:42.089 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/ 2023-05-16T13:37:42.089 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17001 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/88pm800.ko 2023-05-16T13:37:42.089 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12393 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/88pm805.ko 2023-05-16T13:37:42.089 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10169 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/88pm80x.ko 2023-05-16T13:37:42.089 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11377 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/arizona-i2c.ko 2023-05-16T13:37:42.090 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 121913 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/arizona.ko 2023-05-16T13:37:42.090 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11529 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/bcm590xx.ko 2023-05-16T13:37:42.090 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17457 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/cros_ec_dev.ko 2023-05-16T13:37:42.090 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 34201 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/dln2.ko 2023-05-16T13:37:42.091 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16257 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/janz-cmodio.ko 2023-05-16T13:37:42.091 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 52177 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/kempld-core.ko 2023-05-16T13:37:42.091 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26977 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/lm3533-core.ko 2023-05-16T13:37:42.092 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13649 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-05-16T13:37:42.092 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12113 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/lp3943.ko 2023-05-16T13:37:42.092 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 54321 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/lpc_ich.ko 2023-05-16T13:37:42.092 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11617 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/lpc_sch.ko 2023-05-16T13:37:42.093 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17097 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/max8907.ko 2023-05-16T13:37:42.093 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 27545 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/mc13xxx-core.ko 2023-05-16T13:37:42.093 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11369 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-05-16T13:37:42.094 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11233 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/menf21bmc.ko 2023-05-16T13:37:42.094 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16577 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/pcf50633-adc.ko 2023-05-16T13:37:42.094 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8009 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/pcf50633-gpio.ko 2023-05-16T13:37:42.094 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 33097 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/pcf50633.ko 2023-05-16T13:37:42.095 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9681 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-05-16T13:37:42.095 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19625 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/retu-mfd.ko 2023-05-16T13:37:42.095 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 76113 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/si476x-core.ko 2023-05-16T13:37:42.096 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 47329 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/sm501.ko 2023-05-16T13:37:42.096 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18841 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-05-16T13:37:42.096 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 50185 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/tps65010.ko 2023-05-16T13:37:42.096 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9993 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/tps6507x.ko 2023-05-16T13:37:42.097 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12961 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/viperboard.ko 2023-05-16T13:37:42.097 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10097 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/vx855.ko 2023-05-16T13:37:42.097 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17553 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/wl1273-core.ko 2023-05-16T13:37:42.097 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 43329 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/wm8994.ko 2023-05-16T13:37:42.098 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/ 2023-05-16T13:37:42.098 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13401 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-05-16T13:37:42.098 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 47689 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/ad525x_dpot.ko 2023-05-16T13:37:42.099 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/altera-stapl/ 2023-05-16T13:37:42.099 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 45865 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-05-16T13:37:42.099 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17897 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/apds9802als.ko 2023-05-16T13:37:42.099 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 36305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/apds990x.ko 2023-05-16T13:37:42.100 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 45153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/bh1770glc.ko 2023-05-16T13:37:42.100 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/c2port/ 2023-05-16T13:37:42.100 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10649 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-05-16T13:37:42.100 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 34569 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/c2port/core.ko 2023-05-16T13:37:42.101 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/cb710/ 2023-05-16T13:37:42.101 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24145 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/cb710/cb710.ko 2023-05-16T13:37:42.101 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/ds1682.ko 2023-05-16T13:37:42.102 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8457 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/dummy-irq.ko 2023-05-16T13:37:42.102 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/echo/ 2023-05-16T13:37:42.102 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12409 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/echo/echo.ko 2023-05-16T13:37:42.102 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/eeprom/ 2023-05-16T13:37:42.103 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 37201 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/eeprom/at24.ko 2023-05-16T13:37:42.103 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13825 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/eeprom/eeprom.ko 2023-05-16T13:37:42.103 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13561 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-05-16T13:37:42.104 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13113 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/eeprom/max6875.ko 2023-05-16T13:37:42.104 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 31673 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/enclosure.ko 2023-05-16T13:37:42.104 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/genwqe/ 2023-05-16T13:37:42.104 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 151777 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-05-16T13:37:42.105 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13697 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/hmc6352.ko 2023-05-16T13:37:42.105 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 30841 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/hpilo.ko 2023-05-16T13:37:42.105 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/ibmasm/ 2023-05-16T13:37:42.106 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 72113 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-05-16T13:37:42.106 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19353 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/ics932s401.ko 2023-05-16T13:37:42.106 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21249 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/isl29003.ko 2023-05-16T13:37:42.106 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15249 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/isl29020.ko 2023-05-16T13:37:42.107 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/lis3lv02d/ 2023-05-16T13:37:42.107 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 41145 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-05-16T13:37:42.107 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13425 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-05-16T13:37:42.108 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/mei/ 2023-05-16T13:37:42.108 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 123577 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/mei/mei-me.ko 2023-05-16T13:37:42.108 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 56017 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/mei/mei-txe.ko 2023-05-16T13:37:42.108 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 304113 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/mei/mei.ko 2023-05-16T13:37:42.109 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 30921 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/phantom.ko 2023-05-16T13:37:42.109 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/ti-st/ 2023-05-16T13:37:42.109 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 74113 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/ti-st/st_drv.ko 2023-05-16T13:37:42.110 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23873 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/tifm_7xx1.ko 2023-05-16T13:37:42.110 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 27041 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/tifm_core.ko 2023-05-16T13:37:42.110 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/tsl2550.ko 2023-05-16T13:37:42.110 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 48249 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/vmw_balloon.ko 2023-05-16T13:37:42.111 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/vmw_vmci/ 2023-05-16T13:37:42.111 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 180377 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-05-16T13:37:42.111 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ 2023-05-16T13:37:42.111 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/bonding/ 2023-05-16T13:37:42.112 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 484433 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/bonding/bonding.ko 2023-05-16T13:37:42.112 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/dsa/ 2023-05-16T13:37:42.112 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/dsa/b53/ 2023-05-16T13:37:42.113 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 98553 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/dsa/b53/b53_common.ko 2023-05-16T13:37:42.113 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 39777 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/dsa/bcm-sf2.ko 2023-05-16T13:37:42.113 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14193 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/dsa/mv88e6060.ko 2023-05-16T13:37:42.113 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/dsa/mv88e6xxx/ 2023-05-16T13:37:42.113 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 447025 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-05-16T13:37:42.113 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16433 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/dummy.ko 2023-05-16T13:37:42.114 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17449 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/eql.ko 2023-05-16T13:37:42.114 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/ 2023-05-16T13:37:42.114 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/3com/ 2023-05-16T13:37:42.114 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 45289 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-05-16T13:37:42.114 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 41585 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-05-16T13:37:42.114 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 130081 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-05-16T13:37:42.114 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 68353 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-05-16T13:37:42.115 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/8390/ 2023-05-16T13:37:42.115 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 35961 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/8390/8390.ko 2023-05-16T13:37:42.115 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 59193 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-05-16T13:37:42.115 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26697 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-05-16T13:37:42.115 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 98561 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-05-16T13:37:42.115 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/adaptec/ 2023-05-16T13:37:42.115 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 54017 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-05-16T13:37:42.115 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/agere/ 2023-05-16T13:37:42.116 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 68713 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/agere/et131x.ko 2023-05-16T13:37:42.116 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/alteon/ 2023-05-16T13:37:42.116 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 59081 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-05-16T13:37:42.116 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/altera/ 2023-05-16T13:37:42.116 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 40329 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-05-16T13:37:42.116 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/amd/ 2023-05-16T13:37:42.116 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 54113 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-05-16T13:37:42.117 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 48785 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-05-16T13:37:42.117 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 86849 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-05-16T13:37:42.117 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/atheros/ 2023-05-16T13:37:42.117 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/atheros/alx/ 2023-05-16T13:37:42.117 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 97153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-05-16T13:37:42.117 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-05-16T13:37:42.118 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 104297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-05-16T13:37:42.118 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-05-16T13:37:42.118 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 89745 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-05-16T13:37:42.118 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/atheros/atlx/ 2023-05-16T13:37:42.118 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 80993 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-05-16T13:37:42.118 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 69273 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-05-16T13:37:42.118 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/broadcom/ 2023-05-16T13:37:42.118 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 77881 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-05-16T13:37:42.119 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 176761 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-05-16T13:37:42.119 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-05-16T13:37:42.119 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 1422217 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-05-16T13:37:42.119 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 127561 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-05-16T13:37:42.119 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/broadcom/genet/ 2023-05-16T13:37:42.119 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 130553 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-05-16T13:37:42.120 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 311593 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-05-16T13:37:42.120 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/brocade/ 2023-05-16T13:37:42.120 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/brocade/bna/ 2023-05-16T13:37:42.120 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 323097 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-05-16T13:37:42.120 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/chelsio/ 2023-05-16T13:37:42.120 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-05-16T13:37:42.120 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 193001 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-05-16T13:37:42.121 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-05-16T13:37:42.121 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 345433 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-05-16T13:37:42.121 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-05-16T13:37:42.121 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 1038537 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-05-16T13:37:42.121 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-05-16T13:37:42.121 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 165945 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-05-16T13:37:42.121 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-05-16T13:37:42.122 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 33361 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-05-16T13:37:42.122 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/cisco/ 2023-05-16T13:37:42.122 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/cisco/enic/ 2023-05-16T13:37:42.122 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 203169 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-05-16T13:37:42.122 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/dec/ 2023-05-16T13:37:42.122 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/dec/tulip/ 2023-05-16T13:37:42.122 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 68953 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-05-16T13:37:42.123 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 60993 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-05-16T13:37:42.123 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 140721 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-05-16T13:37:42.123 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 51001 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-05-16T13:37:42.123 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 62361 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-05-16T13:37:42.123 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 30873 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-05-16T13:37:42.123 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/dlink/ 2023-05-16T13:37:42.123 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 60369 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-05-16T13:37:42.124 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 62393 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-05-16T13:37:42.124 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 45289 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/dnet.ko 2023-05-16T13:37:42.124 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24953 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/ec_bhf.ko 2023-05-16T13:37:42.124 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/emulex/ 2023-05-16T13:37:42.125 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/emulex/benet/ 2023-05-16T13:37:42.125 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 280937 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-05-16T13:37:42.125 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 49001 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/ethoc.ko 2023-05-16T13:37:42.125 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 51297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/fealnx.ko 2023-05-16T13:37:42.126 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/fujitsu/ 2023-05-16T13:37:42.126 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 44841 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-05-16T13:37:42.126 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/intel/ 2023-05-16T13:37:42.127 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 89969 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/intel/e100.ko 2023-05-16T13:37:42.127 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/intel/e1000/ 2023-05-16T13:37:42.127 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 295217 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-05-16T13:37:42.127 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/intel/e1000e/ 2023-05-16T13:37:42.128 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 583489 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-05-16T13:37:42.128 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/intel/fm10k/ 2023-05-16T13:37:42.128 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 245881 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-05-16T13:37:42.128 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/intel/i40e/ 2023-05-16T13:37:42.129 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 918521 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-05-16T13:37:42.129 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/intel/iavf/ 2023-05-16T13:37:42.129 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 301361 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-05-16T13:37:42.130 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/intel/igb/ 2023-05-16T13:37:42.130 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 513657 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-05-16T13:37:42.130 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/intel/igbvf/ 2023-05-16T13:37:42.131 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 92241 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-05-16T13:37:42.131 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/intel/ixgb/ 2023-05-16T13:37:42.131 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 124121 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/intel/ixgb/ixgb.ko 2023-05-16T13:37:42.132 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-05-16T13:37:42.132 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 733809 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-05-16T13:37:42.132 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-05-16T13:37:42.133 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 151361 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-05-16T13:37:42.133 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 86417 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/jme.ko 2023-05-16T13:37:42.133 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/marvell/ 2023-05-16T13:37:42.133 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20537 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-05-16T13:37:42.133 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 101889 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/marvell/skge.ko 2023-05-16T13:37:42.134 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 122185 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-05-16T13:37:42.134 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/mellanox/ 2023-05-16T13:37:42.134 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-05-16T13:37:42.135 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 709977 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-05-16T13:37:42.135 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 280081 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-05-16T13:37:42.135 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-05-16T13:37:42.136 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-05-16T13:37:42.136 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 1034761 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-05-16T13:37:42.136 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/micrel/ 2023-05-16T13:37:42.136 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 52545 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-05-16T13:37:42.136 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 39961 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-05-16T13:37:42.137 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19129 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-05-16T13:37:42.137 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 95169 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-05-16T13:37:42.137 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/myricom/ 2023-05-16T13:37:42.137 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-05-16T13:37:42.137 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 108305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-05-16T13:37:42.137 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/natsemi/ 2023-05-16T13:37:42.138 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 72945 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-05-16T13:37:42.138 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 47281 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-05-16T13:37:42.138 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/neterion/ 2023-05-16T13:37:42.138 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 150401 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-05-16T13:37:42.138 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/nvidia/ 2023-05-16T13:37:42.138 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 136281 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-05-16T13:37:42.138 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/packetengines/ 2023-05-16T13:37:42.139 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 49985 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-05-16T13:37:42.139 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 42649 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-05-16T13:37:42.139 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/qlogic/ 2023-05-16T13:37:42.139 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-05-16T13:37:42.139 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 227049 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-05-16T13:37:42.139 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 86585 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-05-16T13:37:42.139 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-05-16T13:37:42.140 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 671353 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-05-16T13:37:42.140 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/rdc/ 2023-05-16T13:37:42.140 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 42529 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-05-16T13:37:42.140 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/realtek/ 2023-05-16T13:37:42.140 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 66881 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-05-16T13:37:42.140 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 83481 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-05-16T13:37:42.141 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28833 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/realtek/atp.ko 2023-05-16T13:37:42.141 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 183041 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-05-16T13:37:42.141 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/samsung/ 2023-05-16T13:37:42.141 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-05-16T13:37:42.142 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 103713 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-05-16T13:37:42.142 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/sfc/ 2023-05-16T13:37:42.142 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 862657 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-05-16T13:37:42.142 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/silan/ 2023-05-16T13:37:42.142 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 46737 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-05-16T13:37:42.142 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/sis/ 2023-05-16T13:37:42.142 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 54305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/sis/sis190.ko 2023-05-16T13:37:42.143 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 62841 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/sis/sis900.ko 2023-05-16T13:37:42.143 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/smsc/ 2023-05-16T13:37:42.143 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 61041 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-05-16T13:37:42.143 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 66689 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-05-16T13:37:42.143 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 72905 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-05-16T13:37:42.143 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 67777 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-05-16T13:37:42.143 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/stmicro/ 2023-05-16T13:37:42.144 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-05-16T13:37:42.144 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12961 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-05-16T13:37:42.144 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 39641 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-05-16T13:37:42.144 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13457 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-05-16T13:37:42.144 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 474905 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-05-16T13:37:42.144 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/sun/ 2023-05-16T13:37:42.145 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 102945 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/sun/cassini.ko 2023-05-16T13:37:42.145 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 165841 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/sun/niu.ko 2023-05-16T13:37:42.145 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 65977 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/sun/sungem.ko 2023-05-16T13:37:42.145 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 83257 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-05-16T13:37:42.145 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/tehuti/ 2023-05-16T13:37:42.145 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 49577 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-05-16T13:37:42.145 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/ti/ 2023-05-16T13:37:42.146 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 86025 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/ti/tlan.ko 2023-05-16T13:37:42.146 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/via/ 2023-05-16T13:37:42.146 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 79761 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-05-16T13:37:42.146 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 83169 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-05-16T13:37:42.146 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/wiznet/ 2023-05-16T13:37:42.146 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 45289 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-05-16T13:37:42.146 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 30345 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-05-16T13:37:42.146 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/xircom/ 2023-05-16T13:37:42.147 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 59545 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-05-16T13:37:42.147 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/fddi/ 2023-05-16T13:37:42.147 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 40569 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/fddi/defxx.ko 2023-05-16T13:37:42.147 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/fddi/skfp/ 2023-05-16T13:37:42.147 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 216481 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/fddi/skfp/skfp.ko 2023-05-16T13:37:42.147 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 76673 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/geneve.ko 2023-05-16T13:37:42.147 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/hyperv/ 2023-05-16T13:37:42.148 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 234841 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-05-16T13:37:42.148 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ieee802154/ 2023-05-16T13:37:42.148 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17817 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ieee802154/fakelb.ko 2023-05-16T13:37:42.148 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24649 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ifb.ko 2023-05-16T13:37:42.148 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ipvlan/ 2023-05-16T13:37:42.148 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 82705 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ipvlan/ipvlan.ko 2023-05-16T13:37:42.149 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 60233 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/macvlan.ko 2023-05-16T13:37:42.149 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15521 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/macvtap.ko 2023-05-16T13:37:42.149 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/mdio/ 2023-05-16T13:37:42.149 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19377 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-05-16T13:37:42.149 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12993 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-05-16T13:37:42.149 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13257 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/mdio/mdio-gpio.ko 2023-05-16T13:37:42.149 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14729 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/mdio.ko 2023-05-16T13:37:42.150 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18905 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/mii.ko 2023-05-16T13:37:42.150 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 41265 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/netconsole.ko 2023-05-16T13:37:42.150 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12649 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/nlmon.ko 2023-05-16T13:37:42.150 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/pcs/ 2023-05-16T13:37:42.150 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9097 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/pcs/pcs-altera-tse.ko 2023-05-16T13:37:42.150 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29393 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-05-16T13:37:42.150 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/phy/ 2023-05-16T13:37:42.150 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9241 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/phy/amd.ko 2023-05-16T13:37:42.151 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 40009 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-05-16T13:37:42.151 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 44265 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/phy/bcm7xxx.ko 2023-05-16T13:37:42.151 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11033 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/phy/bcm87xx.ko 2023-05-16T13:37:42.151 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 37281 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/phy/broadcom.ko 2023-05-16T13:37:42.151 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10073 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/phy/cicada.ko 2023-05-16T13:37:42.151 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12409 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/phy/davicom.ko 2023-05-16T13:37:42.151 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8953 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/phy/et1011c.ko 2023-05-16T13:37:42.152 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24345 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/phy/icplus.ko 2023-05-16T13:37:42.152 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15225 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/phy/lxt.ko 2023-05-16T13:37:42.152 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 75673 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/phy/marvell.ko 2023-05-16T13:37:42.152 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 74585 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/phy/micrel.ko 2023-05-16T13:37:42.152 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11545 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/phy/national.ko 2023-05-16T13:37:42.152 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 91833 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/phy/phylink.ko 2023-05-16T13:37:42.153 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9505 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/phy/qsemi.ko 2023-05-16T13:37:42.153 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 46865 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/phy/realtek.ko 2023-05-16T13:37:42.153 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20585 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/phy/smsc.ko 2023-05-16T13:37:42.153 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/phy/ste10Xp.ko 2023-05-16T13:37:42.153 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23353 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/phy/vitesse.ko 2023-05-16T13:37:42.153 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/plip/ 2023-05-16T13:37:42.153 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 43073 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/plip/plip.ko 2023-05-16T13:37:42.154 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ppp/ 2023-05-16T13:37:42.154 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15433 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ppp/bsd_comp.ko 2023-05-16T13:37:42.154 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29425 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ppp/ppp_async.ko 2023-05-16T13:37:42.154 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17169 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ppp/ppp_deflate.ko 2023-05-16T13:37:42.154 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18193 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ppp/ppp_mppe.ko 2023-05-16T13:37:42.154 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28449 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ppp/ppp_synctty.ko 2023-05-16T13:37:42.154 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 42105 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ppp/pppoe.ko 2023-05-16T13:37:42.155 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12313 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ppp/pppox.ko 2023-05-16T13:37:42.155 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 31337 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ppp/pptp.ko 2023-05-16T13:37:42.155 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 27785 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/sb1000.ko 2023-05-16T13:37:42.155 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/slip/ 2023-05-16T13:37:42.155 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 42009 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/slip/slip.ko 2023-05-16T13:37:42.155 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26209 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/sungem_phy.ko 2023-05-16T13:37:42.155 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 63113 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/tap.ko 2023-05-16T13:37:42.156 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/team/ 2023-05-16T13:37:42.156 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 104289 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/team/team.ko 2023-05-16T13:37:42.156 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12985 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/team/team_mode_activebackup.ko 2023-05-16T13:37:42.156 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9721 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/team/team_mode_broadcast.ko 2023-05-16T13:37:42.156 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28497 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-05-16T13:37:42.156 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9209 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/team/team_mode_random.ko 2023-05-16T13:37:42.156 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8825 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-05-16T13:37:42.157 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 87345 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/veth.ko 2023-05-16T13:37:42.157 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/vmxnet3/ 2023-05-16T13:37:42.157 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 120049 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-05-16T13:37:42.157 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/vxlan/ 2023-05-16T13:37:42.157 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 238977 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/vxlan/vxlan.ko 2023-05-16T13:37:42.157 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/xen-netback/ 2023-05-16T13:37:42.157 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 143305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/xen-netback/xen-netback.ko 2023-05-16T13:37:42.157 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ntb/ 2023-05-16T13:37:42.158 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19105 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ntb/ntb.ko 2023-05-16T13:37:42.158 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/nvme/ 2023-05-16T13:37:42.158 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/nvme/host/ 2023-05-16T13:37:42.158 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 257665 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/nvme/host/nvme-core.ko 2023-05-16T13:37:42.158 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 101393 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/nvme/host/nvme.ko 2023-05-16T13:37:42.158 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/parport/ 2023-05-16T13:37:42.158 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 128697 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/parport/parport.ko 2023-05-16T13:37:42.159 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14121 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/parport/parport_cs.ko 2023-05-16T13:37:42.159 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 83385 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/parport/parport_pc.ko 2023-05-16T13:37:42.159 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25625 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/parport/parport_serial.ko 2023-05-16T13:37:42.159 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/pci/ 2023-05-16T13:37:42.159 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/pci/hotplug/ 2023-05-16T13:37:42.159 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24505 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-05-16T13:37:42.159 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17361 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-05-16T13:37:42.160 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19633 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-05-16T13:37:42.160 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11361 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/pci/pci-stub.ko 2023-05-16T13:37:42.160 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 46945 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/pci/xen-pcifront.ko 2023-05-16T13:37:42.160 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/pcmcia/ 2023-05-16T13:37:42.160 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/pcmcia/i82092.ko 2023-05-16T13:37:42.160 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 143273 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/pcmcia/pcmcia.ko 2023-05-16T13:37:42.160 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 60265 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/pcmcia/pcmcia_core.ko 2023-05-16T13:37:42.161 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 33441 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-05-16T13:37:42.161 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 33761 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/pcmcia/pd6729.ko 2023-05-16T13:37:42.161 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 112481 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/pcmcia/yenta_socket.ko 2023-05-16T13:37:42.161 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/phy/ 2023-05-16T13:37:42.161 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/phy/broadcom/ 2023-05-16T13:37:42.161 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10353 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-05-16T13:37:42.161 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/phy/samsung/ 2023-05-16T13:37:42.161 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7953 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-05-16T13:37:42.162 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/pinctrl/ 2023-05-16T13:37:42.162 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/pinctrl/intel/ 2023-05-16T13:37:42.162 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 70569 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-05-16T13:37:42.162 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/ 2023-05-16T13:37:42.162 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/chrome/ 2023-05-16T13:37:42.162 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 49257 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-05-16T13:37:42.162 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19737 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/chrome/cros_ec.ko 2023-05-16T13:37:42.163 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20913 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-05-16T13:37:42.163 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24481 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-05-16T13:37:42.163 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25729 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-05-16T13:37:42.163 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17769 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-05-16T13:37:42.163 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16601 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-05-16T13:37:42.163 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/ 2023-05-16T13:37:42.163 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 66617 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/acer-wmi.ko 2023-05-16T13:37:42.164 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 39857 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/acerhdf.ko 2023-05-16T13:37:42.164 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25993 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/apple-gmux.ko 2023-05-16T13:37:42.164 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 59225 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/asus-laptop.ko 2023-05-16T13:37:42.164 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 30209 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-05-16T13:37:42.164 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 105897 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/asus-wmi.ko 2023-05-16T13:37:42.164 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 36425 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/classmate-laptop.ko 2023-05-16T13:37:42.164 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 48625 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-05-16T13:37:42.165 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13521 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-05-16T13:37:42.165 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 39769 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-05-16T13:37:42.165 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22097 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-05-16T13:37:42.165 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 36153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/hdaps.ko 2023-05-16T13:37:42.165 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18769 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/ibm_rtl.ko 2023-05-16T13:37:42.165 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/intel/ 2023-05-16T13:37:42.165 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11585 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-05-16T13:37:42.166 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8553 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-05-16T13:37:42.166 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 42849 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/intel_ips.ko 2023-05-16T13:37:42.166 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19769 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/msi-wmi.ko 2023-05-16T13:37:42.166 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9425 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/mxm-wmi.ko 2023-05-16T13:37:42.166 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 34297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-05-16T13:37:42.166 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 41825 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/samsung-laptop.ko 2023-05-16T13:37:42.166 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13673 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/samsung-q10.ko 2023-05-16T13:37:42.167 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16817 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/topstar-laptop.ko 2023-05-16T13:37:42.167 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13225 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-05-16T13:37:42.167 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16577 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/toshiba_haps.ko 2023-05-16T13:37:42.167 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9729 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/wmi-bmof.ko 2023-05-16T13:37:42.167 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 54449 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/wmi.ko 2023-05-16T13:37:42.167 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/ 2023-05-16T13:37:42.167 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/ 2023-05-16T13:37:42.167 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29841 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/88pm860x_battery.ko 2023-05-16T13:37:42.168 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 33553 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/88pm860x_charger.ko 2023-05-16T13:37:42.168 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 54625 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/bq2415x_charger.ko 2023-05-16T13:37:42.168 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 53529 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/bq24190_charger.ko 2023-05-16T13:37:42.168 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21033 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/bq24735-charger.ko 2023-05-16T13:37:42.168 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16009 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-05-16T13:37:42.168 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19105 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/da9030_battery.ko 2023-05-16T13:37:42.168 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19345 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/da9052-battery.ko 2023-05-16T13:37:42.169 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28849 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/ds2760_battery.ko 2023-05-16T13:37:42.169 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22777 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/ds2780_battery.ko 2023-05-16T13:37:42.169 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22921 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/ds2781_battery.ko 2023-05-16T13:37:42.169 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/ds2782_battery.ko 2023-05-16T13:37:42.169 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19857 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/gpio-charger.ko 2023-05-16T13:37:42.169 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17553 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/isp1704_charger.ko 2023-05-16T13:37:42.169 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19777 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/lp8727_charger.ko 2023-05-16T13:37:42.170 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/max14577_charger.ko 2023-05-16T13:37:42.170 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25433 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/max17040_battery.ko 2023-05-16T13:37:42.170 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 30009 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/max17042_battery.ko 2023-05-16T13:37:42.170 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18097 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/max8903_charger.ko 2023-05-16T13:37:42.170 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/max8925_power.ko 2023-05-16T13:37:42.170 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20737 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/pcf50633-charger.ko 2023-05-16T13:37:42.170 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 37481 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/sbs-battery.ko 2023-05-16T13:37:42.170 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 27889 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/test_power.ko 2023-05-16T13:37:42.171 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18369 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/tps65090-charger.ko 2023-05-16T13:37:42.171 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11545 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/wm831x_backup.ko 2023-05-16T13:37:42.171 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24025 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/wm831x_power.ko 2023-05-16T13:37:42.171 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21913 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/wm8350_power.ko 2023-05-16T13:37:42.171 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/powercap/ 2023-05-16T13:37:42.171 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 53721 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/powercap/intel_rapl_common.ko 2023-05-16T13:37:42.171 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16873 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/powercap/intel_rapl_msr.ko 2023-05-16T13:37:42.172 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/pps/ 2023-05-16T13:37:42.172 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/pps/clients/ 2023-05-16T13:37:42.172 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15033 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/pps/clients/pps-gpio.ko 2023-05-16T13:37:42.172 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12761 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/pps/clients/pps-ldisc.ko 2023-05-16T13:37:42.172 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15425 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/pps/clients/pps_parport.ko 2023-05-16T13:37:42.172 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 41033 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/pps/pps_core.ko 2023-05-16T13:37:42.173 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ptp/ 2023-05-16T13:37:42.173 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 64265 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ptp/ptp.ko 2023-05-16T13:37:42.173 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15761 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ptp/ptp_kvm.ko 2023-05-16T13:37:42.173 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/ 2023-05-16T13:37:42.173 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22953 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-88pm80x.ko 2023-05-16T13:37:42.173 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24137 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-88pm860x.ko 2023-05-16T13:37:42.173 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14953 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-bq32k.ko 2023-05-16T13:37:42.174 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12465 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-bq4802.ko 2023-05-16T13:37:42.174 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19673 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-da9052.ko 2023-05-16T13:37:42.174 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18073 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-da9055.ko 2023-05-16T13:37:42.174 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19745 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-da9063.ko 2023-05-16T13:37:42.174 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16017 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-ds1286.ko 2023-05-16T13:37:42.174 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 68081 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-ds1307.ko 2023-05-16T13:37:42.174 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20385 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-ds1374.ko 2023-05-16T13:37:42.174 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17721 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-ds1511.ko 2023-05-16T13:37:42.175 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16241 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-ds1553.ko 2023-05-16T13:37:42.175 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13513 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-ds1672.ko 2023-05-16T13:37:42.175 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12945 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-ds1742.ko 2023-05-16T13:37:42.175 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16785 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-ds2404.ko 2023-05-16T13:37:42.175 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23209 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-ds3232.ko 2023-05-16T13:37:42.175 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10593 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-em3027.ko 2023-05-16T13:37:42.175 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23897 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-fm3130.ko 2023-05-16T13:37:42.176 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17273 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-isl12022.ko 2023-05-16T13:37:42.176 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 34769 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-isl1208.ko 2023-05-16T13:37:42.176 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14241 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-lp8788.ko 2023-05-16T13:37:42.176 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 37657 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-m41t80.ko 2023-05-16T13:37:42.176 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11601 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-m48t35.ko 2023-05-16T13:37:42.176 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25441 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-m48t59.ko 2023-05-16T13:37:42.176 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13745 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-m48t86.ko 2023-05-16T13:37:42.177 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11145 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-max6900.ko 2023-05-16T13:37:42.177 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14233 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-max8907.ko 2023-05-16T13:37:42.177 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14905 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-max8925.ko 2023-05-16T13:37:42.177 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25313 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-max8997.ko 2023-05-16T13:37:42.177 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16249 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-max8998.ko 2023-05-16T13:37:42.177 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18025 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-05-16T13:37:42.177 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10969 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-msm6242.ko 2023-05-16T13:37:42.178 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19193 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-palmas.ko 2023-05-16T13:37:42.178 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 39625 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-pcf2127.ko 2023-05-16T13:37:42.178 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17545 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-pcf50633.ko 2023-05-16T13:37:42.178 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26313 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-pcf85063.ko 2023-05-16T13:37:42.178 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21393 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-pcf8523.ko 2023-05-16T13:37:42.178 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29385 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-pcf8563.ko 2023-05-16T13:37:42.178 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12001 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-pcf8583.ko 2023-05-16T13:37:42.178 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17529 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-rc5t583.ko 2023-05-16T13:37:42.179 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12625 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-rp5c01.ko 2023-05-16T13:37:42.179 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 33313 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-rs5c372.ko 2023-05-16T13:37:42.179 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 27329 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-05-16T13:37:42.179 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24833 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-rx8025.ko 2023-05-16T13:37:42.179 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19609 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-rx8581.ko 2023-05-16T13:37:42.179 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21177 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-s35390a.ko 2023-05-16T13:37:42.180 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16337 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-05-16T13:37:42.180 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17393 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-tps6586x.ko 2023-05-16T13:37:42.180 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21105 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-tps65910.ko 2023-05-16T13:37:42.180 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20049 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-wm831x.ko 2023-05-16T13:37:42.180 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20849 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-wm8350.ko 2023-05-16T13:37:42.180 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 27377 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-x1205.ko 2023-05-16T13:37:42.180 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/ 2023-05-16T13:37:42.180 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 77209 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/3w-9xxx.ko 2023-05-16T13:37:42.181 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 57169 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/3w-sas.ko 2023-05-16T13:37:42.181 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 54681 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/3w-xxxx.ko 2023-05-16T13:37:42.181 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 134673 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/BusLogic.ko 2023-05-16T13:37:42.181 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26001 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/a100u2w.ko 2023-05-16T13:37:42.181 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/aacraid/ 2023-05-16T13:37:42.181 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 271161 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/aacraid/aacraid.ko 2023-05-16T13:37:42.181 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 100129 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/advansys.ko 2023-05-16T13:37:42.182 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/aic7xxx/ 2023-05-16T13:37:42.182 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 355761 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-05-16T13:37:42.182 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 295313 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-05-16T13:37:42.182 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/aic94xx/ 2023-05-16T13:37:42.182 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 188825 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-05-16T13:37:42.182 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23569 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/am53c974.ko 2023-05-16T13:37:42.182 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/arcmsr/ 2023-05-16T13:37:42.183 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 106065 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-05-16T13:37:42.183 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 37617 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/atp870u.ko 2023-05-16T13:37:42.183 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/be2iscsi/ 2023-05-16T13:37:42.183 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 246913 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-05-16T13:37:42.183 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/bfa/ 2023-05-16T13:37:42.183 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 1172201 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/bfa/bfa.ko 2023-05-16T13:37:42.183 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/bnx2fc/ 2023-05-16T13:37:42.184 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 236737 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-05-16T13:37:42.184 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/bnx2i/ 2023-05-16T13:37:42.184 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 114969 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-05-16T13:37:42.184 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 40193 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/ch.ko 2023-05-16T13:37:42.184 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/csiostor/ 2023-05-16T13:37:42.184 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 308401 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/csiostor/csiostor.ko 2023-05-16T13:37:42.184 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/cxgbi/ 2023-05-16T13:37:42.185 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-05-16T13:37:42.185 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 75689 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-05-16T13:37:42.185 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-05-16T13:37:42.185 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 101017 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-05-16T13:37:42.185 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 141417 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-05-16T13:37:42.185 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 75105 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/dc395x.ko 2023-05-16T13:37:42.185 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 37553 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/dmx3191d.ko 2023-05-16T13:37:42.186 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/esas2r/ 2023-05-16T13:37:42.186 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 211977 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/esas2r/esas2r.ko 2023-05-16T13:37:42.186 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 59441 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/esp_scsi.ko 2023-05-16T13:37:42.186 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/fcoe/ 2023-05-16T13:37:42.186 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 77713 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/fcoe/fcoe.ko 2023-05-16T13:37:42.186 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 154601 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-05-16T13:37:42.186 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18233 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/fdomain.ko 2023-05-16T13:37:42.187 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/fnic/ 2023-05-16T13:37:42.187 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 262025 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/fnic/fnic.ko 2023-05-16T13:37:42.187 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 201305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/hpsa.ko 2023-05-16T13:37:42.187 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 50657 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/hptiop.ko 2023-05-16T13:37:42.187 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 48721 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/hv_storvsc.ko 2023-05-16T13:37:42.187 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 34881 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/imm.ko 2023-05-16T13:37:42.187 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 43561 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/initio.ko 2023-05-16T13:37:42.188 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 285985 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/ipr.ko 2023-05-16T13:37:42.188 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 101449 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/ips.ko 2023-05-16T13:37:42.188 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/isci/ 2023-05-16T13:37:42.188 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 316817 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/isci/isci.ko 2023-05-16T13:37:42.188 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25025 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-05-16T13:37:42.188 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 52201 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/iscsi_tcp.ko 2023-05-16T13:37:42.188 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/libfc/ 2023-05-16T13:37:42.189 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 307873 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/libfc/libfc.ko 2023-05-16T13:37:42.189 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 139737 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/libiscsi.ko 2023-05-16T13:37:42.189 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 51257 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/libiscsi_tcp.ko 2023-05-16T13:37:42.189 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/libsas/ 2023-05-16T13:37:42.189 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 212217 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/libsas/libsas.ko 2023-05-16T13:37:42.189 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/lpfc/ 2023-05-16T13:37:42.189 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 2194601 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/lpfc/lpfc.ko 2023-05-16T13:37:42.189 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/megaraid/ 2023-05-16T13:37:42.190 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 73113 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-05-16T13:37:42.190 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 32593 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-05-16T13:37:42.190 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 310241 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-05-16T13:37:42.190 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 84289 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/megaraid.ko 2023-05-16T13:37:42.190 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/mpt3sas/ 2023-05-16T13:37:42.190 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 659569 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-05-16T13:37:42.190 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/mvsas/ 2023-05-16T13:37:42.191 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 119425 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/mvsas/mvsas.ko 2023-05-16T13:37:42.191 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 77665 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/mvumi.ko 2023-05-16T13:37:42.191 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/pcmcia/ 2023-05-16T13:37:42.191 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 81113 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-05-16T13:37:42.191 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11281 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-05-16T13:37:42.191 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20369 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-05-16T13:37:42.191 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23361 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-05-16T13:37:42.191 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/pm8001/ 2023-05-16T13:37:42.192 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 360881 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-05-16T13:37:42.192 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 123073 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/pmcraid.ko 2023-05-16T13:37:42.192 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 33177 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/ppa.ko 2023-05-16T13:37:42.192 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 54841 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/qla1280.ko 2023-05-16T13:37:42.192 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/qla2xxx/ 2023-05-16T13:37:42.192 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 1850553 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-05-16T13:37:42.193 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 85353 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-05-16T13:37:42.193 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/qla4xxx/ 2023-05-16T13:37:42.193 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 558737 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-05-16T13:37:42.193 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17393 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/qlogicfas408.ko 2023-05-16T13:37:42.193 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18073 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/raid_class.ko 2023-05-16T13:37:42.193 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 242441 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/scsi_debug.ko 2023-05-16T13:37:42.193 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 171561 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/scsi_transport_fc.ko 2023-05-16T13:37:42.193 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 270153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-05-16T13:37:42.194 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 94049 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/scsi_transport_sas.ko 2023-05-16T13:37:42.194 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 72321 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/scsi_transport_spi.ko 2023-05-16T13:37:42.194 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 43169 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/scsi_transport_srp.ko 2023-05-16T13:37:42.194 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25761 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/ses.ko 2023-05-16T13:37:42.194 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 115409 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/st.ko 2023-05-16T13:37:42.194 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 46329 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/stex.ko 2023-05-16T13:37:42.194 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/sym53c8xx_2/ 2023-05-16T13:37:42.195 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 161697 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-05-16T13:37:42.195 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 41793 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/virtio_scsi.ko 2023-05-16T13:37:42.195 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 49873 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/vmw_pvscsi.ko 2023-05-16T13:37:42.195 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 39513 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/wd719x.ko 2023-05-16T13:37:42.195 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 49529 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/xen-scsifront.ko 2023-05-16T13:37:42.195 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ssb/ 2023-05-16T13:37:42.195 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 126593 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ssb/ssb.ko 2023-05-16T13:37:42.196 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/target/ 2023-05-16T13:37:42.196 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/target/iscsi/ 2023-05-16T13:37:42.196 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 730161 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-05-16T13:37:42.196 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/target/loopback/ 2023-05-16T13:37:42.196 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 50857 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/target/loopback/tcm_loop.ko 2023-05-16T13:37:42.196 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 39145 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/target/target_core_file.ko 2023-05-16T13:37:42.196 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 37961 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/target/target_core_iblock.ko 2023-05-16T13:37:42.197 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 913305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/target/target_core_mod.ko 2023-05-16T13:37:42.197 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 43833 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/target/target_core_pscsi.ko 2023-05-16T13:37:42.197 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 121793 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/target/target_core_user.ko 2023-05-16T13:37:42.197 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/target/tcm_fc/ 2023-05-16T13:37:42.197 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 75905 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-05-16T13:37:42.197 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/thermal/ 2023-05-16T13:37:42.197 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/thermal/intel/ 2023-05-16T13:37:42.198 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/thermal/intel/int340x_thermal/ 2023-05-16T13:37:42.198 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18609 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-05-16T13:37:42.198 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28377 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-05-16T13:37:42.198 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9521 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-05-16T13:37:42.198 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9761 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-05-16T13:37:42.198 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14585 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-05-16T13:37:42.198 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15345 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-05-16T13:37:42.199 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25657 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-05-16T13:37:42.199 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19681 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-05-16T13:37:42.199 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14425 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-05-16T13:37:42.199 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-05-16T13:37:42.199 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12097 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-05-16T13:37:42.199 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 27369 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-05-16T13:37:42.199 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21745 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/thermal/intel/intel_menlow.ko 2023-05-16T13:37:42.200 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 30193 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-05-16T13:37:42.200 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20321 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-05-16T13:37:42.200 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11497 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-05-16T13:37:42.200 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25825 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-05-16T13:37:42.200 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/tty/ 2023-05-16T13:37:42.200 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/tty/ipwireless/ 2023-05-16T13:37:42.200 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 77649 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-05-16T13:37:42.201 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 57377 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/tty/moxa.ko 2023-05-16T13:37:42.201 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 50361 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/tty/mxser.ko 2023-05-16T13:37:42.201 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 104345 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/tty/n_gsm.ko 2023-05-16T13:37:42.201 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 31513 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/tty/n_hdlc.ko 2023-05-16T13:37:42.201 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 67641 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/tty/nozomi.ko 2023-05-16T13:37:42.201 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/tty/serial/ 2023-05-16T13:37:42.201 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/tty/serial/8250/ 2023-05-16T13:37:42.202 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 35105 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-05-16T13:37:42.202 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 59065 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-05-16T13:37:42.202 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17785 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-05-16T13:37:42.202 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21961 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/tty/serial/altera_uart.ko 2023-05-16T13:37:42.202 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9001 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/tty/serial/arc_uart.ko 2023-05-16T13:37:42.202 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 69793 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-05-16T13:37:42.202 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/tty/serial/jsm/ 2023-05-16T13:37:42.202 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 102521 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/tty/serial/jsm/jsm.ko 2023-05-16T13:37:42.203 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28353 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/tty/serial/rp2.ko 2023-05-16T13:37:42.203 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 51705 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/tty/serial/sc16is7xx.ko 2023-05-16T13:37:42.203 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 99985 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/tty/synclink_gt.ko 2023-05-16T13:37:42.203 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ufs/ 2023-05-16T13:37:42.203 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ufs/core/ 2023-05-16T13:37:42.203 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 518025 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ufs/core/ufshcd-core.ko 2023-05-16T13:37:42.203 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ufs/host/ 2023-05-16T13:37:42.204 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 27969 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-05-16T13:37:42.204 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14121 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-05-16T13:37:42.204 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/uio/ 2023-05-16T13:37:42.204 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 43353 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/uio/uio.ko 2023-05-16T13:37:42.204 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11809 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/uio/uio_aec.ko 2023-05-16T13:37:42.204 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10785 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/uio/uio_cif.ko 2023-05-16T13:37:42.204 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17809 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/uio/uio_dmem_genirq.ko 2023-05-16T13:37:42.205 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12505 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/uio/uio_mf624.ko 2023-05-16T13:37:42.205 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11681 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/uio/uio_netx.ko 2023-05-16T13:37:42.205 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10177 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/uio/uio_pci_generic.ko 2023-05-16T13:37:42.205 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15529 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-05-16T13:37:42.205 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13209 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/uio/uio_sercos3.ko 2023-05-16T13:37:42.205 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/ 2023-05-16T13:37:42.205 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/c67x00/ 2023-05-16T13:37:42.206 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 72777 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/c67x00/c67x00.ko 2023-05-16T13:37:42.206 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/chipidea/ 2023-05-16T13:37:42.206 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 144897 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-05-16T13:37:42.206 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18001 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-05-16T13:37:42.206 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12209 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-05-16T13:37:42.206 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12513 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-05-16T13:37:42.206 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/class/ 2023-05-16T13:37:42.207 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 85025 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/class/cdc-acm.ko 2023-05-16T13:37:42.207 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 50681 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/class/cdc-wdm.ko 2023-05-16T13:37:42.207 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 46969 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/class/usblp.ko 2023-05-16T13:37:42.207 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 89409 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/class/usbtmc.ko 2023-05-16T13:37:42.207 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/common/ 2023-05-16T13:37:42.207 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21825 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/common/ulpi.ko 2023-05-16T13:37:42.207 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/dwc2/ 2023-05-16T13:37:42.208 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11385 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-05-16T13:37:42.208 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/dwc3/ 2023-05-16T13:37:42.208 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11657 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-05-16T13:37:42.208 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29433 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-05-16T13:37:42.208 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 433729 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/dwc3/dwc3.ko 2023-05-16T13:37:42.208 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/ 2023-05-16T13:37:42.208 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/function/ 2023-05-16T13:37:42.209 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 54585 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/function/u_ether.ko 2023-05-16T13:37:42.209 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 49873 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/function/u_serial.ko 2023-05-16T13:37:42.209 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28609 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-05-16T13:37:42.209 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 40209 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-05-16T13:37:42.209 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 27657 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-05-16T13:37:42.209 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 36145 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-05-16T13:37:42.209 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 90825 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-05-16T13:37:42.210 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 50657 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-05-16T13:37:42.210 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 117593 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-05-16T13:37:42.210 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 57425 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-05-16T13:37:42.210 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21913 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-05-16T13:37:42.210 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 30761 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-05-16T13:37:42.210 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 57521 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-05-16T13:37:42.210 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 83697 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-05-16T13:37:42.210 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19017 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-05-16T13:37:42.211 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 58001 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-05-16T13:37:42.211 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 67913 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-05-16T13:37:42.211 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/legacy/ 2023-05-16T13:37:42.211 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20761 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-05-16T13:37:42.211 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17625 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-05-16T13:37:42.211 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18041 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-05-16T13:37:42.212 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-05-16T13:37:42.212 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 27969 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-05-16T13:37:42.212 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18489 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-05-16T13:37:42.212 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19913 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-05-16T13:37:42.212 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16537 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-05-16T13:37:42.212 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 31641 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-05-16T13:37:42.212 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16289 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-05-16T13:37:42.213 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18961 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-05-16T13:37:42.213 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26697 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-05-16T13:37:42.213 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 61665 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-05-16T13:37:42.213 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14713 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-05-16T13:37:42.213 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 154617 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/libcomposite.ko 2023-05-16T13:37:42.213 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/udc/ 2023-05-16T13:37:42.213 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16641 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-05-16T13:37:42.213 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/udc/bdc/ 2023-05-16T13:37:42.214 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 157161 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-05-16T13:37:42.214 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 35569 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-05-16T13:37:42.214 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 52441 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-05-16T13:37:42.214 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 69193 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-05-16T13:37:42.214 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 55473 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-05-16T13:37:42.214 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 75545 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/udc/net2272.ko 2023-05-16T13:37:42.214 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 74529 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/udc/net2280.ko 2023-05-16T13:37:42.215 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 72745 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-05-16T13:37:42.215 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 65297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-05-16T13:37:42.215 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 65585 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-05-16T13:37:42.215 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 79913 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-05-16T13:37:42.215 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 139729 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-05-16T13:37:42.215 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/host/ 2023-05-16T13:37:42.215 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11089 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/host/bcma-hcd.ko 2023-05-16T13:37:42.216 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 79529 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/host/isp116x-hcd.ko 2023-05-16T13:37:42.216 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 87185 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-05-16T13:37:42.216 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 78425 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-05-16T13:37:42.216 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 50649 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/host/sl811-hcd.ko 2023-05-16T13:37:42.216 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15169 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/host/sl811_cs.ko 2023-05-16T13:37:42.216 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12817 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/host/ssb-hcd.ko 2023-05-16T13:37:42.216 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 92241 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/host/u132-hcd.ko 2023-05-16T13:37:42.217 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24377 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-05-16T13:37:42.217 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/image/ 2023-05-16T13:37:42.217 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 34097 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/image/mdc800.ko 2023-05-16T13:37:42.217 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20545 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/image/microtek.ko 2023-05-16T13:37:42.217 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/ 2023-05-16T13:37:42.217 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 41345 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/adutux.ko 2023-05-16T13:37:42.217 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20281 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/appledisplay.ko 2023-05-16T13:37:42.217 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17289 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-05-16T13:37:42.218 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22609 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/cytherm.ko 2023-05-16T13:37:42.218 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/ehset.ko 2023-05-16T13:37:42.218 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14625 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/emi26.ko 2023-05-16T13:37:42.218 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15561 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/emi62.ko 2023-05-16T13:37:42.218 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10545 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/ezusb.ko 2023-05-16T13:37:42.218 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 73217 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/ftdi-elan.ko 2023-05-16T13:37:42.218 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18793 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/idmouse.ko 2023-05-16T13:37:42.219 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 36121 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/iowarrior.ko 2023-05-16T13:37:42.219 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11097 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/isight_firmware.ko 2023-05-16T13:37:42.219 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 36065 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/ldusb.ko 2023-05-16T13:37:42.219 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 35745 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/legousbtower.ko 2023-05-16T13:37:42.219 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 27353 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/lvstest.ko 2023-05-16T13:37:42.219 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/sisusbvga/ 2023-05-16T13:37:42.219 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 64033 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-05-16T13:37:42.220 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12441 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/trancevibrator.ko 2023-05-16T13:37:42.220 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19905 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/usb3503.ko 2023-05-16T13:37:42.220 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24721 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/usblcd.ko 2023-05-16T13:37:42.220 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22249 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/usbsevseg.ko 2023-05-16T13:37:42.220 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 70313 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/usbtest.ko 2023-05-16T13:37:42.220 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 41457 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/uss720.ko 2023-05-16T13:37:42.220 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 27193 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/yurex.ko 2023-05-16T13:37:42.221 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/mon/ 2023-05-16T13:37:42.221 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 72321 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/mon/usbmon.ko 2023-05-16T13:37:42.221 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/musb/ 2023-05-16T13:37:42.221 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 294641 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/musb/musb_hdrc.ko 2023-05-16T13:37:42.221 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/phy/ 2023-05-16T13:37:42.221 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19961 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/phy/phy-generic.ko 2023-05-16T13:37:42.221 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19745 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-05-16T13:37:42.222 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11529 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/phy/phy-isp1301.ko 2023-05-16T13:37:42.222 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/phy/phy-tahvo.ko 2023-05-16T13:37:42.222 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/ 2023-05-16T13:37:42.222 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12817 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/aircable.ko 2023-05-16T13:37:42.222 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 32929 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/ark3116.ko 2023-05-16T13:37:42.222 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26049 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/belkin_sa.ko 2023-05-16T13:37:42.222 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 37761 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/ch341.ko 2023-05-16T13:37:42.223 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 69601 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/cp210x.ko 2023-05-16T13:37:42.223 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 30737 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/cyberjack.ko 2023-05-16T13:37:42.223 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 57497 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/cypress_m8.ko 2023-05-16T13:37:42.223 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 49257 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/digi_acceleport.ko 2023-05-16T13:37:42.223 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9121 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/empeg.ko 2023-05-16T13:37:42.223 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 43457 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/f81232.ko 2023-05-16T13:37:42.223 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 174409 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/ftdi_sio.ko 2023-05-16T13:37:42.223 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 52273 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/garmin_gps.ko 2023-05-16T13:37:42.224 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 136441 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/io_edgeport.ko 2023-05-16T13:37:42.224 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 123961 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/io_ti.ko 2023-05-16T13:37:42.224 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 67329 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/ipaq.ko 2023-05-16T13:37:42.224 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18657 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/ipw.ko 2023-05-16T13:37:42.224 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26169 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/ir-usb.ko 2023-05-16T13:37:42.224 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 57505 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-05-16T13:37:42.224 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 106985 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/keyspan.ko 2023-05-16T13:37:42.225 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 34833 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/keyspan_pda.ko 2023-05-16T13:37:42.225 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25009 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/kl5kusb105.ko 2023-05-16T13:37:42.225 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 33025 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/kobil_sct.ko 2023-05-16T13:37:42.225 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 32553 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/mct_u232.ko 2023-05-16T13:37:42.225 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21497 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/metro-usb.ko 2023-05-16T13:37:42.225 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 65801 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/mos7720.ko 2023-05-16T13:37:42.225 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 77673 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/mos7840.ko 2023-05-16T13:37:42.226 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 55569 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/mxuport.ko 2023-05-16T13:37:42.226 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13337 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/navman.ko 2023-05-16T13:37:42.226 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11121 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/omninet.ko 2023-05-16T13:37:42.226 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23785 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/opticon.ko 2023-05-16T13:37:42.226 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 187217 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/option.ko 2023-05-16T13:37:42.226 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 38409 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/oti6858.ko 2023-05-16T13:37:42.226 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 53633 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/pl2303.ko 2023-05-16T13:37:42.227 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/qcaux.ko 2023-05-16T13:37:42.227 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 37393 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/qcserial.ko 2023-05-16T13:37:42.227 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 33993 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/quatech2.ko 2023-05-16T13:37:42.227 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14313 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/safe_serial.ko 2023-05-16T13:37:42.227 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 50865 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/sierra.ko 2023-05-16T13:37:42.227 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21241 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/spcp8x5.ko 2023-05-16T13:37:42.227 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29417 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/ssu100.ko 2023-05-16T13:37:42.228 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16417 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/symbolserial.ko 2023-05-16T13:37:42.228 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 60513 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-05-16T13:37:42.228 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22241 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-05-16T13:37:42.228 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9817 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/usb_debug.ko 2023-05-16T13:37:42.228 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 31561 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/usb_wwan.ko 2023-05-16T13:37:42.228 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 122417 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/usbserial.ko 2023-05-16T13:37:42.228 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28257 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/visor.ko 2023-05-16T13:37:42.229 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 36905 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/whiteheat.ko 2023-05-16T13:37:42.229 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10033 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/wishbone-serial.ko 2023-05-16T13:37:42.229 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8857 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/xsens_mt.ko 2023-05-16T13:37:42.229 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/storage/ 2023-05-16T13:37:42.229 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 52345 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/storage/uas.ko 2023-05-16T13:37:42.229 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25657 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/storage/ums-alauda.ko 2023-05-16T13:37:42.229 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12553 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/storage/ums-cypress.ko 2023-05-16T13:37:42.229 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21561 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/storage/ums-datafab.ko 2023-05-16T13:37:42.230 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 33057 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-05-16T13:37:42.230 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13313 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/storage/ums-freecom.ko 2023-05-16T13:37:42.230 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19345 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/storage/ums-isd200.ko 2023-05-16T13:37:42.230 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18873 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-05-16T13:37:42.230 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13217 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/storage/ums-karma.ko 2023-05-16T13:37:42.230 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17409 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/storage/ums-onetouch.ko 2023-05-16T13:37:42.230 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28001 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/storage/ums-realtek.ko 2023-05-16T13:37:42.231 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28473 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/storage/ums-sddr09.ko 2023-05-16T13:37:42.231 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19097 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/storage/ums-sddr55.ko 2023-05-16T13:37:42.231 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 34913 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/storage/ums-usbat.ko 2023-05-16T13:37:42.231 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 176329 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/storage/usb-storage.ko 2023-05-16T13:37:42.231 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/usbip/ 2023-05-16T13:37:42.231 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 65265 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/usbip/usbip-core.ko 2023-05-16T13:37:42.231 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 71009 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/usbip/usbip-host.ko 2023-05-16T13:37:42.232 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 104905 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-05-16T13:37:42.232 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/vfio/ 2023-05-16T13:37:42.232 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/vfio/pci/ 2023-05-16T13:37:42.232 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 145057 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-05-16T13:37:42.232 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29041 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/vfio/pci/vfio-pci.ko 2023-05-16T13:37:42.232 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 97561 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/vfio/vfio.ko 2023-05-16T13:37:42.232 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 71257 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-05-16T13:37:42.233 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/vhost/ 2023-05-16T13:37:42.233 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 98209 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/vhost/vhost.ko 2023-05-16T13:37:42.233 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15369 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/vhost/vhost_iotlb.ko 2023-05-16T13:37:42.233 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 57665 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/vhost/vhost_net.ko 2023-05-16T13:37:42.233 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 86785 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/vhost/vhost_scsi.ko 2023-05-16T13:37:42.233 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/video/ 2023-05-16T13:37:42.233 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/video/backlight/ 2023-05-16T13:37:42.234 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14977 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-05-16T13:37:42.234 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11889 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/video/backlight/aat2870_bl.ko 2023-05-16T13:37:42.234 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22881 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/video/backlight/adp5520_bl.ko 2023-05-16T13:37:42.234 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 32113 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/video/backlight/adp8860_bl.ko 2023-05-16T13:37:42.234 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 39553 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/video/backlight/adp8870_bl.ko 2023-05-16T13:37:42.234 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17881 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/video/backlight/apple_bl.ko 2023-05-16T13:37:42.234 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16281 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/video/backlight/as3711_bl.ko 2023-05-16T13:37:42.235 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11593 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/video/backlight/bd6107.ko 2023-05-16T13:37:42.235 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10977 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/video/backlight/da903x_bl.ko 2023-05-16T13:37:42.235 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10785 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/video/backlight/da9052_bl.ko 2023-05-16T13:37:42.235 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11449 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/video/backlight/gpio_backlight.ko 2023-05-16T13:37:42.235 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14337 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/video/backlight/kb3886_bl.ko 2023-05-16T13:37:42.235 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21041 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/video/backlight/lcd.ko 2023-05-16T13:37:42.235 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/video/backlight/lm3533_bl.ko 2023-05-16T13:37:42.236 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18841 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/video/backlight/lm3639_bl.ko 2023-05-16T13:37:42.236 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10993 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/video/backlight/lv5207lp.ko 2023-05-16T13:37:42.236 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13849 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/video/backlight/max8925_bl.ko 2023-05-16T13:37:42.236 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10817 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/video/backlight/pandora_bl.ko 2023-05-16T13:37:42.236 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10425 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-05-16T13:37:42.236 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10473 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/video/backlight/platform_lcd.ko 2023-05-16T13:37:42.236 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12289 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/video/backlight/wm831x_bl.ko 2023-05-16T13:37:42.236 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/w1/ 2023-05-16T13:37:42.237 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/w1/masters/ 2023-05-16T13:37:42.237 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18241 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/w1/masters/ds2482.ko 2023-05-16T13:37:42.237 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 38537 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/w1/masters/ds2490.ko 2023-05-16T13:37:42.237 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10969 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/w1/masters/matrox_w1.ko 2023-05-16T13:37:42.237 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12033 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/w1/masters/w1-gpio.ko 2023-05-16T13:37:42.237 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/w1/slaves/ 2023-05-16T13:37:42.237 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11609 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-05-16T13:37:42.238 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-05-16T13:37:42.238 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14609 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-05-16T13:37:42.238 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10329 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-05-16T13:37:42.238 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13649 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-05-16T13:37:42.238 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11497 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-05-16T13:37:42.238 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-05-16T13:37:42.238 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13241 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-05-16T13:37:42.239 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17481 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-05-16T13:37:42.239 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 6889 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/w1/slaves/w1_smem.ko 2023-05-16T13:37:42.239 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 55993 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/w1/slaves/w1_therm.ko 2023-05-16T13:37:42.239 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 101081 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/w1/wire.ko 2023-05-16T13:37:42.239 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/ 2023-05-16T13:37:42.239 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18257 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/acquirewdt.ko 2023-05-16T13:37:42.240 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19441 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/advantechwdt.ko 2023-05-16T13:37:42.240 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18065 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/alim1535_wdt.ko 2023-05-16T13:37:42.240 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22537 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/alim7101_wdt.ko 2023-05-16T13:37:42.240 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18673 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/cpu5wdt.ko 2023-05-16T13:37:42.240 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13121 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/da9052_wdt.ko 2023-05-16T13:37:42.240 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12345 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/da9055_wdt.ko 2023-05-16T13:37:42.241 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16905 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/da9063_wdt.ko 2023-05-16T13:37:42.241 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20369 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/dw_wdt.ko 2023-05-16T13:37:42.241 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19833 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/eurotechwdt.ko 2023-05-16T13:37:42.241 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23369 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/f71808e_wdt.ko 2023-05-16T13:37:42.241 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26969 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/hpwdt.ko 2023-05-16T13:37:42.241 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15073 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/i6300esb.ko 2023-05-16T13:37:42.241 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9777 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-05-16T13:37:42.242 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21481 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/iTCO_wdt.ko 2023-05-16T13:37:42.242 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18817 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/ib700wdt.ko 2023-05-16T13:37:42.242 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18249 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/ibmasr.ko 2023-05-16T13:37:42.242 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19281 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-05-16T13:37:42.242 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20721 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/it8712f_wdt.ko 2023-05-16T13:37:42.242 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13345 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/it87_wdt.ko 2023-05-16T13:37:42.242 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20993 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/kempld_wdt.ko 2023-05-16T13:37:42.242 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18185 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/machzwd.ko 2023-05-16T13:37:42.243 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14281 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/mena21_wdt.ko 2023-05-16T13:37:42.243 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12713 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-05-16T13:37:42.243 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24177 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/nv_tco.ko 2023-05-16T13:37:42.243 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-05-16T13:37:42.243 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21841 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/pc87413_wdt.ko 2023-05-16T13:37:42.243 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 38169 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/pcwd_pci.ko 2023-05-16T13:37:42.244 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 31385 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/pcwd_usb.ko 2023-05-16T13:37:42.244 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12545 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/retu_wdt.ko 2023-05-16T13:37:42.244 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19961 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-05-16T13:37:42.244 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13633 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-05-16T13:37:42.244 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16825 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-05-16T13:37:42.244 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23321 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/sc1200wdt.ko 2023-05-16T13:37:42.244 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22841 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/sch311x_wdt.ko 2023-05-16T13:37:42.244 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21137 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-05-16T13:37:42.245 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16777 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/softdog.ko 2023-05-16T13:37:42.245 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21537 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/sp5100_tco.ko 2023-05-16T13:37:42.245 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12321 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/twl4030_wdt.ko 2023-05-16T13:37:42.245 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17145 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/via_wdt.ko 2023-05-16T13:37:42.245 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18665 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-05-16T13:37:42.245 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20249 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/w83877f_wdt.ko 2023-05-16T13:37:42.245 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24913 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/w83977f_wdt.ko 2023-05-16T13:37:42.246 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18009 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/wafer5823wdt.ko 2023-05-16T13:37:42.246 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 27585 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/wdt_pci.ko 2023-05-16T13:37:42.246 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15753 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/wm831x_wdt.ko 2023-05-16T13:37:42.246 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13577 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/wm8350_wdt.ko 2023-05-16T13:37:42.246 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15201 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/xen_wdt.ko 2023-05-16T13:37:42.246 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/xen/ 2023-05-16T13:37:42.246 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24057 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/xen/xen-evtchn.ko 2023-05-16T13:37:42.247 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25937 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/xen/xen-gntalloc.ko 2023-05-16T13:37:42.247 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 46905 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/xen/xen-gntdev.ko 2023-05-16T13:37:42.247 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/xen/xen-pciback/ 2023-05-16T13:37:42.247 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 176105 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-05-16T13:37:42.247 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 39161 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/xen/xen-privcmd.ko 2023-05-16T13:37:42.247 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 71449 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/xen/xen-scsiback.ko 2023-05-16T13:37:42.247 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/xen/xenfs/ 2023-05-16T13:37:42.248 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18993 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/xen/xenfs/xenfs.ko 2023-05-16T13:37:42.248 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/ 2023-05-16T13:37:42.248 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/9p/ 2023-05-16T13:37:42.248 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 171305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/9p/9p.ko 2023-05-16T13:37:42.248 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/adfs/ 2023-05-16T13:37:42.248 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 60449 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/adfs/adfs.ko 2023-05-16T13:37:42.248 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/affs/ 2023-05-16T13:37:42.249 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 162241 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/affs/affs.ko 2023-05-16T13:37:42.249 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/afs/ 2023-05-16T13:37:42.249 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 924521 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/afs/kafs.ko 2023-05-16T13:37:42.249 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/autofs/ 2023-05-16T13:37:42.249 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 100321 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/autofs/autofs4.ko 2023-05-16T13:37:42.249 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/befs/ 2023-05-16T13:37:42.249 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 63977 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/befs/befs.ko 2023-05-16T13:37:42.250 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/bfs/ 2023-05-16T13:37:42.250 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 40585 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/bfs/bfs.ko 2023-05-16T13:37:42.250 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 34081 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/binfmt_misc.ko 2023-05-16T13:37:42.250 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/btrfs/ 2023-05-16T13:37:42.250 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 3475873 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/btrfs/btrfs.ko 2023-05-16T13:37:42.250 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/cachefiles/ 2023-05-16T13:37:42.250 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 299529 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/cachefiles/cachefiles.ko 2023-05-16T13:37:42.251 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/ceph/ 2023-05-16T13:37:42.251 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 1228449 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/ceph/ceph.ko 2023-05-16T13:37:42.251 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/cifs/ 2023-05-16T13:37:42.251 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 2614625 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/cifs/cifs.ko 2023-05-16T13:37:42.251 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/coda/ 2023-05-16T13:37:42.251 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 99153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/coda/coda.ko 2023-05-16T13:37:42.251 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/configfs/ 2023-05-16T13:37:42.251 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 105385 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/configfs/configfs.ko 2023-05-16T13:37:42.252 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/cramfs/ 2023-05-16T13:37:42.252 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28841 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/cramfs/cramfs.ko 2023-05-16T13:37:42.252 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/dlm/ 2023-05-16T13:37:42.252 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 624153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/dlm/dlm.ko 2023-05-16T13:37:42.252 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/efs/ 2023-05-16T13:37:42.252 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 36145 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/efs/efs.ko 2023-05-16T13:37:42.252 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/f2fs/ 2023-05-16T13:37:42.253 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 1470857 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/f2fs/f2fs.ko 2023-05-16T13:37:42.253 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/fat/ 2023-05-16T13:37:42.253 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 27361 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/fat/msdos.ko 2023-05-16T13:37:42.253 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/freevxfs/ 2023-05-16T13:37:42.253 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 41961 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/freevxfs/freevxfs.ko 2023-05-16T13:37:42.253 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/fscache/ 2023-05-16T13:37:42.253 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 218289 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/fscache/fscache.ko 2023-05-16T13:37:42.254 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/fuse/ 2023-05-16T13:37:42.254 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24169 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/fuse/cuse.ko 2023-05-16T13:37:42.254 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/gfs2/ 2023-05-16T13:37:42.254 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 1222241 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/gfs2/gfs2.ko 2023-05-16T13:37:42.254 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/hfs/ 2023-05-16T13:37:42.254 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 140857 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/hfs/hfs.ko 2023-05-16T13:37:42.254 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/hfsplus/ 2023-05-16T13:37:42.254 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 220953 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/hfsplus/hfsplus.ko 2023-05-16T13:37:42.255 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/hpfs/ 2023-05-16T13:37:42.255 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 193145 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/hpfs/hpfs.ko 2023-05-16T13:37:42.255 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/isofs/ 2023-05-16T13:37:42.255 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 73961 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/isofs/isofs.ko 2023-05-16T13:37:42.255 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/jfs/ 2023-05-16T13:37:42.255 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 418945 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/jfs/jfs.ko 2023-05-16T13:37:42.256 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/lockd/ 2023-05-16T13:37:42.256 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 254633 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/lockd/lockd.ko 2023-05-16T13:37:42.256 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/minix/ 2023-05-16T13:37:42.256 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 87417 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/minix/minix.ko 2023-05-16T13:37:42.256 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/netfs/ 2023-05-16T13:37:42.256 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 128313 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/netfs/netfs.ko 2023-05-16T13:37:42.256 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nfs/ 2023-05-16T13:37:42.257 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nfs/blocklayout/ 2023-05-16T13:37:42.257 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 81025 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-05-16T13:37:42.257 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nfs/filelayout/ 2023-05-16T13:37:42.257 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 58929 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-05-16T13:37:42.257 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nfs/flexfilelayout/ 2023-05-16T13:37:42.257 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 117209 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-05-16T13:37:42.257 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 1016665 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nfs/nfs.ko 2023-05-16T13:37:42.257 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 65665 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nfs/nfsv2.ko 2023-05-16T13:37:42.258 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 119217 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nfs/nfsv3.ko 2023-05-16T13:37:42.258 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 2003553 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nfs/nfsv4.ko 2023-05-16T13:37:42.258 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nfs_common/ 2023-05-16T13:37:42.258 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15905 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nfs_common/grace.ko 2023-05-16T13:37:42.258 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15177 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nfs_common/nfs_acl.ko 2023-05-16T13:37:42.258 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nfsd/ 2023-05-16T13:37:42.258 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 1400409 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nfsd/nfsd.ko 2023-05-16T13:37:42.259 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nilfs2/ 2023-05-16T13:37:42.259 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 587089 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nilfs2/nilfs2.ko 2023-05-16T13:37:42.259 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/ 2023-05-16T13:37:42.259 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/mac-celtic.ko 2023-05-16T13:37:42.259 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12681 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/mac-centeuro.ko 2023-05-16T13:37:42.259 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/mac-croatian.ko 2023-05-16T13:37:42.259 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12369 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/mac-cyrillic.ko 2023-05-16T13:37:42.259 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12985 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/mac-gaelic.ko 2023-05-16T13:37:42.260 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12361 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/mac-greek.ko 2023-05-16T13:37:42.260 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/mac-iceland.ko 2023-05-16T13:37:42.260 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12673 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/mac-inuit.ko 2023-05-16T13:37:42.260 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13609 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/mac-roman.ko 2023-05-16T13:37:42.260 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/mac-romanian.ko 2023-05-16T13:37:42.260 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/mac-turkish.ko 2023-05-16T13:37:42.260 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10801 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_ascii.ko 2023-05-16T13:37:42.261 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12049 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_cp1250.ko 2023-05-16T13:37:42.261 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11737 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_cp1251.ko 2023-05-16T13:37:42.261 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12489 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_cp1255.ko 2023-05-16T13:37:42.261 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12049 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_cp737.ko 2023-05-16T13:37:42.261 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12049 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_cp775.ko 2023-05-16T13:37:42.261 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11737 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_cp850.ko 2023-05-16T13:37:42.261 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11737 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_cp852.ko 2023-05-16T13:37:42.262 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11737 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_cp855.ko 2023-05-16T13:37:42.262 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11425 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_cp857.ko 2023-05-16T13:37:42.262 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12361 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_cp860.ko 2023-05-16T13:37:42.262 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12665 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_cp861.ko 2023-05-16T13:37:42.262 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12977 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_cp862.ko 2023-05-16T13:37:42.262 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12665 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_cp863.ko 2023-05-16T13:37:42.262 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12361 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_cp864.ko 2023-05-16T13:37:42.263 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12665 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_cp865.ko 2023-05-16T13:37:42.263 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12049 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_cp866.ko 2023-05-16T13:37:42.263 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11737 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_cp869.ko 2023-05-16T13:37:42.263 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11561 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_cp874.ko 2023-05-16T13:37:42.263 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 93649 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_cp932.ko 2023-05-16T13:37:42.263 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 142185 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_cp936.ko 2023-05-16T13:37:42.263 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 165257 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_cp949.ko 2023-05-16T13:37:42.263 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 117625 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_cp950.ko 2023-05-16T13:37:42.264 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11969 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_euc-jp.ko 2023-05-16T13:37:42.264 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10809 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_iso8859-1.ko 2023-05-16T13:37:42.264 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11433 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_iso8859-13.ko 2023-05-16T13:37:42.264 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11433 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_iso8859-14.ko 2023-05-16T13:37:42.264 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11433 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_iso8859-15.ko 2023-05-16T13:37:42.264 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11433 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_iso8859-2.ko 2023-05-16T13:37:42.265 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11433 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_iso8859-3.ko 2023-05-16T13:37:42.265 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11433 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_iso8859-4.ko 2023-05-16T13:37:42.265 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11433 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_iso8859-5.ko 2023-05-16T13:37:42.265 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11121 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_iso8859-6.ko 2023-05-16T13:37:42.265 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11745 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_iso8859-7.ko 2023-05-16T13:37:42.265 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11121 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_iso8859-9.ko 2023-05-16T13:37:42.265 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12049 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_koi8-r.ko 2023-05-16T13:37:42.265 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7593 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_koi8-ru.ko 2023-05-16T13:37:42.266 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12049 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_koi8-u.ko 2023-05-16T13:37:42.266 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7849 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_utf8.ko 2023-05-16T13:37:42.266 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/ntfs/ 2023-05-16T13:37:42.266 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 218585 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/ntfs/ntfs.ko 2023-05-16T13:37:42.266 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/ocfs2/ 2023-05-16T13:37:42.266 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/ocfs2/cluster/ 2023-05-16T13:37:42.266 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 240737 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-05-16T13:37:42.267 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/ocfs2/dlm/ 2023-05-16T13:37:42.267 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 439201 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-05-16T13:37:42.267 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/ocfs2/dlmfs/ 2023-05-16T13:37:42.267 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 53377 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-05-16T13:37:42.267 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 2510441 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/ocfs2/ocfs2.ko 2023-05-16T13:37:42.267 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17473 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-05-16T13:37:42.267 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 31153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-05-16T13:37:42.268 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 33577 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-05-16T13:37:42.268 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/omfs/ 2023-05-16T13:37:42.268 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 52145 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/omfs/omfs.ko 2023-05-16T13:37:42.268 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/overlayfs/ 2023-05-16T13:37:42.268 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 320649 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/overlayfs/overlay.ko 2023-05-16T13:37:42.268 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/pstore/ 2023-05-16T13:37:42.268 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 54121 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/pstore/ramoops.ko 2023-05-16T13:37:42.269 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/qnx4/ 2023-05-16T13:37:42.269 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26361 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/qnx4/qnx4.ko 2023-05-16T13:37:42.269 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/qnx6/ 2023-05-16T13:37:42.269 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 46217 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/qnx6/qnx6.ko 2023-05-16T13:37:42.269 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/quota/ 2023-05-16T13:37:42.269 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29673 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/quota/quota_tree.ko 2023-05-16T13:37:42.269 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13857 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/quota/quota_v1.ko 2023-05-16T13:37:42.269 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21521 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/quota/quota_v2.ko 2023-05-16T13:37:42.270 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/reiserfs/ 2023-05-16T13:37:42.270 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 527801 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/reiserfs/reiserfs.ko 2023-05-16T13:37:42.270 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/romfs/ 2023-05-16T13:37:42.270 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28009 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/romfs/romfs.ko 2023-05-16T13:37:42.270 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/smbfs_common/ 2023-05-16T13:37:42.270 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 6361 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/smbfs_common/cifs_arc4.ko 2023-05-16T13:37:42.270 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10313 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/smbfs_common/cifs_md4.ko 2023-05-16T13:37:42.271 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/squashfs/ 2023-05-16T13:37:42.271 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 131193 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/squashfs/squashfs.ko 2023-05-16T13:37:42.271 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/sysv/ 2023-05-16T13:37:42.271 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 88441 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/sysv/sysv.ko 2023-05-16T13:37:42.271 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/udf/ 2023-05-16T13:37:42.271 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 247873 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/udf/udf.ko 2023-05-16T13:37:42.271 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/ufs/ 2023-05-16T13:37:42.272 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 160129 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/ufs/ufs.ko 2023-05-16T13:37:42.272 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/xfs/ 2023-05-16T13:37:42.272 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 3829249 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/xfs/xfs.ko 2023-05-16T13:37:42.272 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/kernel/ 2023-05-16T13:37:42.272 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/kernel/locking/ 2023-05-16T13:37:42.272 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 65265 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/kernel/locking/locktorture.ko 2023-05-16T13:37:42.272 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/kernel/time/ 2023-05-16T13:37:42.273 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13249 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/kernel/time/test_udelay.ko 2023-05-16T13:37:42.273 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 55009 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/kernel/torture.ko 2023-05-16T13:37:42.273 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/ 2023-05-16T13:37:42.273 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 6033 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/crc-itu-t.ko 2023-05-16T13:37:42.273 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 5729 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/crc7.ko 2023-05-16T13:37:42.273 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 6081 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/crc8.ko 2023-05-16T13:37:42.273 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/crypto/ 2023-05-16T13:37:42.274 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 6305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/crypto/libarc4.ko 2023-05-16T13:37:42.274 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 35897 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/crypto/libdes.ko 2023-05-16T13:37:42.274 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12889 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/interval_tree_test.ko 2023-05-16T13:37:42.274 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8121 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/libcrc32c.ko 2023-05-16T13:37:42.274 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22953 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/lru_cache.ko 2023-05-16T13:37:42.274 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/lz4/ 2023-05-16T13:37:42.274 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 32593 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/lz4/lz4_compress.ko 2023-05-16T13:37:42.274 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21593 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/lz4/lz4hc_compress.ko 2023-05-16T13:37:42.275 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/math/ 2023-05-16T13:37:42.275 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 5897 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/math/cordic.ko 2023-05-16T13:37:42.275 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7793 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/memory-notifier-error-inject.ko 2023-05-16T13:37:42.275 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10105 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/notifier-error-inject.ko 2023-05-16T13:37:42.275 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13593 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/percpu_test.ko 2023-05-16T13:37:42.275 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7801 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/pm-notifier-error-inject.ko 2023-05-16T13:37:42.275 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/raid6/ 2023-05-16T13:37:42.276 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 141873 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/raid6/raid6_pq.ko 2023-05-16T13:37:42.276 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20673 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/rbtree_test.ko 2023-05-16T13:37:42.276 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/reed_solomon/ 2023-05-16T13:37:42.276 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17641 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/reed_solomon/reed_solomon.ko 2023-05-16T13:37:42.276 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 38401 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/test-kstrtox.ko 2023-05-16T13:37:42.276 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25889 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/test-string_helpers.ko 2023-05-16T13:37:42.276 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 4760329 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/test_bpf.ko 2023-05-16T13:37:42.277 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 48057 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/test_firmware.ko 2023-05-16T13:37:42.277 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 5873 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/test_module.ko 2023-05-16T13:37:42.277 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21177 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/test_user_copy.ko 2023-05-16T13:37:42.277 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9161 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/ts_bm.ko 2023-05-16T13:37:42.277 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10625 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/ts_fsm.ko 2023-05-16T13:37:42.277 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9201 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/ts_kmp.ko 2023-05-16T13:37:42.277 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/xz/ 2023-05-16T13:37:42.277 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13105 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/xz/xz_dec_test.ko 2023-05-16T13:37:42.278 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/mm/ 2023-05-16T13:37:42.278 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15001 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/mm/hwpoison-inject.ko 2023-05-16T13:37:42.278 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ 2023-05-16T13:37:42.278 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/6lowpan/ 2023-05-16T13:37:42.278 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 54273 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/6lowpan/6lowpan.ko 2023-05-16T13:37:42.278 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 6553 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/6lowpan/nhc_dest.ko 2023-05-16T13:37:42.278 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 6577 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/6lowpan/nhc_fragment.ko 2023-05-16T13:37:42.279 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 6553 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/6lowpan/nhc_hop.ko 2023-05-16T13:37:42.279 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 6553 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/6lowpan/nhc_ipv6.ko 2023-05-16T13:37:42.279 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 6577 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/6lowpan/nhc_mobility.ko 2023-05-16T13:37:42.279 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 6577 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/6lowpan/nhc_routing.ko 2023-05-16T13:37:42.279 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14833 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/6lowpan/nhc_udp.ko 2023-05-16T13:37:42.279 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/802/ 2023-05-16T13:37:42.279 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29225 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/802/garp.ko 2023-05-16T13:37:42.280 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 33657 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/802/mrp.ko 2023-05-16T13:37:42.280 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7729 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/802/p8022.ko 2023-05-16T13:37:42.280 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15025 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/802/psnap.ko 2023-05-16T13:37:42.280 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10721 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/802/stp.ko 2023-05-16T13:37:42.280 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/8021q/ 2023-05-16T13:37:42.280 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 80641 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/8021q/8021q.ko 2023-05-16T13:37:42.280 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/9p/ 2023-05-16T13:37:42.281 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 191305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/9p/9pnet.ko 2023-05-16T13:37:42.281 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 35457 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/9p/9pnet_fd.ko 2023-05-16T13:37:42.281 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25905 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/9p/9pnet_rdma.ko 2023-05-16T13:37:42.281 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 31825 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/9p/9pnet_virtio.ko 2023-05-16T13:37:42.281 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/batman-adv/ 2023-05-16T13:37:42.281 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 652281 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/batman-adv/batman-adv.ko 2023-05-16T13:37:42.281 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/ 2023-05-16T13:37:42.282 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 63505 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/br_netfilter.ko 2023-05-16T13:37:42.282 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 772145 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/bridge.ko 2023-05-16T13:37:42.282 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/ 2023-05-16T13:37:42.282 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7233 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-05-16T13:37:42.282 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11897 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/ebt_among.ko 2023-05-16T13:37:42.282 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8673 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/ebt_arp.ko 2023-05-16T13:37:42.282 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8649 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-05-16T13:37:42.282 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9193 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-05-16T13:37:42.283 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8249 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/ebt_ip.ko 2023-05-16T13:37:42.283 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8649 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-05-16T13:37:42.283 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9401 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/ebt_limit.ko 2023-05-16T13:37:42.283 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12793 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/ebt_log.ko 2023-05-16T13:37:42.283 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8505 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/ebt_mark.ko 2023-05-16T13:37:42.283 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8761 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-05-16T13:37:42.283 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7897 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-05-16T13:37:42.284 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7113 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-05-16T13:37:42.284 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-05-16T13:37:42.284 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8225 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/ebt_snat.ko 2023-05-16T13:37:42.284 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8393 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/ebt_stp.ko 2023-05-16T13:37:42.284 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11961 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-05-16T13:37:42.284 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11025 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-05-16T13:37:42.284 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9393 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-05-16T13:37:42.285 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9369 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-05-16T13:37:42.285 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 73961 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/ebtables.ko 2023-05-16T13:37:42.285 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12497 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-05-16T13:37:42.285 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13449 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-05-16T13:37:42.285 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ceph/ 2023-05-16T13:37:42.285 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 1029801 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ceph/libceph.ko 2023-05-16T13:37:42.285 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/core/ 2023-05-16T13:37:42.286 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 124297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/core/pktgen.ko 2023-05-16T13:37:42.286 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/dccp/ 2023-05-16T13:37:42.286 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 188577 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/dccp/dccp.ko 2023-05-16T13:37:42.286 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8225 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/dccp/dccp_diag.ko 2023-05-16T13:37:42.286 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 55633 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/dccp/dccp_ipv4.ko 2023-05-16T13:37:42.286 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 58905 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/dccp/dccp_ipv6.ko 2023-05-16T13:37:42.286 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/dsa/ 2023-05-16T13:37:42.287 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 274753 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/dsa/dsa_core.ko 2023-05-16T13:37:42.287 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12841 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/dsa/tag_brcm.ko 2023-05-16T13:37:42.287 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12145 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/dsa/tag_dsa.ko 2023-05-16T13:37:42.287 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7289 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/dsa/tag_none.ko 2023-05-16T13:37:42.287 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8465 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/dsa/tag_trailer.ko 2023-05-16T13:37:42.287 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/hsr/ 2023-05-16T13:37:42.287 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 99385 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/hsr/hsr.ko 2023-05-16T13:37:42.288 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ieee802154/ 2023-05-16T13:37:42.288 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ieee802154/6lowpan/ 2023-05-16T13:37:42.288 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 44745 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-05-16T13:37:42.288 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 245489 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ieee802154/ieee802154.ko 2023-05-16T13:37:42.288 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 47073 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ieee802154/ieee802154_socket.ko 2023-05-16T13:37:42.288 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/ 2023-05-16T13:37:42.289 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/ah4.ko 2023-05-16T13:37:42.289 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 37977 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/esp4.ko 2023-05-16T13:37:42.289 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 44425 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/fou.ko 2023-05-16T13:37:42.289 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17353 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/gre.ko 2023-05-16T13:37:42.289 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 46985 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/inet_diag.ko 2023-05-16T13:37:42.289 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 59737 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/ip_gre.ko 2023-05-16T13:37:42.289 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 57265 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/ip_tunnel.ko 2023-05-16T13:37:42.290 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 33737 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/ip_vti.ko 2023-05-16T13:37:42.290 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13577 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/ipcomp.ko 2023-05-16T13:37:42.290 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28265 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/ipip.ko 2023-05-16T13:37:42.290 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/ 2023-05-16T13:37:42.290 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 46769 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/arp_tables.ko 2023-05-16T13:37:42.290 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8385 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-05-16T13:37:42.290 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9913 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-05-16T13:37:42.291 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 53921 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/ip_tables.ko 2023-05-16T13:37:42.291 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9561 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-05-16T13:37:42.291 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9185 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-05-16T13:37:42.291 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13713 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-05-16T13:37:42.291 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10681 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-05-16T13:37:42.291 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14505 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-05-16T13:37:42.291 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10817 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-05-16T13:37:42.292 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-05-16T13:37:42.292 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14505 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-05-16T13:37:42.292 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11105 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-05-16T13:37:42.292 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9985 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/iptable_security.ko 2023-05-16T13:37:42.292 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11281 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-05-16T13:37:42.292 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8097 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-05-16T13:37:42.292 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 27193 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-05-16T13:37:42.293 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17729 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-05-16T13:37:42.293 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12913 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-05-16T13:37:42.293 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19257 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-05-16T13:37:42.293 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8665 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-05-16T13:37:42.293 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14321 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-05-16T13:37:42.293 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9465 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-05-16T13:37:42.293 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16353 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-05-16T13:37:42.293 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8569 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-05-16T13:37:42.294 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12641 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/tcp_bic.ko 2023-05-16T13:37:42.294 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13241 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/tcp_dctcp.ko 2023-05-16T13:37:42.294 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14689 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/tcp_diag.ko 2023-05-16T13:37:42.294 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9105 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/tcp_highspeed.ko 2023-05-16T13:37:42.294 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11961 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/tcp_htcp.ko 2023-05-16T13:37:42.294 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9953 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/tcp_hybla.ko 2023-05-16T13:37:42.294 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10977 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/tcp_illinois.ko 2023-05-16T13:37:42.295 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9993 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/tcp_lp.ko 2023-05-16T13:37:42.295 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7905 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/tcp_scalable.ko 2023-05-16T13:37:42.295 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/tcp_vegas.ko 2023-05-16T13:37:42.295 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9665 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/tcp_veno.ko 2023-05-16T13:37:42.295 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10529 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/tcp_westwood.ko 2023-05-16T13:37:42.295 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9753 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/tcp_yeah.ko 2023-05-16T13:37:42.295 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21785 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/tunnel4.ko 2023-05-16T13:37:42.296 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15921 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/udp_diag.ko 2023-05-16T13:37:42.296 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 40017 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/udp_tunnel.ko 2023-05-16T13:37:42.296 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10929 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/xfrm4_tunnel.ko 2023-05-16T13:37:42.296 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/ 2023-05-16T13:37:42.296 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25945 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/ah6.ko 2023-05-16T13:37:42.296 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 38649 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/esp6.ko 2023-05-16T13:37:42.296 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13993 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/fou6.ko 2023-05-16T13:37:42.297 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 80297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/ip6_gre.ko 2023-05-16T13:37:42.297 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 90857 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/ip6_tunnel.ko 2023-05-16T13:37:42.297 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9801 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-05-16T13:37:42.297 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 53369 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/ip6_vti.ko 2023-05-16T13:37:42.297 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13361 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/ipcomp6.ko 2023-05-16T13:37:42.297 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18593 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/mip6.ko 2023-05-16T13:37:42.297 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/ 2023-05-16T13:37:42.298 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 54497 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-05-16T13:37:42.298 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11329 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-05-16T13:37:42.298 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9257 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-05-16T13:37:42.298 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13721 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-05-16T13:37:42.298 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13833 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-05-16T13:37:42.298 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7369 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-05-16T13:37:42.298 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15777 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-05-16T13:37:42.298 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15601 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-05-16T13:37:42.299 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8481 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-05-16T13:37:42.299 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9457 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-05-16T13:37:42.299 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10441 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-05-16T13:37:42.299 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10465 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-05-16T13:37:42.299 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10825 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-05-16T13:37:42.299 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10633 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-05-16T13:37:42.299 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14537 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-05-16T13:37:42.300 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11121 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-05-16T13:37:42.300 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10001 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-05-16T13:37:42.300 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 37929 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-05-16T13:37:42.300 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7729 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-05-16T13:37:42.300 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24681 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-05-16T13:37:42.300 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9137 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-05-16T13:37:42.300 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14537 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-05-16T13:37:42.301 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9201 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-05-16T13:37:42.301 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15217 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-05-16T13:37:42.301 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8577 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-05-16T13:37:42.301 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 72545 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/sit.ko 2023-05-16T13:37:42.301 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23377 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/tunnel6.ko 2023-05-16T13:37:42.301 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22481 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/xfrm6_tunnel.ko 2023-05-16T13:37:42.301 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/key/ 2023-05-16T13:37:42.302 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 82505 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/key/af_key.ko 2023-05-16T13:37:42.302 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/l2tp/ 2023-05-16T13:37:42.302 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 120265 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/l2tp/l2tp_core.ko 2023-05-16T13:37:42.302 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19841 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/l2tp/l2tp_debugfs.ko 2023-05-16T13:37:42.302 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25209 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/l2tp/l2tp_eth.ko 2023-05-16T13:37:42.302 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 34969 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/l2tp/l2tp_ip.ko 2023-05-16T13:37:42.302 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 36649 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/l2tp/l2tp_ip6.ko 2023-05-16T13:37:42.303 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 32185 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/l2tp/l2tp_netlink.ko 2023-05-16T13:37:42.303 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 53057 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/l2tp/l2tp_ppp.ko 2023-05-16T13:37:42.303 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/lapb/ 2023-05-16T13:37:42.303 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 46641 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/lapb/lapb.ko 2023-05-16T13:37:42.303 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/llc/ 2023-05-16T13:37:42.303 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21849 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/llc/llc.ko 2023-05-16T13:37:42.303 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 266497 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/llc/llc2.ko 2023-05-16T13:37:42.304 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/mac802154/ 2023-05-16T13:37:42.304 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 279905 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/mac802154/mac802154.ko 2023-05-16T13:37:42.304 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/mpls/ 2023-05-16T13:37:42.304 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8897 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/mpls/mpls_gso.ko 2023-05-16T13:37:42.304 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ 2023-05-16T13:37:42.304 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipset/ 2023-05-16T13:37:42.304 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 116641 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipset/ip_set.ko 2023-05-16T13:37:42.305 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28017 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-05-16T13:37:42.305 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26593 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-05-16T13:37:42.305 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26025 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-05-16T13:37:42.305 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 101537 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-05-16T13:37:42.305 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 102681 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-05-16T13:37:42.305 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 104097 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-05-16T13:37:42.305 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 104697 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-05-16T13:37:42.305 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 113953 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-05-16T13:37:42.306 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 60665 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-05-16T13:37:42.306 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 110721 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-05-16T13:37:42.306 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 114241 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-05-16T13:37:42.306 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 113889 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-05-16T13:37:42.306 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 112713 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-05-16T13:37:42.306 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 115777 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-05-16T13:37:42.306 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29713 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-05-16T13:37:42.307 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipvs/ 2023-05-16T13:37:42.307 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 410073 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipvs/ip_vs.ko 2023-05-16T13:37:42.307 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11473 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-05-16T13:37:42.307 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7193 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-05-16T13:37:42.307 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17225 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-05-16T13:37:42.307 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17409 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-05-16T13:37:42.307 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20225 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-05-16T13:37:42.308 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7193 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-05-16T13:37:42.308 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7257 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-05-16T13:37:42.308 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10185 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-05-16T13:37:42.308 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8801 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-05-16T13:37:42.308 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7209 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-05-16T13:37:42.308 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13089 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-05-16T13:37:42.308 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7273 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-05-16T13:37:42.309 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10497 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-05-16T13:37:42.309 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 47601 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_conncount.ko 2023-05-16T13:37:42.309 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 396769 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_conntrack.ko 2023-05-16T13:37:42.309 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15321 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-05-16T13:37:42.309 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9441 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-05-16T13:37:42.309 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 33033 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-05-16T13:37:42.309 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 117313 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_conntrack_h323.ko 2023-05-16T13:37:42.309 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21457 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_conntrack_irc.ko 2023-05-16T13:37:42.310 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8377 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-05-16T13:37:42.310 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 107825 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-05-16T13:37:42.310 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 32833 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-05-16T13:37:42.310 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16961 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_conntrack_sane.ko 2023-05-16T13:37:42.310 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 65305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_conntrack_sip.ko 2023-05-16T13:37:42.310 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10513 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-05-16T13:37:42.310 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18521 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-05-16T13:37:42.311 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9209 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_dup_netdev.ko 2023-05-16T13:37:42.311 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 86233 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_flow_table.ko 2023-05-16T13:37:42.311 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9161 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_flow_table_inet.ko 2023-05-16T13:37:42.311 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 36705 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_log_syslog.ko 2023-05-16T13:37:42.311 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 91201 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_nat.ko 2023-05-16T13:37:42.311 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9625 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_nat_amanda.ko 2023-05-16T13:37:42.312 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12129 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_nat_ftp.ko 2023-05-16T13:37:42.312 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11361 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_nat_irc.ko 2023-05-16T13:37:42.312 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28497 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_nat_sip.ko 2023-05-16T13:37:42.312 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_nat_tftp.ko 2023-05-16T13:37:42.312 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 42105 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_synproxy_core.ko 2023-05-16T13:37:42.312 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 575513 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_tables.ko 2023-05-16T13:37:42.312 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 42137 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nfnetlink.ko 2023-05-16T13:37:42.313 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29241 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nfnetlink_acct.ko 2023-05-16T13:37:42.313 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 30121 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-05-16T13:37:42.313 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 40225 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nfnetlink_log.ko 2023-05-16T13:37:42.313 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 21729 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nfnetlink_osf.ko 2023-05-16T13:37:42.313 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 49001 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nfnetlink_queue.ko 2023-05-16T13:37:42.313 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9961 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nft_chain_nat.ko 2023-05-16T13:37:42.313 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 32753 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nft_compat.ko 2023-05-16T13:37:42.314 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 40217 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nft_ct.ko 2023-05-16T13:37:42.314 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9169 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nft_dup_netdev.ko 2023-05-16T13:37:42.314 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10161 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nft_fib.ko 2023-05-16T13:37:42.314 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13385 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nft_fwd_netdev.ko 2023-05-16T13:37:42.314 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13681 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nft_hash.ko 2023-05-16T13:37:42.314 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19569 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nft_limit.ko 2023-05-16T13:37:42.314 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14905 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nft_log.ko 2023-05-16T13:37:42.315 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14985 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nft_masq.ko 2023-05-16T13:37:42.315 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13937 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nft_nat.ko 2023-05-16T13:37:42.315 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13241 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nft_numgen.ko 2023-05-16T13:37:42.315 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11289 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nft_osf.ko 2023-05-16T13:37:42.315 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13641 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nft_queue.ko 2023-05-16T13:37:42.315 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14417 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nft_redir.ko 2023-05-16T13:37:42.315 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9289 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nft_reject.ko 2023-05-16T13:37:42.315 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9585 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nft_reject_inet.ko 2023-05-16T13:37:42.316 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nft_socket.ko 2023-05-16T13:37:42.316 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19905 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nft_synproxy.ko 2023-05-16T13:37:42.316 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14417 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nft_tproxy.ko 2023-05-16T13:37:42.316 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 98833 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/x_tables.ko 2023-05-16T13:37:42.316 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11665 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_AUDIT.ko 2023-05-16T13:37:42.316 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9193 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_CHECKSUM.ko 2023-05-16T13:37:42.316 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_CLASSIFY.ko 2023-05-16T13:37:42.317 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11033 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-05-16T13:37:42.317 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 17809 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_CT.ko 2023-05-16T13:37:42.317 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10137 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_DSCP.ko 2023-05-16T13:37:42.317 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9041 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_HL.ko 2023-05-16T13:37:42.317 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12937 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_HMARK.ko 2023-05-16T13:37:42.317 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 38513 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_IDLETIMER.ko 2023-05-16T13:37:42.317 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13521 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_LED.ko 2023-05-16T13:37:42.318 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11121 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_LOG.ko 2023-05-16T13:37:42.318 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11313 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_MASQUERADE.ko 2023-05-16T13:37:42.318 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_NETMAP.ko 2023-05-16T13:37:42.318 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9041 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_NFLOG.ko 2023-05-16T13:37:42.318 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12929 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_NFQUEUE.ko 2023-05-16T13:37:42.318 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18889 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_RATEEST.ko 2023-05-16T13:37:42.318 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10313 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_REDIRECT.ko 2023-05-16T13:37:42.319 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13913 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_SECMARK.ko 2023-05-16T13:37:42.319 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15633 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_TCPMSS.ko 2023-05-16T13:37:42.319 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10001 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-05-16T13:37:42.319 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16937 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_TEE.ko 2023-05-16T13:37:42.319 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16417 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_TPROXY.ko 2023-05-16T13:37:42.319 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7833 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_TRACE.ko 2023-05-16T13:37:42.319 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13465 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_addrtype.ko 2023-05-16T13:37:42.320 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13457 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_bpf.ko 2023-05-16T13:37:42.320 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15209 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_cgroup.ko 2023-05-16T13:37:42.320 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10713 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_cluster.ko 2023-05-16T13:37:42.320 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7073 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_comment.ko 2023-05-16T13:37:42.320 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10033 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_connbytes.ko 2023-05-16T13:37:42.320 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10649 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_connlabel.ko 2023-05-16T13:37:42.320 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8913 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_connlimit.ko 2023-05-16T13:37:42.321 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12697 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_connmark.ko 2023-05-16T13:37:42.321 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12033 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_conntrack.ko 2023-05-16T13:37:42.321 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7329 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_cpu.ko 2023-05-16T13:37:42.321 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10545 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_dccp.ko 2023-05-16T13:37:42.321 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7433 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_devgroup.ko 2023-05-16T13:37:42.321 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8433 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_dscp.ko 2023-05-16T13:37:42.321 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10233 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_ecn.ko 2023-05-16T13:37:42.322 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11041 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_esp.ko 2023-05-16T13:37:42.322 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 43025 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_hashlimit.ko 2023-05-16T13:37:42.322 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10889 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_helper.ko 2023-05-16T13:37:42.322 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7433 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_hl.ko 2023-05-16T13:37:42.322 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11553 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_ipcomp.ko 2023-05-16T13:37:42.322 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11033 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_iprange.ko 2023-05-16T13:37:42.322 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11289 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_ipvs.ko 2023-05-16T13:37:42.322 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15609 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_l2tp.ko 2023-05-16T13:37:42.323 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7569 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_length.ko 2023-05-16T13:37:42.323 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10929 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_limit.ko 2023-05-16T13:37:42.323 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7113 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_mac.ko 2023-05-16T13:37:42.323 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_mark.ko 2023-05-16T13:37:42.323 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11393 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_multiport.ko 2023-05-16T13:37:42.323 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13513 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_nat.ko 2023-05-16T13:37:42.323 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9681 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_nfacct.ko 2023-05-16T13:37:42.324 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7913 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_osf.ko 2023-05-16T13:37:42.324 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9121 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_owner.ko 2023-05-16T13:37:42.324 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_physdev.ko 2023-05-16T13:37:42.324 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7137 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_pkttype.ko 2023-05-16T13:37:42.324 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11561 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_policy.ko 2023-05-16T13:37:42.324 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9049 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_quota.ko 2023-05-16T13:37:42.324 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9913 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_rateest.ko 2023-05-16T13:37:42.325 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7761 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_realm.ko 2023-05-16T13:37:42.325 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 36065 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_recent.ko 2023-05-16T13:37:42.325 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12897 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_sctp.ko 2023-05-16T13:37:42.325 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29985 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_set.ko 2023-05-16T13:37:42.325 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15849 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_socket.ko 2023-05-16T13:37:42.325 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9009 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_state.ko 2023-05-16T13:37:42.325 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8985 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_statistic.ko 2023-05-16T13:37:42.325 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8313 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_string.ko 2023-05-16T13:37:42.326 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8129 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_tcpmss.ko 2023-05-16T13:37:42.326 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_tcpudp.ko 2023-05-16T13:37:42.326 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10641 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_time.ko 2023-05-16T13:37:42.326 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8681 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_u32.ko 2023-05-16T13:37:42.326 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netlink/ 2023-05-16T13:37:42.326 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 13417 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netlink/netlink_diag.ko 2023-05-16T13:37:42.326 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/nsh/ 2023-05-16T13:37:42.327 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11753 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/nsh/nsh.ko 2023-05-16T13:37:42.327 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/openvswitch/ 2023-05-16T13:37:42.327 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 377353 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/openvswitch/openvswitch.ko 2023-05-16T13:37:42.327 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9825 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/openvswitch/vport-geneve.ko 2023-05-16T13:37:42.327 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8953 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/openvswitch/vport-gre.ko 2023-05-16T13:37:42.327 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 11297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/openvswitch/vport-vxlan.ko 2023-05-16T13:37:42.327 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/packet/ 2023-05-16T13:37:42.328 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12561 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/packet/af_packet_diag.ko 2023-05-16T13:37:42.328 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/phonet/ 2023-05-16T13:37:42.328 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 109633 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/phonet/phonet.ko 2023-05-16T13:37:42.328 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 54353 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/phonet/pn_pep.ko 2023-05-16T13:37:42.328 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/rds/ 2023-05-16T13:37:42.328 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 248545 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/rds/rds.ko 2023-05-16T13:37:42.328 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 164641 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/rds/rds_rdma.ko 2023-05-16T13:37:42.328 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 66441 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/rds/rds_tcp.ko 2023-05-16T13:37:42.329 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/rxrpc/ 2023-05-16T13:37:42.329 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 805849 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/rxrpc/rxrpc.ko 2023-05-16T13:37:42.329 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/ 2023-05-16T13:37:42.329 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 31817 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/act_csum.ko 2023-05-16T13:37:42.329 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23105 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/act_gact.ko 2023-05-16T13:37:42.329 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 25185 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/act_ipt.ko 2023-05-16T13:37:42.329 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 33569 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/act_mirred.ko 2023-05-16T13:37:42.330 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22929 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/act_nat.ko 2023-05-16T13:37:42.330 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 39593 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/act_pedit.ko 2023-05-16T13:37:42.330 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 31561 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/act_police.ko 2023-05-16T13:37:42.330 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19817 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/act_simple.ko 2023-05-16T13:37:42.330 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 35921 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/act_skbedit.ko 2023-05-16T13:37:42.330 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 35625 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/act_vlan.ko 2023-05-16T13:37:42.330 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24953 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/cls_basic.ko 2023-05-16T13:37:42.331 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 32409 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/cls_bpf.ko 2023-05-16T13:37:42.331 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18729 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/cls_cgroup.ko 2023-05-16T13:37:42.331 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 30953 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/cls_flow.ko 2023-05-16T13:37:42.331 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29809 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/cls_fw.ko 2023-05-16T13:37:42.331 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 36793 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/cls_route.ko 2023-05-16T13:37:42.331 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 57985 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/cls_u32.ko 2023-05-16T13:37:42.331 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 6945 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/em_cmp.ko 2023-05-16T13:37:42.331 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 12969 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/em_ipset.ko 2023-05-16T13:37:42.332 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 32833 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/em_meta.ko 2023-05-16T13:37:42.332 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 7393 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/em_nbyte.ko 2023-05-16T13:37:42.332 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10193 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/em_text.ko 2023-05-16T13:37:42.332 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 6753 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/em_u32.ko 2023-05-16T13:37:42.332 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19609 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/sch_choke.ko 2023-05-16T13:37:42.332 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19201 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/sch_codel.ko 2023-05-16T13:37:42.332 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 30441 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/sch_drr.ko 2023-05-16T13:37:42.333 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 29913 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/sch_fq.ko 2023-05-16T13:37:42.333 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28953 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/sch_fq_codel.ko 2023-05-16T13:37:42.333 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 32145 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/sch_gred.ko 2023-05-16T13:37:42.333 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 44345 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/sch_hfsc.ko 2023-05-16T13:37:42.333 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20369 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/sch_hhf.ko 2023-05-16T13:37:42.333 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 63001 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/sch_htb.ko 2023-05-16T13:37:42.333 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15249 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/sch_ingress.ko 2023-05-16T13:37:42.334 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23329 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/sch_mqprio.ko 2023-05-16T13:37:42.334 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9353 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/sch_mqprio_lib.ko 2023-05-16T13:37:42.334 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23441 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/sch_multiq.ko 2023-05-16T13:37:42.334 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 33329 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/sch_netem.ko 2023-05-16T13:37:42.334 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 23497 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/sch_pie.ko 2023-05-16T13:37:42.334 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9833 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/sch_plug.ko 2023-05-16T13:37:42.334 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22817 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/sch_prio.ko 2023-05-16T13:37:42.335 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 43969 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/sch_qfq.ko 2023-05-16T13:37:42.335 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 28697 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/sch_red.ko 2023-05-16T13:37:42.335 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 24881 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/sch_sfb.ko 2023-05-16T13:37:42.335 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 27985 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/sch_sfq.ko 2023-05-16T13:37:42.335 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26905 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/sch_tbf.ko 2023-05-16T13:37:42.335 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 26857 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/sch_teql.ko 2023-05-16T13:37:42.335 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sctp/ 2023-05-16T13:37:42.335 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 920945 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sctp/sctp.ko 2023-05-16T13:37:42.336 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 18601 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sctp/sctp_diag.ko 2023-05-16T13:37:42.336 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sunrpc/ 2023-05-16T13:37:42.336 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sunrpc/auth_gss/ 2023-05-16T13:37:42.336 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 327521 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-05-16T13:37:42.336 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 61329 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-05-16T13:37:42.336 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 1405641 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sunrpc/sunrpc.ko 2023-05-16T13:37:42.336 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sunrpc/xprtrdma/ 2023-05-16T13:37:42.337 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 681905 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-05-16T13:37:42.337 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/tipc/ 2023-05-16T13:37:42.337 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 9593 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/tipc/diag.ko 2023-05-16T13:37:42.337 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 853201 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/tipc/tipc.ko 2023-05-16T13:37:42.337 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/unix/ 2023-05-16T13:37:42.337 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 15233 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/unix/unix_diag.ko 2023-05-16T13:37:42.337 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/vmw_vsock/ 2023-05-16T13:37:42.338 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 78425 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-05-16T13:37:42.338 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 67537 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-05-16T13:37:42.338 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 82401 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/vmw_vsock/vsock.ko 2023-05-16T13:37:42.338 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10273 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/vmw_vsock/vsock_diag.ko 2023-05-16T13:37:42.338 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 16713 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/vmw_vsock/vsock_loopback.ko 2023-05-16T13:37:42.338 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/x25/ 2023-05-16T13:37:42.338 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 124593 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/x25/x25.ko 2023-05-16T13:37:42.339 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/xfrm/ 2023-05-16T13:37:42.339 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 20793 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/xfrm/xfrm_algo.ko 2023-05-16T13:37:42.339 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 19745 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/xfrm/xfrm_ipcomp.ko 2023-05-16T13:37:42.339 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 101145 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/xfrm/xfrm_user.ko 2023-05-16T13:37:42.339 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/virt/ 2023-05-16T13:37:42.339 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/virt/lib/ 2023-05-16T13:37:42.339 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 14433 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/virt/lib/irqbypass.ko 2023-05-16T13:37:42.339 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 636465 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/modules.alias 2023-05-16T13:37:42.341 INFO:teuthology.orchestra.run.smithi118.stderr:Found linux image: /boot/vmlinuz-6.3.0-g7312ab6f53ec 2023-05-16T13:37:42.341 INFO:teuthology.orchestra.run.smithi118.stderr:Found initrd image: /boot/initrd.img-6.3.0-g7312ab6f53ec 2023-05-16T13:37:42.341 INFO:teuthology.orchestra.run.smithi118.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-05-16T13:37:42.341 INFO:teuthology.orchestra.run.smithi118.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-05-16T13:37:42.342 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 622282 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/modules.alias.bin 2023-05-16T13:37:42.342 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 8260 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/modules.builtin 2023-05-16T13:37:42.343 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 22530 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/modules.builtin.alias.bin 2023-05-16T13:37:42.343 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 10532 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/modules.builtin.bin 2023-05-16T13:37:42.343 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 70097 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/modules.builtin.modinfo 2023-05-16T13:37:42.343 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 146789 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/modules.dep 2023-05-16T13:37:42.343 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 233606 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/modules.dep.bin 2023-05-16T13:37:42.343 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 210 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/modules.devname 2023-05-16T13:37:42.344 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 73038 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/modules.order 2023-05-16T13:37:42.344 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 879 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/modules.softdep 2023-05-16T13:37:42.344 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 251751 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/modules.symbols 2023-05-16T13:37:42.344 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 306320 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/modules.symbols.bin 2023-05-16T13:37:42.344 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./usr/ 2023-05-16T13:37:42.344 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./usr/share/ 2023-05-16T13:37:42.344 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./usr/share/doc/ 2023-05-16T13:37:42.345 INFO:teuthology.orchestra.run.smithi039.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./usr/share/doc/linux-image-6.3.0-g7312ab6f53ec/ 2023-05-16T13:37:42.345 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 169 2023-05-15 02:23 ./usr/share/doc/linux-image-6.3.0-g7312ab6f53ec/changelog.Debian.gz 2023-05-16T13:37:42.345 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r-- root/root 691 2023-05-15 02:23 ./usr/share/doc/linux-image-6.3.0-g7312ab6f53ec/copyright 2023-05-16T13:37:42.346 DEBUG:teuthology.task.kernel:get_image_version: 6.3.0-g7312ab6f53ec 2023-05-16T13:37:42.346 INFO:teuthology.task.kernel:searching for kernel 6.3.0-g7312ab6f53ec 2023-05-16T13:37:42.346 DEBUG:teuthology.orchestra.run.smithi039:> egrep '(submenu|menuentry.*6.3.0-g7312ab6f53ec).*{' /boot/grub/grub.cfg 2023-05-16T13:37:42.353 INFO:teuthology.orchestra.run.smithi039.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-05-16T13:37:42.353 INFO:teuthology.orchestra.run.smithi039.stdout: menuentry 'Ubuntu, with Linux 6.3.0-g7312ab6f53ec' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.3.0-g7312ab6f53ec-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-05-16T13:37:42.353 INFO:teuthology.orchestra.run.smithi039.stdout: menuentry 'Ubuntu, with Linux 6.3.0-g7312ab6f53ec (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.3.0-g7312ab6f53ec-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-05-16T13:37:42.354 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-05-16T13:37:42.354 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.3.0-g7312ab6f53ec 2023-05-16T13:37:42.354 DEBUG:teuthology.orchestra.run.smithi039:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-05-16T13:37:42.355 INFO:teuthology.orchestra.run.smithi118.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-05-16T13:37:42.359 INFO:teuthology.orchestra.run.smithi118.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-05-16T13:37:42.396 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi039.front.sepia.ceph.com to complete... 2023-05-16T13:37:42.492 INFO:teuthology.orchestra.run.smithi118.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-05-16T13:37:42.492 INFO:teuthology.orchestra.run.smithi118.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-05-16T13:37:42.492 INFO:teuthology.orchestra.run.smithi118.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-05-16T13:37:42.510 INFO:teuthology.orchestra.run.smithi118.stderr:done 2023-05-16T13:37:42.752 INFO:teuthology.orchestra.run.smithi039.stderr:Sourcing file `/etc/default/grub' 2023-05-16T13:37:42.753 INFO:teuthology.orchestra.run.smithi039.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-05-16T13:37:42.772 INFO:teuthology.orchestra.run.smithi039.stderr:Generating grub configuration file ... 2023-05-16T13:37:42.985 INFO:teuthology.orchestra.run.smithi039.stderr:Found linux image: /boot/vmlinuz-6.3.0-g7312ab6f53ec 2023-05-16T13:37:42.991 INFO:teuthology.orchestra.run.smithi039.stderr:Found initrd image: /boot/initrd.img-6.3.0-g7312ab6f53ec 2023-05-16T13:37:43.214 INFO:teuthology.orchestra.run.smithi039.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-05-16T13:37:43.220 INFO:teuthology.orchestra.run.smithi039.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-05-16T13:37:43.259 INFO:teuthology.orchestra.run.smithi039.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-05-16T13:37:43.264 INFO:teuthology.orchestra.run.smithi039.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-05-16T13:37:43.411 INFO:teuthology.orchestra.run.smithi039.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-05-16T13:37:43.412 INFO:teuthology.orchestra.run.smithi039.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-05-16T13:37:43.412 INFO:teuthology.orchestra.run.smithi039.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-05-16T13:37:43.422 INFO:teuthology.orchestra.run.smithi039.stderr:done 2023-05-16T13:38:13.666 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-05-16T13:38:13.666 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-05-16T13:38:13.667 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-16T13:38:14.554 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-05-16T13:38:14.555 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2023-05-16T13:38:14.555 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-16T13:38:32.176 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-05-16T13:38:32.944 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.39 2023-05-16T13:39:02.204 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-05-16T13:39:02.205 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-16T13:39:02.946 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2023-05-16T13:39:02.946 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-16T13:39:06.000 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.39 2023-05-16T13:39:36.031 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2023-05-16T13:39:36.031 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-16T13:39:54.352 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.39 2023-05-16T13:40:02.212 DEBUG:teuthology.orchestra.remote:timed out 2023-05-16T13:40:24.374 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2023-05-16T13:40:24.374 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-16T13:40:24.565 DEBUG:teuthology.orchestra.run.smithi039:> true 2023-05-16T13:40:25.374 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi039.front.sepia.ceph.com' 2023-05-16T13:40:25.374 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.3.0-g7312ab6f53ec"... 2023-05-16T13:40:25.374 DEBUG:teuthology.orchestra.run.smithi039:> uname -r 2023-05-16T13:40:25.428 INFO:teuthology.orchestra.run.smithi039.stdout:6.3.0-g7312ab6f53ec 2023-05-16T13:40:25.428 DEBUG:teuthology.task.kernel:current kernel version is 6.3.0-g7312ab6f53ec vs 6.3.0-g7312ab6f53ec 2023-05-16T13:40:25.428 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-05-16T13:40:25.428 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-05-16T13:40:26.429 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-05-16T13:40:26.430 DEBUG:teuthology.orchestra.run.smithi039:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-05-16T13:40:26.527 INFO:teuthology.orchestra.run.smithi039.stdout:ttyS1 2023-05-16T13:40:26.571 DEBUG:teuthology.parallel:result is None 2023-05-16T13:40:32.214 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-05-16T13:40:32.215 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-16T13:40:32.428 DEBUG:teuthology.orchestra.run.smithi118:> true 2023-05-16T13:40:33.109 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-05-16T13:40:33.110 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.3.0-g7312ab6f53ec"... 2023-05-16T13:40:33.110 DEBUG:teuthology.orchestra.run.smithi118:> uname -r 2023-05-16T13:40:33.118 INFO:teuthology.orchestra.run.smithi118.stdout:6.3.0-g7312ab6f53ec 2023-05-16T13:40:33.118 DEBUG:teuthology.task.kernel:current kernel version is 6.3.0-g7312ab6f53ec vs 6.3.0-g7312ab6f53ec 2023-05-16T13:40:33.118 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-05-16T13:40:33.118 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-05-16T13:40:34.119 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-05-16T13:40:34.120 DEBUG:teuthology.orchestra.run.smithi118:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-05-16T13:40:34.200 INFO:teuthology.orchestra.run.smithi118.stdout:ttyS1 2023-05-16T13:40:34.247 DEBUG:teuthology.parallel:result is None 2023-05-16T13:40:34.247 INFO:teuthology.run_tasks:Running task internal.base... 2023-05-16T13:40:34.258 INFO:teuthology.task.internal:Creating test directory... 2023-05-16T13:40:34.259 DEBUG:teuthology.orchestra.run.smithi039:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-05-16T13:40:34.263 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-05-16T13:40:34.271 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-05-16T13:40:34.278 INFO:teuthology.run_tasks:Running task internal.archive... 2023-05-16T13:40:34.289 INFO:teuthology.task.internal:Creating archive directory... 2023-05-16T13:40:34.289 DEBUG:teuthology.orchestra.run.smithi039:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-05-16T13:40:34.311 DEBUG:teuthology.orchestra.run.smithi118:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-05-16T13:40:34.336 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-05-16T13:40:34.343 INFO:teuthology.task.internal:Enabling coredump saving... 2023-05-16T13:40:34.343 DEBUG:teuthology.orchestra.run.smithi039:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-05-16T13:40:34.375 DEBUG:teuthology.orchestra.run.smithi118:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-05-16T13:40:34.398 INFO:teuthology.orchestra.run.smithi039.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-05-16T13:40:34.399 INFO:teuthology.orchestra.run.smithi118.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-05-16T13:40:34.411 INFO:teuthology.orchestra.run.smithi118.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-05-16T13:40:34.412 INFO:teuthology.orchestra.run.smithi039.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-05-16T13:40:34.414 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-05-16T13:40:34.421 INFO:teuthology.task.internal:Configuring sudo... 2023-05-16T13:40:34.421 DEBUG:teuthology.orchestra.run.smithi039:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-05-16T13:40:34.459 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-05-16T13:40:34.479 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-05-16T13:40:34.488 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-05-16T13:40:34.489 DEBUG:teuthology.orchestra.run.smithi039:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-05-16T13:40:34.523 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-05-16T13:40:34.532 DEBUG:teuthology.orchestra.run.smithi039:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-05-16T13:40:34.584 DEBUG:teuthology.orchestra.run.smithi039:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-05-16T13:40:34.636 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-05-16T13:40:34.637 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-05-16T13:40:34.708 DEBUG:teuthology.orchestra.run.smithi118:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-05-16T13:40:34.717 DEBUG:teuthology.orchestra.run.smithi118:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-05-16T13:40:34.767 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-05-16T13:40:34.768 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-05-16T13:40:34.847 DEBUG:teuthology.orchestra.run.smithi039:> sudo service rsyslog restart 2023-05-16T13:40:34.850 DEBUG:teuthology.orchestra.run.smithi118:> sudo service rsyslog restart 2023-05-16T13:40:35.002 INFO:teuthology.run_tasks:Running task internal.timer... 2023-05-16T13:40:35.009 INFO:teuthology.task.internal:Starting timer... 2023-05-16T13:40:35.010 INFO:teuthology.run_tasks:Running task pcp... 2023-05-16T13:40:35.023 INFO:teuthology.run_tasks:Running task selinux... 2023-05-16T13:40:35.044 DEBUG:teuthology.task.selinux:Excluding smithi039: OS 'ubuntu' does not support SELinux 2023-05-16T13:40:35.044 DEBUG:teuthology.task.selinux:Excluding smithi118: OS 'ubuntu' does not support SELinux 2023-05-16T13:40:35.045 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-05-16T13:40:35.045 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-05-16T13:40:35.045 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-05-16T13:40:35.045 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-05-16T13:40:35.057 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-05-16T13:40:35.058 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-05-16T13:40:35.078 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-05-16T13:40:35.080 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi039.front.sepia.ceph.com,smithi118.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-05-16T13:48:55.402 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi039.front.sepia.ceph.com'), Remote(name='ubuntu@smithi118.front.sepia.ceph.com')] 2023-05-16T13:48:55.404 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2023-05-16T13:48:55.405 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-16T13:48:55.480 DEBUG:teuthology.orchestra.run.smithi039:> true 2023-05-16T13:48:55.618 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-05-16T13:48:55.619 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-16T13:48:55.698 DEBUG:teuthology.orchestra.run.smithi118:> true 2023-05-16T13:48:55.850 INFO:teuthology.run_tasks:Running task clock... 2023-05-16T13:48:55.860 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-05-16T13:48:55.861 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-05-16T13:48:55.861 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-05-16T13:48:55.864 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-05-16T13:48:55.864 DEBUG:teuthology.orchestra.run.smithi118:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-05-16T13:48:55.898 INFO:teuthology.orchestra.run.smithi039.stdout:16 May 13:48:55 ntpd[26906]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-05-16T13:48:55.899 INFO:teuthology.orchestra.run.smithi039.stdout:16 May 13:48:55 ntpd[26906]: Command line: ntpd -gq 2023-05-16T13:48:55.899 INFO:teuthology.orchestra.run.smithi039.stdout:16 May 13:48:55 ntpd[26906]: ---------------------------------------------------- 2023-05-16T13:48:55.899 INFO:teuthology.orchestra.run.smithi039.stdout:16 May 13:48:55 ntpd[26906]: ntp-4 is maintained by Network Time Foundation, 2023-05-16T13:48:55.899 INFO:teuthology.orchestra.run.smithi039.stdout:16 May 13:48:55 ntpd[26906]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-05-16T13:48:55.899 INFO:teuthology.orchestra.run.smithi039.stdout:16 May 13:48:55 ntpd[26906]: corporation. Support and training for ntp-4 are 2023-05-16T13:48:55.899 INFO:teuthology.orchestra.run.smithi039.stdout:16 May 13:48:55 ntpd[26906]: available at https://www.nwtime.org/support 2023-05-16T13:48:55.900 INFO:teuthology.orchestra.run.smithi039.stdout:16 May 13:48:55 ntpd[26906]: ---------------------------------------------------- 2023-05-16T13:48:55.901 INFO:teuthology.orchestra.run.smithi039.stdout:16 May 13:48:55 ntpd[26906]: proto: precision = 0.043 usec (-24) 2023-05-16T13:48:55.901 INFO:teuthology.orchestra.run.smithi039.stdout:16 May 13:48:55 ntpd[26906]: basedate set to 2022-02-04 2023-05-16T13:48:55.901 INFO:teuthology.orchestra.run.smithi039.stdout:16 May 13:48:55 ntpd[26906]: gps base set to 2022-02-06 (week 2196) 2023-05-16T13:48:55.901 INFO:teuthology.orchestra.run.smithi039.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-05-16T13:48:55.902 INFO:teuthology.orchestra.run.smithi039.stdout:16 May 13:48:55 ntpd[26906]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-05-16T13:48:55.902 INFO:teuthology.orchestra.run.smithi039.stderr:restrict ::: KOD does nothing without LIMITED. 2023-05-16T13:48:55.903 INFO:teuthology.orchestra.run.smithi039.stdout:16 May 13:48:55 ntpd[26906]: restrict ::: KOD does nothing without LIMITED. 2023-05-16T13:48:55.903 INFO:teuthology.orchestra.run.smithi039.stdout:16 May 13:48:55 ntpd[26906]: Listen and drop on 0 v6wildcard [::]:123 2023-05-16T13:48:55.903 INFO:teuthology.orchestra.run.smithi039.stdout:16 May 13:48:55 ntpd[26906]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-05-16T13:48:55.903 INFO:teuthology.orchestra.run.smithi039.stdout:16 May 13:48:55 ntpd[26906]: Listen normally on 2 lo 127.0.0.1:123 2023-05-16T13:48:55.903 INFO:teuthology.orchestra.run.smithi039.stdout:16 May 13:48:55 ntpd[26906]: Listen normally on 3 ens1f0 172.21.15.39:123 2023-05-16T13:48:55.904 INFO:teuthology.orchestra.run.smithi039.stdout:16 May 13:48:55 ntpd[26906]: Listen normally on 4 lo [::1]:123 2023-05-16T13:48:55.904 INFO:teuthology.orchestra.run.smithi039.stdout:16 May 13:48:55 ntpd[26906]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:1370%4]:123 2023-05-16T13:48:55.904 INFO:teuthology.orchestra.run.smithi039.stdout:16 May 13:48:55 ntpd[26906]: Listening on routing socket on fd #22 for interface updates 2023-05-16T13:48:55.933 INFO:teuthology.orchestra.run.smithi118.stdout:16 May 13:48:55 ntpd[26945]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-05-16T13:48:55.933 INFO:teuthology.orchestra.run.smithi118.stdout:16 May 13:48:55 ntpd[26945]: Command line: ntpd -gq 2023-05-16T13:48:55.933 INFO:teuthology.orchestra.run.smithi118.stdout:16 May 13:48:55 ntpd[26945]: ---------------------------------------------------- 2023-05-16T13:48:55.933 INFO:teuthology.orchestra.run.smithi118.stdout:16 May 13:48:55 ntpd[26945]: ntp-4 is maintained by Network Time Foundation, 2023-05-16T13:48:55.934 INFO:teuthology.orchestra.run.smithi118.stdout:16 May 13:48:55 ntpd[26945]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-05-16T13:48:55.934 INFO:teuthology.orchestra.run.smithi118.stdout:16 May 13:48:55 ntpd[26945]: corporation. Support and training for ntp-4 are 2023-05-16T13:48:55.934 INFO:teuthology.orchestra.run.smithi118.stdout:16 May 13:48:55 ntpd[26945]: available at https://www.nwtime.org/support 2023-05-16T13:48:55.934 INFO:teuthology.orchestra.run.smithi118.stdout:16 May 13:48:55 ntpd[26945]: ---------------------------------------------------- 2023-05-16T13:48:55.935 INFO:teuthology.orchestra.run.smithi118.stdout:16 May 13:48:55 ntpd[26945]: proto: precision = 0.041 usec (-24) 2023-05-16T13:48:55.935 INFO:teuthology.orchestra.run.smithi118.stdout:16 May 13:48:55 ntpd[26945]: basedate set to 2022-02-04 2023-05-16T13:48:55.935 INFO:teuthology.orchestra.run.smithi118.stdout:16 May 13:48:55 ntpd[26945]: gps base set to 2022-02-06 (week 2196) 2023-05-16T13:48:55.935 INFO:teuthology.orchestra.run.smithi118.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-05-16T13:48:55.936 INFO:teuthology.orchestra.run.smithi118.stdout:16 May 13:48:55 ntpd[26945]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-05-16T13:48:55.936 INFO:teuthology.orchestra.run.smithi118.stderr:restrict ::: KOD does nothing without LIMITED. 2023-05-16T13:48:55.937 INFO:teuthology.orchestra.run.smithi118.stdout:16 May 13:48:55 ntpd[26945]: restrict ::: KOD does nothing without LIMITED. 2023-05-16T13:48:55.937 INFO:teuthology.orchestra.run.smithi118.stdout:16 May 13:48:55 ntpd[26945]: Listen and drop on 0 v6wildcard [::]:123 2023-05-16T13:48:55.937 INFO:teuthology.orchestra.run.smithi118.stdout:16 May 13:48:55 ntpd[26945]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-05-16T13:48:55.937 INFO:teuthology.orchestra.run.smithi118.stdout:16 May 13:48:55 ntpd[26945]: Listen normally on 2 lo 127.0.0.1:123 2023-05-16T13:48:55.937 INFO:teuthology.orchestra.run.smithi118.stdout:16 May 13:48:55 ntpd[26945]: Listen normally on 3 enp3s0f1 172.21.15.118:123 2023-05-16T13:48:55.937 INFO:teuthology.orchestra.run.smithi118.stdout:16 May 13:48:55 ntpd[26945]: Listen normally on 4 lo [::1]:123 2023-05-16T13:48:55.938 INFO:teuthology.orchestra.run.smithi118.stdout:16 May 13:48:55 ntpd[26945]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d725%5]:123 2023-05-16T13:48:55.938 INFO:teuthology.orchestra.run.smithi118.stdout:16 May 13:48:55 ntpd[26945]: Listening on routing socket on fd #22 for interface updates 2023-05-16T13:48:56.899 INFO:teuthology.orchestra.run.smithi039.stderr:16 May 13:48:56 ntpd[26906]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-16T13:48:56.899 INFO:teuthology.orchestra.run.smithi039.stderr:16 May 13:48:56 ntpd[26906]: can't open /var/log/ntpstats/rawstats.20230516: Permission denied 2023-05-16T13:48:56.900 INFO:teuthology.orchestra.run.smithi039.stderr:16 May 13:48:56 ntpd[26906]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-16T13:48:56.900 INFO:teuthology.orchestra.run.smithi039.stderr:16 May 13:48:56 ntpd[26906]: can't open /var/log/ntpstats/rawstats.20230516: Permission denied 2023-05-16T13:48:56.900 INFO:teuthology.orchestra.run.smithi039.stderr:16 May 13:48:56 ntpd[26906]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-16T13:48:56.901 INFO:teuthology.orchestra.run.smithi039.stderr:16 May 13:48:56 ntpd[26906]: can't open /var/log/ntpstats/peerstats.20230516: Permission denied 2023-05-16T13:48:57.934 INFO:teuthology.orchestra.run.smithi118.stderr:16 May 13:48:57 ntpd[26945]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-16T13:48:57.934 INFO:teuthology.orchestra.run.smithi118.stderr:16 May 13:48:57 ntpd[26945]: can't open /var/log/ntpstats/rawstats.20230516: Permission denied 2023-05-16T13:48:57.934 INFO:teuthology.orchestra.run.smithi118.stderr:16 May 13:48:57 ntpd[26945]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-16T13:48:57.934 INFO:teuthology.orchestra.run.smithi118.stderr:16 May 13:48:57 ntpd[26945]: can't open /var/log/ntpstats/rawstats.20230516: Permission denied 2023-05-16T13:48:57.934 INFO:teuthology.orchestra.run.smithi118.stderr:16 May 13:48:57 ntpd[26945]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-16T13:48:57.934 INFO:teuthology.orchestra.run.smithi118.stderr:16 May 13:48:57 ntpd[26945]: can't open /var/log/ntpstats/peerstats.20230516: Permission denied 2023-05-16T13:48:58.900 INFO:teuthology.orchestra.run.smithi039.stderr:16 May 13:48:58 ntpd[26906]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-16T13:48:58.900 INFO:teuthology.orchestra.run.smithi039.stderr:16 May 13:48:58 ntpd[26906]: can't open /var/log/ntpstats/rawstats.20230516: Permission denied 2023-05-16T13:48:58.900 INFO:teuthology.orchestra.run.smithi039.stderr:16 May 13:48:58 ntpd[26906]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-16T13:48:58.900 INFO:teuthology.orchestra.run.smithi039.stderr:16 May 13:48:58 ntpd[26906]: can't open /var/log/ntpstats/rawstats.20230516: Permission denied 2023-05-16T13:48:58.901 INFO:teuthology.orchestra.run.smithi039.stderr:16 May 13:48:58 ntpd[26906]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-16T13:48:58.901 INFO:teuthology.orchestra.run.smithi039.stderr:16 May 13:48:58 ntpd[26906]: can't open /var/log/ntpstats/rawstats.20230516: Permission denied 2023-05-16T13:48:58.901 INFO:teuthology.orchestra.run.smithi039.stderr:16 May 13:48:58 ntpd[26906]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-16T13:48:58.901 INFO:teuthology.orchestra.run.smithi039.stderr:16 May 13:48:58 ntpd[26906]: can't open /var/log/ntpstats/peerstats.20230516: Permission denied 2023-05-16T13:48:58.901 INFO:teuthology.orchestra.run.smithi039.stderr:16 May 13:48:58 ntpd[26906]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-16T13:48:58.901 INFO:teuthology.orchestra.run.smithi039.stderr:16 May 13:48:58 ntpd[26906]: can't open /var/log/ntpstats/rawstats.20230516: Permission denied 2023-05-16T13:48:58.901 INFO:teuthology.orchestra.run.smithi039.stderr:16 May 13:48:58 ntpd[26906]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-16T13:48:58.902 INFO:teuthology.orchestra.run.smithi039.stderr:16 May 13:48:58 ntpd[26906]: can't open /var/log/ntpstats/peerstats.20230516: Permission denied 2023-05-16T13:48:58.934 INFO:teuthology.orchestra.run.smithi118.stderr:16 May 13:48:58 ntpd[26945]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-16T13:48:58.934 INFO:teuthology.orchestra.run.smithi118.stderr:16 May 13:48:58 ntpd[26945]: can't open /var/log/ntpstats/rawstats.20230516: Permission denied 2023-05-16T13:48:58.934 INFO:teuthology.orchestra.run.smithi118.stderr:16 May 13:48:58 ntpd[26945]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-16T13:48:58.934 INFO:teuthology.orchestra.run.smithi118.stderr:16 May 13:48:58 ntpd[26945]: can't open /var/log/ntpstats/rawstats.20230516: Permission denied 2023-05-16T13:48:58.934 INFO:teuthology.orchestra.run.smithi118.stderr:16 May 13:48:58 ntpd[26945]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-16T13:48:58.934 INFO:teuthology.orchestra.run.smithi118.stderr:16 May 13:48:58 ntpd[26945]: can't open /var/log/ntpstats/peerstats.20230516: Permission denied 2023-05-16T13:48:59.934 INFO:teuthology.orchestra.run.smithi118.stderr:16 May 13:48:59 ntpd[26945]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-16T13:48:59.934 INFO:teuthology.orchestra.run.smithi118.stderr:16 May 13:48:59 ntpd[26945]: can't open /var/log/ntpstats/rawstats.20230516: Permission denied 2023-05-16T13:48:59.934 INFO:teuthology.orchestra.run.smithi118.stderr:16 May 13:48:59 ntpd[26945]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-16T13:48:59.935 INFO:teuthology.orchestra.run.smithi118.stderr:16 May 13:48:59 ntpd[26945]: can't open /var/log/ntpstats/rawstats.20230516: Permission denied 2023-05-16T13:48:59.935 INFO:teuthology.orchestra.run.smithi118.stderr:16 May 13:48:59 ntpd[26945]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-16T13:48:59.935 INFO:teuthology.orchestra.run.smithi118.stderr:16 May 13:48:59 ntpd[26945]: can't open /var/log/ntpstats/rawstats.20230516: Permission denied 2023-05-16T13:48:59.935 INFO:teuthology.orchestra.run.smithi118.stderr:16 May 13:48:59 ntpd[26945]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-16T13:48:59.935 INFO:teuthology.orchestra.run.smithi118.stderr:16 May 13:48:59 ntpd[26945]: can't open /var/log/ntpstats/peerstats.20230516: Permission denied 2023-05-16T13:49:00.900 INFO:teuthology.orchestra.run.smithi039.stderr:16 May 13:49:00 ntpd[26906]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-16T13:49:00.901 INFO:teuthology.orchestra.run.smithi039.stderr:16 May 13:49:00 ntpd[26906]: can't open /var/log/ntpstats/rawstats.20230516: Permission denied 2023-05-16T13:49:00.901 INFO:teuthology.orchestra.run.smithi039.stderr:16 May 13:49:00 ntpd[26906]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-16T13:49:00.901 INFO:teuthology.orchestra.run.smithi039.stderr:16 May 13:49:00 ntpd[26906]: can't open /var/log/ntpstats/rawstats.20230516: Permission denied 2023-05-16T13:49:00.901 INFO:teuthology.orchestra.run.smithi039.stderr:16 May 13:49:00 ntpd[26906]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-16T13:49:00.901 INFO:teuthology.orchestra.run.smithi039.stderr:16 May 13:49:00 ntpd[26906]: can't open /var/log/ntpstats/rawstats.20230516: Permission denied 2023-05-16T13:49:00.901 INFO:teuthology.orchestra.run.smithi039.stderr:16 May 13:49:00 ntpd[26906]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-16T13:49:00.902 INFO:teuthology.orchestra.run.smithi039.stderr:16 May 13:49:00 ntpd[26906]: can't open /var/log/ntpstats/rawstats.20230516: Permission denied 2023-05-16T13:49:00.902 INFO:teuthology.orchestra.run.smithi039.stderr:16 May 13:49:00 ntpd[26906]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-16T13:49:00.902 INFO:teuthology.orchestra.run.smithi039.stderr:16 May 13:49:00 ntpd[26906]: can't open /var/log/ntpstats/rawstats.20230516: Permission denied 2023-05-16T13:49:00.902 INFO:teuthology.orchestra.run.smithi039.stderr:16 May 13:49:00 ntpd[26906]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-16T13:49:00.902 INFO:teuthology.orchestra.run.smithi039.stderr:16 May 13:49:00 ntpd[26906]: can't open /var/log/ntpstats/peerstats.20230516: Permission denied 2023-05-16T13:49:00.902 INFO:teuthology.orchestra.run.smithi039.stderr:16 May 13:49:00 ntpd[26906]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-16T13:49:00.902 INFO:teuthology.orchestra.run.smithi039.stderr:16 May 13:49:00 ntpd[26906]: can't open /var/log/ntpstats/rawstats.20230516: Permission denied 2023-05-16T13:49:00.903 INFO:teuthology.orchestra.run.smithi039.stderr:16 May 13:49:00 ntpd[26906]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-16T13:49:00.903 INFO:teuthology.orchestra.run.smithi039.stderr:16 May 13:49:00 ntpd[26906]: can't open /var/log/ntpstats/peerstats.20230516: Permission denied 2023-05-16T13:49:00.903 INFO:teuthology.orchestra.run.smithi039.stderr:16 May 13:49:00 ntpd[26906]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-16T13:49:00.903 INFO:teuthology.orchestra.run.smithi039.stderr:16 May 13:49:00 ntpd[26906]: can't open /var/log/ntpstats/rawstats.20230516: Permission denied 2023-05-16T13:49:00.903 INFO:teuthology.orchestra.run.smithi039.stderr:16 May 13:49:00 ntpd[26906]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-16T13:49:00.903 INFO:teuthology.orchestra.run.smithi039.stderr:16 May 13:49:00 ntpd[26906]: can't open /var/log/ntpstats/peerstats.20230516: Permission denied 2023-05-16T13:49:00.934 INFO:teuthology.orchestra.run.smithi118.stderr:16 May 13:49:00 ntpd[26945]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-16T13:49:00.935 INFO:teuthology.orchestra.run.smithi118.stderr:16 May 13:49:00 ntpd[26945]: can't open /var/log/ntpstats/rawstats.20230516: Permission denied 2023-05-16T13:49:00.935 INFO:teuthology.orchestra.run.smithi118.stderr:16 May 13:49:00 ntpd[26945]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-16T13:49:00.935 INFO:teuthology.orchestra.run.smithi118.stderr:16 May 13:49:00 ntpd[26945]: can't open /var/log/ntpstats/rawstats.20230516: Permission denied 2023-05-16T13:49:00.935 INFO:teuthology.orchestra.run.smithi118.stderr:16 May 13:49:00 ntpd[26945]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-16T13:49:00.935 INFO:teuthology.orchestra.run.smithi118.stderr:16 May 13:49:00 ntpd[26945]: can't open /var/log/ntpstats/rawstats.20230516: Permission denied 2023-05-16T13:49:00.935 INFO:teuthology.orchestra.run.smithi118.stderr:16 May 13:49:00 ntpd[26945]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-16T13:49:00.935 INFO:teuthology.orchestra.run.smithi118.stderr:16 May 13:49:00 ntpd[26945]: can't open /var/log/ntpstats/peerstats.20230516: Permission denied 2023-05-16T13:49:00.936 INFO:teuthology.orchestra.run.smithi118.stderr:16 May 13:49:00 ntpd[26945]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-16T13:49:00.936 INFO:teuthology.orchestra.run.smithi118.stderr:16 May 13:49:00 ntpd[26945]: can't open /var/log/ntpstats/rawstats.20230516: Permission denied 2023-05-16T13:49:00.936 INFO:teuthology.orchestra.run.smithi118.stderr:16 May 13:49:00 ntpd[26945]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-16T13:49:00.936 INFO:teuthology.orchestra.run.smithi118.stderr:16 May 13:49:00 ntpd[26945]: can't open /var/log/ntpstats/peerstats.20230516: Permission denied 2023-05-16T13:49:01.934 INFO:teuthology.orchestra.run.smithi118.stderr:16 May 13:49:01 ntpd[26945]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-16T13:49:01.934 INFO:teuthology.orchestra.run.smithi118.stderr:16 May 13:49:01 ntpd[26945]: can't open /var/log/ntpstats/rawstats.20230516: Permission denied 2023-05-16T13:49:01.934 INFO:teuthology.orchestra.run.smithi118.stderr:16 May 13:49:01 ntpd[26945]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-16T13:49:01.934 INFO:teuthology.orchestra.run.smithi118.stderr:16 May 13:49:01 ntpd[26945]: can't open /var/log/ntpstats/rawstats.20230516: Permission denied 2023-05-16T13:49:01.934 INFO:teuthology.orchestra.run.smithi118.stderr:16 May 13:49:01 ntpd[26945]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-16T13:49:01.935 INFO:teuthology.orchestra.run.smithi118.stderr:16 May 13:49:01 ntpd[26945]: can't open /var/log/ntpstats/peerstats.20230516: Permission denied 2023-05-16T13:49:02.899 INFO:teuthology.orchestra.run.smithi039.stderr:16 May 13:49:02 ntpd[26906]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-16T13:49:02.900 INFO:teuthology.orchestra.run.smithi039.stderr:16 May 13:49:02 ntpd[26906]: can't open /var/log/ntpstats/rawstats.20230516: Permission denied 2023-05-16T13:49:02.900 INFO:teuthology.orchestra.run.smithi039.stderr:16 May 13:49:02 ntpd[26906]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-16T13:49:02.900 INFO:teuthology.orchestra.run.smithi039.stderr:16 May 13:49:02 ntpd[26906]: can't open /var/log/ntpstats/rawstats.20230516: Permission denied 2023-05-16T13:49:02.900 INFO:teuthology.orchestra.run.smithi039.stderr:16 May 13:49:02 ntpd[26906]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-16T13:49:02.900 INFO:teuthology.orchestra.run.smithi039.stderr:16 May 13:49:02 ntpd[26906]: can't open /var/log/ntpstats/rawstats.20230516: Permission denied 2023-05-16T13:49:02.901 INFO:teuthology.orchestra.run.smithi039.stderr:16 May 13:49:02 ntpd[26906]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-16T13:49:02.901 INFO:teuthology.orchestra.run.smithi039.stderr:16 May 13:49:02 ntpd[26906]: can't open /var/log/ntpstats/rawstats.20230516: Permission denied 2023-05-16T13:49:02.901 INFO:teuthology.orchestra.run.smithi039.stderr:16 May 13:49:02 ntpd[26906]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-16T13:49:02.901 INFO:teuthology.orchestra.run.smithi039.stderr:16 May 13:49:02 ntpd[26906]: can't open /var/log/ntpstats/peerstats.20230516: Permission denied 2023-05-16T13:49:02.901 INFO:teuthology.orchestra.run.smithi039.stderr:16 May 13:49:02 ntpd[26906]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-16T13:49:02.901 INFO:teuthology.orchestra.run.smithi039.stderr:16 May 13:49:02 ntpd[26906]: can't open /var/log/ntpstats/rawstats.20230516: Permission denied 2023-05-16T13:49:02.902 INFO:teuthology.orchestra.run.smithi039.stdout:16 May 13:49:02 ntpd[26906]: ntpd: time slew -0.006457 s 2023-05-16T13:49:02.902 INFO:teuthology.orchestra.run.smithi039.stdout:ntpd: time slew -0.006457s 2023-05-16T13:49:02.902 INFO:teuthology.orchestra.run.smithi039.stderr:16 May 13:49:02 ntpd[26906]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-16T13:49:02.902 INFO:teuthology.orchestra.run.smithi039.stderr:16 May 13:49:02 ntpd[26906]: can't open /var/log/ntpstats/peerstats.20230516: Permission denied 2023-05-16T13:49:02.902 INFO:teuthology.orchestra.run.smithi039.stderr:16 May 13:49:02 ntpd[26906]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-05-16T13:49:02.902 INFO:teuthology.orchestra.run.smithi039.stderr:16 May 13:49:02 ntpd[26906]: can't open /var/log/ntpstats/loopstats.20230516: Permission denied 2023-05-16T13:49:02.934 INFO:teuthology.orchestra.run.smithi118.stderr:16 May 13:49:02 ntpd[26945]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-16T13:49:02.934 INFO:teuthology.orchestra.run.smithi118.stderr:16 May 13:49:02 ntpd[26945]: can't open /var/log/ntpstats/rawstats.20230516: Permission denied 2023-05-16T13:49:02.934 INFO:teuthology.orchestra.run.smithi118.stderr:16 May 13:49:02 ntpd[26945]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-16T13:49:02.935 INFO:teuthology.orchestra.run.smithi118.stderr:16 May 13:49:02 ntpd[26945]: can't open /var/log/ntpstats/rawstats.20230516: Permission denied 2023-05-16T13:49:02.935 INFO:teuthology.orchestra.run.smithi118.stderr:16 May 13:49:02 ntpd[26945]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-16T13:49:02.935 INFO:teuthology.orchestra.run.smithi118.stderr:16 May 13:49:02 ntpd[26945]: can't open /var/log/ntpstats/rawstats.20230516: Permission denied 2023-05-16T13:49:02.935 INFO:teuthology.orchestra.run.smithi118.stderr:16 May 13:49:02 ntpd[26945]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-16T13:49:02.935 INFO:teuthology.orchestra.run.smithi118.stderr:16 May 13:49:02 ntpd[26945]: can't open /var/log/ntpstats/peerstats.20230516: Permission denied 2023-05-16T13:49:02.935 INFO:teuthology.orchestra.run.smithi118.stderr:16 May 13:49:02 ntpd[26945]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-16T13:49:02.935 INFO:teuthology.orchestra.run.smithi118.stderr:16 May 13:49:02 ntpd[26945]: can't open /var/log/ntpstats/rawstats.20230516: Permission denied 2023-05-16T13:49:02.936 INFO:teuthology.orchestra.run.smithi118.stderr:16 May 13:49:02 ntpd[26945]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-16T13:49:02.936 INFO:teuthology.orchestra.run.smithi118.stderr:16 May 13:49:02 ntpd[26945]: can't open /var/log/ntpstats/peerstats.20230516: Permission denied 2023-05-16T13:49:03.024 INFO:teuthology.orchestra.run.smithi039.stdout: remote refid st t when poll reach delay offset jitter 2023-05-16T13:49:03.025 INFO:teuthology.orchestra.run.smithi039.stdout:============================================================================== 2023-05-16T13:49:03.025 INFO:teuthology.orchestra.run.smithi039.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-05-16T13:49:03.025 INFO:teuthology.orchestra.run.smithi039.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-05-16T13:49:03.025 INFO:teuthology.orchestra.run.smithi039.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-05-16T13:49:03.025 INFO:teuthology.orchestra.run.smithi039.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-05-16T13:49:03.934 INFO:teuthology.orchestra.run.smithi118.stderr:16 May 13:49:03 ntpd[26945]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-16T13:49:03.934 INFO:teuthology.orchestra.run.smithi118.stderr:16 May 13:49:03 ntpd[26945]: can't open /var/log/ntpstats/rawstats.20230516: Permission denied 2023-05-16T13:49:03.934 INFO:teuthology.orchestra.run.smithi118.stderr:16 May 13:49:03 ntpd[26945]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-16T13:49:03.934 INFO:teuthology.orchestra.run.smithi118.stderr:16 May 13:49:03 ntpd[26945]: can't open /var/log/ntpstats/rawstats.20230516: Permission denied 2023-05-16T13:49:03.935 INFO:teuthology.orchestra.run.smithi118.stderr:16 May 13:49:03 ntpd[26945]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-16T13:49:03.935 INFO:teuthology.orchestra.run.smithi118.stderr:16 May 13:49:03 ntpd[26945]: can't open /var/log/ntpstats/peerstats.20230516: Permission denied 2023-05-16T13:49:03.935 INFO:teuthology.orchestra.run.smithi118.stdout:16 May 13:49:03 ntpd[26945]: ntpd: time slew -0.000459 s 2023-05-16T13:49:03.935 INFO:teuthology.orchestra.run.smithi118.stdout:ntpd: time slew -0.000459s 2023-05-16T13:49:03.936 INFO:teuthology.orchestra.run.smithi118.stderr:16 May 13:49:03 ntpd[26945]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-05-16T13:49:03.936 INFO:teuthology.orchestra.run.smithi118.stderr:16 May 13:49:03 ntpd[26945]: can't open /var/log/ntpstats/loopstats.20230516: Permission denied 2023-05-16T13:49:04.055 INFO:teuthology.orchestra.run.smithi118.stdout: remote refid st t when poll reach delay offset jitter 2023-05-16T13:49:04.056 INFO:teuthology.orchestra.run.smithi118.stdout:============================================================================== 2023-05-16T13:49:04.056 INFO:teuthology.orchestra.run.smithi118.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-05-16T13:49:04.057 INFO:teuthology.orchestra.run.smithi118.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-05-16T13:49:04.057 INFO:teuthology.orchestra.run.smithi118.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-05-16T13:49:04.057 INFO:teuthology.orchestra.run.smithi118.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-05-16T13:49:04.058 INFO:teuthology.run_tasks:Running task install... 2023-05-16T13:49:04.071 DEBUG:teuthology.task.install:project ceph 2023-05-16T13:49:04.071 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '27be51263d3d0c721b6d1ca9f42550bf0ab3c97b'}} 2023-05-16T13:49:04.072 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '27be51263d3d0c721b6d1ca9f42550bf0ab3c97b'} 2023-05-16T13:49:04.072 INFO:teuthology.task.install:Using flavor: default 2023-05-16T13:49:04.078 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-05-16T13:49:04.078 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-05-16T13:49:04.079 DEBUG:teuthology.orchestra.run.smithi039:> sudo apt-key list | grep Ceph 2023-05-16T13:49:04.080 DEBUG:teuthology.orchestra.run.smithi118:> sudo apt-key list | grep Ceph 2023-05-16T13:49:04.183 INFO:teuthology.orchestra.run.smithi039.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-05-16T13:49:04.196 INFO:teuthology.orchestra.run.smithi118.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-05-16T13:49:04.233 INFO:teuthology.orchestra.run.smithi039.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-05-16T13:49:04.233 INFO:teuthology.orchestra.run.smithi039.stdout:uid [ unknown] Ceph.com (release key) 2023-05-16T13:49:04.234 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-05-16T13:49:04.235 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-05-16T13:49:04.235 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=27be51263d3d0c721b6d1ca9f42550bf0ab3c97b 2023-05-16T13:49:04.244 INFO:teuthology.orchestra.run.smithi118.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-05-16T13:49:04.244 INFO:teuthology.orchestra.run.smithi118.stdout:uid [ unknown] Ceph.com (release key) 2023-05-16T13:49:04.245 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-05-16T13:49:04.245 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-05-16T13:49:04.245 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=27be51263d3d0c721b6d1ca9f42550bf0ab3c97b 2023-05-16T13:49:04.374 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default/ 2023-05-16T13:49:04.375 INFO:teuthology.task.install.deb:Package version is 18.0.0-3926-g27be5126-1jammy 2023-05-16T13:49:04.379 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default/ 2023-05-16T13:49:04.380 INFO:teuthology.task.install.deb:Package version is 18.0.0-3926-g27be5126-1jammy 2023-05-16T13:49:04.481 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-05-16T13:49:04.482 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-05-16T13:49:04.500 DEBUG:teuthology.orchestra.run.smithi039:> sudo apt-get update 2023-05-16T13:49:04.508 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-05-16T13:49:04.508 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-05-16T13:49:04.526 DEBUG:teuthology.orchestra.run.smithi118:> sudo apt-get update 2023-05-16T13:49:04.688 INFO:teuthology.orchestra.run.smithi039.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-05-16T13:49:04.695 INFO:teuthology.orchestra.run.smithi039.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-05-16T13:49:04.713 INFO:teuthology.orchestra.run.smithi039.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-05-16T13:49:04.737 INFO:teuthology.orchestra.run.smithi039.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy InRelease 2023-05-16T13:49:04.752 INFO:teuthology.orchestra.run.smithi118.stdout:Ign:1 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy InRelease 2023-05-16T13:49:04.759 INFO:teuthology.orchestra.run.smithi039.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-05-16T13:49:04.773 INFO:teuthology.orchestra.run.smithi118.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-05-16T13:49:04.781 INFO:teuthology.orchestra.run.smithi039.stdout:Ign:6 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy Release.gpg 2023-05-16T13:49:04.795 INFO:teuthology.orchestra.run.smithi118.stdout:Ign:3 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy Release.gpg 2023-05-16T13:49:04.803 INFO:teuthology.orchestra.run.smithi039.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.4 kB] 2023-05-16T13:49:04.817 INFO:teuthology.orchestra.run.smithi118.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,414 B] 2023-05-16T13:49:04.834 INFO:teuthology.orchestra.run.smithi039.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,414 B] 2023-05-16T13:49:04.849 INFO:teuthology.orchestra.run.smithi118.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.4 kB] 2023-05-16T13:49:04.890 INFO:teuthology.orchestra.run.smithi039.stdout:Hit:9 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-05-16T13:49:04.913 INFO:teuthology.orchestra.run.smithi118.stdout:Hit:6 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-05-16T13:49:05.275 INFO:teuthology.orchestra.run.smithi039.stdout:Fetched 28.5 kB in 1s (51.6 kB/s) 2023-05-16T13:49:06.160 INFO:teuthology.orchestra.run.smithi039.stdout:Reading package lists... 2023-05-16T13:49:06.176 DEBUG:teuthology.orchestra.run.smithi039:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-3926-g27be5126-1jammy cephadm=18.0.0-3926-g27be5126-1jammy ceph-mds=18.0.0-3926-g27be5126-1jammy ceph-mgr=18.0.0-3926-g27be5126-1jammy ceph-common=18.0.0-3926-g27be5126-1jammy ceph-fuse=18.0.0-3926-g27be5126-1jammy ceph-test=18.0.0-3926-g27be5126-1jammy ceph-volume=18.0.0-3926-g27be5126-1jammy radosgw=18.0.0-3926-g27be5126-1jammy python3-rados=18.0.0-3926-g27be5126-1jammy python3-rgw=18.0.0-3926-g27be5126-1jammy python3-cephfs=18.0.0-3926-g27be5126-1jammy python3-rbd=18.0.0-3926-g27be5126-1jammy libcephfs2=18.0.0-3926-g27be5126-1jammy libcephfs-dev=18.0.0-3926-g27be5126-1jammy librados2=18.0.0-3926-g27be5126-1jammy librbd1=18.0.0-3926-g27be5126-1jammy rbd-fuse=18.0.0-3926-g27be5126-1jammy python3-cephfs=18.0.0-3926-g27be5126-1jammy cephfs-shell=18.0.0-3926-g27be5126-1jammy cephfs-top=18.0.0-3926-g27be5126-1jammy cephfs-mirror=18.0.0-3926-g27be5126-1jammy 2023-05-16T13:49:06.203 INFO:teuthology.orchestra.run.smithi118.stdout:Hit:7 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-05-16T13:49:06.250 INFO:teuthology.orchestra.run.smithi039.stdout:Reading package lists... 2023-05-16T13:49:06.285 INFO:teuthology.orchestra.run.smithi118.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-05-16T13:49:06.369 INFO:teuthology.orchestra.run.smithi118.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-05-16T13:49:06.404 INFO:teuthology.orchestra.run.smithi039.stdout:Building dependency tree... 2023-05-16T13:49:06.405 INFO:teuthology.orchestra.run.smithi039.stdout:Reading state information... 2023-05-16T13:49:06.548 INFO:teuthology.orchestra.run.smithi039.stdout:The following packages were automatically installed and are no longer required: 2023-05-16T13:49:06.548 INFO:teuthology.orchestra.run.smithi039.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-05-16T13:49:06.549 INFO:teuthology.orchestra.run.smithi039.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-05-16T13:49:06.549 INFO:teuthology.orchestra.run.smithi039.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-05-16T13:49:06.549 INFO:teuthology.orchestra.run.smithi039.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-05-16T13:49:06.550 INFO:teuthology.orchestra.run.smithi039.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-05-16T13:49:06.550 INFO:teuthology.orchestra.run.smithi039.stdout:Use 'sudo apt autoremove' to remove them. 2023-05-16T13:49:06.550 INFO:teuthology.orchestra.run.smithi039.stdout:The following additional packages will be installed: 2023-05-16T13:49:06.550 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-05-16T13:49:06.551 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-05-16T13:49:06.551 INFO:teuthology.orchestra.run.smithi039.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-05-16T13:49:06.551 INFO:teuthology.orchestra.run.smithi039.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-05-16T13:49:06.551 INFO:teuthology.orchestra.run.smithi039.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-05-16T13:49:06.551 INFO:teuthology.orchestra.run.smithi039.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-05-16T13:49:06.551 INFO:teuthology.orchestra.run.smithi039.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-05-16T13:49:06.551 INFO:teuthology.orchestra.run.smithi039.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-05-16T13:49:06.551 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-05-16T13:49:06.552 INFO:teuthology.orchestra.run.smithi039.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-05-16T13:49:06.552 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-05-16T13:49:06.552 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-05-16T13:49:06.552 INFO:teuthology.orchestra.run.smithi039.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-05-16T13:49:06.552 INFO:teuthology.orchestra.run.smithi039.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-05-16T13:49:06.552 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-05-16T13:49:06.552 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-05-16T13:49:06.553 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-05-16T13:49:06.553 INFO:teuthology.orchestra.run.smithi039.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-05-16T13:49:06.553 INFO:teuthology.orchestra.run.smithi039.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-05-16T13:49:06.553 INFO:teuthology.orchestra.run.smithi039.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-05-16T13:49:06.553 INFO:teuthology.orchestra.run.smithi039.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-05-16T13:49:06.553 INFO:teuthology.orchestra.run.smithi039.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-05-16T13:49:06.553 INFO:teuthology.orchestra.run.smithi039.stdout: qttranslations5-l10n socat xmlstarlet 2023-05-16T13:49:06.554 INFO:teuthology.orchestra.run.smithi039.stdout:Suggested packages: 2023-05-16T13:49:06.554 INFO:teuthology.orchestra.run.smithi039.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-05-16T13:49:06.554 INFO:teuthology.orchestra.run.smithi039.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-05-16T13:49:06.554 INFO:teuthology.orchestra.run.smithi039.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-05-16T13:49:06.554 INFO:teuthology.orchestra.run.smithi039.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-05-16T13:49:06.554 INFO:teuthology.orchestra.run.smithi039.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-05-16T13:49:06.555 INFO:teuthology.orchestra.run.smithi039.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-05-16T13:49:06.555 INFO:teuthology.orchestra.run.smithi039.stdout: python3-watchdog 2023-05-16T13:49:06.555 INFO:teuthology.orchestra.run.smithi039.stdout:Recommended packages: 2023-05-16T13:49:06.555 INFO:teuthology.orchestra.run.smithi039.stdout: btrfs-tools 2023-05-16T13:49:06.661 INFO:teuthology.orchestra.run.smithi118.stdout:Fetched 28.5 kB in 2s (14.8 kB/s) 2023-05-16T13:49:06.691 INFO:teuthology.orchestra.run.smithi039.stdout:The following NEW packages will be installed: 2023-05-16T13:49:06.692 INFO:teuthology.orchestra.run.smithi039.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-05-16T13:49:06.692 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-05-16T13:49:06.692 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-05-16T13:49:06.692 INFO:teuthology.orchestra.run.smithi039.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-05-16T13:49:06.693 INFO:teuthology.orchestra.run.smithi039.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-05-16T13:49:06.693 INFO:teuthology.orchestra.run.smithi039.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-05-16T13:49:06.694 INFO:teuthology.orchestra.run.smithi039.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-05-16T13:49:06.694 INFO:teuthology.orchestra.run.smithi039.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-05-16T13:49:06.694 INFO:teuthology.orchestra.run.smithi039.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-05-16T13:49:06.694 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-05-16T13:49:06.694 INFO:teuthology.orchestra.run.smithi039.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-05-16T13:49:06.694 INFO:teuthology.orchestra.run.smithi039.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-05-16T13:49:06.694 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-05-16T13:49:06.694 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-05-16T13:49:06.695 INFO:teuthology.orchestra.run.smithi039.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-05-16T13:49:06.695 INFO:teuthology.orchestra.run.smithi039.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-05-16T13:49:06.695 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-05-16T13:49:06.695 INFO:teuthology.orchestra.run.smithi039.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-05-16T13:49:06.695 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-05-16T13:49:06.695 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-05-16T13:49:06.695 INFO:teuthology.orchestra.run.smithi039.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-05-16T13:49:06.695 INFO:teuthology.orchestra.run.smithi039.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-05-16T13:49:06.696 INFO:teuthology.orchestra.run.smithi039.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-05-16T13:49:06.696 INFO:teuthology.orchestra.run.smithi039.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-05-16T13:49:06.696 INFO:teuthology.orchestra.run.smithi039.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-05-16T13:49:06.696 INFO:teuthology.orchestra.run.smithi039.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-05-16T13:49:06.696 INFO:teuthology.orchestra.run.smithi039.stdout: socat xmlstarlet 2023-05-16T13:49:06.856 INFO:teuthology.orchestra.run.smithi039.stdout:0 upgraded, 115 newly installed, 0 to remove and 145 not upgraded. 2023-05-16T13:49:06.856 INFO:teuthology.orchestra.run.smithi039.stdout:Need to get 175 MB of archives. 2023-05-16T13:49:06.856 INFO:teuthology.orchestra.run.smithi039.stdout:After this operation, 792 MB of additional disk space will be used. 2023-05-16T13:49:06.856 INFO:teuthology.orchestra.run.smithi039.stdout:Get:1 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-3926-g27be5126-1jammy [3,403 kB] 2023-05-16T13:49:07.072 INFO:teuthology.orchestra.run.smithi039.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-3926-g27be5126-1jammy [3,095 kB] 2023-05-16T13:49:07.206 INFO:teuthology.orchestra.run.smithi039.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-3926-g27be5126-1jammy [657 kB] 2023-05-16T13:49:07.226 INFO:teuthology.orchestra.run.smithi039.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-3926-g27be5126-1jammy [343 kB] 2023-05-16T13:49:07.237 INFO:teuthology.orchestra.run.smithi039.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-3926-g27be5126-1jammy [23.0 kB] 2023-05-16T13:49:07.241 INFO:teuthology.orchestra.run.smithi039.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-3926-g27be5126-1jammy [170 kB] 2023-05-16T13:49:07.256 INFO:teuthology.orchestra.run.smithi039.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-3926-g27be5126-1jammy [49.0 kB] 2023-05-16T13:49:07.259 INFO:teuthology.orchestra.run.smithi039.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-05-16T13:49:07.268 INFO:teuthology.orchestra.run.smithi039.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-3926-g27be5126-1jammy [319 kB] 2023-05-16T13:49:07.277 INFO:teuthology.orchestra.run.smithi039.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-05-16T13:49:07.286 INFO:teuthology.orchestra.run.smithi039.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-05-16T13:49:07.313 INFO:teuthology.orchestra.run.smithi039.stdout:Get:12 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-3926-g27be5126-1jammy [5,850 kB] 2023-05-16T13:49:07.328 INFO:teuthology.orchestra.run.smithi039.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-05-16T13:49:07.337 INFO:teuthology.orchestra.run.smithi039.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-05-16T13:49:07.353 INFO:teuthology.orchestra.run.smithi039.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-05-16T13:49:07.355 INFO:teuthology.orchestra.run.smithi039.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-05-16T13:49:07.367 INFO:teuthology.orchestra.run.smithi039.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-05-16T13:49:07.405 INFO:teuthology.orchestra.run.smithi039.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-05-16T13:49:07.407 INFO:teuthology.orchestra.run.smithi039.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-05-16T13:49:07.415 INFO:teuthology.orchestra.run.smithi039.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-05-16T13:49:07.454 INFO:teuthology.orchestra.run.smithi039.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-05-16T13:49:07.495 INFO:teuthology.orchestra.run.smithi118.stdout:Reading package lists... 2023-05-16T13:49:07.496 INFO:teuthology.orchestra.run.smithi039.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-05-16T13:49:07.500 INFO:teuthology.orchestra.run.smithi039.stdout:Get:23 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-3926-g27be5126-1jammy [102 kB] 2023-05-16T13:49:07.502 INFO:teuthology.orchestra.run.smithi039.stdout:Get:24 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-3926-g27be5126-1jammy [429 kB] 2023-05-16T13:49:07.510 DEBUG:teuthology.orchestra.run.smithi118:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-3926-g27be5126-1jammy cephadm=18.0.0-3926-g27be5126-1jammy ceph-mds=18.0.0-3926-g27be5126-1jammy ceph-mgr=18.0.0-3926-g27be5126-1jammy ceph-common=18.0.0-3926-g27be5126-1jammy ceph-fuse=18.0.0-3926-g27be5126-1jammy ceph-test=18.0.0-3926-g27be5126-1jammy ceph-volume=18.0.0-3926-g27be5126-1jammy radosgw=18.0.0-3926-g27be5126-1jammy python3-rados=18.0.0-3926-g27be5126-1jammy python3-rgw=18.0.0-3926-g27be5126-1jammy python3-cephfs=18.0.0-3926-g27be5126-1jammy python3-rbd=18.0.0-3926-g27be5126-1jammy libcephfs2=18.0.0-3926-g27be5126-1jammy libcephfs-dev=18.0.0-3926-g27be5126-1jammy librados2=18.0.0-3926-g27be5126-1jammy librbd1=18.0.0-3926-g27be5126-1jammy rbd-fuse=18.0.0-3926-g27be5126-1jammy python3-cephfs=18.0.0-3926-g27be5126-1jammy cephfs-shell=18.0.0-3926-g27be5126-1jammy cephfs-top=18.0.0-3926-g27be5126-1jammy cephfs-mirror=18.0.0-3926-g27be5126-1jammy 2023-05-16T13:49:07.515 INFO:teuthology.orchestra.run.smithi039.stdout:Get:25 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-3926-g27be5126-1jammy [21.9 MB] 2023-05-16T13:49:07.573 INFO:teuthology.orchestra.run.smithi039.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-05-16T13:49:07.575 INFO:teuthology.orchestra.run.smithi039.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-05-16T13:49:07.575 INFO:teuthology.orchestra.run.smithi039.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-05-16T13:49:07.577 INFO:teuthology.orchestra.run.smithi039.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-05-16T13:49:07.578 INFO:teuthology.orchestra.run.smithi039.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-05-16T13:49:07.578 INFO:teuthology.orchestra.run.smithi039.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-05-16T13:49:07.578 INFO:teuthology.orchestra.run.smithi039.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-05-16T13:49:07.579 INFO:teuthology.orchestra.run.smithi039.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-05-16T13:49:07.579 INFO:teuthology.orchestra.run.smithi039.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-05-16T13:49:07.581 INFO:teuthology.orchestra.run.smithi118.stdout:Reading package lists... 2023-05-16T13:49:07.615 INFO:teuthology.orchestra.run.smithi039.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-05-16T13:49:07.708 INFO:teuthology.orchestra.run.smithi039.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-05-16T13:49:07.710 INFO:teuthology.orchestra.run.smithi039.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-05-16T13:49:07.711 INFO:teuthology.orchestra.run.smithi039.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-05-16T13:49:07.712 INFO:teuthology.orchestra.run.smithi039.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-05-16T13:49:07.715 INFO:teuthology.orchestra.run.smithi039.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-05-16T13:49:07.716 INFO:teuthology.orchestra.run.smithi039.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-05-16T13:49:07.716 INFO:teuthology.orchestra.run.smithi039.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-05-16T13:49:07.726 INFO:teuthology.orchestra.run.smithi039.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-05-16T13:49:07.728 INFO:teuthology.orchestra.run.smithi039.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-05-16T13:49:07.729 INFO:teuthology.orchestra.run.smithi039.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-05-16T13:49:07.731 INFO:teuthology.orchestra.run.smithi118.stdout:Building dependency tree... 2023-05-16T13:49:07.731 INFO:teuthology.orchestra.run.smithi118.stdout:Reading state information... 2023-05-16T13:49:07.785 INFO:teuthology.orchestra.run.smithi039.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-05-16T13:49:07.803 INFO:teuthology.orchestra.run.smithi039.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-05-16T13:49:07.822 INFO:teuthology.orchestra.run.smithi039.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-05-16T13:49:07.833 INFO:teuthology.orchestra.run.smithi039.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-05-16T13:49:07.859 INFO:teuthology.orchestra.run.smithi039.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-05-16T13:49:07.867 INFO:teuthology.orchestra.run.smithi118.stdout:The following packages were automatically installed and are no longer required: 2023-05-16T13:49:07.867 INFO:teuthology.orchestra.run.smithi118.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-05-16T13:49:07.868 INFO:teuthology.orchestra.run.smithi118.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-05-16T13:49:07.868 INFO:teuthology.orchestra.run.smithi118.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-05-16T13:49:07.868 INFO:teuthology.orchestra.run.smithi118.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-05-16T13:49:07.869 INFO:teuthology.orchestra.run.smithi118.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-05-16T13:49:07.869 INFO:teuthology.orchestra.run.smithi118.stdout:Use 'sudo apt autoremove' to remove them. 2023-05-16T13:49:07.870 INFO:teuthology.orchestra.run.smithi118.stdout:The following additional packages will be installed: 2023-05-16T13:49:07.870 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-05-16T13:49:07.870 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-05-16T13:49:07.870 INFO:teuthology.orchestra.run.smithi118.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-05-16T13:49:07.870 INFO:teuthology.orchestra.run.smithi118.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-05-16T13:49:07.870 INFO:teuthology.orchestra.run.smithi118.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-05-16T13:49:07.870 INFO:teuthology.orchestra.run.smithi118.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-05-16T13:49:07.871 INFO:teuthology.orchestra.run.smithi118.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-05-16T13:49:07.871 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-05-16T13:49:07.871 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-05-16T13:49:07.871 INFO:teuthology.orchestra.run.smithi118.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-05-16T13:49:07.871 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-05-16T13:49:07.871 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-05-16T13:49:07.871 INFO:teuthology.orchestra.run.smithi118.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-05-16T13:49:07.871 INFO:teuthology.orchestra.run.smithi118.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-05-16T13:49:07.872 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-05-16T13:49:07.872 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-05-16T13:49:07.872 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-05-16T13:49:07.872 INFO:teuthology.orchestra.run.smithi118.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-05-16T13:49:07.872 INFO:teuthology.orchestra.run.smithi118.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-05-16T13:49:07.872 INFO:teuthology.orchestra.run.smithi118.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-05-16T13:49:07.872 INFO:teuthology.orchestra.run.smithi118.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-05-16T13:49:07.872 INFO:teuthology.orchestra.run.smithi118.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-05-16T13:49:07.873 INFO:teuthology.orchestra.run.smithi118.stdout: qttranslations5-l10n socat xmlstarlet 2023-05-16T13:49:07.873 INFO:teuthology.orchestra.run.smithi118.stdout:Suggested packages: 2023-05-16T13:49:07.873 INFO:teuthology.orchestra.run.smithi118.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-05-16T13:49:07.873 INFO:teuthology.orchestra.run.smithi118.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-05-16T13:49:07.874 INFO:teuthology.orchestra.run.smithi118.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-05-16T13:49:07.874 INFO:teuthology.orchestra.run.smithi118.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-05-16T13:49:07.874 INFO:teuthology.orchestra.run.smithi118.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-05-16T13:49:07.874 INFO:teuthology.orchestra.run.smithi118.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-05-16T13:49:07.874 INFO:teuthology.orchestra.run.smithi118.stdout: python3-watchdog 2023-05-16T13:49:07.874 INFO:teuthology.orchestra.run.smithi118.stdout:Recommended packages: 2023-05-16T13:49:07.874 INFO:teuthology.orchestra.run.smithi118.stdout: btrfs-tools 2023-05-16T13:49:07.878 INFO:teuthology.orchestra.run.smithi039.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-05-16T13:49:07.881 INFO:teuthology.orchestra.run.smithi039.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-urllib3 all 1.26.5-1~exp1 [96.4 kB] 2023-05-16T13:49:07.888 INFO:teuthology.orchestra.run.smithi039.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-requests all 2.25.1+dfsg-2 [47.9 kB] 2023-05-16T13:49:07.890 INFO:teuthology.orchestra.run.smithi039.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-05-16T13:49:07.898 INFO:teuthology.orchestra.run.smithi039.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-05-16T13:49:07.900 INFO:teuthology.orchestra.run.smithi039.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-05-16T13:49:07.942 INFO:teuthology.orchestra.run.smithi039.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-05-16T13:49:08.005 INFO:teuthology.orchestra.run.smithi118.stdout:The following NEW packages will be installed: 2023-05-16T13:49:08.005 INFO:teuthology.orchestra.run.smithi118.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-05-16T13:49:08.005 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-05-16T13:49:08.005 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-05-16T13:49:08.006 INFO:teuthology.orchestra.run.smithi118.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-05-16T13:49:08.007 INFO:teuthology.orchestra.run.smithi118.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-05-16T13:49:08.007 INFO:teuthology.orchestra.run.smithi118.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-05-16T13:49:08.007 INFO:teuthology.orchestra.run.smithi118.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-05-16T13:49:08.007 INFO:teuthology.orchestra.run.smithi118.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-05-16T13:49:08.007 INFO:teuthology.orchestra.run.smithi118.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-05-16T13:49:08.008 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-05-16T13:49:08.008 INFO:teuthology.orchestra.run.smithi118.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-05-16T13:49:08.008 INFO:teuthology.orchestra.run.smithi118.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-05-16T13:49:08.008 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-05-16T13:49:08.008 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-05-16T13:49:08.008 INFO:teuthology.orchestra.run.smithi118.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-05-16T13:49:08.008 INFO:teuthology.orchestra.run.smithi118.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-05-16T13:49:08.009 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-05-16T13:49:08.009 INFO:teuthology.orchestra.run.smithi118.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-05-16T13:49:08.009 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-05-16T13:49:08.009 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-05-16T13:49:08.009 INFO:teuthology.orchestra.run.smithi118.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-05-16T13:49:08.009 INFO:teuthology.orchestra.run.smithi118.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-05-16T13:49:08.009 INFO:teuthology.orchestra.run.smithi118.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-05-16T13:49:08.009 INFO:teuthology.orchestra.run.smithi118.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-05-16T13:49:08.010 INFO:teuthology.orchestra.run.smithi118.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-05-16T13:49:08.010 INFO:teuthology.orchestra.run.smithi118.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-05-16T13:49:08.010 INFO:teuthology.orchestra.run.smithi118.stdout: socat xmlstarlet 2023-05-16T13:49:08.074 INFO:teuthology.orchestra.run.smithi118.stdout:0 upgraded, 115 newly installed, 0 to remove and 145 not upgraded. 2023-05-16T13:49:08.074 INFO:teuthology.orchestra.run.smithi118.stdout:Need to get 175 MB of archives. 2023-05-16T13:49:08.074 INFO:teuthology.orchestra.run.smithi118.stdout:After this operation, 792 MB of additional disk space will be used. 2023-05-16T13:49:08.074 INFO:teuthology.orchestra.run.smithi118.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-05-16T13:49:08.093 INFO:teuthology.orchestra.run.smithi118.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-05-16T13:49:08.104 INFO:teuthology.orchestra.run.smithi118.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-05-16T13:49:08.126 INFO:teuthology.orchestra.run.smithi039.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-05-16T13:49:08.128 INFO:teuthology.orchestra.run.smithi039.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-05-16T13:49:08.129 INFO:teuthology.orchestra.run.smithi039.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-05-16T13:49:08.130 INFO:teuthology.orchestra.run.smithi039.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-05-16T13:49:08.130 INFO:teuthology.orchestra.run.smithi039.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-05-16T13:49:08.132 INFO:teuthology.orchestra.run.smithi039.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-05-16T13:49:08.146 INFO:teuthology.orchestra.run.smithi118.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-05-16T13:49:08.154 INFO:teuthology.orchestra.run.smithi118.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-05-16T13:49:08.155 INFO:teuthology.orchestra.run.smithi039.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-05-16T13:49:08.157 INFO:teuthology.orchestra.run.smithi039.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-05-16T13:49:08.157 INFO:teuthology.orchestra.run.smithi039.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-05-16T13:49:08.172 INFO:teuthology.orchestra.run.smithi118.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-05-16T13:49:08.173 INFO:teuthology.orchestra.run.smithi118.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-05-16T13:49:08.175 INFO:teuthology.orchestra.run.smithi039.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-05-16T13:49:08.184 INFO:teuthology.orchestra.run.smithi118.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-05-16T13:49:08.212 INFO:teuthology.orchestra.run.smithi039.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-05-16T13:49:08.222 INFO:teuthology.orchestra.run.smithi118.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-05-16T13:49:08.225 INFO:teuthology.orchestra.run.smithi118.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-05-16T13:49:08.232 INFO:teuthology.orchestra.run.smithi118.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-05-16T13:49:08.266 INFO:teuthology.orchestra.run.smithi039.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-05-16T13:49:08.270 INFO:teuthology.orchestra.run.smithi118.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-05-16T13:49:08.273 INFO:teuthology.orchestra.run.smithi039.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-05-16T13:49:08.278 INFO:teuthology.orchestra.run.smithi039.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-05-16T13:49:08.290 INFO:teuthology.orchestra.run.smithi039.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-05-16T13:49:08.294 INFO:teuthology.orchestra.run.smithi039.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-05-16T13:49:08.299 INFO:teuthology.orchestra.run.smithi039.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-05-16T13:49:08.313 INFO:teuthology.orchestra.run.smithi118.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-05-16T13:49:08.329 INFO:teuthology.orchestra.run.smithi039.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-05-16T13:49:08.329 INFO:teuthology.orchestra.run.smithi118.stdout:Get:14 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-3926-g27be5126-1jammy [3,403 kB] 2023-05-16T13:49:08.336 INFO:teuthology.orchestra.run.smithi039.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-05-16T13:49:08.343 INFO:teuthology.orchestra.run.smithi039.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-05-16T13:49:08.344 INFO:teuthology.orchestra.run.smithi039.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-05-16T13:49:08.387 INFO:teuthology.orchestra.run.smithi039.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-05-16T13:49:08.400 INFO:teuthology.orchestra.run.smithi118.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-05-16T13:49:08.402 INFO:teuthology.orchestra.run.smithi118.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-05-16T13:49:08.403 INFO:teuthology.orchestra.run.smithi118.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-05-16T13:49:08.407 INFO:teuthology.orchestra.run.smithi118.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-05-16T13:49:08.408 INFO:teuthology.orchestra.run.smithi118.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-05-16T13:49:08.409 INFO:teuthology.orchestra.run.smithi118.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-05-16T13:49:08.409 INFO:teuthology.orchestra.run.smithi118.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-05-16T13:49:08.410 INFO:teuthology.orchestra.run.smithi118.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-05-16T13:49:08.447 INFO:teuthology.orchestra.run.smithi118.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-05-16T13:49:08.449 INFO:teuthology.orchestra.run.smithi118.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-05-16T13:49:08.486 INFO:teuthology.orchestra.run.smithi039.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-05-16T13:49:08.487 INFO:teuthology.orchestra.run.smithi039.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-05-16T13:49:08.507 INFO:teuthology.orchestra.run.smithi039.stdout:Get:82 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-3926-g27be5126-1jammy [6,825 kB] 2023-05-16T13:49:08.514 INFO:teuthology.orchestra.run.smithi039.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-05-16T13:49:08.522 INFO:teuthology.orchestra.run.smithi118.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-05-16T13:49:08.525 INFO:teuthology.orchestra.run.smithi039.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-05-16T13:49:08.525 INFO:teuthology.orchestra.run.smithi039.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-05-16T13:49:08.526 INFO:teuthology.orchestra.run.smithi118.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-05-16T13:49:08.526 INFO:teuthology.orchestra.run.smithi039.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-05-16T13:49:08.526 INFO:teuthology.orchestra.run.smithi039.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-05-16T13:49:08.527 INFO:teuthology.orchestra.run.smithi118.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-05-16T13:49:08.529 INFO:teuthology.orchestra.run.smithi118.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-05-16T13:49:08.530 INFO:teuthology.orchestra.run.smithi039.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-05-16T13:49:08.531 INFO:teuthology.orchestra.run.smithi039.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-05-16T13:49:08.534 INFO:teuthology.orchestra.run.smithi118.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-05-16T13:49:08.534 INFO:teuthology.orchestra.run.smithi118.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-05-16T13:49:08.535 INFO:teuthology.orchestra.run.smithi118.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-05-16T13:49:08.540 INFO:teuthology.orchestra.run.smithi118.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-05-16T13:49:08.543 INFO:teuthology.orchestra.run.smithi118.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-05-16T13:49:08.546 INFO:teuthology.orchestra.run.smithi039.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-05-16T13:49:08.579 INFO:teuthology.orchestra.run.smithi118.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-05-16T13:49:08.582 INFO:teuthology.orchestra.run.smithi039.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-05-16T13:49:08.617 INFO:teuthology.orchestra.run.smithi039.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-05-16T13:49:08.677 INFO:teuthology.orchestra.run.smithi039.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-3926-g27be5126-1jammy [226 kB] 2023-05-16T13:49:08.679 INFO:teuthology.orchestra.run.smithi039.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-05-16T13:49:08.681 INFO:teuthology.orchestra.run.smithi039.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-3926-g27be5126-1jammy [114 kB] 2023-05-16T13:49:08.685 INFO:teuthology.orchestra.run.smithi039.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-3926-g27be5126-1jammy [1,469 kB] 2023-05-16T13:49:08.687 INFO:teuthology.orchestra.run.smithi039.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-05-16T13:49:08.693 INFO:teuthology.orchestra.run.smithi118.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-05-16T13:49:08.693 INFO:teuthology.orchestra.run.smithi118.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-05-16T13:49:08.693 INFO:teuthology.orchestra.run.smithi118.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-05-16T13:49:08.694 INFO:teuthology.orchestra.run.smithi118.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-05-16T13:49:08.697 INFO:teuthology.orchestra.run.smithi118.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-05-16T13:49:08.701 INFO:teuthology.orchestra.run.smithi118.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-05-16T13:49:08.702 INFO:teuthology.orchestra.run.smithi118.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-urllib3 all 1.26.5-1~exp1 [96.4 kB] 2023-05-16T13:49:08.706 INFO:teuthology.orchestra.run.smithi118.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-requests all 2.25.1+dfsg-2 [47.9 kB] 2023-05-16T13:49:08.711 INFO:teuthology.orchestra.run.smithi118.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-05-16T13:49:08.716 INFO:teuthology.orchestra.run.smithi118.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-05-16T13:49:08.735 INFO:teuthology.orchestra.run.smithi039.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-3926-g27be5126-1jammy [9,853 kB] 2023-05-16T13:49:08.753 INFO:teuthology.orchestra.run.smithi118.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-05-16T13:49:08.843 INFO:teuthology.orchestra.run.smithi118.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-05-16T13:49:08.968 INFO:teuthology.orchestra.run.smithi118.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-05-16T13:49:08.969 INFO:teuthology.orchestra.run.smithi118.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-05-16T13:49:08.970 INFO:teuthology.orchestra.run.smithi118.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-05-16T13:49:08.971 INFO:teuthology.orchestra.run.smithi118.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-05-16T13:49:08.971 INFO:teuthology.orchestra.run.smithi118.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-05-16T13:49:08.972 INFO:teuthology.orchestra.run.smithi118.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-05-16T13:49:08.991 INFO:teuthology.orchestra.run.smithi118.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-05-16T13:49:08.994 INFO:teuthology.orchestra.run.smithi118.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-05-16T13:49:08.994 INFO:teuthology.orchestra.run.smithi118.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-05-16T13:49:09.046 INFO:teuthology.orchestra.run.smithi118.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-05-16T13:49:09.065 INFO:teuthology.orchestra.run.smithi118.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-05-16T13:49:09.075 INFO:teuthology.orchestra.run.smithi039.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-3926-g27be5126-1jammy [31.5 MB] 2023-05-16T13:49:09.093 INFO:teuthology.orchestra.run.smithi118.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-05-16T13:49:09.103 INFO:teuthology.orchestra.run.smithi118.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-05-16T13:49:09.110 INFO:teuthology.orchestra.run.smithi118.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-05-16T13:49:09.117 INFO:teuthology.orchestra.run.smithi118.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-05-16T13:49:09.121 INFO:teuthology.orchestra.run.smithi118.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-05-16T13:49:09.125 INFO:teuthology.orchestra.run.smithi118.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-05-16T13:49:09.151 INFO:teuthology.orchestra.run.smithi118.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-05-16T13:49:09.157 INFO:teuthology.orchestra.run.smithi118.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-05-16T13:49:09.161 INFO:teuthology.orchestra.run.smithi118.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-05-16T13:49:09.202 INFO:teuthology.orchestra.run.smithi118.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-05-16T13:49:09.309 INFO:teuthology.orchestra.run.smithi118.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-05-16T13:49:09.318 INFO:teuthology.orchestra.run.smithi118.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-05-16T13:49:09.318 INFO:teuthology.orchestra.run.smithi118.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-05-16T13:49:09.344 INFO:teuthology.orchestra.run.smithi118.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-05-16T13:49:09.352 INFO:teuthology.orchestra.run.smithi118.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-05-16T13:49:09.352 INFO:teuthology.orchestra.run.smithi118.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-05-16T13:49:09.353 INFO:teuthology.orchestra.run.smithi118.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-05-16T13:49:09.353 INFO:teuthology.orchestra.run.smithi118.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-05-16T13:49:09.356 INFO:teuthology.orchestra.run.smithi118.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-05-16T13:49:09.357 INFO:teuthology.orchestra.run.smithi118.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-05-16T13:49:09.405 INFO:teuthology.orchestra.run.smithi118.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-05-16T13:49:09.444 INFO:teuthology.orchestra.run.smithi118.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-05-16T13:49:09.450 INFO:teuthology.orchestra.run.smithi118.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-05-16T13:49:09.499 INFO:teuthology.orchestra.run.smithi118.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-05-16T13:49:09.504 INFO:teuthology.orchestra.run.smithi118.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-05-16T13:49:10.261 INFO:teuthology.orchestra.run.smithi039.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-3926-g27be5126-1jammy [3,592 B] 2023-05-16T13:49:10.261 INFO:teuthology.orchestra.run.smithi039.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-3926-g27be5126-1jammy [810 kB] 2023-05-16T13:49:10.308 INFO:teuthology.orchestra.run.smithi039.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-3926-g27be5126-1jammy [2,157 kB] 2023-05-16T13:49:10.377 INFO:teuthology.orchestra.run.smithi039.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-3926-g27be5126-1jammy [96.5 kB] 2023-05-16T13:49:10.378 INFO:teuthology.orchestra.run.smithi039.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-3926-g27be5126-1jammy [124 kB] 2023-05-16T13:49:10.382 INFO:teuthology.orchestra.run.smithi039.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-3926-g27be5126-1jammy [1,840 kB] 2023-05-16T13:49:10.446 INFO:teuthology.orchestra.run.smithi039.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-3926-g27be5126-1jammy [8,615 kB] 2023-05-16T13:49:10.602 INFO:teuthology.orchestra.run.smithi118.stdout:Get:83 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-3926-g27be5126-1jammy [3,095 kB] 2023-05-16T13:49:10.744 INFO:teuthology.orchestra.run.smithi039.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-3926-g27be5126-1jammy [3,724 B] 2023-05-16T13:49:10.745 INFO:teuthology.orchestra.run.smithi039.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-3926-g27be5126-1jammy [40.9 MB] 2023-05-16T13:49:12.161 INFO:teuthology.orchestra.run.smithi039.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-3926-g27be5126-1jammy [238 kB] 2023-05-16T13:49:12.163 INFO:teuthology.orchestra.run.smithi039.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-3926-g27be5126-1jammy [214 kB] 2023-05-16T13:49:12.165 INFO:teuthology.orchestra.run.smithi039.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-3926-g27be5126-1jammy [23.8 kB] 2023-05-16T13:49:12.166 INFO:teuthology.orchestra.run.smithi039.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-3926-g27be5126-1jammy [13.2 kB] 2023-05-16T13:49:12.166 INFO:teuthology.orchestra.run.smithi039.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-3926-g27be5126-1jammy [28.3 kB] 2023-05-16T13:49:12.166 INFO:teuthology.orchestra.run.smithi039.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-3926-g27be5126-1jammy [11.5 MB] 2023-05-16T13:49:12.566 INFO:teuthology.orchestra.run.smithi039.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-3926-g27be5126-1jammy [82.1 kB] 2023-05-16T13:49:12.609 INFO:teuthology.orchestra.run.smithi118.stdout:Get:84 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-3926-g27be5126-1jammy [657 kB] 2023-05-16T13:49:12.734 INFO:teuthology.orchestra.run.smithi118.stdout:Get:85 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-3926-g27be5126-1jammy [343 kB] 2023-05-16T13:49:12.796 INFO:teuthology.orchestra.run.smithi118.stdout:Get:86 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-3926-g27be5126-1jammy [23.0 kB] 2023-05-16T13:49:12.797 INFO:teuthology.orchestra.run.smithi118.stdout:Get:87 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-3926-g27be5126-1jammy [170 kB] 2023-05-16T13:49:12.838 INFO:teuthology.orchestra.run.smithi118.stdout:Get:88 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-3926-g27be5126-1jammy [49.0 kB] 2023-05-16T13:49:12.839 INFO:teuthology.orchestra.run.smithi118.stdout:Get:89 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-3926-g27be5126-1jammy [319 kB] 2023-05-16T13:49:12.901 INFO:teuthology.orchestra.run.smithi118.stdout:Get:90 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-3926-g27be5126-1jammy [5,850 kB] 2023-05-16T13:49:13.140 INFO:teuthology.orchestra.run.smithi039.stdout:Fetched 175 MB in 6s (29.8 MB/s) 2023-05-16T13:49:13.283 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-pyperclip. 2023-05-16T13:49:13.354 INFO:teuthology.orchestra.run.smithi039.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132939 files and directories currently installed.) 2023-05-16T13:49:13.357 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-05-16T13:49:13.390 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-05-16T13:49:13.760 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-wcwidth. 2023-05-16T13:49:13.772 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-05-16T13:49:13.805 INFO:teuthology.orchestra.run.smithi118.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-3926-g27be5126-1jammy [102 kB] 2023-05-16T13:49:13.810 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-05-16T13:49:13.823 INFO:teuthology.orchestra.run.smithi118.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-3926-g27be5126-1jammy [429 kB] 2023-05-16T13:49:13.886 INFO:teuthology.orchestra.run.smithi118.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-3926-g27be5126-1jammy [21.9 MB] 2023-05-16T13:49:14.104 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-cmd2. 2023-05-16T13:49:14.117 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-05-16T13:49:14.154 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-05-16T13:49:14.473 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libfmt8:amd64. 2023-05-16T13:49:14.486 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-05-16T13:49:14.565 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-05-16T13:49:14.860 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-05-16T13:49:14.874 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-05-16T13:49:14.918 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-05-16T13:49:15.197 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-05-16T13:49:15.210 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-05-16T13:49:15.255 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-05-16T13:49:15.600 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-05-16T13:49:15.614 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-05-16T13:49:15.658 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-05-16T13:49:16.103 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-05-16T13:49:16.117 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-05-16T13:49:16.169 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-16T13:49:16.240 INFO:teuthology.orchestra.run.smithi118.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-3926-g27be5126-1jammy [6,825 kB] 2023-05-16T13:49:16.514 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-05-16T13:49:16.528 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-05-16T13:49:16.573 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-16T13:49:16.826 INFO:teuthology.orchestra.run.smithi118.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-3926-g27be5126-1jammy [226 kB] 2023-05-16T13:49:16.844 INFO:teuthology.orchestra.run.smithi118.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-3926-g27be5126-1jammy [114 kB] 2023-05-16T13:49:16.846 INFO:teuthology.orchestra.run.smithi118.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-3926-g27be5126-1jammy [1,469 kB] 2023-05-16T13:49:16.892 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-05-16T13:49:16.906 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-05-16T13:49:16.951 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-16T13:49:16.971 INFO:teuthology.orchestra.run.smithi118.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-3926-g27be5126-1jammy [9,853 kB] 2023-05-16T13:49:17.304 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-05-16T13:49:17.317 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-05-16T13:49:17.362 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-05-16T13:49:17.648 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package librados2. 2023-05-16T13:49:17.662 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../011-librados2_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-16T13:49:17.698 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking librados2 (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:49:17.728 INFO:teuthology.orchestra.run.smithi118.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-3926-g27be5126-1jammy [31.5 MB] 2023-05-16T13:49:18.109 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package librbd1. 2023-05-16T13:49:18.123 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../012-librbd1_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-16T13:49:18.167 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking librbd1 (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:49:18.787 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libcephfs2. 2023-05-16T13:49:18.800 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../013-libcephfs2_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-16T13:49:18.837 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libcephfs2 (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:49:19.089 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-rados. 2023-05-16T13:49:19.102 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../014-python3-rados_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-16T13:49:19.130 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-rados (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:49:19.467 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-05-16T13:49:19.480 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.0.0-3926-g27be5126-1jammy_all.deb ... 2023-05-16T13:49:19.517 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-ceph-argparse (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:49:19.761 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-cephfs. 2023-05-16T13:49:19.774 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../016-python3-cephfs_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-16T13:49:19.811 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-cephfs (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:49:19.814 INFO:teuthology.orchestra.run.smithi118.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-3926-g27be5126-1jammy [3,592 B] 2023-05-16T13:49:19.814 INFO:teuthology.orchestra.run.smithi118.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-3926-g27be5126-1jammy [810 kB] 2023-05-16T13:49:19.862 INFO:teuthology.orchestra.run.smithi118.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-3926-g27be5126-1jammy [2,157 kB] 2023-05-16T13:49:19.987 INFO:teuthology.orchestra.run.smithi118.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-3926-g27be5126-1jammy [96.5 kB] 2023-05-16T13:49:19.988 INFO:teuthology.orchestra.run.smithi118.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-3926-g27be5126-1jammy [124 kB] 2023-05-16T13:49:19.990 INFO:teuthology.orchestra.run.smithi118.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-3926-g27be5126-1jammy [1,840 kB] 2023-05-16T13:49:20.101 INFO:teuthology.orchestra.run.smithi118.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-3926-g27be5126-1jammy [8,615 kB] 2023-05-16T13:49:20.122 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-ceph-common. 2023-05-16T13:49:20.136 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../017-python3-ceph-common_18.0.0-3926-g27be5126-1jammy_all.deb ... 2023-05-16T13:49:20.180 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-ceph-common (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:49:20.483 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-prettytable. 2023-05-16T13:49:20.496 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-05-16T13:49:20.541 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-05-16T13:49:20.575 INFO:teuthology.orchestra.run.smithi118.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-3926-g27be5126-1jammy [3,724 B] 2023-05-16T13:49:20.575 INFO:teuthology.orchestra.run.smithi118.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-3926-g27be5126-1jammy [40.9 MB] 2023-05-16T13:49:20.785 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-rbd. 2023-05-16T13:49:20.800 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../019-python3-rbd_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-16T13:49:20.844 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-rbd (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:49:21.188 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-05-16T13:49:21.202 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-05-16T13:49:21.246 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-05-16T13:49:21.582 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package librgw2. 2023-05-16T13:49:21.596 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../021-librgw2_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-16T13:49:21.641 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking librgw2 (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:49:22.068 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-rgw. 2023-05-16T13:49:22.081 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../022-python3-rgw_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-16T13:49:22.110 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-rgw (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:49:22.223 INFO:teuthology.orchestra.run.smithi118.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-3926-g27be5126-1jammy [238 kB] 2023-05-16T13:49:22.225 INFO:teuthology.orchestra.run.smithi118.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-3926-g27be5126-1jammy [214 kB] 2023-05-16T13:49:22.227 INFO:teuthology.orchestra.run.smithi118.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-3926-g27be5126-1jammy [23.8 kB] 2023-05-16T13:49:22.228 INFO:teuthology.orchestra.run.smithi118.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-3926-g27be5126-1jammy [13.2 kB] 2023-05-16T13:49:22.228 INFO:teuthology.orchestra.run.smithi118.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-3926-g27be5126-1jammy [28.3 kB] 2023-05-16T13:49:22.229 INFO:teuthology.orchestra.run.smithi118.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-3926-g27be5126-1jammy [11.5 MB] 2023-05-16T13:49:22.421 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package liboath0:amd64. 2023-05-16T13:49:22.435 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-05-16T13:49:22.479 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-05-16T13:49:22.612 INFO:teuthology.orchestra.run.smithi118.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023May15-1524/27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-3926-g27be5126-1jammy [82.1 kB] 2023-05-16T13:49:22.790 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libradosstriper1. 2023-05-16T13:49:22.804 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../024-libradosstriper1_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-16T13:49:22.849 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libradosstriper1 (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:49:23.190 INFO:teuthology.orchestra.run.smithi118.stdout:Fetched 175 MB in 15s (12.0 MB/s) 2023-05-16T13:49:23.279 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package ceph-common. 2023-05-16T13:49:23.292 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../025-ceph-common_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-16T13:49:23.337 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking ceph-common (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:49:23.399 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-pyperclip. 2023-05-16T13:49:23.466 INFO:teuthology.orchestra.run.smithi118.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132939 files and directories currently installed.) 2023-05-16T13:49:23.469 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-05-16T13:49:23.573 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-05-16T13:49:23.876 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-wcwidth. 2023-05-16T13:49:23.888 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-05-16T13:49:23.925 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-05-16T13:49:24.254 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-cmd2. 2023-05-16T13:49:24.265 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-05-16T13:49:24.304 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-05-16T13:49:24.401 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package ceph-base. 2023-05-16T13:49:24.414 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../026-ceph-base_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-16T13:49:24.468 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking ceph-base (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:49:24.623 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libfmt8:amd64. 2023-05-16T13:49:24.636 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-05-16T13:49:24.715 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-05-16T13:49:25.051 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-05-16T13:49:25.064 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-05-16T13:49:25.101 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-05-16T13:49:25.146 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-05-16T13:49:25.159 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-05-16T13:49:25.197 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-05-16T13:49:25.413 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-05-16T13:49:25.427 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-05-16T13:49:25.449 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-cheroot. 2023-05-16T13:49:25.462 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-05-16T13:49:25.463 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-05-16T13:49:25.491 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-05-16T13:49:25.783 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-05-16T13:49:25.785 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-05-16T13:49:25.796 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-05-16T13:49:25.798 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-05-16T13:49:25.833 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-05-16T13:49:25.836 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-05-16T13:49:26.138 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-jaraco.text. 2023-05-16T13:49:26.151 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-05-16T13:49:26.188 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-05-16T13:49:26.253 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-05-16T13:49:26.267 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-05-16T13:49:26.319 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-16T13:49:26.491 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-05-16T13:49:26.505 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-05-16T13:49:26.566 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-05-16T13:49:26.748 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-05-16T13:49:26.761 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-05-16T13:49:26.798 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-16T13:49:26.852 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-tempora. 2023-05-16T13:49:26.866 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-05-16T13:49:26.919 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-05-16T13:49:27.135 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-05-16T13:49:27.148 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-05-16T13:49:27.185 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-16T13:49:27.221 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-portend. 2023-05-16T13:49:27.235 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-05-16T13:49:27.280 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-05-16T13:49:27.522 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-05-16T13:49:27.524 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-05-16T13:49:27.535 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-05-16T13:49:27.539 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-05-16T13:49:27.574 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-05-16T13:49:27.580 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-05-16T13:49:27.877 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-cherrypy3. 2023-05-16T13:49:27.891 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-05-16T13:49:27.899 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package librados2. 2023-05-16T13:49:27.912 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../011-librados2_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-16T13:49:27.944 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-05-16T13:49:27.949 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking librados2 (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:49:28.272 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-natsort. 2023-05-16T13:49:28.285 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-05-16T13:49:28.322 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-05-16T13:49:28.352 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package librbd1. 2023-05-16T13:49:28.365 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../012-librbd1_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-16T13:49:28.402 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking librbd1 (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:49:28.583 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-logutils. 2023-05-16T13:49:28.596 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-05-16T13:49:28.625 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-05-16T13:49:28.788 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libcephfs2. 2023-05-16T13:49:28.801 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../013-libcephfs2_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-16T13:49:28.838 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libcephfs2 (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:49:29.053 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-markupsafe. 2023-05-16T13:49:29.066 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-05-16T13:49:29.091 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-rados. 2023-05-16T13:49:29.104 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../014-python3-rados_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-16T13:49:29.111 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-05-16T13:49:29.141 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-rados (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:49:29.414 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-mako. 2023-05-16T13:49:29.427 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-05-16T13:49:29.460 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-05-16T13:49:29.472 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-05-16T13:49:29.473 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.0.0-3926-g27be5126-1jammy_all.deb ... 2023-05-16T13:49:29.510 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-ceph-argparse (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:49:29.738 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-cephfs. 2023-05-16T13:49:29.751 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../016-python3-cephfs_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-16T13:49:29.784 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-simplegeneric. 2023-05-16T13:49:29.788 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-cephfs (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:49:29.797 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-05-16T13:49:29.842 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-05-16T13:49:30.091 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-ceph-common. 2023-05-16T13:49:30.104 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../017-python3-ceph-common_18.0.0-3926-g27be5126-1jammy_all.deb ... 2023-05-16T13:49:30.149 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-ceph-common (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:49:30.153 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-singledispatch. 2023-05-16T13:49:30.167 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-05-16T13:49:30.203 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-05-16T13:49:30.469 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-prettytable. 2023-05-16T13:49:30.481 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-webob. 2023-05-16T13:49:30.482 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-05-16T13:49:30.495 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-05-16T13:49:30.519 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-05-16T13:49:30.539 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-05-16T13:49:30.763 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-rbd. 2023-05-16T13:49:30.776 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../019-python3-rbd_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-16T13:49:30.813 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-rbd (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:49:30.883 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-waitress. 2023-05-16T13:49:30.897 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-05-16T13:49:30.928 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-05-16T13:49:31.133 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-05-16T13:49:31.146 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-05-16T13:49:31.183 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-05-16T13:49:31.220 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-tempita. 2023-05-16T13:49:31.234 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-05-16T13:49:31.278 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-05-16T13:49:31.527 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package librgw2. 2023-05-16T13:49:31.540 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../021-librgw2_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-16T13:49:31.564 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-paste. 2023-05-16T13:49:31.578 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-05-16T13:49:31.585 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking librgw2 (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:49:31.622 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-05-16T13:49:31.925 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-05-16T13:49:31.939 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-05-16T13:49:31.983 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-05-16T13:49:32.063 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-rgw. 2023-05-16T13:49:32.076 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../022-python3-rgw_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-16T13:49:32.113 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-rgw (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:49:32.295 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-pastedeploy. 2023-05-16T13:49:32.309 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-05-16T13:49:32.353 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-05-16T13:49:32.399 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package liboath0:amd64. 2023-05-16T13:49:32.413 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-05-16T13:49:32.450 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-05-16T13:49:32.639 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-webtest. 2023-05-16T13:49:32.654 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-05-16T13:49:32.697 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-05-16T13:49:32.752 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libradosstriper1. 2023-05-16T13:49:32.765 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../024-libradosstriper1_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-16T13:49:32.802 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libradosstriper1 (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:49:32.967 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-pecan. 2023-05-16T13:49:32.981 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-05-16T13:49:33.017 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-05-16T13:49:33.239 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph-common. 2023-05-16T13:49:33.252 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../025-ceph-common_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-16T13:49:33.289 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-common (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:49:33.380 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-certifi. 2023-05-16T13:49:33.393 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-05-16T13:49:33.430 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-05-16T13:49:33.749 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-idna. 2023-05-16T13:49:33.762 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-05-16T13:49:33.799 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-idna (3.3-1) ... 2023-05-16T13:49:34.069 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-urllib3. 2023-05-16T13:49:34.082 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1_all.deb ... 2023-05-16T13:49:34.110 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1) ... 2023-05-16T13:49:34.355 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-requests. 2023-05-16T13:49:34.368 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2_all.deb ... 2023-05-16T13:49:34.397 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-requests (2.25.1+dfsg-2) ... 2023-05-16T13:49:34.486 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph-base. 2023-05-16T13:49:34.499 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../026-ceph-base_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-16T13:49:34.545 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-base (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:49:34.683 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-werkzeug. 2023-05-16T13:49:34.696 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-05-16T13:49:34.733 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-05-16T13:49:34.985 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-05-16T13:49:34.999 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.0.0-3926-g27be5126-1jammy_all.deb ... 2023-05-16T13:49:35.035 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking ceph-mgr-modules-core (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:49:35.224 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-05-16T13:49:35.237 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-05-16T13:49:35.266 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-05-16T13:49:35.415 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-05-16T13:49:35.428 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-16T13:49:35.465 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:49:35.552 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-cheroot. 2023-05-16T13:49:35.565 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-05-16T13:49:35.602 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-05-16T13:49:35.718 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-openssl. 2023-05-16T13:49:35.732 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-05-16T13:49:35.776 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-05-16T13:49:35.956 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-05-16T13:49:35.968 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-05-16T13:49:36.005 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-05-16T13:49:36.104 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package ceph-mgr. 2023-05-16T13:49:36.118 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../058-ceph-mgr_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-16T13:49:36.163 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking ceph-mgr (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:49:36.308 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-jaraco.text. 2023-05-16T13:49:36.321 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-05-16T13:49:36.358 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-05-16T13:49:36.491 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package ceph-mon. 2023-05-16T13:49:36.504 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../059-ceph-mon_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-16T13:49:36.549 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking ceph-mon (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:49:36.628 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-05-16T13:49:36.641 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-05-16T13:49:36.669 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-05-16T13:49:36.998 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-tempora. 2023-05-16T13:49:37.011 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-05-16T13:49:37.048 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-05-16T13:49:37.350 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-portend. 2023-05-16T13:49:37.364 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-05-16T13:49:37.377 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package ceph-osd. 2023-05-16T13:49:37.391 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../060-ceph-osd_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-16T13:49:37.409 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-05-16T13:49:37.436 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking ceph-osd (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:49:37.712 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-05-16T13:49:37.725 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-05-16T13:49:37.770 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-05-16T13:49:38.031 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-cherrypy3. 2023-05-16T13:49:38.045 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-05-16T13:49:38.082 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-05-16T13:49:38.427 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-natsort. 2023-05-16T13:49:38.440 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-05-16T13:49:38.468 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-05-16T13:49:38.631 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package ceph. 2023-05-16T13:49:38.645 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../061-ceph_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-16T13:49:38.689 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking ceph (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:49:38.772 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-logutils. 2023-05-16T13:49:38.785 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-05-16T13:49:38.822 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-05-16T13:49:39.133 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-markupsafe. 2023-05-16T13:49:39.146 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-05-16T13:49:39.183 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-05-16T13:49:39.469 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-mako. 2023-05-16T13:49:39.482 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-05-16T13:49:39.519 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-05-16T13:49:39.709 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package ceph-fuse. 2023-05-16T13:49:39.723 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../062-ceph-fuse_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-16T13:49:39.767 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking ceph-fuse (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:49:40.170 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package ceph-mds. 2023-05-16T13:49:40.184 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../063-ceph-mds_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-16T13:49:40.229 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking ceph-mds (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:49:40.439 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-simplegeneric. 2023-05-16T13:49:40.453 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-05-16T13:49:40.489 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-05-16T13:49:40.598 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package cephadm. 2023-05-16T13:49:40.612 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../064-cephadm_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-16T13:49:40.656 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking cephadm (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:49:40.784 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-singledispatch. 2023-05-16T13:49:40.797 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-05-16T13:49:40.842 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-05-16T13:49:40.943 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-asyncssh. 2023-05-16T13:49:40.957 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-05-16T13:49:40.992 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-05-16T13:49:41.145 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-webob. 2023-05-16T13:49:41.158 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-05-16T13:49:41.203 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-05-16T13:49:41.295 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python-babel-localedata. 2023-05-16T13:49:41.309 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-05-16T13:49:41.354 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-05-16T13:49:41.556 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-waitress. 2023-05-16T13:49:41.570 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-05-16T13:49:41.617 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-05-16T13:49:41.901 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-tempita. 2023-05-16T13:49:41.914 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-05-16T13:49:41.942 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-05-16T13:49:42.220 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-paste. 2023-05-16T13:49:42.234 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-05-16T13:49:42.278 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-05-16T13:49:42.383 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-babel. 2023-05-16T13:49:42.396 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-05-16T13:49:42.441 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-05-16T13:49:42.582 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-05-16T13:49:42.595 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-05-16T13:49:42.649 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-05-16T13:49:42.820 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-jinja2. 2023-05-16T13:49:42.832 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-05-16T13:49:42.886 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-05-16T13:49:42.943 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-pastedeploy. 2023-05-16T13:49:42.956 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-05-16T13:49:43.001 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-05-16T13:49:43.206 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-05-16T13:49:43.219 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.0.0-3926-g27be5126-1jammy_all.deb ... 2023-05-16T13:49:43.248 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking ceph-mgr-cephadm (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:49:43.304 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-webtest. 2023-05-16T13:49:43.318 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-05-16T13:49:43.362 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-05-16T13:49:43.584 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-bcrypt. 2023-05-16T13:49:43.597 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-05-16T13:49:43.634 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-05-16T13:49:43.674 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-pecan. 2023-05-16T13:49:43.688 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-05-16T13:49:43.732 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-05-16T13:49:43.962 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-repoze.lru. 2023-05-16T13:49:43.975 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../071-python3-repoze.lru_0.7-2_all.deb ... 2023-05-16T13:49:44.021 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-05-16T13:49:44.246 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-certifi. 2023-05-16T13:49:44.259 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-05-16T13:49:44.303 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-05-16T13:49:44.374 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-routes. 2023-05-16T13:49:44.386 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../072-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-05-16T13:49:44.448 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-05-16T13:49:44.615 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-idna. 2023-05-16T13:49:44.628 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-05-16T13:49:44.707 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-idna (3.3-1) ... 2023-05-16T13:49:44.843 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-05-16T13:49:44.856 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../073-ceph-mgr-dashboard_18.0.0-3926-g27be5126-1jammy_all.deb ... 2023-05-16T13:49:44.901 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking ceph-mgr-dashboard (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:49:45.018 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-urllib3. 2023-05-16T13:49:45.032 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1_all.deb ... 2023-05-16T13:49:45.076 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1) ... 2023-05-16T13:49:45.330 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-05-16T13:49:45.343 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-05-16T13:49:45.380 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-05-16T13:49:45.396 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-requests. 2023-05-16T13:49:45.410 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2_all.deb ... 2023-05-16T13:49:45.454 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-requests (2.25.1+dfsg-2) ... 2023-05-16T13:49:45.766 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-werkzeug. 2023-05-16T13:49:45.779 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-05-16T13:49:45.824 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-05-16T13:49:45.842 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-joblib. 2023-05-16T13:49:45.854 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../075-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-05-16T13:49:45.883 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-05-16T13:49:46.111 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-05-16T13:49:46.124 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.0.0-3926-g27be5126-1jammy_all.deb ... 2023-05-16T13:49:46.160 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-mgr-modules-core (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:49:46.237 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-05-16T13:49:46.250 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../076-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-05-16T13:49:46.287 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-05-16T13:49:46.524 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-05-16T13:49:46.537 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-16T13:49:46.564 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-sklearn. 2023-05-16T13:49:46.574 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:49:46.577 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../077-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-05-16T13:49:46.614 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-05-16T13:49:46.885 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-openssl. 2023-05-16T13:49:46.898 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-05-16T13:49:46.943 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-05-16T13:49:47.256 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-05-16T13:49:47.263 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph-mgr. 2023-05-16T13:49:47.269 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../078-ceph-mgr-diskprediction-local_18.0.0-3926-g27be5126-1jammy_all.deb ... 2023-05-16T13:49:47.276 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../058-ceph-mgr_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-16T13:49:47.306 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:49:47.313 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-mgr (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:49:47.683 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph-mon. 2023-05-16T13:49:47.696 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../059-ceph-mon_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-16T13:49:47.741 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-mon (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:49:48.234 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-cachetools. 2023-05-16T13:49:48.249 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../079-python3-cachetools_5.0.0-1_all.deb ... 2023-05-16T13:49:48.293 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-05-16T13:49:48.520 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph-osd. 2023-05-16T13:49:48.533 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../060-ceph-osd_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-16T13:49:48.562 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-pyasn1. 2023-05-16T13:49:48.577 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../080-python3-pyasn1_0.4.8-1_all.deb ... 2023-05-16T13:49:48.578 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-osd (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:49:48.612 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-05-16T13:49:48.907 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-05-16T13:49:48.921 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../081-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-05-16T13:49:48.965 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-05-16T13:49:49.251 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-rsa. 2023-05-16T13:49:49.266 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../082-python3-rsa_4.8-1_all.deb ... 2023-05-16T13:49:49.309 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-rsa (4.8-1) ... 2023-05-16T13:49:49.723 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-google-auth. 2023-05-16T13:49:49.738 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../083-python3-google-auth_1.5.1-3_all.deb ... 2023-05-16T13:49:49.773 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-05-16T13:49:49.848 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph. 2023-05-16T13:49:49.862 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../061-ceph_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-16T13:49:49.898 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:49:50.218 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph-fuse. 2023-05-16T13:49:50.230 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../062-ceph-fuse_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-16T13:49:50.234 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-05-16T13:49:50.249 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../084-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-05-16T13:49:50.259 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-fuse (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:49:50.292 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-05-16T13:49:50.604 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-websocket. 2023-05-16T13:49:50.618 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../085-python3-websocket_1.2.3-1_all.deb ... 2023-05-16T13:49:50.621 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph-mds. 2023-05-16T13:49:50.634 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../063-ceph-mds_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-16T13:49:50.671 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-mds (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:49:50.671 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-05-16T13:49:50.982 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-kubernetes. 2023-05-16T13:49:50.997 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../086-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-05-16T13:49:51.041 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package cephadm. 2023-05-16T13:49:51.054 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../064-cephadm_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-16T13:49:51.065 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-05-16T13:49:51.090 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking cephadm (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:49:51.360 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-asyncssh. 2023-05-16T13:49:51.374 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-05-16T13:49:51.418 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-05-16T13:49:51.704 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-05-16T13:49:51.705 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python-babel-localedata. 2023-05-16T13:49:51.717 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../087-ceph-mgr-k8sevents_18.0.0-3926-g27be5126-1jammy_all.deb ... 2023-05-16T13:49:51.718 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-05-16T13:49:51.754 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:49:51.755 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-05-16T13:49:52.073 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libonig5:amd64. 2023-05-16T13:49:52.086 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../088-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-05-16T13:49:52.123 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-05-16T13:49:52.459 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libjq1:amd64. 2023-05-16T13:49:52.472 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../089-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-05-16T13:49:52.509 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-05-16T13:49:52.728 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package jq. 2023-05-16T13:49:52.742 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../090-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-05-16T13:49:52.760 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-babel. 2023-05-16T13:49:52.770 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-05-16T13:49:52.773 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-05-16T13:49:52.810 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-05-16T13:49:53.015 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package socat. 2023-05-16T13:49:53.028 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../091-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-05-16T13:49:53.065 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-05-16T13:49:53.130 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-jinja2. 2023-05-16T13:49:53.142 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-05-16T13:49:53.180 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-05-16T13:49:53.359 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package xmlstarlet. 2023-05-16T13:49:53.373 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../092-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-05-16T13:49:53.417 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-05-16T13:49:53.533 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-05-16T13:49:53.546 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.0.0-3926-g27be5126-1jammy_all.deb ... 2023-05-16T13:49:53.583 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-mgr-cephadm (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:49:53.739 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package ceph-test. 2023-05-16T13:49:53.751 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../093-ceph-test_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-16T13:49:53.788 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking ceph-test (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:49:53.912 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-bcrypt. 2023-05-16T13:49:53.925 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-05-16T13:49:53.961 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-05-16T13:49:54.476 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-repoze.lru. 2023-05-16T13:49:54.489 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../071-python3-repoze.lru_0.7-2_all.deb ... 2023-05-16T13:49:54.533 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-05-16T13:49:54.836 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-routes. 2023-05-16T13:49:54.850 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../072-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-05-16T13:49:54.895 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-05-16T13:49:55.282 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-05-16T13:49:55.296 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../073-ceph-mgr-dashboard_18.0.0-3926-g27be5126-1jammy_all.deb ... 2023-05-16T13:49:55.340 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-mgr-dashboard (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:49:55.442 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package ceph-volume. 2023-05-16T13:49:55.456 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../094-ceph-volume_18.0.0-3926-g27be5126-1jammy_all.deb ... 2023-05-16T13:49:55.500 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking ceph-volume (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:49:55.728 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-05-16T13:49:55.741 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-05-16T13:49:55.777 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-05-16T13:49:55.814 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package cephfs-mirror. 2023-05-16T13:49:55.827 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../095-cephfs-mirror_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-16T13:49:55.872 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking cephfs-mirror (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:49:56.183 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-colorama. 2023-05-16T13:49:56.198 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../096-python3-colorama_0.4.4-1_all.deb ... 2023-05-16T13:49:56.265 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-joblib. 2023-05-16T13:49:56.278 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../075-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-05-16T13:49:56.323 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-05-16T13:49:56.333 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-05-16T13:49:56.577 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package cephfs-shell. 2023-05-16T13:49:56.592 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../097-cephfs-shell_18.0.0-3926-g27be5126-1jammy_all.deb ... 2023-05-16T13:49:56.635 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking cephfs-shell (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:49:56.677 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-05-16T13:49:56.690 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../076-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-05-16T13:49:56.727 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-05-16T13:49:56.872 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package cephfs-top. 2023-05-16T13:49:56.886 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../098-cephfs-top_18.0.0-3926-g27be5126-1jammy_all.deb ... 2023-05-16T13:49:56.922 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking cephfs-top (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:49:56.988 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-sklearn. 2023-05-16T13:49:57.001 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../077-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-05-16T13:49:57.029 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-05-16T13:49:57.149 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libcephfs-dev. 2023-05-16T13:49:57.164 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../099-libcephfs-dev_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-16T13:49:57.207 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libcephfs-dev (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:49:57.577 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package nvme-cli. 2023-05-16T13:49:57.592 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../100-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-05-16T13:49:57.635 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-05-16T13:49:57.747 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-05-16T13:49:57.759 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../078-ceph-mgr-diskprediction-local_18.0.0-3926-g27be5126-1jammy_all.deb ... 2023-05-16T13:49:57.797 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:49:57.965 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-05-16T13:49:57.979 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../101-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-05-16T13:49:58.023 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-05-16T13:49:58.451 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-iniconfig. 2023-05-16T13:49:58.465 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../102-python3-iniconfig_1.1.1-2_all.deb ... 2023-05-16T13:49:58.509 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-05-16T13:49:58.725 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-cachetools. 2023-05-16T13:49:58.739 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../079-python3-cachetools_5.0.0-1_all.deb ... 2023-05-16T13:49:58.776 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-05-16T13:49:58.837 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-pastescript. 2023-05-16T13:49:58.852 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../103-python3-pastescript_2.0.2-4_all.deb ... 2023-05-16T13:49:58.896 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-05-16T13:49:59.079 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-pyasn1. 2023-05-16T13:49:59.092 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../080-python3-pyasn1_0.4.8-1_all.deb ... 2023-05-16T13:49:59.137 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-05-16T13:49:59.216 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-pluggy. 2023-05-16T13:49:59.230 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../104-python3-pluggy_0.13.0-7.1_all.deb ... 2023-05-16T13:49:59.273 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-05-16T13:49:59.457 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-05-16T13:49:59.471 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../081-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-05-16T13:49:59.515 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-05-16T13:49:59.585 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-psutil. 2023-05-16T13:49:59.599 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../105-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-05-16T13:49:59.643 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-05-16T13:49:59.826 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-rsa. 2023-05-16T13:49:59.840 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../082-python3-rsa_4.8-1_all.deb ... 2023-05-16T13:49:59.885 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-rsa (4.8-1) ... 2023-05-16T13:49:59.979 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-py. 2023-05-16T13:49:59.994 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../106-python3-py_1.10.0-1_all.deb ... 2023-05-16T13:50:00.037 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-py (1.10.0-1) ... 2023-05-16T13:50:00.290 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-google-auth. 2023-05-16T13:50:00.304 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../083-python3-google-auth_1.5.1-3_all.deb ... 2023-05-16T13:50:00.348 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-05-16T13:50:00.368 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-pygments. 2023-05-16T13:50:00.381 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../107-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-05-16T13:50:00.418 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-05-16T13:50:00.669 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-05-16T13:50:00.682 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../084-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-05-16T13:50:00.727 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-05-16T13:50:00.872 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-pyinotify. 2023-05-16T13:50:00.885 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../108-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-05-16T13:50:00.922 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-05-16T13:50:01.038 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-websocket. 2023-05-16T13:50:01.052 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../085-python3-websocket_1.2.3-1_all.deb ... 2023-05-16T13:50:01.097 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-05-16T13:50:01.216 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-toml. 2023-05-16T13:50:01.229 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../109-python3-toml_0.10.2-1_all.deb ... 2023-05-16T13:50:01.266 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-05-16T13:50:01.400 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-kubernetes. 2023-05-16T13:50:01.414 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../086-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-05-16T13:50:01.467 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-05-16T13:50:01.552 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-pytest. 2023-05-16T13:50:01.565 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../110-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-05-16T13:50:01.603 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-05-16T13:50:01.931 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-simplejson. 2023-05-16T13:50:01.944 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-05-16T13:50:01.981 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-05-16T13:50:02.181 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-05-16T13:50:02.193 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../087-ceph-mgr-k8sevents_18.0.0-3926-g27be5126-1jammy_all.deb ... 2023-05-16T13:50:02.231 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:02.250 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-05-16T13:50:02.263 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-05-16T13:50:02.300 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-05-16T13:50:02.559 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libonig5:amd64. 2023-05-16T13:50:02.571 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../088-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-05-16T13:50:02.609 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-05-16T13:50:02.904 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libjq1:amd64. 2023-05-16T13:50:02.913 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package radosgw. 2023-05-16T13:50:02.916 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../089-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-05-16T13:50:02.926 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../113-radosgw_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-16T13:50:02.945 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-05-16T13:50:02.962 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking radosgw (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:03.206 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package jq. 2023-05-16T13:50:03.218 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../090-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-05-16T13:50:03.256 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-05-16T13:50:03.508 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package rbd-fuse. 2023-05-16T13:50:03.509 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package socat. 2023-05-16T13:50:03.521 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../114-rbd-fuse_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-16T13:50:03.522 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../091-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-05-16T13:50:03.557 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking rbd-fuse (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:03.559 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-05-16T13:50:03.848 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-05-16T13:50:03.855 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package xmlstarlet. 2023-05-16T13:50:03.867 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../092-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-05-16T13:50:03.913 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-05-16T13:50:04.113 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-05-16T13:50:04.222 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-05-16T13:50:04.326 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph-test. 2023-05-16T13:50:04.338 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../093-ceph-test_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-16T13:50:04.471 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-05-16T13:50:04.593 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-test (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:04.892 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-05-16T13:50:05.519 INFO:teuthology.orchestra.run.smithi039.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-05-16T13:50:05.550 INFO:teuthology.orchestra.run.smithi039.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-05-16T13:50:05.649 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up cephadm (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:06.160 INFO:teuthology.orchestra.run.smithi039.stdout:Adding system user cephadm....done 2023-05-16T13:50:06.230 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph-volume. 2023-05-16T13:50:06.243 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../094-ceph-volume_18.0.0-3926-g27be5126-1jammy_all.deb ... 2023-05-16T13:50:06.280 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-05-16T13:50:06.288 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-volume (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:06.557 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-05-16T13:50:06.668 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package cephfs-mirror. 2023-05-16T13:50:06.681 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../095-cephfs-mirror_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-16T13:50:06.726 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking cephfs-mirror (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:06.816 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-05-16T13:50:06.951 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-05-16T13:50:07.021 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-colorama. 2023-05-16T13:50:07.034 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../096-python3-colorama_0.4.4-1_all.deb ... 2023-05-16T13:50:07.079 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-05-16T13:50:07.219 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-05-16T13:50:07.332 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package cephfs-shell. 2023-05-16T13:50:07.345 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../097-cephfs-shell_18.0.0-3926-g27be5126-1jammy_all.deb ... 2023-05-16T13:50:07.390 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking cephfs-shell (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:07.486 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-05-16T13:50:07.596 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-py (1.10.0-1) ... 2023-05-16T13:50:07.626 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package cephfs-top. 2023-05-16T13:50:07.640 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../098-cephfs-top_18.0.0-3926-g27be5126-1jammy_all.deb ... 2023-05-16T13:50:07.684 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking cephfs-top (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:07.897 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-05-16T13:50:07.954 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libcephfs-dev. 2023-05-16T13:50:07.967 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../099-libcephfs-dev_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-16T13:50:08.021 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libcephfs-dev (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:08.266 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-05-16T13:50:08.482 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package nvme-cli. 2023-05-16T13:50:08.496 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../100-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-05-16T13:50:08.535 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-05-16T13:50:08.549 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-05-16T13:50:08.803 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-05-16T13:50:08.930 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-05-16T13:50:08.943 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../101-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-05-16T13:50:08.996 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-05-16T13:50:09.087 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-05-16T13:50:09.338 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-05-16T13:50:09.508 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-iniconfig. 2023-05-16T13:50:09.521 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../102-python3-iniconfig_1.1.1-2_all.deb ... 2023-05-16T13:50:09.574 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-05-16T13:50:09.665 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-05-16T13:50:09.915 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-ceph-argparse (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:09.952 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-pastescript. 2023-05-16T13:50:09.966 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../103-python3-pastescript_2.0.2-4_all.deb ... 2023-05-16T13:50:10.010 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-05-16T13:50:10.192 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-05-16T13:50:10.289 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-pluggy. 2023-05-16T13:50:10.302 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../104-python3-pluggy_0.13.0-7.1_all.deb ... 2023-05-16T13:50:10.317 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-05-16T13:50:10.347 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-05-16T13:50:10.585 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-05-16T13:50:10.642 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-psutil. 2023-05-16T13:50:10.655 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../105-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-05-16T13:50:10.700 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-05-16T13:50:10.845 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-05-16T13:50:10.971 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-05-16T13:50:11.054 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-py. 2023-05-16T13:50:11.067 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../106-python3-py_1.10.0-1_all.deb ... 2023-05-16T13:50:11.112 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-py (1.10.0-1) ... 2023-05-16T13:50:11.330 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-05-16T13:50:11.440 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-05-16T13:50:11.440 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-pygments. 2023-05-16T13:50:11.454 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../107-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-05-16T13:50:11.498 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-05-16T13:50:11.716 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-05-16T13:50:11.936 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-pyinotify. 2023-05-16T13:50:11.949 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../108-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-05-16T13:50:11.986 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-05-16T13:50:11.992 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-05-16T13:50:12.247 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-toml. 2023-05-16T13:50:12.260 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../109-python3-toml_0.10.2-1_all.deb ... 2023-05-16T13:50:12.289 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-05-16T13:50:12.302 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-05-16T13:50:12.567 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-pytest. 2023-05-16T13:50:12.581 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../110-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-05-16T13:50:12.625 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-05-16T13:50:12.979 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-simplejson. 2023-05-16T13:50:12.993 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-05-16T13:50:13.021 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-05-16T13:50:13.037 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-05-16T13:50:13.280 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-05-16T13:50:13.290 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-05-16T13:50:13.304 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-05-16T13:50:13.348 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-05-16T13:50:13.381 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-05-16T13:50:13.516 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-05-16T13:50:13.833 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-05-16T13:50:14.061 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package radosgw. 2023-05-16T13:50:14.074 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../113-radosgw_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-16T13:50:14.111 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking radosgw (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:14.243 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-05-16T13:50:14.502 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-05-16T13:50:14.881 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package rbd-fuse. 2023-05-16T13:50:14.894 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../114-rbd-fuse_18.0.0-3926-g27be5126-1jammy_amd64.deb ... 2023-05-16T13:50:14.912 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-05-16T13:50:14.939 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking rbd-fuse (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:15.197 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-05-16T13:50:15.231 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-05-16T13:50:15.486 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-05-16T13:50:15.498 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-05-16T13:50:15.612 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-05-16T13:50:15.858 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-05-16T13:50:15.868 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-05-16T13:50:16.118 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-05-16T13:50:16.244 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-ceph-common (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:16.284 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-05-16T13:50:16.545 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-idna (3.3-1) ... 2023-05-16T13:50:16.888 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-05-16T13:50:16.991 INFO:teuthology.orchestra.run.smithi118.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-05-16T13:50:17.004 INFO:teuthology.orchestra.run.smithi118.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-05-16T13:50:17.039 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up cephadm (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:17.542 INFO:teuthology.orchestra.run.smithi118.stdout:Adding system user cephadm....done 2023-05-16T13:50:17.696 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-05-16T13:50:17.956 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-05-16T13:50:18.144 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-16T13:50:18.199 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-05-16T13:50:18.278 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-toml (0.10.2-1) ... 2023-05-16T13:50:18.325 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-05-16T13:50:18.529 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-05-16T13:50:18.593 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-05-16T13:50:18.630 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-05-16T13:50:18.739 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-urllib3 (1.26.5-1~exp1) ... 2023-05-16T13:50:18.852 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-05-16T13:50:18.995 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-py (1.10.0-1) ... 2023-05-16T13:50:19.058 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-05-16T13:50:19.305 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-05-16T13:50:19.326 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-05-16T13:50:19.585 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-16T13:50:19.650 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-05-16T13:50:19.711 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-05-16T13:50:19.837 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-05-16T13:50:19.909 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-05-16T13:50:20.130 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-05-16T13:50:20.169 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-05-16T13:50:20.390 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-05-16T13:50:20.445 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-05-16T13:50:20.666 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-05-16T13:50:20.704 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-05-16T13:50:20.942 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-05-16T13:50:20.956 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-05-16T13:50:21.199 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-ceph-argparse (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:21.377 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-05-16T13:50:21.458 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-05-16T13:50:21.592 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-05-16T13:50:21.653 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-05-16T13:50:21.779 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-05-16T13:50:21.868 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-05-16T13:50:22.047 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-05-16T13:50:22.128 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-05-16T13:50:22.173 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-05-16T13:50:22.254 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-05-16T13:50:22.474 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-05-16T13:50:22.614 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-05-16T13:50:22.714 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-05-16T13:50:22.792 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-05-16T13:50:23.016 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-05-16T13:50:23.068 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-05-16T13:50:23.284 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-05-16T13:50:23.475 INFO:teuthology.orchestra.run.smithi039.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-05-16T13:50:23.610 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-05-16T13:50:23.721 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-05-16T13:50:23.822 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-05-16T13:50:24.258 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-05-16T13:50:24.312 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-05-16T13:50:24.533 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-portend (3.0.0-1) ... 2023-05-16T13:50:24.555 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-05-16T13:50:24.656 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-05-16T13:50:24.774 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-05-16T13:50:24.801 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-16T13:50:24.927 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-05-16T13:50:25.100 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-05-16T13:50:25.245 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-05-16T13:50:25.518 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-05-16T13:50:25.538 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-requests (2.25.1+dfsg-2) ... 2023-05-16T13:50:25.778 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-05-16T13:50:25.797 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-05-16T13:50:25.949 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-rsa (4.8-1) ... 2023-05-16T13:50:26.188 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-05-16T13:50:26.225 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-05-16T13:50:26.481 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-05-16T13:50:26.501 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-05-16T13:50:26.769 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-05-16T13:50:26.790 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-05-16T13:50:27.154 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-05-16T13:50:27.158 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-05-16T13:50:27.427 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-05-16T13:50:27.447 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-05-16T13:50:27.552 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-ceph-common (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:27.807 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-05-16T13:50:27.862 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-idna (3.3-1) ... 2023-05-16T13:50:27.933 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up librados2 (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:28.060 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up librgw2 (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:28.222 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-05-16T13:50:28.271 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libsqlite3-mod-ceph (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:28.397 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libcephfs2 (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:28.515 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libradosstriper1 (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:28.616 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-05-16T13:50:28.909 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up librbd1 (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:29.036 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up ceph-mgr-modules-core (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:29.137 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up ceph-fuse (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:29.336 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-05-16T13:50:29.336 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-05-16T13:50:29.428 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-16T13:50:29.554 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-toml (0.10.2-1) ... 2023-05-16T13:50:29.797 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-05-16T13:50:29.906 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-05-16T13:50:29.988 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libcephfs-dev (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:30.032 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-urllib3 (1.26.5-1~exp1) ... 2023-05-16T13:50:30.114 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-rados (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:30.249 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up cephfs-top (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:30.351 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-05-16T13:50:30.375 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-05-16T13:50:30.627 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-05-16T13:50:30.886 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-16T13:50:31.004 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-05-16T13:50:31.105 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-05-16T13:50:31.415 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-05-16T13:50:31.674 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-05-16T13:50:31.713 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-rbd (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:31.839 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up rbd-fuse (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:31.959 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-05-16T13:50:31.974 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-rgw (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:32.083 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-cephfs (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:32.209 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up cephfs-shell (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:32.219 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-05-16T13:50:32.335 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up ceph-common (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:32.503 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-05-16T13:50:32.813 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-05-16T13:50:32.872 INFO:teuthology.orchestra.run.smithi039.stdout:Adding group ceph....done 2023-05-16T13:50:32.922 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-05-16T13:50:33.190 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-05-16T13:50:33.206 INFO:teuthology.orchestra.run.smithi039.stdout:Adding system user ceph....done 2023-05-16T13:50:33.316 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-05-16T13:50:33.392 INFO:teuthology.orchestra.run.smithi039.stdout:Setting system user ceph properties....done 2023-05-16T13:50:33.408 INFO:teuthology.orchestra.run.smithi039.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-05-16T13:50:33.549 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-05-16T13:50:33.634 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-05-16T13:50:33.949 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-05-16T13:50:33.986 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-05-16T13:50:34.245 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-05-16T13:50:34.659 INFO:teuthology.orchestra.run.smithi118.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-05-16T13:50:34.721 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up cephfs-mirror (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:34.821 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up ceph-test (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:34.940 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-05-16T13:50:34.947 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up radosgw (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:35.065 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-05-16T13:50:35.209 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-05-16T13:50:35.210 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-05-16T13:50:35.484 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-05-16T13:50:35.752 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-portend (3.0.0-1) ... 2023-05-16T13:50:36.036 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-16T13:50:36.146 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-05-16T13:50:36.157 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up ceph-base (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:36.464 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-05-16T13:50:36.510 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-05-16T13:50:36.748 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-requests (2.25.1+dfsg-2) ... 2023-05-16T13:50:37.025 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-05-16T13:50:37.159 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-rsa (4.8-1) ... 2023-05-16T13:50:37.226 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up ceph-mds (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:37.435 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-05-16T13:50:37.461 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-05-16T13:50:37.462 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-05-16T13:50:37.736 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-05-16T13:50:37.996 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-05-16T13:50:38.145 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up ceph-mgr (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:38.370 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-05-16T13:50:38.370 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-05-16T13:50:38.381 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-05-16T13:50:38.674 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-05-16T13:50:39.021 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up ceph-osd (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:39.036 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-05-16T13:50:39.145 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up librados2 (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:39.246 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up librgw2 (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:39.357 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-05-16T13:50:39.358 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-05-16T13:50:39.449 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libsqlite3-mod-ceph (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:39.575 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libcephfs2 (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:39.704 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libradosstriper1 (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:39.828 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-05-16T13:50:40.014 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up ceph-mgr-k8sevents (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:40.115 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:40.137 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up librbd1 (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:40.255 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-mgr-modules-core (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:40.258 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up ceph-mon (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:40.356 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-fuse (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:40.474 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-05-16T13:50:40.474 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-05-16T13:50:40.564 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-05-16T13:50:40.565 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-05-16T13:50:41.184 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up ceph-mgr-cephadm (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:41.275 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libcephfs-dev (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:41.310 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up ceph (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:41.436 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up ceph-mgr-dashboard (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:41.579 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up ceph-volume (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:41.698 INFO:teuthology.orchestra.run.smithi039.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-05-16T13:50:41.701 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-rados (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:41.836 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up cephfs-top (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:41.954 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-05-16T13:50:42.800 INFO:teuthology.orchestra.run.smithi039.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-05-16T13:50:43.216 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-rbd (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:43.264 INFO:teuthology.orchestra.run.smithi039.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-05-16T13:50:43.267 DEBUG:teuthology.orchestra.run.smithi039:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-05-16T13:50:43.340 INFO:teuthology.orchestra.run.smithi039.stdout:Reading package lists... 2023-05-16T13:50:43.342 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up rbd-fuse (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:43.468 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-rgw (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:43.495 INFO:teuthology.orchestra.run.smithi039.stdout:Building dependency tree... 2023-05-16T13:50:43.495 INFO:teuthology.orchestra.run.smithi039.stdout:Reading state information... 2023-05-16T13:50:43.603 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-cephfs (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:43.636 INFO:teuthology.orchestra.run.smithi039.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-05-16T13:50:43.637 INFO:teuthology.orchestra.run.smithi039.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-05-16T13:50:43.637 INFO:teuthology.orchestra.run.smithi039.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-05-16T13:50:43.637 INFO:teuthology.orchestra.run.smithi039.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-05-16T13:50:43.637 INFO:teuthology.orchestra.run.smithi039.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-05-16T13:50:43.637 INFO:teuthology.orchestra.run.smithi039.stdout:The following packages were automatically installed and are no longer required: 2023-05-16T13:50:43.637 INFO:teuthology.orchestra.run.smithi039.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-05-16T13:50:43.637 INFO:teuthology.orchestra.run.smithi039.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-05-16T13:50:43.638 INFO:teuthology.orchestra.run.smithi039.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-05-16T13:50:43.638 INFO:teuthology.orchestra.run.smithi039.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-05-16T13:50:43.639 INFO:teuthology.orchestra.run.smithi039.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-05-16T13:50:43.639 INFO:teuthology.orchestra.run.smithi039.stdout:Use 'sudo apt autoremove' to remove them. 2023-05-16T13:50:43.639 INFO:teuthology.orchestra.run.smithi039.stdout:The following additional packages will be installed: 2023-05-16T13:50:43.639 INFO:teuthology.orchestra.run.smithi039.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-05-16T13:50:43.640 INFO:teuthology.orchestra.run.smithi039.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-05-16T13:50:43.640 INFO:teuthology.orchestra.run.smithi039.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-05-16T13:50:43.640 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-05-16T13:50:43.640 INFO:teuthology.orchestra.run.smithi039.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-05-16T13:50:43.640 INFO:teuthology.orchestra.run.smithi039.stdout:Suggested packages: 2023-05-16T13:50:43.640 INFO:teuthology.orchestra.run.smithi039.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-05-16T13:50:43.640 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-05-16T13:50:43.641 INFO:teuthology.orchestra.run.smithi039.stdout: libengine-pkcs11-openssl 2023-05-16T13:50:43.683 INFO:teuthology.orchestra.run.smithi039.stdout:The following NEW packages will be installed: 2023-05-16T13:50:43.684 INFO:teuthology.orchestra.run.smithi039.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-05-16T13:50:43.684 INFO:teuthology.orchestra.run.smithi039.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-05-16T13:50:43.685 INFO:teuthology.orchestra.run.smithi039.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-05-16T13:50:43.685 INFO:teuthology.orchestra.run.smithi039.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-05-16T13:50:43.685 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-05-16T13:50:43.685 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-05-16T13:50:43.685 INFO:teuthology.orchestra.run.smithi039.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-05-16T13:50:43.686 INFO:teuthology.orchestra.run.smithi039.stdout:The following packages will be upgraded: 2023-05-16T13:50:43.686 INFO:teuthology.orchestra.run.smithi039.stdout: libssl3 2023-05-16T13:50:43.720 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up cephfs-shell (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:43.823 INFO:teuthology.orchestra.run.smithi039.stdout:1 upgraded, 39 newly installed, 0 to remove and 144 not upgraded. 2023-05-16T13:50:43.824 INFO:teuthology.orchestra.run.smithi039.stdout:Need to get 54.6 MB of archives. 2023-05-16T13:50:43.824 INFO:teuthology.orchestra.run.smithi039.stdout:After this operation, 202 MB of additional disk space will be used. 2023-05-16T13:50:43.824 INFO:teuthology.orchestra.run.smithi039.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-05-16T13:50:43.838 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-common (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:43.925 INFO:teuthology.orchestra.run.smithi039.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.9 [1,902 kB] 2023-05-16T13:50:43.981 INFO:teuthology.orchestra.run.smithi039.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-05-16T13:50:43.988 INFO:teuthology.orchestra.run.smithi039.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-05-16T13:50:43.989 INFO:teuthology.orchestra.run.smithi039.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-05-16T13:50:43.990 INFO:teuthology.orchestra.run.smithi039.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 indent amd64 2.2.12-1build2 [90.8 kB] 2023-05-16T13:50:43.992 INFO:teuthology.orchestra.run.smithi039.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-05-16T13:50:43.992 INFO:teuthology.orchestra.run.smithi039.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-05-16T13:50:43.993 INFO:teuthology.orchestra.run.smithi039.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-05-16T13:50:43.994 INFO:teuthology.orchestra.run.smithi039.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-05-16T13:50:44.030 INFO:teuthology.orchestra.run.smithi039.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-05-16T13:50:44.031 INFO:teuthology.orchestra.run.smithi039.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-05-16T13:50:44.081 INFO:teuthology.orchestra.run.smithi039.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1 [24.0 MB] 2023-05-16T13:50:44.356 INFO:teuthology.orchestra.run.smithi118.stdout:Adding group ceph....done 2023-05-16T13:50:44.377 INFO:teuthology.orchestra.run.smithi039.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-05-16T13:50:44.379 INFO:teuthology.orchestra.run.smithi039.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-05-16T13:50:44.379 INFO:teuthology.orchestra.run.smithi039.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.1 [263 kB] 2023-05-16T13:50:44.382 INFO:teuthology.orchestra.run.smithi039.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-05-16T13:50:44.382 INFO:teuthology.orchestra.run.smithi039.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-05-16T13:50:44.387 INFO:teuthology.orchestra.run.smithi039.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.7-0ubuntu0.22.04.1 [141 kB] 2023-05-16T13:50:44.389 INFO:teuthology.orchestra.run.smithi039.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-05-16T13:50:44.396 INFO:teuthology.orchestra.run.smithi039.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-05-16T13:50:44.432 INFO:teuthology.orchestra.run.smithi039.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.9 [2,373 kB] 2023-05-16T13:50:44.588 INFO:teuthology.orchestra.run.smithi039.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-05-16T13:50:44.588 INFO:teuthology.orchestra.run.smithi039.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.1 [1,094 kB] 2023-05-16T13:50:44.599 INFO:teuthology.orchestra.run.smithi039.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-05-16T13:50:44.621 INFO:teuthology.orchestra.run.smithi039.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-05-16T13:50:44.624 INFO:teuthology.orchestra.run.smithi039.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-05-16T13:50:44.625 INFO:teuthology.orchestra.run.smithi039.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-05-16T13:50:44.626 INFO:teuthology.orchestra.run.smithi039.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-05-16T13:50:44.626 INFO:teuthology.orchestra.run.smithi039.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.7-0ubuntu0.22.04.1 [1,220 kB] 2023-05-16T13:50:44.638 INFO:teuthology.orchestra.run.smithi039.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-05-16T13:50:44.640 INFO:teuthology.orchestra.run.smithi039.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.7-0ubuntu0.22.04.1 [16.1 MB] 2023-05-16T13:50:44.724 INFO:teuthology.orchestra.run.smithi118.stdout:Adding system user ceph....done 2023-05-16T13:50:44.832 INFO:teuthology.orchestra.run.smithi039.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-05-16T13:50:44.850 INFO:teuthology.orchestra.run.smithi039.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-05-16T13:50:44.850 INFO:teuthology.orchestra.run.smithi039.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-05-16T13:50:44.851 INFO:teuthology.orchestra.run.smithi039.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-05-16T13:50:44.869 INFO:teuthology.orchestra.run.smithi039.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-05-16T13:50:44.870 INFO:teuthology.orchestra.run.smithi039.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-05-16T13:50:44.885 INFO:teuthology.orchestra.run.smithi118.stdout:Setting system user ceph properties....done 2023-05-16T13:50:44.904 INFO:teuthology.orchestra.run.smithi118.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-05-16T13:50:44.970 INFO:teuthology.orchestra.run.smithi039.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-05-16T13:50:44.970 INFO:teuthology.orchestra.run.smithi039.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-05-16T13:50:45.037 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-05-16T13:50:45.351 INFO:teuthology.orchestra.run.smithi039.stdout:Preconfiguring packages ... 2023-05-16T13:50:45.455 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-05-16T13:50:45.502 INFO:teuthology.orchestra.run.smithi039.stdout:Fetched 54.6 MB in 1s (42.8 MB/s) 2023-05-16T13:50:45.648 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package flex. 2023-05-16T13:50:45.723 INFO:teuthology.orchestra.run.smithi039.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139905 files and directories currently installed.) 2023-05-16T13:50:45.727 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-05-16T13:50:45.772 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking flex (2.6.4-8build2) ... 2023-05-16T13:50:46.163 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up cephfs-mirror (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:46.274 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.9_amd64.deb ... 2023-05-16T13:50:46.289 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-test (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:46.415 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up radosgw (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:46.419 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.9) over (3.0.2-0ubuntu1.7) ... 2023-05-16T13:50:46.668 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-05-16T13:50:46.669 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-05-16T13:50:46.815 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.9) ... 2023-05-16T13:50:47.447 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package bison. 2023-05-16T13:50:47.522 INFO:teuthology.orchestra.run.smithi039.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139978 files and directories currently installed.) 2023-05-16T13:50:47.526 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-05-16T13:50:47.558 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-05-16T13:50:47.617 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-base (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:47.926 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-05-16T13:50:47.938 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-05-16T13:50:47.959 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-05-16T13:50:47.968 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-05-16T13:50:48.295 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package dump. 2023-05-16T13:50:48.309 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-05-16T13:50:48.346 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking dump (0.4b47-3) ... 2023-05-16T13:50:48.624 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package indent. 2023-05-16T13:50:48.638 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../03-indent_2.2.12-1build2_amd64.deb ... 2023-05-16T13:50:48.674 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking indent (2.2.12-1build2) ... 2023-05-16T13:50:48.694 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-mds (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:48.914 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-05-16T13:50:48.915 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-05-16T13:50:48.960 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-05-16T13:50:48.974 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-05-16T13:50:49.010 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-05-16T13:50:49.330 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-05-16T13:50:49.345 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-05-16T13:50:49.389 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-05-16T13:50:49.658 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-05-16T13:50:49.673 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-05-16T13:50:49.679 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-mgr (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:49.750 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-05-16T13:50:49.889 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-05-16T13:50:49.890 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-05-16T13:50:50.053 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libfl2:amd64. 2023-05-16T13:50:50.068 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-05-16T13:50:50.103 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-05-16T13:50:50.306 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-05-16T13:50:50.320 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-05-16T13:50:50.364 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-05-16T13:50:50.608 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libjson-perl. 2023-05-16T13:50:50.622 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-05-16T13:50:50.667 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-05-16T13:50:50.750 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-osd (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:50.978 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libllvm14:amd64. 2023-05-16T13:50:50.993 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1_amd64.deb ... 2023-05-16T13:50:51.036 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-05-16T13:50:51.173 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-05-16T13:50:51.174 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-05-16T13:50:51.849 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-mgr-k8sevents (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:51.959 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:52.101 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-mon (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:52.308 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-05-16T13:50:52.308 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-05-16T13:50:52.389 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-05-16T13:50:52.404 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-05-16T13:50:52.447 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-05-16T13:50:52.854 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libmbim-proxy. 2023-05-16T13:50:52.869 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-05-16T13:50:52.912 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-05-16T13:50:52.986 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-mgr-cephadm (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:53.112 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:53.214 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-05-16T13:50:53.221 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-mgr-dashboard (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:53.229 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.1_amd64.deb ... 2023-05-16T13:50:53.273 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.1) ... 2023-05-16T13:50:53.356 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-volume (18.0.0-3926-g27be5126-1jammy) ... 2023-05-16T13:50:53.482 INFO:teuthology.orchestra.run.smithi118.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-05-16T13:50:53.584 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libndp0:amd64. 2023-05-16T13:50:53.598 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-05-16T13:50:53.642 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-05-16T13:50:53.937 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libnm0:amd64. 2023-05-16T13:50:53.951 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-05-16T13:50:53.995 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-05-16T13:50:54.248 INFO:teuthology.orchestra.run.smithi118.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-05-16T13:50:54.339 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libpq5:amd64. 2023-05-16T13:50:54.354 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../16-libpq5_14.7-0ubuntu0.22.04.1_amd64.deb ... 2023-05-16T13:50:54.397 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libpq5:amd64 (14.7-0ubuntu0.22.04.1) ... 2023-05-16T13:50:54.733 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-05-16T13:50:54.740 INFO:teuthology.orchestra.run.smithi118.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-05-16T13:50:54.744 DEBUG:teuthology.orchestra.run.smithi118:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-05-16T13:50:54.748 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-05-16T13:50:54.791 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-05-16T13:50:54.815 INFO:teuthology.orchestra.run.smithi118.stdout:Reading package lists... 2023-05-16T13:50:54.967 INFO:teuthology.orchestra.run.smithi118.stdout:Building dependency tree... 2023-05-16T13:50:54.967 INFO:teuthology.orchestra.run.smithi118.stdout:Reading state information... 2023-05-16T13:50:55.044 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libqmi-proxy. 2023-05-16T13:50:55.058 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-05-16T13:50:55.094 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-05-16T13:50:55.103 INFO:teuthology.orchestra.run.smithi118.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-05-16T13:50:55.103 INFO:teuthology.orchestra.run.smithi118.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-05-16T13:50:55.103 INFO:teuthology.orchestra.run.smithi118.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-05-16T13:50:55.103 INFO:teuthology.orchestra.run.smithi118.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-05-16T13:50:55.103 INFO:teuthology.orchestra.run.smithi118.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-05-16T13:50:55.104 INFO:teuthology.orchestra.run.smithi118.stdout:The following packages were automatically installed and are no longer required: 2023-05-16T13:50:55.104 INFO:teuthology.orchestra.run.smithi118.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-05-16T13:50:55.104 INFO:teuthology.orchestra.run.smithi118.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-05-16T13:50:55.104 INFO:teuthology.orchestra.run.smithi118.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-05-16T13:50:55.104 INFO:teuthology.orchestra.run.smithi118.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-05-16T13:50:55.105 INFO:teuthology.orchestra.run.smithi118.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-05-16T13:50:55.105 INFO:teuthology.orchestra.run.smithi118.stdout:Use 'sudo apt autoremove' to remove them. 2023-05-16T13:50:55.106 INFO:teuthology.orchestra.run.smithi118.stdout:The following additional packages will be installed: 2023-05-16T13:50:55.106 INFO:teuthology.orchestra.run.smithi118.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-05-16T13:50:55.106 INFO:teuthology.orchestra.run.smithi118.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-05-16T13:50:55.106 INFO:teuthology.orchestra.run.smithi118.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-05-16T13:50:55.106 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-05-16T13:50:55.106 INFO:teuthology.orchestra.run.smithi118.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-05-16T13:50:55.107 INFO:teuthology.orchestra.run.smithi118.stdout:Suggested packages: 2023-05-16T13:50:55.107 INFO:teuthology.orchestra.run.smithi118.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-05-16T13:50:55.107 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-05-16T13:50:55.107 INFO:teuthology.orchestra.run.smithi118.stdout: libengine-pkcs11-openssl 2023-05-16T13:50:55.147 INFO:teuthology.orchestra.run.smithi118.stdout:The following NEW packages will be installed: 2023-05-16T13:50:55.147 INFO:teuthology.orchestra.run.smithi118.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-05-16T13:50:55.148 INFO:teuthology.orchestra.run.smithi118.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-05-16T13:50:55.148 INFO:teuthology.orchestra.run.smithi118.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-05-16T13:50:55.148 INFO:teuthology.orchestra.run.smithi118.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-05-16T13:50:55.149 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-05-16T13:50:55.149 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-05-16T13:50:55.149 INFO:teuthology.orchestra.run.smithi118.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-05-16T13:50:55.149 INFO:teuthology.orchestra.run.smithi118.stdout:The following packages will be upgraded: 2023-05-16T13:50:55.149 INFO:teuthology.orchestra.run.smithi118.stdout: libssl3 2023-05-16T13:50:55.338 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-05-16T13:50:55.340 INFO:teuthology.orchestra.run.smithi118.stdout:1 upgraded, 39 newly installed, 0 to remove and 144 not upgraded. 2023-05-16T13:50:55.340 INFO:teuthology.orchestra.run.smithi118.stdout:Need to get 54.6 MB of archives. 2023-05-16T13:50:55.340 INFO:teuthology.orchestra.run.smithi118.stdout:After this operation, 202 MB of additional disk space will be used. 2023-05-16T13:50:55.341 INFO:teuthology.orchestra.run.smithi118.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-05-16T13:50:55.352 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.9_amd64.deb ... 2023-05-16T13:50:55.396 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.9) ... 2023-05-16T13:50:55.856 INFO:teuthology.orchestra.run.smithi118.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.9 [1,902 kB] 2023-05-16T13:50:55.899 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-05-16T13:50:55.913 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-05-16T13:50:55.958 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-05-16T13:50:56.277 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package modemmanager. 2023-05-16T13:50:56.292 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.1_amd64.deb ... 2023-05-16T13:50:56.327 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.1) ... 2023-05-16T13:50:56.933 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package network-manager. 2023-05-16T13:50:56.947 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-05-16T13:50:56.999 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-05-16T13:50:57.548 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package ppp. 2023-05-16T13:50:57.561 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-05-16T13:50:57.951 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-05-16T13:50:58.261 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package pptp-linux. 2023-05-16T13:50:58.274 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-05-16T13:50:58.312 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-05-16T13:50:58.564 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package network-manager-pptp. 2023-05-16T13:50:58.577 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-05-16T13:50:58.614 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-05-16T13:50:58.933 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package postgresql-client-common. 2023-05-16T13:50:58.947 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-05-16T13:50:58.991 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking postgresql-client-common (238) ... 2023-05-16T13:50:59.254 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package postgresql-client-14. 2023-05-16T13:50:59.267 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../27-postgresql-client-14_14.7-0ubuntu0.22.04.1_amd64.deb ... 2023-05-16T13:50:59.303 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking postgresql-client-14 (14.7-0ubuntu0.22.04.1) ... 2023-05-16T13:50:59.908 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package postgresql-common. 2023-05-16T13:50:59.922 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-05-16T13:50:59.984 INFO:teuthology.orchestra.run.smithi039.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-05-16T13:51:00.015 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking postgresql-common (238) ... 2023-05-16T13:51:00.482 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package postgresql-14. 2023-05-16T13:51:00.496 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../29-postgresql-14_14.7-0ubuntu0.22.04.1_amd64.deb ... 2023-05-16T13:51:00.551 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking postgresql-14 (14.7-0ubuntu0.22.04.1) ... 2023-05-16T13:51:01.709 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package postgresql. 2023-05-16T13:51:01.723 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-05-16T13:51:01.759 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking postgresql (14+238) ... 2023-05-16T13:51:02.003 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package postgresql-client. 2023-05-16T13:51:02.016 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-05-16T13:51:02.053 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking postgresql-client (14+238) ... 2023-05-16T13:51:02.289 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package postgresql-contrib. 2023-05-16T13:51:02.302 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-05-16T13:51:02.338 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking postgresql-contrib (14+238) ... 2023-05-16T13:51:02.616 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package tcl8.6. 2023-05-16T13:51:02.630 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-05-16T13:51:02.674 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-05-16T13:51:02.677 INFO:teuthology.orchestra.run.smithi118.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-05-16T13:51:03.113 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package tcl. 2023-05-16T13:51:03.127 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-05-16T13:51:03.176 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-05-16T13:51:03.540 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package wpasupplicant. 2023-05-16T13:51:03.555 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-05-16T13:51:03.590 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-05-16T13:51:03.952 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-05-16T13:51:03.967 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-05-16T13:51:04.011 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-05-16T13:51:04.388 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package usb-modeswitch. 2023-05-16T13:51:04.403 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-05-16T13:51:04.454 INFO:teuthology.orchestra.run.smithi118.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-05-16T13:51:04.454 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-05-16T13:51:04.729 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up postgresql-client-common (238) ... 2023-05-16T13:51:04.732 INFO:teuthology.orchestra.run.smithi118.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-05-16T13:51:04.936 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up flex (2.6.4-8build2) ... 2023-05-16T13:51:05.062 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-05-16T13:51:05.188 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libpq5:amd64 (14.7-0ubuntu0.22.04.1) ... 2023-05-16T13:51:05.313 INFO:teuthology.orchestra.run.smithi118.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 indent amd64 2.2.12-1build2 [90.8 kB] 2023-05-16T13:51:05.322 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-05-16T13:51:05.431 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-05-16T13:51:05.541 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up postgresql-client-14 (14.7-0ubuntu0.22.04.1) ... 2023-05-16T13:51:05.825 INFO:teuthology.orchestra.run.smithi118.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-05-16T13:51:05.866 INFO:teuthology.orchestra.run.smithi118.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-05-16T13:51:06.054 INFO:teuthology.orchestra.run.smithi118.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-05-16T13:51:06.202 INFO:teuthology.orchestra.run.smithi118.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-05-16T13:51:06.232 INFO:teuthology.orchestra.run.smithi118.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-05-16T13:51:06.421 INFO:teuthology.orchestra.run.smithi118.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-05-16T13:51:06.448 INFO:teuthology.orchestra.run.smithi039.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-05-16T13:51:06.545 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-05-16T13:51:06.747 INFO:teuthology.orchestra.run.smithi118.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1 [24.0 MB] 2023-05-16T13:51:06.894 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-05-16T13:51:06.894 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-05-16T13:51:07.623 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-05-16T13:51:07.749 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.9) ... 2023-05-16T13:51:08.202 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-05-16T13:51:08.359 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-05-16T13:51:08.493 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-05-16T13:51:08.594 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-05-16T13:51:08.796 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-05-16T13:51:09.426 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-05-16T13:51:09.560 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up dump (0.4b47-3) ... 2023-05-16T13:51:09.655 INFO:teuthology.orchestra.run.smithi039.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-05-16T13:51:09.712 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.1) ... 2023-05-16T13:51:09.813 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-05-16T13:51:09.931 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up tcl (8.6.11+1build2) ... 2023-05-16T13:51:10.056 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libjson-perl (4.04000-1) ... 2023-05-16T13:51:10.182 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-05-16T13:51:10.272 INFO:teuthology.orchestra.run.smithi039.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-05-16T13:51:10.342 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up indent (2.2.12-1build2) ... 2023-05-16T13:51:10.493 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-05-16T13:51:10.645 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-05-16T13:51:10.746 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-05-16T13:51:10.847 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-05-16T13:51:11.015 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up postgresql-client (14+238) ... 2023-05-16T13:51:11.141 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-05-16T13:51:11.752 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:51:11.752 INFO:teuthology.orchestra.run.smithi039.stdout:The following network interfaces were found in /etc/network/interfaces 2023-05-16T13:51:11.752 INFO:teuthology.orchestra.run.smithi039.stdout:which means they are currently configured by ifupdown: 2023-05-16T13:51:11.752 INFO:teuthology.orchestra.run.smithi039.stdout:- ens1f0 2023-05-16T13:51:11.752 INFO:teuthology.orchestra.run.smithi039.stdout:If you want to manage those interfaces with NetworkManager instead 2023-05-16T13:51:11.753 INFO:teuthology.orchestra.run.smithi039.stdout:remove their configuration from /etc/network/interfaces. 2023-05-16T13:51:11.753 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:51:11.888 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-05-16T13:51:12.310 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-05-16T13:51:12.736 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-05-16T13:51:13.486 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-05-16T13:51:13.637 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-05-16T13:51:13.762 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-05-16T13:51:13.880 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up postgresql-common (238) ... 2023-05-16T13:51:14.785 INFO:teuthology.orchestra.run.smithi039.stdout:Adding user postgres to group ssl-cert 2023-05-16T13:51:15.030 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:51:15.030 INFO:teuthology.orchestra.run.smithi039.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-05-16T13:51:15.267 INFO:teuthology.orchestra.run.smithi039.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-05-16T13:51:15.268 INFO:teuthology.orchestra.run.smithi039.stdout:Removing obsolete dictionary files: 2023-05-16T13:51:16.034 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-05-16T13:51:16.499 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up postgresql-14 (14.7-0ubuntu0.22.04.1) ... 2023-05-16T13:51:16.963 INFO:teuthology.orchestra.run.smithi039.stdout:Creating new PostgreSQL cluster 14/main ... 2023-05-16T13:51:16.983 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-05-16T13:51:17.038 INFO:teuthology.orchestra.run.smithi039.stdout:The files belonging to this database system will be owned by user "postgres". 2023-05-16T13:51:17.038 INFO:teuthology.orchestra.run.smithi039.stdout:This user must also own the server process. 2023-05-16T13:51:17.039 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:51:17.039 INFO:teuthology.orchestra.run.smithi039.stdout:The database cluster will be initialized with locale "en_US". 2023-05-16T13:51:17.039 INFO:teuthology.orchestra.run.smithi039.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-05-16T13:51:17.039 INFO:teuthology.orchestra.run.smithi039.stdout:The default text search configuration will be set to "english". 2023-05-16T13:51:17.040 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:51:17.040 INFO:teuthology.orchestra.run.smithi039.stdout:Data page checksums are disabled. 2023-05-16T13:51:17.040 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:51:17.040 INFO:teuthology.orchestra.run.smithi039.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-05-16T13:51:17.041 INFO:teuthology.orchestra.run.smithi039.stdout:creating subdirectories ... ok 2023-05-16T13:51:17.041 INFO:teuthology.orchestra.run.smithi039.stdout:selecting dynamic shared memory implementation ... posix 2023-05-16T13:51:17.061 INFO:teuthology.orchestra.run.smithi039.stdout:selecting default max_connections ... 100 2023-05-16T13:51:17.095 INFO:teuthology.orchestra.run.smithi039.stdout:selecting default shared_buffers ... 128MB 2023-05-16T13:51:17.109 INFO:teuthology.orchestra.run.smithi039.stdout:selecting default time zone ... Etc/UTC 2023-05-16T13:51:17.109 INFO:teuthology.orchestra.run.smithi039.stdout:creating configuration files ... ok 2023-05-16T13:51:17.293 INFO:teuthology.orchestra.run.smithi039.stdout:running bootstrap script ... ok 2023-05-16T13:51:17.944 INFO:teuthology.orchestra.run.smithi039.stdout:performing post-bootstrap initialization ... ok 2023-05-16T13:51:18.752 INFO:teuthology.orchestra.run.smithi039.stdout:syncing data to disk ... ok 2023-05-16T13:51:19.304 INFO:teuthology.orchestra.run.smithi039.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-05-16T13:51:22.398 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-05-16T13:51:22.524 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up postgresql-contrib (14+238) ... 2023-05-16T13:51:22.652 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up postgresql (14+238) ... 2023-05-16T13:51:22.776 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-05-16T13:51:22.894 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.1) ... 2023-05-16T13:51:23.143 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-05-16T13:51:23.144 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-05-16T13:51:23.913 INFO:teuthology.orchestra.run.smithi039.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-05-16T13:51:24.215 INFO:teuthology.orchestra.run.smithi039.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-05-16T13:51:24.358 INFO:teuthology.orchestra.run.smithi039.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-05-16T13:51:25.617 INFO:teuthology.orchestra.run.smithi039.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-05-16T13:51:25.718 INFO:teuthology.orchestra.run.smithi039.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-05-16T13:51:26.383 INFO:teuthology.orchestra.run.smithi039.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-05-16T13:51:26.387 DEBUG:teuthology.parallel:result is None 2023-05-16T13:51:35.235 INFO:teuthology.orchestra.run.smithi118.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-05-16T13:51:35.576 INFO:teuthology.orchestra.run.smithi118.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-05-16T13:51:35.587 INFO:teuthology.orchestra.run.smithi118.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.1 [263 kB] 2023-05-16T13:51:35.903 INFO:teuthology.orchestra.run.smithi118.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-05-16T13:51:35.917 INFO:teuthology.orchestra.run.smithi118.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-05-16T13:51:36.952 INFO:teuthology.orchestra.run.smithi118.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.7-0ubuntu0.22.04.1 [141 kB] 2023-05-16T13:51:37.132 INFO:teuthology.orchestra.run.smithi118.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-05-16T13:51:39.246 INFO:teuthology.orchestra.run.smithi118.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-05-16T13:51:39.281 INFO:teuthology.orchestra.run.smithi118.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.9 [2,373 kB] 2023-05-16T13:51:43.628 INFO:teuthology.orchestra.run.smithi118.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-05-16T13:51:43.755 INFO:teuthology.orchestra.run.smithi118.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.1 [1,094 kB] 2023-05-16T13:51:44.230 INFO:teuthology.orchestra.run.smithi118.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-05-16T13:51:44.392 INFO:teuthology.orchestra.run.smithi118.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-05-16T13:51:44.406 INFO:teuthology.orchestra.run.smithi118.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-05-16T13:51:44.408 INFO:teuthology.orchestra.run.smithi118.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-05-16T13:51:44.409 INFO:teuthology.orchestra.run.smithi118.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-05-16T13:51:44.410 INFO:teuthology.orchestra.run.smithi118.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.7-0ubuntu0.22.04.1 [1,220 kB] 2023-05-16T13:51:44.463 INFO:teuthology.orchestra.run.smithi118.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-05-16T13:51:44.468 INFO:teuthology.orchestra.run.smithi118.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.7-0ubuntu0.22.04.1 [16.1 MB] 2023-05-16T13:52:05.046 INFO:teuthology.orchestra.run.smithi118.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-05-16T13:52:05.235 INFO:teuthology.orchestra.run.smithi118.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-05-16T13:52:05.318 INFO:teuthology.orchestra.run.smithi118.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-05-16T13:52:05.319 INFO:teuthology.orchestra.run.smithi118.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-05-16T13:52:05.400 INFO:teuthology.orchestra.run.smithi118.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-05-16T13:52:05.408 INFO:teuthology.orchestra.run.smithi118.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-05-16T13:52:22.889 INFO:teuthology.orchestra.run.smithi118.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-05-16T13:52:23.404 INFO:teuthology.orchestra.run.smithi118.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-05-16T13:52:24.273 INFO:teuthology.orchestra.run.smithi118.stdout:Preconfiguring packages ... 2023-05-16T13:52:24.418 INFO:teuthology.orchestra.run.smithi118.stdout:Fetched 54.6 MB in 1min 29s (615 kB/s) 2023-05-16T13:52:24.541 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package flex. 2023-05-16T13:52:24.611 INFO:teuthology.orchestra.run.smithi118.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139905 files and directories currently installed.) 2023-05-16T13:52:24.614 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-05-16T13:52:24.656 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking flex (2.6.4-8build2) ... 2023-05-16T13:52:25.199 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.9_amd64.deb ... 2023-05-16T13:52:25.370 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.9) over (3.0.2-0ubuntu1.7) ... 2023-05-16T13:52:25.791 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.9) ... 2023-05-16T13:52:26.303 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package bison. 2023-05-16T13:52:26.374 INFO:teuthology.orchestra.run.smithi118.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139978 files and directories currently installed.) 2023-05-16T13:52:26.377 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-05-16T13:52:26.423 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-05-16T13:52:26.848 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-05-16T13:52:26.861 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-05-16T13:52:26.898 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-05-16T13:52:27.235 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package dump. 2023-05-16T13:52:27.247 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-05-16T13:52:27.285 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking dump (0.4b47-3) ... 2023-05-16T13:52:27.546 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package indent. 2023-05-16T13:52:27.558 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../03-indent_2.2.12-1build2_amd64.deb ... 2023-05-16T13:52:27.596 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking indent (2.2.12-1build2) ... 2023-05-16T13:52:27.848 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-05-16T13:52:27.861 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-05-16T13:52:27.898 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-05-16T13:52:28.410 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-05-16T13:52:28.424 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-05-16T13:52:28.468 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-05-16T13:52:28.712 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-05-16T13:52:28.726 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-05-16T13:52:28.771 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-05-16T13:52:29.090 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libfl2:amd64. 2023-05-16T13:52:29.104 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-05-16T13:52:29.140 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-05-16T13:52:29.376 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-05-16T13:52:29.390 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-05-16T13:52:29.434 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-05-16T13:52:29.687 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libjson-perl. 2023-05-16T13:52:29.700 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-05-16T13:52:29.745 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-05-16T13:52:30.081 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libllvm14:amd64. 2023-05-16T13:52:30.095 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1_amd64.deb ... 2023-05-16T13:52:30.140 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-05-16T13:52:31.475 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-05-16T13:52:31.489 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-05-16T13:52:31.533 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-05-16T13:52:31.803 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libmbim-proxy. 2023-05-16T13:52:31.816 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-05-16T13:52:31.861 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-05-16T13:52:32.163 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-05-16T13:52:32.177 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.1_amd64.deb ... 2023-05-16T13:52:32.222 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.1) ... 2023-05-16T13:52:32.549 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libndp0:amd64. 2023-05-16T13:52:32.563 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-05-16T13:52:32.608 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-05-16T13:52:32.902 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libnm0:amd64. 2023-05-16T13:52:32.916 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-05-16T13:52:32.960 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-05-16T13:52:33.271 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libpq5:amd64. 2023-05-16T13:52:33.284 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../16-libpq5_14.7-0ubuntu0.22.04.1_amd64.deb ... 2023-05-16T13:52:33.329 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libpq5:amd64 (14.7-0ubuntu0.22.04.1) ... 2023-05-16T13:52:33.665 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-05-16T13:52:33.679 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-05-16T13:52:33.724 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-05-16T13:52:33.992 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libqmi-proxy. 2023-05-16T13:52:34.006 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-05-16T13:52:34.051 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-05-16T13:52:34.286 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-05-16T13:52:34.300 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.9_amd64.deb ... 2023-05-16T13:52:34.345 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.9) ... 2023-05-16T13:52:34.848 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-05-16T13:52:34.861 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-05-16T13:52:34.906 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-05-16T13:52:35.200 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package modemmanager. 2023-05-16T13:52:35.214 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.1_amd64.deb ... 2023-05-16T13:52:35.251 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.1) ... 2023-05-16T13:52:35.881 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package network-manager. 2023-05-16T13:52:35.895 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-05-16T13:52:35.947 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-05-16T13:52:36.588 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ppp. 2023-05-16T13:52:36.602 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-05-16T13:52:36.970 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-05-16T13:52:37.292 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package pptp-linux. 2023-05-16T13:52:37.305 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-05-16T13:52:37.342 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-05-16T13:52:37.578 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package network-manager-pptp. 2023-05-16T13:52:37.591 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-05-16T13:52:37.620 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-05-16T13:52:37.906 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package postgresql-client-common. 2023-05-16T13:52:37.918 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-05-16T13:52:37.956 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking postgresql-client-common (238) ... 2023-05-16T13:52:38.259 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package postgresql-client-14. 2023-05-16T13:52:38.272 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../27-postgresql-client-14_14.7-0ubuntu0.22.04.1_amd64.deb ... 2023-05-16T13:52:38.309 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking postgresql-client-14 (14.7-0ubuntu0.22.04.1) ... 2023-05-16T13:52:38.897 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package postgresql-common. 2023-05-16T13:52:38.910 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-05-16T13:52:38.964 INFO:teuthology.orchestra.run.smithi118.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-05-16T13:52:38.995 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking postgresql-common (238) ... 2023-05-16T13:52:39.446 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package postgresql-14. 2023-05-16T13:52:39.458 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../29-postgresql-14_14.7-0ubuntu0.22.04.1_amd64.deb ... 2023-05-16T13:52:39.498 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking postgresql-14 (14.7-0ubuntu0.22.04.1) ... 2023-05-16T13:52:40.507 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package postgresql. 2023-05-16T13:52:40.519 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-05-16T13:52:40.548 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking postgresql (14+238) ... 2023-05-16T13:52:40.750 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package postgresql-client. 2023-05-16T13:52:40.763 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-05-16T13:52:40.800 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking postgresql-client (14+238) ... 2023-05-16T13:52:41.044 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package postgresql-contrib. 2023-05-16T13:52:41.056 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-05-16T13:52:41.094 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking postgresql-contrib (14+238) ... 2023-05-16T13:52:41.413 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package tcl8.6. 2023-05-16T13:52:41.425 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-05-16T13:52:41.463 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-05-16T13:52:41.748 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package tcl. 2023-05-16T13:52:41.761 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-05-16T13:52:41.802 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-05-16T13:52:42.084 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package wpasupplicant. 2023-05-16T13:52:42.097 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-05-16T13:52:42.126 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-05-16T13:52:42.488 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-05-16T13:52:42.501 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-05-16T13:52:42.538 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-05-16T13:52:42.899 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package usb-modeswitch. 2023-05-16T13:52:42.912 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-05-16T13:52:42.956 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-05-16T13:52:43.262 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up postgresql-client-common (238) ... 2023-05-16T13:52:43.447 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up flex (2.6.4-8build2) ... 2023-05-16T13:52:43.565 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-05-16T13:52:43.691 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libpq5:amd64 (14.7-0ubuntu0.22.04.1) ... 2023-05-16T13:52:43.817 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-05-16T13:52:43.942 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-05-16T13:52:44.069 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up postgresql-client-14 (14.7-0ubuntu0.22.04.1) ... 2023-05-16T13:52:44.976 INFO:teuthology.orchestra.run.smithi118.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-05-16T13:52:45.066 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-05-16T13:52:45.424 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-05-16T13:52:45.424 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-05-16T13:52:46.135 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-05-16T13:52:46.286 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.9) ... 2023-05-16T13:52:46.412 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-05-16T13:52:46.537 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-05-16T13:52:46.663 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-05-16T13:52:46.798 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-05-16T13:52:46.924 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-05-16T13:52:47.604 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-05-16T13:52:47.721 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up dump (0.4b47-3) ... 2023-05-16T13:52:47.799 INFO:teuthology.orchestra.run.smithi118.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-05-16T13:52:47.865 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.1) ... 2023-05-16T13:52:47.991 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-05-16T13:52:48.117 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up tcl (8.6.11+1build2) ... 2023-05-16T13:52:48.243 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libjson-perl (4.04000-1) ... 2023-05-16T13:52:48.369 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-05-16T13:52:48.458 INFO:teuthology.orchestra.run.smithi118.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-05-16T13:52:48.530 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up indent (2.2.12-1build2) ... 2023-05-16T13:52:48.654 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-05-16T13:52:48.814 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-05-16T13:52:48.925 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-05-16T13:52:49.051 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-05-16T13:52:49.219 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up postgresql-client (14+238) ... 2023-05-16T13:52:49.345 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-05-16T13:52:50.002 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-05-16T13:52:50.002 INFO:teuthology.orchestra.run.smithi118.stdout:The following network interfaces were found in /etc/network/interfaces 2023-05-16T13:52:50.002 INFO:teuthology.orchestra.run.smithi118.stdout:which means they are currently configured by ifupdown: 2023-05-16T13:52:50.002 INFO:teuthology.orchestra.run.smithi118.stdout:- enp3s0f1 2023-05-16T13:52:50.002 INFO:teuthology.orchestra.run.smithi118.stdout:If you want to manage those interfaces with NetworkManager instead 2023-05-16T13:52:50.003 INFO:teuthology.orchestra.run.smithi118.stdout:remove their configuration from /etc/network/interfaces. 2023-05-16T13:52:50.003 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-05-16T13:52:50.130 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-05-16T13:52:50.548 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-05-16T13:52:50.973 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-05-16T13:52:51.697 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-05-16T13:52:51.865 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-05-16T13:52:51.974 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-05-16T13:52:52.109 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up postgresql-common (238) ... 2023-05-16T13:52:53.019 INFO:teuthology.orchestra.run.smithi118.stdout:Adding user postgres to group ssl-cert 2023-05-16T13:52:53.239 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-05-16T13:52:53.239 INFO:teuthology.orchestra.run.smithi118.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-05-16T13:52:53.495 INFO:teuthology.orchestra.run.smithi118.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-05-16T13:52:53.495 INFO:teuthology.orchestra.run.smithi118.stdout:Removing obsolete dictionary files: 2023-05-16T13:52:54.257 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-05-16T13:52:54.734 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up postgresql-14 (14.7-0ubuntu0.22.04.1) ... 2023-05-16T13:52:55.064 INFO:teuthology.orchestra.run.smithi118.stdout:Creating new PostgreSQL cluster 14/main ... 2023-05-16T13:52:55.085 INFO:teuthology.orchestra.run.smithi118.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-05-16T13:52:55.194 INFO:teuthology.orchestra.run.smithi118.stdout:The files belonging to this database system will be owned by user "postgres". 2023-05-16T13:52:55.195 INFO:teuthology.orchestra.run.smithi118.stdout:This user must also own the server process. 2023-05-16T13:52:55.195 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-05-16T13:52:55.195 INFO:teuthology.orchestra.run.smithi118.stdout:The database cluster will be initialized with locale "en_US". 2023-05-16T13:52:55.195 INFO:teuthology.orchestra.run.smithi118.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-05-16T13:52:55.195 INFO:teuthology.orchestra.run.smithi118.stdout:The default text search configuration will be set to "english". 2023-05-16T13:52:55.196 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-05-16T13:52:55.196 INFO:teuthology.orchestra.run.smithi118.stdout:Data page checksums are disabled. 2023-05-16T13:52:55.196 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-05-16T13:52:55.196 INFO:teuthology.orchestra.run.smithi118.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-05-16T13:52:55.197 INFO:teuthology.orchestra.run.smithi118.stdout:creating subdirectories ... ok 2023-05-16T13:52:55.197 INFO:teuthology.orchestra.run.smithi118.stdout:selecting dynamic shared memory implementation ... posix 2023-05-16T13:52:55.218 INFO:teuthology.orchestra.run.smithi118.stdout:selecting default max_connections ... 100 2023-05-16T13:52:55.249 INFO:teuthology.orchestra.run.smithi118.stdout:selecting default shared_buffers ... 128MB 2023-05-16T13:52:55.263 INFO:teuthology.orchestra.run.smithi118.stdout:selecting default time zone ... Etc/UTC 2023-05-16T13:52:55.264 INFO:teuthology.orchestra.run.smithi118.stdout:creating configuration files ... ok 2023-05-16T13:52:55.435 INFO:teuthology.orchestra.run.smithi118.stdout:running bootstrap script ... ok 2023-05-16T13:52:56.156 INFO:teuthology.orchestra.run.smithi118.stdout:performing post-bootstrap initialization ... ok 2023-05-16T13:52:56.815 INFO:teuthology.orchestra.run.smithi118.stdout:syncing data to disk ... ok 2023-05-16T13:52:57.343 INFO:teuthology.orchestra.run.smithi118.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-05-16T13:53:00.292 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-05-16T13:53:00.418 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up postgresql-contrib (14+238) ... 2023-05-16T13:53:00.569 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up postgresql (14+238) ... 2023-05-16T13:53:00.695 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-05-16T13:53:00.821 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.1) ... 2023-05-16T13:53:01.078 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-05-16T13:53:01.078 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-05-16T13:53:01.848 INFO:teuthology.orchestra.run.smithi118.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-05-16T13:53:02.158 INFO:teuthology.orchestra.run.smithi118.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-05-16T13:53:02.310 INFO:teuthology.orchestra.run.smithi118.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-05-16T13:53:03.904 INFO:teuthology.orchestra.run.smithi118.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-05-16T13:53:04.012 INFO:teuthology.orchestra.run.smithi118.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-05-16T13:53:04.707 INFO:teuthology.orchestra.run.smithi118.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-05-16T13:53:04.711 DEBUG:teuthology.parallel:result is None 2023-05-16T13:53:04.712 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=27be51263d3d0c721b6d1ca9f42550bf0ab3c97b 2023-05-16T13:53:04.861 DEBUG:teuthology.orchestra.run.smithi039:> dpkg-query -W -f '${Version}' ceph 2023-05-16T13:53:04.884 INFO:teuthology.orchestra.run.smithi039.stdout:18.0.0-3926-g27be5126-1jammy 2023-05-16T13:53:04.885 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-3926-g27be5126-1jammy 2023-05-16T13:53:04.885 INFO:teuthology.task.install:The correct ceph version 18.0.0-3926-g27be5126-1jammy is installed. 2023-05-16T13:53:04.885 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=27be51263d3d0c721b6d1ca9f42550bf0ab3c97b 2023-05-16T13:53:05.023 DEBUG:teuthology.orchestra.run.smithi118:> dpkg-query -W -f '${Version}' ceph 2023-05-16T13:53:05.045 INFO:teuthology.orchestra.run.smithi118.stdout:18.0.0-3926-g27be5126-1jammy 2023-05-16T13:53:05.045 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-3926-g27be5126-1jammy 2023-05-16T13:53:05.045 INFO:teuthology.task.install:The correct ceph version 18.0.0-3926-g27be5126-1jammy is installed. 2023-05-16T13:53:05.046 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-05-16T13:53:05.047 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-05-16T13:53:05.047 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-05-16T13:53:05.069 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-05-16T13:53:05.070 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-05-16T13:53:05.107 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-05-16T13:53:05.107 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-05-16T13:53:05.108 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/usr/bin/daemon-helper 2023-05-16T13:53:05.132 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-05-16T13:53:05.192 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-05-16T13:53:05.192 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/usr/bin/daemon-helper 2023-05-16T13:53:05.211 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-05-16T13:53:05.270 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-05-16T13:53:05.270 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-05-16T13:53:05.270 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/usr/bin/adjust-ulimits 2023-05-16T13:53:05.291 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-05-16T13:53:05.356 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-05-16T13:53:05.356 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/usr/bin/adjust-ulimits 2023-05-16T13:53:05.375 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-05-16T13:53:05.438 INFO:teuthology.run_tasks:Running task ceph... 2023-05-16T13:53:05.524 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-05-16T13:53:05.525 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 777 /var/log/ceph 2023-05-16T13:53:05.528 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 777 /var/log/ceph 2023-05-16T13:53:05.546 INFO:tasks.ceph:Disabling ceph logrotate... 2023-05-16T13:53:05.547 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -f -- /etc/logrotate.d/ceph 2023-05-16T13:53:05.595 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -f -- /etc/logrotate.d/ceph 2023-05-16T13:53:05.612 INFO:tasks.ceph:Creating extra log directories... 2023-05-16T13:53:05.613 DEBUG:teuthology.orchestra.run.smithi039:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-05-16T13:53:05.655 DEBUG:teuthology.orchestra.run.smithi118:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-05-16T13:53:05.679 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-05-16T13:53:05.679 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-05-16T13:53:05.680 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-05-16T13:53:05.680 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-05-16T13:53:05.680 DEBUG:teuthology.orchestra.run.smithi039:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-05-16T13:53:05.724 DEBUG:teuthology.orchestra.run.smithi039:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-05-16T13:53:05.813 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-05-16T13:53:05.813 DEBUG:teuthology.orchestra.run.smithi118:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-05-16T13:53:05.821 DEBUG:teuthology.orchestra.run.smithi118:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-05-16T13:53:05.912 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-05-16T13:53:05.912 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-05-16T13:53:05.913 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2023-05-16_10:39:13-fs-wip-rishabh-2023May15-1524-testing-default-smithi/7275621', 'branch': 'wip-rishabh-2023May15-1524', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev}', 'email': None, 'first_in_suite': False, 'job_id': '7275621', 'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '7312ab6f53ec3dd1c2d90b6652327feae750728b'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2023-05-16_10:39:13-fs-wip-rishabh-2023May15-1524-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-2023May15-1524'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '27be51263d3d0c721b6d1ca9f42550bf0ab3c97b'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '27be51263d3d0c721b6d1ca9f42550bf0ab3c97b'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-2023May15-1524', 'sha1': '27be51263d3d0c721b6d1ca9f42550bf0ab3c97b'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'sha1': '27be51263d3d0c721b6d1ca9f42550bf0ab3c97b', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-rishabh-2023May15-1524', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '27be51263d3d0c721b6d1ca9f42550bf0ab3c97b', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi039.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPLgaZCgHHMb7615CwV1jD6tdN818YQl793IoebK306r65ouKS05wr9CGi5q+T8SHPYD6DCXssZMoQdJs8hVxQw=', 'smithi118.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNwSPNtYBXgfmoEnZDpfFy9ahqSbLJN34KRcKWt5KPl3RPB/pOqJOzsI6h9wTqbMMlWECXlVZ1Byj88v2kZ5fHk='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '7312ab6f53ec3dd1c2d90b6652327feae750728b'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '27be51263d3d0c721b6d1ca9f42550bf0ab3c97b'}}, {'ceph': None}, {'ceph-fuse': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '69caab8ec6f44c61c991ae693e8e7b8cd859a896', 'timestamp': '2023-05-16_10:39:13', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.23459'} 2023-05-16T13:53:05.914 DEBUG:teuthology.orchestra.run.smithi039:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-05-16T13:53:05.917 DEBUG:teuthology.orchestra.run.smithi118:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-05-16T13:53:05.956 DEBUG:teuthology.orchestra.run.smithi039:> sudo install -d -m0777 -- /var/run/ceph 2023-05-16T13:53:05.971 DEBUG:teuthology.orchestra.run.smithi118:> sudo install -d -m0777 -- /var/run/ceph 2023-05-16T13:53:06.014 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-05-16T13:53:06.015 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/scratch_devs of=/dev/stdout 2023-05-16T13:53:06.036 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-05-16T13:53:06.037 DEBUG:teuthology.orchestra.run.smithi039:> stat /dev/vg_nvme/lv_1 2023-05-16T13:53:06.092 INFO:teuthology.orchestra.run.smithi039.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-05-16T13:53:06.092 INFO:teuthology.orchestra.run.smithi039.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-16T13:53:06.093 INFO:teuthology.orchestra.run.smithi039.stdout:Device: 5h/5d Inode: 878 Links: 1 2023-05-16T13:53:06.093 INFO:teuthology.orchestra.run.smithi039.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-16T13:53:06.093 INFO:teuthology.orchestra.run.smithi039.stdout:Access: 2023-05-16 13:45:25.340288983 +0000 2023-05-16T13:53:06.093 INFO:teuthology.orchestra.run.smithi039.stdout:Modify: 2023-05-16 13:45:24.952269070 +0000 2023-05-16T13:53:06.093 INFO:teuthology.orchestra.run.smithi039.stdout:Change: 2023-05-16 13:45:24.952269070 +0000 2023-05-16T13:53:06.093 INFO:teuthology.orchestra.run.smithi039.stdout: Birth: 2023-05-16 13:45:24.952269070 +0000 2023-05-16T13:53:06.094 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-05-16T13:53:06.155 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records in 2023-05-16T13:53:06.155 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records out 2023-05-16T13:53:06.155 INFO:teuthology.orchestra.run.smithi039.stderr:512 bytes copied, 0.000724728 s, 706 kB/s 2023-05-16T13:53:06.157 DEBUG:teuthology.orchestra.run.smithi039:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-05-16T13:53:06.210 DEBUG:teuthology.orchestra.run.smithi039:> stat /dev/vg_nvme/lv_2 2023-05-16T13:53:06.260 INFO:teuthology.orchestra.run.smithi039.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-05-16T13:53:06.260 INFO:teuthology.orchestra.run.smithi039.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-16T13:53:06.261 INFO:teuthology.orchestra.run.smithi039.stdout:Device: 5h/5d Inode: 893 Links: 1 2023-05-16T13:53:06.261 INFO:teuthology.orchestra.run.smithi039.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-16T13:53:06.261 INFO:teuthology.orchestra.run.smithi039.stdout:Access: 2023-05-16 13:45:26.016323491 +0000 2023-05-16T13:53:06.261 INFO:teuthology.orchestra.run.smithi039.stdout:Modify: 2023-05-16 13:45:25.624303486 +0000 2023-05-16T13:53:06.261 INFO:teuthology.orchestra.run.smithi039.stdout:Change: 2023-05-16 13:45:25.624303486 +0000 2023-05-16T13:53:06.261 INFO:teuthology.orchestra.run.smithi039.stdout: Birth: 2023-05-16 13:45:25.624303486 +0000 2023-05-16T13:53:06.262 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-05-16T13:53:06.322 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records in 2023-05-16T13:53:06.323 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records out 2023-05-16T13:53:06.323 INFO:teuthology.orchestra.run.smithi039.stderr:512 bytes copied, 0.000376601 s, 1.4 MB/s 2023-05-16T13:53:06.324 DEBUG:teuthology.orchestra.run.smithi039:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-05-16T13:53:06.378 DEBUG:teuthology.orchestra.run.smithi039:> stat /dev/vg_nvme/lv_3 2023-05-16T13:53:06.432 INFO:teuthology.orchestra.run.smithi039.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-05-16T13:53:06.433 INFO:teuthology.orchestra.run.smithi039.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-16T13:53:06.433 INFO:teuthology.orchestra.run.smithi039.stdout:Device: 5h/5d Inode: 913 Links: 1 2023-05-16T13:53:06.433 INFO:teuthology.orchestra.run.smithi039.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-16T13:53:06.433 INFO:teuthology.orchestra.run.smithi039.stdout:Access: 2023-05-16 13:45:26.644354933 +0000 2023-05-16T13:53:06.433 INFO:teuthology.orchestra.run.smithi039.stdout:Modify: 2023-05-16 13:45:26.272336307 +0000 2023-05-16T13:53:06.433 INFO:teuthology.orchestra.run.smithi039.stdout:Change: 2023-05-16 13:45:26.272336307 +0000 2023-05-16T13:53:06.433 INFO:teuthology.orchestra.run.smithi039.stdout: Birth: 2023-05-16 13:45:26.272336307 +0000 2023-05-16T13:53:06.434 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-05-16T13:53:06.494 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records in 2023-05-16T13:53:06.495 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records out 2023-05-16T13:53:06.495 INFO:teuthology.orchestra.run.smithi039.stderr:512 bytes copied, 0.000362997 s, 1.4 MB/s 2023-05-16T13:53:06.496 DEBUG:teuthology.orchestra.run.smithi039:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-05-16T13:53:06.550 DEBUG:teuthology.orchestra.run.smithi039:> stat /dev/vg_nvme/lv_4 2023-05-16T13:53:06.601 INFO:teuthology.orchestra.run.smithi039.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-05-16T13:53:06.601 INFO:teuthology.orchestra.run.smithi039.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-16T13:53:06.602 INFO:teuthology.orchestra.run.smithi039.stdout:Device: 5h/5d Inode: 927 Links: 1 2023-05-16T13:53:06.602 INFO:teuthology.orchestra.run.smithi039.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-16T13:53:06.602 INFO:teuthology.orchestra.run.smithi039.stdout:Access: 2023-05-16 13:45:27.320387882 +0000 2023-05-16T13:53:06.602 INFO:teuthology.orchestra.run.smithi039.stdout:Modify: 2023-05-16 13:45:26.920368754 +0000 2023-05-16T13:53:06.603 INFO:teuthology.orchestra.run.smithi039.stdout:Change: 2023-05-16 13:45:26.920368754 +0000 2023-05-16T13:53:06.603 INFO:teuthology.orchestra.run.smithi039.stdout: Birth: 2023-05-16 13:45:26.920368754 +0000 2023-05-16T13:53:06.603 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-05-16T13:53:06.663 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records in 2023-05-16T13:53:06.663 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records out 2023-05-16T13:53:06.664 INFO:teuthology.orchestra.run.smithi039.stderr:512 bytes copied, 0.000447609 s, 1.1 MB/s 2023-05-16T13:53:06.665 DEBUG:teuthology.orchestra.run.smithi039:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-05-16T13:53:06.718 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-05-16T13:53:06.719 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-05-16T13:53:06.719 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/scratch_devs of=/dev/stdout 2023-05-16T13:53:06.728 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-05-16T13:53:06.728 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_1 2023-05-16T13:53:06.781 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-05-16T13:53:06.781 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-16T13:53:06.781 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 5h/5d Inode: 900 Links: 1 2023-05-16T13:53:06.781 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-16T13:53:06.781 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2023-05-16 13:45:25.212562866 +0000 2023-05-16T13:53:06.782 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2023-05-16 13:45:25.208562901 +0000 2023-05-16T13:53:06.782 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2023-05-16 13:45:25.208562901 +0000 2023-05-16T13:53:06.782 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: 2023-05-16 13:45:25.208562901 +0000 2023-05-16T13:53:06.782 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-05-16T13:53:06.842 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2023-05-16T13:53:06.842 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2023-05-16T13:53:06.842 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 0.000268207 s, 1.9 MB/s 2023-05-16T13:53:06.844 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-05-16T13:53:06.898 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_2 2023-05-16T13:53:06.952 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-05-16T13:53:06.953 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-16T13:53:06.953 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 5h/5d Inode: 917 Links: 1 2023-05-16T13:53:06.953 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-16T13:53:06.953 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2023-05-16 13:45:25.848557185 +0000 2023-05-16T13:53:06.953 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2023-05-16 13:45:25.844557221 +0000 2023-05-16T13:53:06.953 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2023-05-16 13:45:25.844557221 +0000 2023-05-16T13:53:06.953 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: 2023-05-16 13:45:25.844557221 +0000 2023-05-16T13:53:06.954 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-05-16T13:53:07.010 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2023-05-16T13:53:07.010 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2023-05-16T13:53:07.010 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 0.000256784 s, 2.0 MB/s 2023-05-16T13:53:07.012 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-05-16T13:53:07.063 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_3 2023-05-16T13:53:07.112 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-05-16T13:53:07.113 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-16T13:53:07.113 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 5h/5d Inode: 933 Links: 1 2023-05-16T13:53:07.113 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-16T13:53:07.114 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2023-05-16 13:45:26.872548038 +0000 2023-05-16T13:53:07.114 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2023-05-16 13:45:26.480551540 +0000 2023-05-16T13:53:07.114 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2023-05-16 13:45:26.480551540 +0000 2023-05-16T13:53:07.114 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: 2023-05-16 13:45:26.480551540 +0000 2023-05-16T13:53:07.115 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-05-16T13:53:07.174 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2023-05-16T13:53:07.174 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2023-05-16T13:53:07.175 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 0.000258736 s, 2.0 MB/s 2023-05-16T13:53:07.176 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-05-16T13:53:07.225 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_4 2023-05-16T13:53:07.276 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-05-16T13:53:07.276 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-16T13:53:07.276 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 5h/5d Inode: 949 Links: 1 2023-05-16T13:53:07.277 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-16T13:53:07.277 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2023-05-16 13:45:27.488542536 +0000 2023-05-16T13:53:07.277 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2023-05-16 13:45:27.116545859 +0000 2023-05-16T13:53:07.277 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2023-05-16 13:45:27.116545859 +0000 2023-05-16T13:53:07.277 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: 2023-05-16 13:45:27.116545859 +0000 2023-05-16T13:53:07.278 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-05-16T13:53:07.337 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2023-05-16T13:53:07.338 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2023-05-16T13:53:07.338 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 0.000259149 s, 2.0 MB/s 2023-05-16T13:53:07.339 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-05-16T13:53:07.394 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-05-16T13:53:07.394 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi039.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi118.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-05-16T13:53:07.394 INFO:tasks.ceph:Generating config... 2023-05-16T13:53:07.396 INFO:tasks.ceph:[client] client mount timeout = 600 2023-05-16T13:53:07.396 INFO:tasks.ceph:[client] debug client = 20 2023-05-16T13:53:07.396 INFO:tasks.ceph:[client] debug ms = 1 2023-05-16T13:53:07.396 INFO:tasks.ceph:[client] pid file = 2023-05-16T13:53:07.397 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-05-16T13:53:07.397 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-05-16T13:53:07.397 INFO:tasks.ceph:[mds] debug mds = 20 2023-05-16T13:53:07.397 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-05-16T13:53:07.397 INFO:tasks.ceph:[mds] debug ms = 1 2023-05-16T13:53:07.398 INFO:tasks.ceph:[mds] mds debug frag = True 2023-05-16T13:53:07.398 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-05-16T13:53:07.398 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-05-16T13:53:07.398 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-05-16T13:53:07.398 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-05-16T13:53:07.399 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-05-16T13:53:07.399 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-05-16T13:53:07.399 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-05-16T13:53:07.399 INFO:tasks.ceph:[mgr] debug ms = 1 2023-05-16T13:53:07.399 INFO:tasks.ceph:[mon] debug mon = 20 2023-05-16T13:53:07.399 INFO:tasks.ceph:[mon] debug ms = 1 2023-05-16T13:53:07.400 INFO:tasks.ceph:[mon] debug paxos = 20 2023-05-16T13:53:07.400 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-05-16T13:53:07.400 INFO:tasks.ceph:[osd] bdev async discard = True 2023-05-16T13:53:07.400 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-05-16T13:53:07.400 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-05-16T13:53:07.401 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-05-16T13:53:07.401 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-05-16T13:53:07.401 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-05-16T13:53:07.401 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-05-16T13:53:07.401 INFO:tasks.ceph:[osd] debug ms = 1 2023-05-16T13:53:07.402 INFO:tasks.ceph:[osd] debug osd = 20 2023-05-16T13:53:07.402 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-05-16T13:53:07.402 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-05-16T13:53:07.402 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-05-16T13:53:07.403 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-05-16T13:53:07.403 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-05-16T13:53:07.403 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-05-16T13:53:07.403 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-05-16T13:53:07.405 INFO:tasks.ceph:Setting up mon.a... 2023-05-16T13:53:07.405 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-05-16T13:53:07.450 INFO:teuthology.orchestra.run.smithi039.stdout:creating /etc/ceph/ceph.keyring 2023-05-16T13:53:07.465 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-05-16T13:53:07.556 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-05-16T13:53:07.577 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.39'), ('mon.b', '172.21.15.118'), ('mon.c', '[v2:172.21.15.118:3301,v1:172.21.15.118:6790]')] 2023-05-16T13:53:07.578 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.39,172.21.15.118,[v2:172.21.15.118:3301,v1:172.21.15.118:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-05-16T13:53:07.580 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-05-16T13:53:07.580 DEBUG:teuthology.orchestra.run.smithi039:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-05-16T13:53:07.628 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.39 --add b 172.21.15.118 --addv c '[v2:172.21.15.118:3301,v1:172.21.15.118:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-05-16T13:53:07.713 INFO:teuthology.orchestra.run.smithi039.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-05-16T13:53:07.713 INFO:teuthology.orchestra.run.smithi039.stdout:monmaptool: generated fsid 9c1e210b-c515-4ea4-a065-397956895c68 2023-05-16T13:53:07.713 INFO:teuthology.orchestra.run.smithi039.stdout:setting min_mon_release = pacific 2023-05-16T13:53:07.714 INFO:teuthology.orchestra.run.smithi039.stdout:epoch 0 2023-05-16T13:53:07.714 INFO:teuthology.orchestra.run.smithi039.stdout:fsid 9c1e210b-c515-4ea4-a065-397956895c68 2023-05-16T13:53:07.714 INFO:teuthology.orchestra.run.smithi039.stdout:last_changed 2023-05-16T13:53:07.713823+0000 2023-05-16T13:53:07.714 INFO:teuthology.orchestra.run.smithi039.stdout:created 2023-05-16T13:53:07.713823+0000 2023-05-16T13:53:07.714 INFO:teuthology.orchestra.run.smithi039.stdout:min_mon_release 16 (pacific) 2023-05-16T13:53:07.714 INFO:teuthology.orchestra.run.smithi039.stdout:election_strategy: 1 2023-05-16T13:53:07.714 INFO:teuthology.orchestra.run.smithi039.stdout:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2023-05-16T13:53:07.715 INFO:teuthology.orchestra.run.smithi039.stdout:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2023-05-16T13:53:07.715 INFO:teuthology.orchestra.run.smithi039.stdout:2: [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] mon.c 2023-05-16T13:53:07.715 INFO:teuthology.orchestra.run.smithi039.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-05-16T13:53:07.716 DEBUG:teuthology.orchestra.run.smithi039:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-05-16T13:53:07.723 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 9c1e210b-c515-4ea4-a065-397956895c68... 2023-05-16T13:53:07.724 DEBUG:teuthology.orchestra.run.smithi039:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-05-16T13:53:07.770 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-05-16T13:53:07.809 INFO:teuthology.orchestra.run.smithi039.stdout:[global] 2023-05-16T13:53:07.809 INFO:teuthology.orchestra.run.smithi039.stdout: chdir = "" 2023-05-16T13:53:07.809 INFO:teuthology.orchestra.run.smithi039.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-05-16T13:53:07.809 INFO:teuthology.orchestra.run.smithi039.stdout: auth supported = cephx 2023-05-16T13:53:07.810 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:53:07.810 INFO:teuthology.orchestra.run.smithi039.stdout: filestore xattr use omap = true 2023-05-16T13:53:07.810 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:53:07.810 INFO:teuthology.orchestra.run.smithi039.stdout: mon clock drift allowed = 1.000 2023-05-16T13:53:07.810 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:53:07.810 INFO:teuthology.orchestra.run.smithi039.stdout: osd crush chooseleaf type = 0 2023-05-16T13:53:07.810 INFO:teuthology.orchestra.run.smithi039.stdout: auth debug = true 2023-05-16T13:53:07.811 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:53:07.811 INFO:teuthology.orchestra.run.smithi039.stdout: ms die on old message = true 2023-05-16T13:53:07.811 INFO:teuthology.orchestra.run.smithi039.stdout: ms die on bug = true 2023-05-16T13:53:07.811 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:53:07.811 INFO:teuthology.orchestra.run.smithi039.stdout: mon max pg per osd = 10000 # >= luminous 2023-05-16T13:53:07.811 INFO:teuthology.orchestra.run.smithi039.stdout: mon pg warn max object skew = 0 2023-05-16T13:53:07.811 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:53:07.811 INFO:teuthology.orchestra.run.smithi039.stdout: # disable pg_autoscaler by default for new pools 2023-05-16T13:53:07.812 INFO:teuthology.orchestra.run.smithi039.stdout: osd_pool_default_pg_autoscale_mode = off 2023-05-16T13:53:07.812 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:53:07.812 INFO:teuthology.orchestra.run.smithi039.stdout: osd pool default size = 2 2023-05-16T13:53:07.812 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:53:07.812 INFO:teuthology.orchestra.run.smithi039.stdout: mon osd allow primary affinity = true 2023-05-16T13:53:07.812 INFO:teuthology.orchestra.run.smithi039.stdout: mon osd allow pg remap = true 2023-05-16T13:53:07.813 INFO:teuthology.orchestra.run.smithi039.stdout: mon warn on legacy crush tunables = false 2023-05-16T13:53:07.813 INFO:teuthology.orchestra.run.smithi039.stdout: mon warn on crush straw calc version zero = false 2023-05-16T13:53:07.813 INFO:teuthology.orchestra.run.smithi039.stdout: mon warn on no sortbitwise = false 2023-05-16T13:53:07.813 INFO:teuthology.orchestra.run.smithi039.stdout: mon warn on osd down out interval zero = false 2023-05-16T13:53:07.813 INFO:teuthology.orchestra.run.smithi039.stdout: mon warn on too few osds = false 2023-05-16T13:53:07.814 INFO:teuthology.orchestra.run.smithi039.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-05-16T13:53:07.814 INFO:teuthology.orchestra.run.smithi039.stdout: mon_warn_on_pool_no_redundancy = false 2023-05-16T13:53:07.814 INFO:teuthology.orchestra.run.smithi039.stdout: mon_allow_pool_size_one = true 2023-05-16T13:53:07.814 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:53:07.814 INFO:teuthology.orchestra.run.smithi039.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-05-16T13:53:07.814 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:53:07.814 INFO:teuthology.orchestra.run.smithi039.stdout: osd default data pool replay window = 5 2023-05-16T13:53:07.814 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:53:07.815 INFO:teuthology.orchestra.run.smithi039.stdout: mon allow pool delete = true 2023-05-16T13:53:07.815 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:53:07.815 INFO:teuthology.orchestra.run.smithi039.stdout: mon cluster log file level = debug 2023-05-16T13:53:07.815 INFO:teuthology.orchestra.run.smithi039.stdout: debug asserts on shutdown = true 2023-05-16T13:53:07.815 INFO:teuthology.orchestra.run.smithi039.stdout: mon health detail to clog = false 2023-05-16T13:53:07.815 INFO:teuthology.orchestra.run.smithi039.stdout: mon host = "172.21.15.39,172.21.15.118,[v2:172.21.15.118:3301,v1:172.21.15.118:6790]" 2023-05-16T13:53:07.815 INFO:teuthology.orchestra.run.smithi039.stdout: fsid = 9c1e210b-c515-4ea4-a065-397956895c68 2023-05-16T13:53:07.816 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:53:07.816 INFO:teuthology.orchestra.run.smithi039.stdout:[osd] 2023-05-16T13:53:07.816 INFO:teuthology.orchestra.run.smithi039.stdout: osd journal size = 100 2023-05-16T13:53:07.816 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:53:07.816 INFO:teuthology.orchestra.run.smithi039.stdout: osd scrub load threshold = 5.0 2023-05-16T13:53:07.817 INFO:teuthology.orchestra.run.smithi039.stdout: osd scrub max interval = 600 2023-05-16T13:53:07.817 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:53:07.817 INFO:teuthology.orchestra.run.smithi039.stdout: osd recover clone overlap = true 2023-05-16T13:53:07.817 INFO:teuthology.orchestra.run.smithi039.stdout: osd recovery max chunk = 1048576 2023-05-16T13:53:07.817 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:53:07.817 INFO:teuthology.orchestra.run.smithi039.stdout: osd debug shutdown = true 2023-05-16T13:53:07.817 INFO:teuthology.orchestra.run.smithi039.stdout: osd debug op order = true 2023-05-16T13:53:07.817 INFO:teuthology.orchestra.run.smithi039.stdout: osd debug verify stray on activate = true 2023-05-16T13:53:07.818 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:53:07.818 INFO:teuthology.orchestra.run.smithi039.stdout: osd open classes on start = true 2023-05-16T13:53:07.818 INFO:teuthology.orchestra.run.smithi039.stdout: osd debug pg log writeout = true 2023-05-16T13:53:07.818 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:53:07.818 INFO:teuthology.orchestra.run.smithi039.stdout: osd deep scrub update digest min age = 30 2023-05-16T13:53:07.818 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:53:07.818 INFO:teuthology.orchestra.run.smithi039.stdout: osd map max advance = 10 2023-05-16T13:53:07.819 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:53:07.819 INFO:teuthology.orchestra.run.smithi039.stdout: journal zero on create = true 2023-05-16T13:53:07.819 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:53:07.819 INFO:teuthology.orchestra.run.smithi039.stdout: filestore ondisk finisher threads = 3 2023-05-16T13:53:07.819 INFO:teuthology.orchestra.run.smithi039.stdout: filestore apply finisher threads = 3 2023-05-16T13:53:07.819 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:53:07.820 INFO:teuthology.orchestra.run.smithi039.stdout: bdev debug aio = true 2023-05-16T13:53:07.820 INFO:teuthology.orchestra.run.smithi039.stdout: osd debug misdirected ops = true 2023-05-16T13:53:07.820 INFO:teuthology.orchestra.run.smithi039.stdout: bdev async discard = True 2023-05-16T13:53:07.821 INFO:teuthology.orchestra.run.smithi039.stdout: bdev enable discard = True 2023-05-16T13:53:07.821 INFO:teuthology.orchestra.run.smithi039.stdout: bluestore allocator = bitmap 2023-05-16T13:53:07.821 INFO:teuthology.orchestra.run.smithi039.stdout: bluestore block size = 96636764160 2023-05-16T13:53:07.821 INFO:teuthology.orchestra.run.smithi039.stdout: bluestore fsck on mount = True 2023-05-16T13:53:07.822 INFO:teuthology.orchestra.run.smithi039.stdout: debug bluefs = 1/20 2023-05-16T13:53:07.822 INFO:teuthology.orchestra.run.smithi039.stdout: debug bluestore = 1/20 2023-05-16T13:53:07.822 INFO:teuthology.orchestra.run.smithi039.stdout: debug ms = 1 2023-05-16T13:53:07.822 INFO:teuthology.orchestra.run.smithi039.stdout: debug osd = 20 2023-05-16T13:53:07.823 INFO:teuthology.orchestra.run.smithi039.stdout: debug rocksdb = 4/10 2023-05-16T13:53:07.823 INFO:teuthology.orchestra.run.smithi039.stdout: mon osd backfillfull_ratio = 0.85 2023-05-16T13:53:07.823 INFO:teuthology.orchestra.run.smithi039.stdout: mon osd full ratio = 0.9 2023-05-16T13:53:07.824 INFO:teuthology.orchestra.run.smithi039.stdout: mon osd nearfull ratio = 0.8 2023-05-16T13:53:07.824 INFO:teuthology.orchestra.run.smithi039.stdout: osd failsafe full ratio = 0.95 2023-05-16T13:53:07.824 INFO:teuthology.orchestra.run.smithi039.stdout: osd objectstore = bluestore 2023-05-16T13:53:07.824 INFO:teuthology.orchestra.run.smithi039.stdout: osd op complaint time = 180 2023-05-16T13:53:07.825 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:53:07.825 INFO:teuthology.orchestra.run.smithi039.stdout:[mgr] 2023-05-16T13:53:07.825 INFO:teuthology.orchestra.run.smithi039.stdout: debug ms = 1 2023-05-16T13:53:07.825 INFO:teuthology.orchestra.run.smithi039.stdout: debug mgr = 20 2023-05-16T13:53:07.826 INFO:teuthology.orchestra.run.smithi039.stdout: debug mon = 20 2023-05-16T13:53:07.826 INFO:teuthology.orchestra.run.smithi039.stdout: debug auth = 20 2023-05-16T13:53:07.826 INFO:teuthology.orchestra.run.smithi039.stdout: mon reweight min pgs per osd = 4 2023-05-16T13:53:07.826 INFO:teuthology.orchestra.run.smithi039.stdout: mon reweight min bytes per osd = 10 2023-05-16T13:53:07.826 INFO:teuthology.orchestra.run.smithi039.stdout: mgr/telemetry/nag = false 2023-05-16T13:53:07.827 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:53:07.827 INFO:teuthology.orchestra.run.smithi039.stdout:[mon] 2023-05-16T13:53:07.827 INFO:teuthology.orchestra.run.smithi039.stdout: debug ms = 1 2023-05-16T13:53:07.827 INFO:teuthology.orchestra.run.smithi039.stdout: debug mon = 20 2023-05-16T13:53:07.827 INFO:teuthology.orchestra.run.smithi039.stdout: debug paxos = 20 2023-05-16T13:53:07.827 INFO:teuthology.orchestra.run.smithi039.stdout: debug auth = 20 2023-05-16T13:53:07.827 INFO:teuthology.orchestra.run.smithi039.stdout: mon data avail warn = 5 2023-05-16T13:53:07.827 INFO:teuthology.orchestra.run.smithi039.stdout: mon mgr mkfs grace = 240 2023-05-16T13:53:07.828 INFO:teuthology.orchestra.run.smithi039.stdout: mon reweight min pgs per osd = 4 2023-05-16T13:53:07.828 INFO:teuthology.orchestra.run.smithi039.stdout: mon osd reporter subtree level = osd 2023-05-16T13:53:07.828 INFO:teuthology.orchestra.run.smithi039.stdout: mon osd prime pg temp = true 2023-05-16T13:53:07.828 INFO:teuthology.orchestra.run.smithi039.stdout: mon reweight min bytes per osd = 10 2023-05-16T13:53:07.828 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:53:07.828 INFO:teuthology.orchestra.run.smithi039.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-05-16T13:53:07.828 INFO:teuthology.orchestra.run.smithi039.stdout: auth mon ticket ttl = 660 # 11m 2023-05-16T13:53:07.829 INFO:teuthology.orchestra.run.smithi039.stdout: auth service ticket ttl = 240 # 4m 2023-05-16T13:53:07.829 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:53:07.829 INFO:teuthology.orchestra.run.smithi039.stdout: # don't complain about insecure global_id in the test suite 2023-05-16T13:53:07.829 INFO:teuthology.orchestra.run.smithi039.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-05-16T13:53:07.829 INFO:teuthology.orchestra.run.smithi039.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-05-16T13:53:07.829 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:53:07.830 INFO:teuthology.orchestra.run.smithi039.stdout: # 1m isn't quite enough 2023-05-16T13:53:07.830 INFO:teuthology.orchestra.run.smithi039.stdout: mon_down_mkfs_grace = 2m 2023-05-16T13:53:07.830 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:53:07.830 INFO:teuthology.orchestra.run.smithi039.stdout: mon_warn_on_filestore_osds = false 2023-05-16T13:53:07.830 INFO:teuthology.orchestra.run.smithi039.stdout: mon op complaint time = 120 2023-05-16T13:53:07.830 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:53:07.830 INFO:teuthology.orchestra.run.smithi039.stdout:[client] 2023-05-16T13:53:07.830 INFO:teuthology.orchestra.run.smithi039.stdout: rgw cache enabled = true 2023-05-16T13:53:07.831 INFO:teuthology.orchestra.run.smithi039.stdout: rgw enable ops log = true 2023-05-16T13:53:07.831 INFO:teuthology.orchestra.run.smithi039.stdout: rgw enable usage log = true 2023-05-16T13:53:07.831 INFO:teuthology.orchestra.run.smithi039.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-05-16T13:53:07.831 INFO:teuthology.orchestra.run.smithi039.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-05-16T13:53:07.831 INFO:teuthology.orchestra.run.smithi039.stdout: client mount timeout = 600 2023-05-16T13:53:07.831 INFO:teuthology.orchestra.run.smithi039.stdout: debug client = 20 2023-05-16T13:53:07.831 INFO:teuthology.orchestra.run.smithi039.stdout: debug ms = 1 2023-05-16T13:53:07.831 INFO:teuthology.orchestra.run.smithi039.stdout: pid file = "" 2023-05-16T13:53:07.832 INFO:teuthology.orchestra.run.smithi039.stdout: rados mon op timeout = 900 2023-05-16T13:53:07.832 INFO:teuthology.orchestra.run.smithi039.stdout: rados osd op timeout = 900 2023-05-16T13:53:07.832 INFO:teuthology.orchestra.run.smithi039.stdout:[mon.a] 2023-05-16T13:53:07.832 INFO:teuthology.orchestra.run.smithi039.stdout:[mon.b] 2023-05-16T13:53:07.832 INFO:teuthology.orchestra.run.smithi039.stdout:[mon.c] 2023-05-16T13:53:07.832 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.a] 2023-05-16T13:53:07.832 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.c] 2023-05-16T13:53:07.833 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.b] 2023-05-16T13:53:07.833 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.d] 2023-05-16T13:53:07.833 INFO:teuthology.orchestra.run.smithi039.stdout:[mds] 2023-05-16T13:53:07.833 INFO:teuthology.orchestra.run.smithi039.stdout: debug mds = 20 2023-05-16T13:53:07.833 INFO:teuthology.orchestra.run.smithi039.stdout: debug mds balancer = 20 2023-05-16T13:53:07.833 INFO:teuthology.orchestra.run.smithi039.stdout: debug ms = 1 2023-05-16T13:53:07.833 INFO:teuthology.orchestra.run.smithi039.stdout: mds debug frag = True 2023-05-16T13:53:07.833 INFO:teuthology.orchestra.run.smithi039.stdout: mds debug scatterstat = True 2023-05-16T13:53:07.834 INFO:teuthology.orchestra.run.smithi039.stdout: mds op complaint time = 180 2023-05-16T13:53:07.834 INFO:teuthology.orchestra.run.smithi039.stdout: mds verify scatter = True 2023-05-16T13:53:07.834 INFO:teuthology.orchestra.run.smithi039.stdout: osd op complaint time = 180 2023-05-16T13:53:07.834 INFO:teuthology.orchestra.run.smithi039.stdout: rados mon op timeout = 900 2023-05-16T13:53:07.835 INFO:teuthology.orchestra.run.smithi039.stdout: rados osd op timeout = 900 2023-05-16T13:53:07.837 INFO:teuthology.orchestra.run.smithi118.stdout:[global] 2023-05-16T13:53:07.837 INFO:teuthology.orchestra.run.smithi118.stdout: chdir = "" 2023-05-16T13:53:07.838 INFO:teuthology.orchestra.run.smithi118.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-05-16T13:53:07.838 INFO:teuthology.orchestra.run.smithi118.stdout: auth supported = cephx 2023-05-16T13:53:07.838 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-05-16T13:53:07.838 INFO:teuthology.orchestra.run.smithi118.stdout: filestore xattr use omap = true 2023-05-16T13:53:07.839 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-05-16T13:53:07.839 INFO:teuthology.orchestra.run.smithi118.stdout: mon clock drift allowed = 1.000 2023-05-16T13:53:07.839 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-05-16T13:53:07.840 INFO:teuthology.orchestra.run.smithi118.stdout: osd crush chooseleaf type = 0 2023-05-16T13:53:07.840 INFO:teuthology.orchestra.run.smithi118.stdout: auth debug = true 2023-05-16T13:53:07.840 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-05-16T13:53:07.840 INFO:teuthology.orchestra.run.smithi118.stdout: ms die on old message = true 2023-05-16T13:53:07.841 INFO:teuthology.orchestra.run.smithi118.stdout: ms die on bug = true 2023-05-16T13:53:07.841 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-05-16T13:53:07.841 INFO:teuthology.orchestra.run.smithi118.stdout: mon max pg per osd = 10000 # >= luminous 2023-05-16T13:53:07.842 INFO:teuthology.orchestra.run.smithi118.stdout: mon pg warn max object skew = 0 2023-05-16T13:53:07.842 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-05-16T13:53:07.842 INFO:teuthology.orchestra.run.smithi118.stdout: # disable pg_autoscaler by default for new pools 2023-05-16T13:53:07.842 INFO:teuthology.orchestra.run.smithi118.stdout: osd_pool_default_pg_autoscale_mode = off 2023-05-16T13:53:07.843 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-05-16T13:53:07.843 INFO:teuthology.orchestra.run.smithi118.stdout: osd pool default size = 2 2023-05-16T13:53:07.843 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-05-16T13:53:07.843 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd allow primary affinity = true 2023-05-16T13:53:07.843 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd allow pg remap = true 2023-05-16T13:53:07.844 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on legacy crush tunables = false 2023-05-16T13:53:07.844 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on crush straw calc version zero = false 2023-05-16T13:53:07.844 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on no sortbitwise = false 2023-05-16T13:53:07.844 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on osd down out interval zero = false 2023-05-16T13:53:07.845 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on too few osds = false 2023-05-16T13:53:07.845 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-05-16T13:53:07.845 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_pool_no_redundancy = false 2023-05-16T13:53:07.846 INFO:teuthology.orchestra.run.smithi118.stdout: mon_allow_pool_size_one = true 2023-05-16T13:53:07.846 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-05-16T13:53:07.846 INFO:teuthology.orchestra.run.smithi118.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-05-16T13:53:07.846 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-05-16T13:53:07.846 INFO:teuthology.orchestra.run.smithi118.stdout: osd default data pool replay window = 5 2023-05-16T13:53:07.846 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-05-16T13:53:07.847 INFO:teuthology.orchestra.run.smithi118.stdout: mon allow pool delete = true 2023-05-16T13:53:07.847 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-05-16T13:53:07.847 INFO:teuthology.orchestra.run.smithi118.stdout: mon cluster log file level = debug 2023-05-16T13:53:07.847 INFO:teuthology.orchestra.run.smithi118.stdout: debug asserts on shutdown = true 2023-05-16T13:53:07.847 INFO:teuthology.orchestra.run.smithi118.stdout: mon health detail to clog = false 2023-05-16T13:53:07.847 INFO:teuthology.orchestra.run.smithi118.stdout: mon host = "172.21.15.39,172.21.15.118,[v2:172.21.15.118:3301,v1:172.21.15.118:6790]" 2023-05-16T13:53:07.847 INFO:teuthology.orchestra.run.smithi118.stdout: fsid = 9c1e210b-c515-4ea4-a065-397956895c68 2023-05-16T13:53:07.848 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-05-16T13:53:07.848 INFO:teuthology.orchestra.run.smithi118.stdout:[osd] 2023-05-16T13:53:07.848 INFO:teuthology.orchestra.run.smithi118.stdout: osd journal size = 100 2023-05-16T13:53:07.848 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-05-16T13:53:07.848 INFO:teuthology.orchestra.run.smithi118.stdout: osd scrub load threshold = 5.0 2023-05-16T13:53:07.848 INFO:teuthology.orchestra.run.smithi118.stdout: osd scrub max interval = 600 2023-05-16T13:53:07.848 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-05-16T13:53:07.849 INFO:teuthology.orchestra.run.smithi118.stdout: osd recover clone overlap = true 2023-05-16T13:53:07.849 INFO:teuthology.orchestra.run.smithi118.stdout: osd recovery max chunk = 1048576 2023-05-16T13:53:07.849 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-05-16T13:53:07.849 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug shutdown = true 2023-05-16T13:53:07.849 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug op order = true 2023-05-16T13:53:07.849 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug verify stray on activate = true 2023-05-16T13:53:07.849 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-05-16T13:53:07.849 INFO:teuthology.orchestra.run.smithi118.stdout: osd open classes on start = true 2023-05-16T13:53:07.850 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug pg log writeout = true 2023-05-16T13:53:07.850 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-05-16T13:53:07.850 INFO:teuthology.orchestra.run.smithi118.stdout: osd deep scrub update digest min age = 30 2023-05-16T13:53:07.850 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-05-16T13:53:07.850 INFO:teuthology.orchestra.run.smithi118.stdout: osd map max advance = 10 2023-05-16T13:53:07.850 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-05-16T13:53:07.850 INFO:teuthology.orchestra.run.smithi118.stdout: journal zero on create = true 2023-05-16T13:53:07.850 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-05-16T13:53:07.851 INFO:teuthology.orchestra.run.smithi118.stdout: filestore ondisk finisher threads = 3 2023-05-16T13:53:07.851 INFO:teuthology.orchestra.run.smithi118.stdout: filestore apply finisher threads = 3 2023-05-16T13:53:07.851 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-05-16T13:53:07.851 INFO:teuthology.orchestra.run.smithi118.stdout: bdev debug aio = true 2023-05-16T13:53:07.851 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug misdirected ops = true 2023-05-16T13:53:07.851 INFO:teuthology.orchestra.run.smithi118.stdout: bdev async discard = True 2023-05-16T13:53:07.851 INFO:teuthology.orchestra.run.smithi118.stdout: bdev enable discard = True 2023-05-16T13:53:07.851 INFO:teuthology.orchestra.run.smithi118.stdout: bluestore allocator = bitmap 2023-05-16T13:53:07.852 INFO:teuthology.orchestra.run.smithi118.stdout: bluestore block size = 96636764160 2023-05-16T13:53:07.852 INFO:teuthology.orchestra.run.smithi118.stdout: bluestore fsck on mount = True 2023-05-16T13:53:07.852 INFO:teuthology.orchestra.run.smithi118.stdout: debug bluefs = 1/20 2023-05-16T13:53:07.852 INFO:teuthology.orchestra.run.smithi118.stdout: debug bluestore = 1/20 2023-05-16T13:53:07.852 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2023-05-16T13:53:07.852 INFO:teuthology.orchestra.run.smithi118.stdout: debug osd = 20 2023-05-16T13:53:07.852 INFO:teuthology.orchestra.run.smithi118.stdout: debug rocksdb = 4/10 2023-05-16T13:53:07.852 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd backfillfull_ratio = 0.85 2023-05-16T13:53:07.853 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd full ratio = 0.9 2023-05-16T13:53:07.853 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd nearfull ratio = 0.8 2023-05-16T13:53:07.853 INFO:teuthology.orchestra.run.smithi118.stdout: osd failsafe full ratio = 0.95 2023-05-16T13:53:07.853 INFO:teuthology.orchestra.run.smithi118.stdout: osd objectstore = bluestore 2023-05-16T13:53:07.853 INFO:teuthology.orchestra.run.smithi118.stdout: osd op complaint time = 180 2023-05-16T13:53:07.853 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-05-16T13:53:07.853 INFO:teuthology.orchestra.run.smithi118.stdout:[mgr] 2023-05-16T13:53:07.853 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2023-05-16T13:53:07.854 INFO:teuthology.orchestra.run.smithi118.stdout: debug mgr = 20 2023-05-16T13:53:07.854 INFO:teuthology.orchestra.run.smithi118.stdout: debug mon = 20 2023-05-16T13:53:07.854 INFO:teuthology.orchestra.run.smithi118.stdout: debug auth = 20 2023-05-16T13:53:07.854 INFO:teuthology.orchestra.run.smithi118.stdout: mon reweight min pgs per osd = 4 2023-05-16T13:53:07.854 INFO:teuthology.orchestra.run.smithi118.stdout: mon reweight min bytes per osd = 10 2023-05-16T13:53:07.854 INFO:teuthology.orchestra.run.smithi118.stdout: mgr/telemetry/nag = false 2023-05-16T13:53:07.854 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-05-16T13:53:07.854 INFO:teuthology.orchestra.run.smithi118.stdout:[mon] 2023-05-16T13:53:07.855 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2023-05-16T13:53:07.855 INFO:teuthology.orchestra.run.smithi118.stdout: debug mon = 20 2023-05-16T13:53:07.855 INFO:teuthology.orchestra.run.smithi118.stdout: debug paxos = 20 2023-05-16T13:53:07.855 INFO:teuthology.orchestra.run.smithi118.stdout: debug auth = 20 2023-05-16T13:53:07.855 INFO:teuthology.orchestra.run.smithi118.stdout: mon data avail warn = 5 2023-05-16T13:53:07.855 INFO:teuthology.orchestra.run.smithi118.stdout: mon mgr mkfs grace = 240 2023-05-16T13:53:07.855 INFO:teuthology.orchestra.run.smithi118.stdout: mon reweight min pgs per osd = 4 2023-05-16T13:53:07.855 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd reporter subtree level = osd 2023-05-16T13:53:07.856 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd prime pg temp = true 2023-05-16T13:53:07.856 INFO:teuthology.orchestra.run.smithi118.stdout: mon reweight min bytes per osd = 10 2023-05-16T13:53:07.856 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-05-16T13:53:07.856 INFO:teuthology.orchestra.run.smithi118.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-05-16T13:53:07.856 INFO:teuthology.orchestra.run.smithi118.stdout: auth mon ticket ttl = 660 # 11m 2023-05-16T13:53:07.856 INFO:teuthology.orchestra.run.smithi118.stdout: auth service ticket ttl = 240 # 4m 2023-05-16T13:53:07.857 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-05-16T13:53:07.857 INFO:teuthology.orchestra.run.smithi118.stdout: # don't complain about insecure global_id in the test suite 2023-05-16T13:53:07.857 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-05-16T13:53:07.857 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-05-16T13:53:07.857 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-05-16T13:53:07.857 INFO:teuthology.orchestra.run.smithi118.stdout: # 1m isn't quite enough 2023-05-16T13:53:07.857 INFO:teuthology.orchestra.run.smithi118.stdout: mon_down_mkfs_grace = 2m 2023-05-16T13:53:07.857 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-05-16T13:53:07.858 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_filestore_osds = false 2023-05-16T13:53:07.858 INFO:teuthology.orchestra.run.smithi118.stdout: mon op complaint time = 120 2023-05-16T13:53:07.858 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-05-16T13:53:07.858 INFO:teuthology.orchestra.run.smithi118.stdout:[client] 2023-05-16T13:53:07.858 INFO:teuthology.orchestra.run.smithi118.stdout: rgw cache enabled = true 2023-05-16T13:53:07.858 INFO:teuthology.orchestra.run.smithi118.stdout: rgw enable ops log = true 2023-05-16T13:53:07.858 INFO:teuthology.orchestra.run.smithi118.stdout: rgw enable usage log = true 2023-05-16T13:53:07.858 INFO:teuthology.orchestra.run.smithi118.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-05-16T13:53:07.859 INFO:teuthology.orchestra.run.smithi118.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-05-16T13:53:07.859 INFO:teuthology.orchestra.run.smithi118.stdout: client mount timeout = 600 2023-05-16T13:53:07.859 INFO:teuthology.orchestra.run.smithi118.stdout: debug client = 20 2023-05-16T13:53:07.859 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2023-05-16T13:53:07.859 INFO:teuthology.orchestra.run.smithi118.stdout: pid file = "" 2023-05-16T13:53:07.859 INFO:teuthology.orchestra.run.smithi118.stdout: rados mon op timeout = 900 2023-05-16T13:53:07.859 INFO:teuthology.orchestra.run.smithi118.stdout: rados osd op timeout = 900 2023-05-16T13:53:07.859 INFO:teuthology.orchestra.run.smithi118.stdout:[mon.a] 2023-05-16T13:53:07.860 INFO:teuthology.orchestra.run.smithi118.stdout:[mon.b] 2023-05-16T13:53:07.860 INFO:teuthology.orchestra.run.smithi118.stdout:[mon.c] 2023-05-16T13:53:07.860 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.a] 2023-05-16T13:53:07.860 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.c] 2023-05-16T13:53:07.860 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.b] 2023-05-16T13:53:07.860 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.d] 2023-05-16T13:53:07.860 INFO:teuthology.orchestra.run.smithi118.stdout:[mds] 2023-05-16T13:53:07.861 INFO:teuthology.orchestra.run.smithi118.stdout: debug mds = 20 2023-05-16T13:53:07.861 INFO:teuthology.orchestra.run.smithi118.stdout: debug mds balancer = 20 2023-05-16T13:53:07.861 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2023-05-16T13:53:07.861 INFO:teuthology.orchestra.run.smithi118.stdout: mds debug frag = True 2023-05-16T13:53:07.861 INFO:teuthology.orchestra.run.smithi118.stdout: mds debug scatterstat = True 2023-05-16T13:53:07.861 INFO:teuthology.orchestra.run.smithi118.stdout: mds op complaint time = 180 2023-05-16T13:53:07.861 INFO:teuthology.orchestra.run.smithi118.stdout: mds verify scatter = True 2023-05-16T13:53:07.861 INFO:teuthology.orchestra.run.smithi118.stdout: osd op complaint time = 180 2023-05-16T13:53:07.862 INFO:teuthology.orchestra.run.smithi118.stdout: rados mon op timeout = 900 2023-05-16T13:53:07.862 INFO:teuthology.orchestra.run.smithi118.stdout: rados osd op timeout = 900 2023-05-16T13:53:07.862 INFO:tasks.ceph:Creating admin key on mon.a... 2023-05-16T13:53:07.862 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-05-16T13:53:07.935 INFO:tasks.ceph:Copying monmap to all nodes... 2023-05-16T13:53:07.935 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-05-16T13:53:07.935 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-05-16T13:53:07.943 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-05-16T13:53:07.943 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-05-16T13:53:07.996 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi039.front.sepia.ceph.com 2023-05-16T13:53:07.996 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-05-16T13:53:07.997 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/etc/ceph/ceph.keyring 2023-05-16T13:53:07.997 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-05-16T13:53:08.070 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-05-16T13:53:08.071 DEBUG:teuthology.orchestra.run.smithi039:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-05-16T13:53:08.123 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi118.front.sepia.ceph.com 2023-05-16T13:53:08.124 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-05-16T13:53:08.124 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/etc/ceph/ceph.keyring 2023-05-16T13:53:08.124 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-05-16T13:53:08.157 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-05-16T13:53:08.157 DEBUG:teuthology.orchestra.run.smithi118:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-05-16T13:53:08.208 INFO:tasks.ceph:Setting up mon nodes... 2023-05-16T13:53:08.208 INFO:tasks.ceph:Setting up mgr nodes... 2023-05-16T13:53:08.208 DEBUG:teuthology.orchestra.run.smithi039:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-05-16T13:53:08.262 INFO:teuthology.orchestra.run.smithi039.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-05-16T13:53:08.267 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-05-16T13:53:08.321 INFO:teuthology.orchestra.run.smithi118.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-05-16T13:53:08.336 INFO:tasks.ceph:Setting up mds nodes... 2023-05-16T13:53:08.337 DEBUG:teuthology.orchestra.run.smithi039:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-05-16T13:53:08.391 INFO:teuthology.orchestra.run.smithi039.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-05-16T13:53:08.395 DEBUG:teuthology.orchestra.run.smithi039:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-05-16T13:53:08.414 DEBUG:teuthology.orchestra.run.smithi039:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-05-16T13:53:08.508 INFO:teuthology.orchestra.run.smithi039.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-05-16T13:53:08.512 DEBUG:teuthology.orchestra.run.smithi039:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-05-16T13:53:08.531 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-05-16T13:53:08.584 INFO:teuthology.orchestra.run.smithi118.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-05-16T13:53:08.588 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-05-16T13:53:08.607 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-05-16T13:53:08.699 INFO:teuthology.orchestra.run.smithi118.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-05-16T13:53:08.703 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-05-16T13:53:08.721 INFO:tasks.ceph_client:Setting up client nodes... 2023-05-16T13:53:08.722 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-05-16T13:53:08.765 INFO:teuthology.orchestra.run.smithi039.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-05-16T13:53:08.781 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-05-16T13:53:08.869 INFO:teuthology.orchestra.run.smithi039.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-05-16T13:53:08.885 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-05-16T13:53:08.924 INFO:teuthology.orchestra.run.smithi118.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-05-16T13:53:08.940 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-05-16T13:53:09.023 INFO:teuthology.orchestra.run.smithi118.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-05-16T13:53:09.039 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-05-16T13:53:09.039 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi039.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi118.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-05-16T13:53:09.040 DEBUG:teuthology.orchestra.run.smithi039:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-05-16T13:53:09.058 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-05-16T13:53:09.059 INFO:tasks.ceph:role: osd.0 2023-05-16T13:53:09.059 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi039.front.sepia.ceph.com 2023-05-16T13:53:09.059 DEBUG:teuthology.orchestra.run.smithi039:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-05-16T13:53:09.146 INFO:teuthology.orchestra.run.smithi039.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-05-16T13:53:09.146 INFO:teuthology.orchestra.run.smithi039.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-16T13:53:09.146 INFO:teuthology.orchestra.run.smithi039.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-16T13:53:09.146 INFO:teuthology.orchestra.run.smithi039.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-16T13:53:09.146 INFO:teuthology.orchestra.run.smithi039.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-16T13:53:09.147 INFO:teuthology.orchestra.run.smithi039.stdout: = sunit=0 swidth=0 blks 2023-05-16T13:53:09.147 INFO:teuthology.orchestra.run.smithi039.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-16T13:53:09.147 INFO:teuthology.orchestra.run.smithi039.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-16T13:53:09.148 INFO:teuthology.orchestra.run.smithi039.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-16T13:53:09.148 INFO:teuthology.orchestra.run.smithi039.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-16T13:53:10.437 INFO:teuthology.orchestra.run.smithi039.stdout:Discarding blocks...Done. 2023-05-16T13:53:10.440 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi039.front.sepia.ceph.com -o noatime 2023-05-16T13:53:10.441 DEBUG:teuthology.orchestra.run.smithi039:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-05-16T13:53:10.470 DEBUG:teuthology.orchestra.run.smithi039:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-05-16T13:53:10.528 INFO:teuthology.orchestra.run.smithi039.stderr:sudo: /sbin/restorecon: command not found 2023-05-16T13:53:10.529 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-16T13:53:10.530 DEBUG:teuthology.orchestra.run.smithi039:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-05-16T13:53:10.596 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-05-16T13:53:10.596 INFO:tasks.ceph:role: osd.1 2023-05-16T13:53:10.596 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi039.front.sepia.ceph.com 2023-05-16T13:53:10.597 DEBUG:teuthology.orchestra.run.smithi039:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-05-16T13:53:10.684 INFO:teuthology.orchestra.run.smithi039.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-05-16T13:53:10.685 INFO:teuthology.orchestra.run.smithi039.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-16T13:53:10.685 INFO:teuthology.orchestra.run.smithi039.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-16T13:53:10.685 INFO:teuthology.orchestra.run.smithi039.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-16T13:53:10.685 INFO:teuthology.orchestra.run.smithi039.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-16T13:53:10.685 INFO:teuthology.orchestra.run.smithi039.stdout: = sunit=0 swidth=0 blks 2023-05-16T13:53:10.686 INFO:teuthology.orchestra.run.smithi039.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-16T13:53:10.686 INFO:teuthology.orchestra.run.smithi039.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-16T13:53:10.686 INFO:teuthology.orchestra.run.smithi039.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-16T13:53:10.686 INFO:teuthology.orchestra.run.smithi039.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-16T13:53:11.974 INFO:teuthology.orchestra.run.smithi039.stdout:Discarding blocks...Done. 2023-05-16T13:53:11.976 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi039.front.sepia.ceph.com -o noatime 2023-05-16T13:53:11.977 DEBUG:teuthology.orchestra.run.smithi039:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-05-16T13:53:12.005 DEBUG:teuthology.orchestra.run.smithi039:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-05-16T13:53:12.069 INFO:teuthology.orchestra.run.smithi039.stderr:sudo: /sbin/restorecon: command not found 2023-05-16T13:53:12.070 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-16T13:53:12.070 DEBUG:teuthology.orchestra.run.smithi039:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-05-16T13:53:12.136 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-05-16T13:53:12.136 INFO:tasks.ceph:role: osd.2 2023-05-16T13:53:12.136 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi039.front.sepia.ceph.com 2023-05-16T13:53:12.136 DEBUG:teuthology.orchestra.run.smithi039:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-05-16T13:53:12.223 INFO:teuthology.orchestra.run.smithi039.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-05-16T13:53:12.224 INFO:teuthology.orchestra.run.smithi039.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-16T13:53:12.224 INFO:teuthology.orchestra.run.smithi039.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-16T13:53:12.224 INFO:teuthology.orchestra.run.smithi039.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-16T13:53:12.224 INFO:teuthology.orchestra.run.smithi039.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-16T13:53:12.224 INFO:teuthology.orchestra.run.smithi039.stdout: = sunit=0 swidth=0 blks 2023-05-16T13:53:12.224 INFO:teuthology.orchestra.run.smithi039.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-16T13:53:12.225 INFO:teuthology.orchestra.run.smithi039.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-16T13:53:12.225 INFO:teuthology.orchestra.run.smithi039.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-16T13:53:12.225 INFO:teuthology.orchestra.run.smithi039.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-16T13:53:13.515 INFO:teuthology.orchestra.run.smithi039.stdout:Discarding blocks...Done. 2023-05-16T13:53:13.518 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi039.front.sepia.ceph.com -o noatime 2023-05-16T13:53:13.518 DEBUG:teuthology.orchestra.run.smithi039:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-05-16T13:53:13.546 DEBUG:teuthology.orchestra.run.smithi039:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-05-16T13:53:13.604 INFO:teuthology.orchestra.run.smithi039.stderr:sudo: /sbin/restorecon: command not found 2023-05-16T13:53:13.605 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-16T13:53:13.606 DEBUG:teuthology.orchestra.run.smithi039:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-05-16T13:53:13.667 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-05-16T13:53:13.668 INFO:tasks.ceph:role: osd.3 2023-05-16T13:53:13.668 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi039.front.sepia.ceph.com 2023-05-16T13:53:13.668 DEBUG:teuthology.orchestra.run.smithi039:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-05-16T13:53:13.755 INFO:teuthology.orchestra.run.smithi039.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-05-16T13:53:13.756 INFO:teuthology.orchestra.run.smithi039.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-16T13:53:13.756 INFO:teuthology.orchestra.run.smithi039.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-16T13:53:13.756 INFO:teuthology.orchestra.run.smithi039.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-16T13:53:13.756 INFO:teuthology.orchestra.run.smithi039.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-16T13:53:13.756 INFO:teuthology.orchestra.run.smithi039.stdout: = sunit=0 swidth=0 blks 2023-05-16T13:53:13.756 INFO:teuthology.orchestra.run.smithi039.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-16T13:53:13.756 INFO:teuthology.orchestra.run.smithi039.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-16T13:53:13.757 INFO:teuthology.orchestra.run.smithi039.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-16T13:53:13.757 INFO:teuthology.orchestra.run.smithi039.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-16T13:53:15.046 INFO:teuthology.orchestra.run.smithi039.stdout:Discarding blocks...Done. 2023-05-16T13:53:15.048 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi039.front.sepia.ceph.com -o noatime 2023-05-16T13:53:15.049 DEBUG:teuthology.orchestra.run.smithi039:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-05-16T13:53:15.077 DEBUG:teuthology.orchestra.run.smithi039:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-05-16T13:53:15.141 INFO:teuthology.orchestra.run.smithi039.stderr:sudo: /sbin/restorecon: command not found 2023-05-16T13:53:15.141 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-16T13:53:15.142 DEBUG:teuthology.orchestra.run.smithi039:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-16T13:53:15.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:15.278+0000 7fdc84cf7640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-05-16T13:53:15.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:15.278+0000 7fdc84cf7640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-05-16T13:53:15.283 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:15.278+0000 7fdc84cf7640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-05-16T13:53:15.283 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:15.278+0000 7fdc84cf7640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-05-16T13:53:15.283 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:15.278+0000 7fdc84cf7640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-05-16T13:53:15.286 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:15.282+0000 7fdc84cf7640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-05-16T13:53:18.267 DEBUG:teuthology.orchestra.run.smithi039:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-05-16T13:53:18.287 DEBUG:teuthology.orchestra.run.smithi039:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-16T13:53:18.379 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:18.374+0000 7fafb762b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-05-16T13:53:18.380 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:18.374+0000 7fafb762b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-05-16T13:53:18.380 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:18.374+0000 7fafb762b640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-05-16T13:53:18.380 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:18.374+0000 7fafb762b640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-05-16T13:53:18.380 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:18.374+0000 7fafb762b640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-05-16T13:53:18.382 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:18.378+0000 7fafb762b640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-05-16T13:53:21.375 DEBUG:teuthology.orchestra.run.smithi039:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-05-16T13:53:21.394 DEBUG:teuthology.orchestra.run.smithi039:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-16T13:53:21.490 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:21.486+0000 7fda7014c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-05-16T13:53:21.492 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:21.486+0000 7fda7014c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-05-16T13:53:21.492 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:21.486+0000 7fda7014c640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-05-16T13:53:21.492 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:21.486+0000 7fda7014c640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-05-16T13:53:21.492 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:21.486+0000 7fda7014c640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-05-16T13:53:21.493 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:21.490+0000 7fda7014c640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-05-16T13:53:24.487 DEBUG:teuthology.orchestra.run.smithi039:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-05-16T13:53:24.507 DEBUG:teuthology.orchestra.run.smithi039:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-16T13:53:24.598 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:24.593+0000 7f4ab4e95640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-05-16T13:53:24.599 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:24.593+0000 7f4ab4e95640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-05-16T13:53:24.600 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:24.593+0000 7f4ab4e95640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-05-16T13:53:24.600 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:24.593+0000 7f4ab4e95640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-05-16T13:53:24.600 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:24.593+0000 7f4ab4e95640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-05-16T13:53:24.601 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:24.597+0000 7f4ab4e95640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-05-16T13:53:27.587 DEBUG:teuthology.orchestra.run.smithi039:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-05-16T13:53:27.606 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-05-16T13:53:27.627 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-05-16T13:53:27.627 INFO:tasks.ceph:role: osd.4 2023-05-16T13:53:27.627 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi118.front.sepia.ceph.com 2023-05-16T13:53:27.627 DEBUG:teuthology.orchestra.run.smithi118:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-05-16T13:53:27.691 INFO:teuthology.orchestra.run.smithi118.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-05-16T13:53:27.691 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-16T13:53:27.691 INFO:teuthology.orchestra.run.smithi118.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-16T13:53:27.691 INFO:teuthology.orchestra.run.smithi118.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-16T13:53:27.691 INFO:teuthology.orchestra.run.smithi118.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-16T13:53:27.691 INFO:teuthology.orchestra.run.smithi118.stdout: = sunit=0 swidth=0 blks 2023-05-16T13:53:27.692 INFO:teuthology.orchestra.run.smithi118.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-16T13:53:27.692 INFO:teuthology.orchestra.run.smithi118.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-16T13:53:27.692 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-16T13:53:27.692 INFO:teuthology.orchestra.run.smithi118.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-16T13:53:27.715 INFO:teuthology.orchestra.run.smithi118.stdout:Discarding blocks...Done. 2023-05-16T13:53:27.718 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi118.front.sepia.ceph.com -o noatime 2023-05-16T13:53:27.718 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-05-16T13:53:27.784 DEBUG:teuthology.orchestra.run.smithi118:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-05-16T13:53:27.843 INFO:teuthology.orchestra.run.smithi118.stderr:sudo: /sbin/restorecon: command not found 2023-05-16T13:53:27.844 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-16T13:53:27.844 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-05-16T13:53:27.902 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-05-16T13:53:27.902 INFO:tasks.ceph:role: osd.5 2023-05-16T13:53:27.902 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi118.front.sepia.ceph.com 2023-05-16T13:53:27.903 DEBUG:teuthology.orchestra.run.smithi118:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-05-16T13:53:27.962 INFO:teuthology.orchestra.run.smithi118.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-05-16T13:53:27.962 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-16T13:53:27.962 INFO:teuthology.orchestra.run.smithi118.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-16T13:53:27.963 INFO:teuthology.orchestra.run.smithi118.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-16T13:53:27.963 INFO:teuthology.orchestra.run.smithi118.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-16T13:53:27.963 INFO:teuthology.orchestra.run.smithi118.stdout: = sunit=0 swidth=0 blks 2023-05-16T13:53:27.963 INFO:teuthology.orchestra.run.smithi118.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-16T13:53:27.963 INFO:teuthology.orchestra.run.smithi118.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-16T13:53:27.963 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-16T13:53:27.963 INFO:teuthology.orchestra.run.smithi118.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-16T13:53:27.987 INFO:teuthology.orchestra.run.smithi118.stdout:Discarding blocks...Done. 2023-05-16T13:53:27.989 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi118.front.sepia.ceph.com -o noatime 2023-05-16T13:53:27.989 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-05-16T13:53:28.059 DEBUG:teuthology.orchestra.run.smithi118:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-05-16T13:53:28.115 INFO:teuthology.orchestra.run.smithi118.stderr:sudo: /sbin/restorecon: command not found 2023-05-16T13:53:28.116 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-16T13:53:28.116 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-05-16T13:53:28.178 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-05-16T13:53:28.178 INFO:tasks.ceph:role: osd.6 2023-05-16T13:53:28.179 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi118.front.sepia.ceph.com 2023-05-16T13:53:28.179 DEBUG:teuthology.orchestra.run.smithi118:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-05-16T13:53:28.237 INFO:teuthology.orchestra.run.smithi118.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-05-16T13:53:28.238 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-16T13:53:28.238 INFO:teuthology.orchestra.run.smithi118.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-16T13:53:28.238 INFO:teuthology.orchestra.run.smithi118.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-16T13:53:28.238 INFO:teuthology.orchestra.run.smithi118.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-16T13:53:28.238 INFO:teuthology.orchestra.run.smithi118.stdout: = sunit=0 swidth=0 blks 2023-05-16T13:53:28.238 INFO:teuthology.orchestra.run.smithi118.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-16T13:53:28.239 INFO:teuthology.orchestra.run.smithi118.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-16T13:53:28.239 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-16T13:53:28.239 INFO:teuthology.orchestra.run.smithi118.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-16T13:53:28.262 INFO:teuthology.orchestra.run.smithi118.stdout:Discarding blocks...Done. 2023-05-16T13:53:28.264 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi118.front.sepia.ceph.com -o noatime 2023-05-16T13:53:28.264 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-05-16T13:53:28.327 DEBUG:teuthology.orchestra.run.smithi118:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-05-16T13:53:28.383 INFO:teuthology.orchestra.run.smithi118.stderr:sudo: /sbin/restorecon: command not found 2023-05-16T13:53:28.384 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-16T13:53:28.384 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-05-16T13:53:28.450 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-05-16T13:53:28.451 INFO:tasks.ceph:role: osd.7 2023-05-16T13:53:28.451 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi118.front.sepia.ceph.com 2023-05-16T13:53:28.451 DEBUG:teuthology.orchestra.run.smithi118:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-05-16T13:53:28.510 INFO:teuthology.orchestra.run.smithi118.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-05-16T13:53:28.510 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-16T13:53:28.511 INFO:teuthology.orchestra.run.smithi118.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-16T13:53:28.511 INFO:teuthology.orchestra.run.smithi118.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-16T13:53:28.511 INFO:teuthology.orchestra.run.smithi118.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-16T13:53:28.511 INFO:teuthology.orchestra.run.smithi118.stdout: = sunit=0 swidth=0 blks 2023-05-16T13:53:28.511 INFO:teuthology.orchestra.run.smithi118.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-16T13:53:28.511 INFO:teuthology.orchestra.run.smithi118.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-16T13:53:28.511 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-16T13:53:28.511 INFO:teuthology.orchestra.run.smithi118.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-16T13:53:28.534 INFO:teuthology.orchestra.run.smithi118.stdout:Discarding blocks...Done. 2023-05-16T13:53:28.537 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi118.front.sepia.ceph.com -o noatime 2023-05-16T13:53:28.537 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-05-16T13:53:28.608 DEBUG:teuthology.orchestra.run.smithi118:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-05-16T13:53:28.663 INFO:teuthology.orchestra.run.smithi118.stderr:sudo: /sbin/restorecon: command not found 2023-05-16T13:53:28.664 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-16T13:53:28.664 DEBUG:teuthology.orchestra.run.smithi118:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-16T13:53:28.780 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:28.773+0000 7f8540295640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-05-16T13:53:28.781 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:28.773+0000 7f8540295640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-05-16T13:53:28.781 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:28.773+0000 7f8540295640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-05-16T13:53:28.781 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:28.773+0000 7f8540295640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-05-16T13:53:28.781 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:28.773+0000 7f8540295640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-05-16T13:53:28.782 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:28.777+0000 7f8540295640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-05-16T13:53:31.763 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-05-16T13:53:31.783 DEBUG:teuthology.orchestra.run.smithi118:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-16T13:53:31.878 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:31.877+0000 7f5c5e919640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-05-16T13:53:31.879 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:31.877+0000 7f5c5e919640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-05-16T13:53:31.879 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:31.877+0000 7f5c5e919640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-05-16T13:53:31.879 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:31.877+0000 7f5c5e919640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-05-16T13:53:31.879 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:31.877+0000 7f5c5e919640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-05-16T13:53:31.880 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:31.877+0000 7f5c5e919640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-05-16T13:53:34.875 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-05-16T13:53:34.894 DEBUG:teuthology.orchestra.run.smithi118:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-16T13:53:34.989 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:34.985+0000 7f8e785b6640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-05-16T13:53:34.990 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:34.989+0000 7f8e785b6640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-05-16T13:53:34.990 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:34.989+0000 7f8e785b6640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-05-16T13:53:34.990 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:34.989+0000 7f8e785b6640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-05-16T13:53:34.991 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:34.989+0000 7f8e785b6640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-05-16T13:53:34.991 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:34.989+0000 7f8e785b6640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-05-16T13:53:35.915 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T13:53:35.919 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T13:53:37.967 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-05-16T13:53:37.988 DEBUG:teuthology.orchestra.run.smithi118:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-16T13:53:38.084 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:38.080+0000 7f4f25b6e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-05-16T13:53:38.085 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:38.080+0000 7f4f25b6e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-05-16T13:53:38.085 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:38.080+0000 7f4f25b6e640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-05-16T13:53:38.085 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:38.080+0000 7f4f25b6e640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-05-16T13:53:38.086 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:38.080+0000 7f4f25b6e640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-05-16T13:53:38.086 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:38.084+0000 7f4f25b6e640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-05-16T13:53:41.055 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-05-16T13:53:41.075 INFO:tasks.ceph:Reading keys from all nodes... 2023-05-16T13:53:41.075 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-05-16T13:53:41.075 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-05-16T13:53:41.096 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-05-16T13:53:41.097 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-05-16T13:53:41.160 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-05-16T13:53:41.160 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-05-16T13:53:41.221 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-05-16T13:53:41.222 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-05-16T13:53:41.281 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-05-16T13:53:41.282 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-05-16T13:53:41.345 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-05-16T13:53:41.346 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-05-16T13:53:41.405 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-05-16T13:53:41.406 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-05-16T13:53:41.465 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-05-16T13:53:41.466 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-05-16T13:53:41.485 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-05-16T13:53:41.486 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-05-16T13:53:41.548 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-05-16T13:53:41.549 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-05-16T13:53:41.608 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-05-16T13:53:41.609 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-05-16T13:53:41.669 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-05-16T13:53:41.669 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-05-16T13:53:41.728 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-05-16T13:53:41.729 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-05-16T13:53:41.788 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-05-16T13:53:41.789 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-05-16T13:53:41.848 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-05-16T13:53:41.849 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-05-16T13:53:41.857 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-05-16T13:53:41.857 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-05-16T13:53:41.910 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-05-16T13:53:41.910 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-05-16T13:53:41.918 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-05-16T13:53:41.918 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-05-16T13:53:41.969 INFO:tasks.ceph:Adding keys to all mons... 2023-05-16T13:53:41.969 DEBUG:teuthology.orchestra.run.smithi039:> sudo tee -a /etc/ceph/ceph.keyring 2023-05-16T13:53:41.972 DEBUG:teuthology.orchestra.run.smithi118:> sudo tee -a /etc/ceph/ceph.keyring 2023-05-16T13:53:42.013 INFO:teuthology.orchestra.run.smithi039.stdout:[mgr.y] 2023-05-16T13:53:42.013 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQDEimNkC1auDxAAJJOTGeM8/5aRi3XX9rx1Wg== 2023-05-16T13:53:42.013 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.a] 2023-05-16T13:53:42.013 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQDEimNkC0xZFxAA00l75LfFsCjS+Fk8XxjIKw== 2023-05-16T13:53:42.014 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.c] 2023-05-16T13:53:42.014 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQDEimNkCGpdHhAAW8oMXx3GXs/BWtU8HhVhnQ== 2023-05-16T13:53:42.014 INFO:teuthology.orchestra.run.smithi039.stdout:[osd.0] 2023-05-16T13:53:42.014 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQDLimNkjb7HEBAAw52EfP2J1pItGm5fPPR1xA== 2023-05-16T13:53:42.014 INFO:teuthology.orchestra.run.smithi039.stdout:[osd.1] 2023-05-16T13:53:42.014 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQDOimNktVygFhAA3mtB1PemE6PcVLb2Qh6Q5w== 2023-05-16T13:53:42.014 INFO:teuthology.orchestra.run.smithi039.stdout:[osd.2] 2023-05-16T13:53:42.015 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQDRimNkwXZDHRAAXcL0G+LKLwdKTl4nNw1i7A== 2023-05-16T13:53:42.015 INFO:teuthology.orchestra.run.smithi039.stdout:[osd.3] 2023-05-16T13:53:42.015 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQDUimNkF0y5IxAAX6rco3be4G9HAkX1uvTZHQ== 2023-05-16T13:53:42.015 INFO:teuthology.orchestra.run.smithi039.stdout:[mgr.x] 2023-05-16T13:53:42.015 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQDEimNk4i84ExAAKpzbf5Hl8JvWWxiql9pQtg== 2023-05-16T13:53:42.015 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.b] 2023-05-16T13:53:42.015 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQDEimNkSRDiIhAA1sm/XseDgOA/7p5wQ6VfFw== 2023-05-16T13:53:42.016 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.d] 2023-05-16T13:53:42.016 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQDEimNkqmm4KRAAx0V3HlqAinbNxzGR+Hj+cQ== 2023-05-16T13:53:42.016 INFO:teuthology.orchestra.run.smithi039.stdout:[osd.4] 2023-05-16T13:53:42.016 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQDYimNks4KILhAA4/T9QW3SaCHVm22HcBKxNg== 2023-05-16T13:53:42.016 INFO:teuthology.orchestra.run.smithi039.stdout:[osd.5] 2023-05-16T13:53:42.016 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQDbimNklIRmNBAAqEDoxwnXhIBzpd7kIlRbOA== 2023-05-16T13:53:42.016 INFO:teuthology.orchestra.run.smithi039.stdout:[osd.6] 2023-05-16T13:53:42.017 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQDeimNkKoL+OhAAlisn6trkeC34SoITM0Hoiw== 2023-05-16T13:53:42.017 INFO:teuthology.orchestra.run.smithi039.stdout:[osd.7] 2023-05-16T13:53:42.017 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQDiimNkxiAKBRAA9Zj/TSPVVfu4QQ689ZIJPw== 2023-05-16T13:53:42.017 INFO:teuthology.orchestra.run.smithi039.stdout:[client.0] 2023-05-16T13:53:42.017 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQDEimNk1qqgLRAACZMHJldjFl2Cvgx7gJ6yhA== 2023-05-16T13:53:42.017 INFO:teuthology.orchestra.run.smithi039.stdout:[client.2] 2023-05-16T13:53:42.017 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQDEimNk48fVMxAAyGDUmFSeMFFIi/n5q6uibw== 2023-05-16T13:53:42.017 INFO:teuthology.orchestra.run.smithi039.stdout:[client.1] 2023-05-16T13:53:42.018 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQDEimNkU0ImNxAAI9U5Rj/iTyAbwX7kzVwEXQ== 2023-05-16T13:53:42.018 INFO:teuthology.orchestra.run.smithi039.stdout:[client.3] 2023-05-16T13:53:42.018 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQDFimNk2uFvARAARvQpkLQK0UDOfZOPSm7+kQ== 2023-05-16T13:53:42.026 INFO:teuthology.orchestra.run.smithi118.stdout:[mgr.y] 2023-05-16T13:53:42.027 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQDEimNkC1auDxAAJJOTGeM8/5aRi3XX9rx1Wg== 2023-05-16T13:53:42.027 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.a] 2023-05-16T13:53:42.027 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQDEimNkC0xZFxAA00l75LfFsCjS+Fk8XxjIKw== 2023-05-16T13:53:42.027 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.c] 2023-05-16T13:53:42.027 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQDEimNkCGpdHhAAW8oMXx3GXs/BWtU8HhVhnQ== 2023-05-16T13:53:42.027 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.0] 2023-05-16T13:53:42.027 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQDLimNkjb7HEBAAw52EfP2J1pItGm5fPPR1xA== 2023-05-16T13:53:42.028 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.1] 2023-05-16T13:53:42.028 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQDOimNktVygFhAA3mtB1PemE6PcVLb2Qh6Q5w== 2023-05-16T13:53:42.028 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.2] 2023-05-16T13:53:42.028 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQDRimNkwXZDHRAAXcL0G+LKLwdKTl4nNw1i7A== 2023-05-16T13:53:42.028 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.3] 2023-05-16T13:53:42.028 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQDUimNkF0y5IxAAX6rco3be4G9HAkX1uvTZHQ== 2023-05-16T13:53:42.028 INFO:teuthology.orchestra.run.smithi118.stdout:[mgr.x] 2023-05-16T13:53:42.029 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQDEimNk4i84ExAAKpzbf5Hl8JvWWxiql9pQtg== 2023-05-16T13:53:42.029 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.b] 2023-05-16T13:53:42.029 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQDEimNkSRDiIhAA1sm/XseDgOA/7p5wQ6VfFw== 2023-05-16T13:53:42.029 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.d] 2023-05-16T13:53:42.029 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQDEimNkqmm4KRAAx0V3HlqAinbNxzGR+Hj+cQ== 2023-05-16T13:53:42.029 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.4] 2023-05-16T13:53:42.030 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQDYimNks4KILhAA4/T9QW3SaCHVm22HcBKxNg== 2023-05-16T13:53:42.030 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.5] 2023-05-16T13:53:42.030 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQDbimNklIRmNBAAqEDoxwnXhIBzpd7kIlRbOA== 2023-05-16T13:53:42.030 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.6] 2023-05-16T13:53:42.030 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQDeimNkKoL+OhAAlisn6trkeC34SoITM0Hoiw== 2023-05-16T13:53:42.030 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.7] 2023-05-16T13:53:42.030 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQDiimNkxiAKBRAA9Zj/TSPVVfu4QQ689ZIJPw== 2023-05-16T13:53:42.030 INFO:teuthology.orchestra.run.smithi118.stdout:[client.0] 2023-05-16T13:53:42.031 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQDEimNk1qqgLRAACZMHJldjFl2Cvgx7gJ6yhA== 2023-05-16T13:53:42.031 INFO:teuthology.orchestra.run.smithi118.stdout:[client.2] 2023-05-16T13:53:42.031 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQDEimNk48fVMxAAyGDUmFSeMFFIi/n5q6uibw== 2023-05-16T13:53:42.031 INFO:teuthology.orchestra.run.smithi118.stdout:[client.1] 2023-05-16T13:53:42.031 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQDEimNkU0ImNxAAI9U5Rj/iTyAbwX7kzVwEXQ== 2023-05-16T13:53:42.031 INFO:teuthology.orchestra.run.smithi118.stdout:[client.3] 2023-05-16T13:53:42.031 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQDFimNk2uFvARAARvQpkLQK0UDOfZOPSm7+kQ== 2023-05-16T13:53:42.032 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-05-16T13:53:42.069 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-05-16T13:53:42.131 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-16T13:53:42.135 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-16T13:53:42.190 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-16T13:53:42.194 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-16T13:53:42.248 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-16T13:53:42.252 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-16T13:53:42.302 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-16T13:53:42.305 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-16T13:53:42.355 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-16T13:53:42.358 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-16T13:53:42.408 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-16T13:53:42.411 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-16T13:53:42.461 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-05-16T13:53:42.464 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-05-16T13:53:42.515 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-16T13:53:42.519 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-16T13:53:42.572 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-16T13:53:42.575 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-16T13:53:42.628 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-16T13:53:42.631 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-16T13:53:42.681 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-16T13:53:42.685 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-16T13:53:42.735 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-16T13:53:42.738 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-16T13:53:42.788 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-16T13:53:42.791 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-16T13:53:42.842 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-16T13:53:42.845 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-16T13:53:42.898 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-16T13:53:42.901 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-16T13:53:42.955 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-16T13:53:42.958 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-16T13:53:43.011 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-16T13:53:43.014 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-16T13:53:43.068 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-05-16T13:53:43.068 DEBUG:teuthology.orchestra.run.smithi039:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-05-16T13:53:43.087 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-05-16T13:53:43.198 DEBUG:teuthology.orchestra.run.smithi039:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-05-16T13:53:43.217 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-05-16T13:53:43.236 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-05-16T13:53:43.344 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-05-16T13:53:43.363 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-05-16T13:53:43.427 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-05-16T13:53:43.536 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-05-16T13:53:43.555 DEBUG:teuthology.orchestra.run.smithi039:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-05-16T13:53:43.557 DEBUG:teuthology.orchestra.run.smithi118:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-05-16T13:53:43.604 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-05-16T13:53:43.605 INFO:tasks.ceph.mon.a:Restarting daemon 2023-05-16T13:53:43.606 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-05-16T13:53:43.609 INFO:tasks.ceph.mon.a:Started 2023-05-16T13:53:43.609 INFO:tasks.ceph.mon.b:Restarting daemon 2023-05-16T13:53:43.610 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-05-16T13:53:43.652 INFO:tasks.ceph.mon.b:Started 2023-05-16T13:53:43.652 INFO:tasks.ceph.mon.c:Restarting daemon 2023-05-16T13:53:43.653 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-05-16T13:53:43.655 INFO:tasks.ceph.mon.c:Started 2023-05-16T13:53:43.655 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-05-16T13:53:43.656 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-05-16T13:53:43.656 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-05-16T13:53:43.659 INFO:tasks.ceph.mgr.y:Started 2023-05-16T13:53:43.659 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-05-16T13:53:43.659 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-05-16T13:53:43.662 INFO:tasks.ceph.mgr.x:Started 2023-05-16T13:53:43.662 INFO:tasks.ceph:Setting crush tunables to default 2023-05-16T13:53:43.663 DEBUG:teuthology.orchestra.run.smithi039:> sudo ceph --cluster ceph osd crush tunables default 2023-05-16T13:53:43.800 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:43.796+0000 7f54cf59e640 1 Processor -- start 2023-05-16T13:53:43.800 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:43.796+0000 7f54cf59e640 1 -- start start 2023-05-16T13:53:43.801 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:43.796+0000 7f54cf59e640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54d00cf7f0 0x7f54d00d0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:53:43.801 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:43.796+0000 7f54cf59e640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54d00b4fb0 con 0x7f54d00b16a0 2023-05-16T13:53:43.801 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:43.796+0000 7f54cf59e640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54d006b940 con 0x7f54d006b440 2023-05-16T13:53:43.801 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:43.796+0000 7f54cf59e640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54d006bc20 con 0x7f54d00cf7f0 2023-05-16T13:53:43.802 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:43.796+0000 7f54c7fff640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f54d00b16a0 0x7f54d00b4190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:37514/0 (socket says 172.21.15.39:37514) 2023-05-16T13:53:43.802 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:43.796+0000 7f54c7fff640 1 -- 172.21.15.39:0/715614554 learned_addr learned my addr 172.21.15.39:0/715614554 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:53:43.802 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:43.796+0000 7f54ce59c640 1 --2- 172.21.15.39:0/715614554 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54d00cf7f0 0x7f54d00d0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:53:43.802 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:43.796+0000 7f54ce59c640 1 -- 172.21.15.39:0/715614554 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54d00cf7f0 msgr2=0x7f54d00d0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-05-16T13:53:43.802 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:43.796+0000 7f54ce59c640 1 -- 172.21.15.39:0/715614554 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54d00cf7f0 msgr2=0x7f54d00d0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-16T13:53:43.802 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:43.796+0000 7f54ce59c640 1 --2- 172.21.15.39:0/715614554 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54d00cf7f0 0x7f54d00d0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-05-16T13:53:43.803 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:43.796+0000 7f54ce59c640 1 --2- 172.21.15.39:0/715614554 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54d00cf7f0 0x7f54d00d0250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-05-16T13:53:44.003 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:43.999+0000 7f54ce59c640 1 --2- 172.21.15.39:0/715614554 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54d00cf7f0 0x7f54d00d0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:53:44.003 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:43.999+0000 7f54ce59c640 1 -- 172.21.15.39:0/715614554 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54d00cf7f0 msgr2=0x7f54d00d0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-05-16T13:53:44.003 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:43.999+0000 7f54ce59c640 1 -- 172.21.15.39:0/715614554 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54d00cf7f0 msgr2=0x7f54d00d0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-16T13:53:44.003 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:43.999+0000 7f54ce59c640 1 --2- 172.21.15.39:0/715614554 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54d00cf7f0 0x7f54d00d0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-05-16T13:53:44.004 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:43.999+0000 7f54ce59c640 1 --2- 172.21.15.39:0/715614554 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54d00cf7f0 0x7f54d00d0250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-05-16T13:53:44.407 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:44.403+0000 7f54ce59c640 1 --2- 172.21.15.39:0/715614554 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54d00cf7f0 0x7f54d00d0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:53:44.407 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:44.403+0000 7f54ce59c640 1 -- 172.21.15.39:0/715614554 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54d00cf7f0 msgr2=0x7f54d00d0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-05-16T13:53:44.407 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:44.403+0000 7f54ce59c640 1 -- 172.21.15.39:0/715614554 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54d00cf7f0 msgr2=0x7f54d00d0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-16T13:53:44.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:44.403+0000 7f54ce59c640 1 --2- 172.21.15.39:0/715614554 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54d00cf7f0 0x7f54d00d0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-05-16T13:53:44.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:44.403+0000 7f54ce59c640 1 --2- 172.21.15.39:0/715614554 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54d00cf7f0 0x7f54d00d0250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-05-16T13:53:45.211 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:45.207+0000 7f54ce59c640 1 --2- 172.21.15.39:0/715614554 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54d00cf7f0 0x7f54d00d0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:53:45.211 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:45.207+0000 7f54ce59c640 1 -- 172.21.15.39:0/715614554 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54d00cf7f0 msgr2=0x7f54d00d0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-05-16T13:53:45.212 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:45.207+0000 7f54ce59c640 1 -- 172.21.15.39:0/715614554 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54d00cf7f0 msgr2=0x7f54d00d0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-16T13:53:45.212 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:45.207+0000 7f54ce59c640 1 --2- 172.21.15.39:0/715614554 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54d00cf7f0 0x7f54d00d0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-05-16T13:53:45.212 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:45.207+0000 7f54ce59c640 1 --2- 172.21.15.39:0/715614554 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54d00cf7f0 0x7f54d00d0250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-05-16T13:53:46.802 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:46.795+0000 7f54ccd99640 1 -- 172.21.15.39:0/715614554 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54d00cf7f0 msgr2=0x7f54d00d0250 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-05-16T13:53:46.802 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:46.795+0000 7f54ccd99640 1 --2- 172.21.15.39:0/715614554 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54d00cf7f0 0x7f54d00d0250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:46.802 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:46.795+0000 7f54ccd99640 1 -- 172.21.15.39:0/715614554 >> v1:172.21.15.118:6789/0 conn(0x7f54d006b440 legacy=0x7f54d00b48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:53:46.803 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:46.795+0000 7f54ccd99640 1 -- 172.21.15.39:0/715614554 >> v1:172.21.15.39:6789/0 conn(0x7f54d00b16a0 legacy=0x7f54d00b4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:53:46.803 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:46.795+0000 7f54ccd99640 1 --2- 172.21.15.39:0/715614554 >> v2:172.21.15.39:3300/0 conn(0x7f54b0003720 0x7f54b0005b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:53:46.803 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:46.795+0000 7f54ccd99640 1 --2- 172.21.15.39:0/715614554 >> v2:172.21.15.118:3300/0 conn(0x7f54b00061c0 0x7f54b0008670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:53:46.803 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:46.795+0000 7f54ccd99640 1 -- 172.21.15.39:0/715614554 --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54d006bc20 con 0x7f54b0003720 2023-05-16T13:53:46.803 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:46.795+0000 7f54ccd99640 1 -- 172.21.15.39:0/715614554 --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54b0008d00 con 0x7f54b00061c0 2023-05-16T13:53:46.803 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:46.795+0000 7f54ce59c640 1 --2- 172.21.15.39:0/715614554 >> v2:172.21.15.39:3300/0 conn(0x7f54b0003720 0x7f54b0005b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:53:46.803 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:46.795+0000 7f54ce59c640 1 -- 172.21.15.39:0/715614554 >> v2:172.21.15.39:3300/0 conn(0x7f54b0003720 msgr2=0x7f54b0005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-05-16T13:53:46.804 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:46.795+0000 7f54ce59c640 1 -- 172.21.15.39:0/715614554 >> v2:172.21.15.39:3300/0 conn(0x7f54b0003720 msgr2=0x7f54b0005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-16T13:53:46.804 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:46.795+0000 7f54ce59c640 1 --2- 172.21.15.39:0/715614554 >> v2:172.21.15.39:3300/0 conn(0x7f54b0003720 0x7f54b0005b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-05-16T13:53:46.804 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:46.795+0000 7f54c7fff640 1 --2- 172.21.15.39:0/715614554 >> v2:172.21.15.118:3300/0 conn(0x7f54b00061c0 0x7f54b0008670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:53:46.804 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:46.795+0000 7f54ce59c640 1 --2- 172.21.15.39:0/715614554 >> v2:172.21.15.39:3300/0 conn(0x7f54b0003720 0x7f54b0005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-05-16T13:53:46.804 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:46.795+0000 7f54c7fff640 1 -- 172.21.15.39:0/715614554 >> v2:172.21.15.118:3300/0 conn(0x7f54b00061c0 msgr2=0x7f54b0008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-05-16T13:53:46.804 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:46.795+0000 7f54c7fff640 1 -- 172.21.15.39:0/715614554 >> v2:172.21.15.118:3300/0 conn(0x7f54b00061c0 msgr2=0x7f54b0008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-16T13:53:46.804 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:46.795+0000 7f54c7fff640 1 --2- 172.21.15.39:0/715614554 >> v2:172.21.15.118:3300/0 conn(0x7f54b00061c0 0x7f54b0008670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-05-16T13:53:46.805 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:46.795+0000 7f54c7fff640 1 --2- 172.21.15.39:0/715614554 >> v2:172.21.15.118:3300/0 conn(0x7f54b00061c0 0x7f54b0008670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-05-16T13:53:47.003 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:46.999+0000 7f54ce59c640 1 --2- 172.21.15.39:0/715614554 >> v2:172.21.15.39:3300/0 conn(0x7f54b0003720 0x7f54b0005b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:53:47.003 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:46.999+0000 7f54c7fff640 1 --2- 172.21.15.39:0/715614554 >> v2:172.21.15.118:3300/0 conn(0x7f54b00061c0 0x7f54b0008670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:53:47.003 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:46.999+0000 7f54ce59c640 1 -- 172.21.15.39:0/715614554 >> v2:172.21.15.39:3300/0 conn(0x7f54b0003720 msgr2=0x7f54b0005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-05-16T13:53:47.004 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:46.999+0000 7f54ce59c640 1 -- 172.21.15.39:0/715614554 >> v2:172.21.15.39:3300/0 conn(0x7f54b0003720 msgr2=0x7f54b0005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-16T13:53:47.004 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:46.999+0000 7f54ce59c640 1 --2- 172.21.15.39:0/715614554 >> v2:172.21.15.39:3300/0 conn(0x7f54b0003720 0x7f54b0005b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-05-16T13:53:47.004 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:46.999+0000 7f54ce59c640 1 --2- 172.21.15.39:0/715614554 >> v2:172.21.15.39:3300/0 conn(0x7f54b0003720 0x7f54b0005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-05-16T13:53:47.004 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:46.999+0000 7f54c7fff640 1 -- 172.21.15.39:0/715614554 >> v2:172.21.15.118:3300/0 conn(0x7f54b00061c0 msgr2=0x7f54b0008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-05-16T13:53:47.004 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:46.999+0000 7f54c7fff640 1 -- 172.21.15.39:0/715614554 >> v2:172.21.15.118:3300/0 conn(0x7f54b00061c0 msgr2=0x7f54b0008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-16T13:53:47.004 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:46.999+0000 7f54c7fff640 1 --2- 172.21.15.39:0/715614554 >> v2:172.21.15.118:3300/0 conn(0x7f54b00061c0 0x7f54b0008670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-05-16T13:53:47.005 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:46.999+0000 7f54c7fff640 1 --2- 172.21.15.39:0/715614554 >> v2:172.21.15.118:3300/0 conn(0x7f54b00061c0 0x7f54b0008670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-05-16T13:53:47.407 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:47.403+0000 7f54ce59c640 1 --2- 172.21.15.39:0/715614554 >> v2:172.21.15.39:3300/0 conn(0x7f54b0003720 0x7f54b0005b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:53:47.407 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:47.403+0000 7f54c7fff640 1 --2- 172.21.15.39:0/715614554 >> v2:172.21.15.118:3300/0 conn(0x7f54b00061c0 0x7f54b0008670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:53:47.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:47.403+0000 7f54ce59c640 1 -- 172.21.15.39:0/715614554 >> v2:172.21.15.39:3300/0 conn(0x7f54b0003720 msgr2=0x7f54b0005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-05-16T13:53:47.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:47.403+0000 7f54ce59c640 1 -- 172.21.15.39:0/715614554 >> v2:172.21.15.39:3300/0 conn(0x7f54b0003720 msgr2=0x7f54b0005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-16T13:53:47.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:47.403+0000 7f54ce59c640 1 --2- 172.21.15.39:0/715614554 >> v2:172.21.15.39:3300/0 conn(0x7f54b0003720 0x7f54b0005b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-05-16T13:53:47.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:47.403+0000 7f54ce59c640 1 --2- 172.21.15.39:0/715614554 >> v2:172.21.15.39:3300/0 conn(0x7f54b0003720 0x7f54b0005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-05-16T13:53:47.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:47.403+0000 7f54c7fff640 1 -- 172.21.15.39:0/715614554 >> v2:172.21.15.118:3300/0 conn(0x7f54b00061c0 msgr2=0x7f54b0008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-05-16T13:53:47.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:47.403+0000 7f54c7fff640 1 -- 172.21.15.39:0/715614554 >> v2:172.21.15.118:3300/0 conn(0x7f54b00061c0 msgr2=0x7f54b0008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-16T13:53:47.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:47.403+0000 7f54c7fff640 1 --2- 172.21.15.39:0/715614554 >> v2:172.21.15.118:3300/0 conn(0x7f54b00061c0 0x7f54b0008670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-05-16T13:53:47.409 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:47.403+0000 7f54c7fff640 1 --2- 172.21.15.39:0/715614554 >> v2:172.21.15.118:3300/0 conn(0x7f54b00061c0 0x7f54b0008670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-05-16T13:53:48.211 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:48.207+0000 7f54ce59c640 1 --2- 172.21.15.39:0/715614554 >> v2:172.21.15.39:3300/0 conn(0x7f54b0003720 0x7f54b0005b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:53:48.212 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:48.207+0000 7f54ce59c640 1 -- 172.21.15.39:0/715614554 >> v2:172.21.15.39:3300/0 conn(0x7f54b0003720 msgr2=0x7f54b0005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-05-16T13:53:48.212 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:48.207+0000 7f54ce59c640 1 -- 172.21.15.39:0/715614554 >> v2:172.21.15.39:3300/0 conn(0x7f54b0003720 msgr2=0x7f54b0005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-16T13:53:48.212 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:48.207+0000 7f54ce59c640 1 --2- 172.21.15.39:0/715614554 >> v2:172.21.15.39:3300/0 conn(0x7f54b0003720 0x7f54b0005b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-05-16T13:53:48.212 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:48.207+0000 7f54c7fff640 1 --2- 172.21.15.39:0/715614554 >> v2:172.21.15.118:3300/0 conn(0x7f54b00061c0 0x7f54b0008670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:53:48.212 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:48.207+0000 7f54ce59c640 1 --2- 172.21.15.39:0/715614554 >> v2:172.21.15.39:3300/0 conn(0x7f54b0003720 0x7f54b0005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-05-16T13:53:48.212 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:48.207+0000 7f54c7fff640 1 -- 172.21.15.39:0/715614554 >> v2:172.21.15.118:3300/0 conn(0x7f54b00061c0 msgr2=0x7f54b0008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-05-16T13:53:48.213 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:48.207+0000 7f54c7fff640 1 -- 172.21.15.39:0/715614554 >> v2:172.21.15.118:3300/0 conn(0x7f54b00061c0 msgr2=0x7f54b0008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-16T13:53:48.213 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:48.207+0000 7f54c7fff640 1 --2- 172.21.15.39:0/715614554 >> v2:172.21.15.118:3300/0 conn(0x7f54b00061c0 0x7f54b0008670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-05-16T13:53:48.213 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:48.207+0000 7f54c7fff640 1 --2- 172.21.15.39:0/715614554 >> v2:172.21.15.118:3300/0 conn(0x7f54b00061c0 0x7f54b0008670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-05-16T13:53:49.802 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:49.795+0000 7f54ccd99640 1 -- 172.21.15.39:0/715614554 >> v2:172.21.15.118:3300/0 conn(0x7f54b00061c0 msgr2=0x7f54b0008670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-05-16T13:53:49.802 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:49.795+0000 7f54ccd99640 1 --2- 172.21.15.39:0/715614554 >> v2:172.21.15.118:3300/0 conn(0x7f54b00061c0 0x7f54b0008670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:49.803 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:49.795+0000 7f54ccd99640 1 -- 172.21.15.39:0/715614554 >> v2:172.21.15.39:3300/0 conn(0x7f54b0003720 msgr2=0x7f54b0005b70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-05-16T13:53:49.803 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:49.795+0000 7f54ccd99640 1 --2- 172.21.15.39:0/715614554 >> v2:172.21.15.39:3300/0 conn(0x7f54b0003720 0x7f54b0005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:49.803 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:49.795+0000 7f54ced9d640 1 -- 172.21.15.39:0/715614554 reap_dead start 2023-05-16T13:53:49.803 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:49.795+0000 7f54ccd99640 1 --2- 172.21.15.39:0/715614554 >> v2:172.21.15.39:3300/0 conn(0x7f54b0003b60 0x7f54b0006660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:53:49.803 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:49.795+0000 7f54ccd99640 1 --2- 172.21.15.39:0/715614554 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54b0006ba0 0x7f54b0007010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:53:49.803 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:49.795+0000 7f54ccd99640 1 -- 172.21.15.39:0/715614554 --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54d00af240 con 0x7f54d00b16a0 2023-05-16T13:53:49.803 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:49.795+0000 7f54ccd99640 1 -- 172.21.15.39:0/715614554 --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54d006bc20 con 0x7f54b0003b60 2023-05-16T13:53:49.803 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:49.795+0000 7f54ccd99640 1 -- 172.21.15.39:0/715614554 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54b0008d00 con 0x7f54b0006ba0 2023-05-16T13:53:49.804 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:49.795+0000 7f54c7fff640 1 --2- 172.21.15.39:0/715614554 >> v2:172.21.15.39:3300/0 conn(0x7f54b0003b60 0x7f54b0006660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:53:49.804 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:49.795+0000 7f54ced9d640 1 --2- 172.21.15.39:0/715614554 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54b0006ba0 0x7f54b0007010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:53:49.804 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:49.799+0000 7f54c7fff640 1 -- 172.21.15.39:0/715614554 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54b0006ba0 msgr2=0x7f54b0007010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:53:49.805 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:49.799+0000 7f54c7fff640 1 --2- 172.21.15.39:0/715614554 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54b0006ba0 0x7f54b0007010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:49.805 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:49.799+0000 7f54c7fff640 1 -- 172.21.15.39:0/715614554 >> v1:172.21.15.39:6789/0 conn(0x7f54d00b16a0 legacy=0x7f54b000b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:53:49.805 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:49.799+0000 7f54c7fff640 1 -- 172.21.15.39:0/715614554 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b00087a0 con 0x7f54b0003b60 2023-05-16T13:53:49.805 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:49.799+0000 7f54cdd9b640 1 -- 172.21.15.39:0/715614554 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 451222337 0 0) 0x7f54d00af240 con 0x7f54d00b16a0 2023-05-16T13:53:49.806 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:49.799+0000 7f54c7fff640 1 --2- 172.21.15.39:0/715614554 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f54b0003b60 0x7f54b0006660 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f54b8007d30 tx=0x7f54b801cfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6facc4be309fd3b7 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:53:49.807 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:49.799+0000 7f54cdd9b640 1 -- 172.21.15.39:0/715614554 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b80a5e70 con 0x7f54b0003b60 2023-05-16T13:53:49.807 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:49.799+0000 7f54cdd9b640 1 -- 172.21.15.39:0/715614554 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54b80a9070 con 0x7f54b0003b60 2023-05-16T13:53:49.807 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:49.799+0000 7f54cdd9b640 1 -- 172.21.15.39:0/715614554 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b80af660 con 0x7f54b0003b60 2023-05-16T13:53:49.809 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:49.803+0000 7f54cf59e640 1 -- 172.21.15.39:0/715614554 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f54b0003b60 msgr2=0x7f54b0006660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:53:49.809 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:49.803+0000 7f54cf59e640 1 --2- 172.21.15.39:0/715614554 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f54b0003b60 0x7f54b0006660 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f54b8007d30 tx=0x7f54b801cfd0 comp rx=0 tx=0).stop 2023-05-16T13:53:49.809 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:49.803+0000 7f54cf59e640 1 -- 172.21.15.39:0/715614554 shutdown_connections 2023-05-16T13:53:49.810 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:49.803+0000 7f54cf59e640 1 --2- 172.21.15.39:0/715614554 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54b0006ba0 0x7f54b0007010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:49.810 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:49.803+0000 7f54cf59e640 1 --2- 172.21.15.39:0/715614554 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f54b0003b60 0x7f54b0006660 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:49.810 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:49.803+0000 7f54cf59e640 1 -- 172.21.15.39:0/715614554 >> 172.21.15.39:0/715614554 conn(0x7f54d0071aa0 msgr2=0x7f54d009b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:53:49.810 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:49.803+0000 7f54cf59e640 1 -- 172.21.15.39:0/715614554 shutdown_connections 2023-05-16T13:53:49.810 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:49.803+0000 7f54cf59e640 1 -- 172.21.15.39:0/715614554 wait complete. 2023-05-16T13:53:49.812 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:49.803+0000 7f54cf59e640 1 Processor -- start 2023-05-16T13:53:49.812 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:49.803+0000 7f54cf59e640 1 -- start start 2023-05-16T13:53:49.812 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:49.803+0000 7f54cf59e640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54b0003b60 0x7f54d00cba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:53:49.812 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:49.807+0000 7f54cf59e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f54b0006ba0 0x7f54d0158f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:53:49.812 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:49.807+0000 7f54cf59e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f54d00b16a0 0x7f54d00b7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:53:49.812 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:49.807+0000 7f54cf59e640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d00b6010 con 0x7f54b0006ba0 2023-05-16T13:53:49.813 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:49.807+0000 7f54cf59e640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d00cbfd0 con 0x7f54d00b16a0 2023-05-16T13:53:49.813 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:49.807+0000 7f54cf59e640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54d01f90e0 con 0x7f54b0003b60 2023-05-16T13:53:49.813 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:49.807+0000 7f54c7fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f54b0006ba0 0x7f54d0158f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:53:49.813 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:49.807+0000 7f54c7fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f54b0006ba0 0x7f54d0158f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33692/0 (socket says 172.21.15.39:33692) 2023-05-16T13:53:49.813 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:49.807+0000 7f54c7fff640 1 -- 172.21.15.39:0/2429693838 learned_addr learned my addr 172.21.15.39:0/2429693838 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:53:49.813 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:49.807+0000 7f54ce59c640 1 --2- 172.21.15.39:0/2429693838 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54b0003b60 0x7f54d00cba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:53:49.813 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:49.807+0000 7f54ced9d640 1 --2- 172.21.15.39:0/2429693838 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f54d00b16a0 0x7f54d00b7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:53:49.814 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:49.807+0000 7f54c7fff640 1 -- 172.21.15.39:0/2429693838 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54b0003b60 msgr2=0x7f54d00cba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:53:49.814 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:49.807+0000 7f54c7fff640 1 --2- 172.21.15.39:0/2429693838 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54b0003b60 0x7f54d00cba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:49.814 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:49.807+0000 7f54c7fff640 1 -- 172.21.15.39:0/2429693838 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f54d00b16a0 msgr2=0x7f54d00b7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:53:49.814 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:49.807+0000 7f54c7fff640 1 --2- 172.21.15.39:0/2429693838 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f54d00b16a0 0x7f54d00b7a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:49.814 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:49.807+0000 7f54c7fff640 1 -- 172.21.15.39:0/2429693838 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b800f040 con 0x7f54b0006ba0 2023-05-16T13:53:49.814 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:49.807+0000 7f54c7fff640 1 --2- 172.21.15.39:0/2429693838 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f54b0006ba0 0x7f54d0158f30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f54b8000c10 tx=0x7f54b8019d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:53:49.815 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:49.807+0000 7f54c6ffd640 1 -- 172.21.15.39:0/2429693838 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b8005240 con 0x7f54b0006ba0 2023-05-16T13:53:49.815 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:49.807+0000 7f54c6ffd640 1 -- 172.21.15.39:0/2429693838 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54b80053a0 con 0x7f54b0006ba0 2023-05-16T13:53:49.815 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:49.807+0000 7f54c6ffd640 1 -- 172.21.15.39:0/2429693838 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b8005750 con 0x7f54b0006ba0 2023-05-16T13:53:49.815 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:49.807+0000 7f54cf59e640 1 -- 172.21.15.39:0/2429693838 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54d00b4320 con 0x7f54b0006ba0 2023-05-16T13:53:49.816 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:49.807+0000 7f54cf59e640 1 -- 172.21.15.39:0/2429693838 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54d00b4190 con 0x7f54b0006ba0 2023-05-16T13:53:49.816 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:49.807+0000 7f54c6ffd640 1 -- 172.21.15.39:0/2429693838 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f54b80ba770 con 0x7f54b0006ba0 2023-05-16T13:53:49.816 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:49.807+0000 7f54c6ffd640 1 -- 172.21.15.39:0/2429693838 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f54b80c3610 con 0x7f54b0006ba0 2023-05-16T13:53:49.816 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:49.807+0000 7f54cf59e640 1 -- 172.21.15.39:0/2429693838 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54d00b44b0 con 0x7f54b0006ba0 2023-05-16T13:53:49.820 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:49.815+0000 7f54c6ffd640 1 -- 172.21.15.39:0/2429693838 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f54b80be020 con 0x7f54b0006ba0 2023-05-16T13:53:49.884 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:49.879+0000 7f54cf59e640 1 -- 172.21.15.39:0/2429693838 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f54d004ed20 con 0x7f54b0006ba0 2023-05-16T13:53:49.894 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:49.887+0000 7f54c6ffd640 1 -- 172.21.15.39:0/2429693838 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f54b80d0020 con 0x7f54b0006ba0 2023-05-16T13:53:49.894 INFO:teuthology.orchestra.run.smithi039.stderr:adjusted tunables profile to default 2023-05-16T13:53:49.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:49.891+0000 7f54cf59e640 1 -- 172.21.15.39:0/2429693838 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f54b0006ba0 msgr2=0x7f54d0158f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:53:49.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:49.891+0000 7f54cf59e640 1 --2- 172.21.15.39:0/2429693838 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f54b0006ba0 0x7f54d0158f30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f54b8000c10 tx=0x7f54b8019d70 comp rx=0 tx=0).stop 2023-05-16T13:53:49.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:49.891+0000 7f54cf59e640 1 -- 172.21.15.39:0/2429693838 shutdown_connections 2023-05-16T13:53:49.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:49.891+0000 7f54cf59e640 1 --2- 172.21.15.39:0/2429693838 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f54d00b16a0 0x7f54d00b7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:49.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:49.891+0000 7f54cf59e640 1 --2- 172.21.15.39:0/2429693838 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f54b0006ba0 0x7f54d0158f30 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:49.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:49.891+0000 7f54cf59e640 1 --2- 172.21.15.39:0/2429693838 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f54b0003b60 0x7f54d00cba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:49.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:49.891+0000 7f54cf59e640 1 -- 172.21.15.39:0/2429693838 >> 172.21.15.39:0/2429693838 conn(0x7f54d0071aa0 msgr2=0x7f54d00b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:53:49.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:49.891+0000 7f54cf59e640 1 -- 172.21.15.39:0/2429693838 shutdown_connections 2023-05-16T13:53:49.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:49.891+0000 7f54cf59e640 1 -- 172.21.15.39:0/2429693838 wait complete. 2023-05-16T13:53:49.916 INFO:tasks.ceph:check_enable_crimson: False 2023-05-16T13:53:49.916 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-05-16T13:53:49.916 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-05-16T13:53:49.916 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-05-16T13:53:49.936 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-05-16T13:53:49.937 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-05-16T13:53:49.989 INFO:tasks.ceph.mgr.y.smithi039.stderr:2023-05-16T13:53:49.983+0000 7f09e8dff180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-05-16T13:53:49.997 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-05-16T13:53:49.997 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-05-16T13:53:50.046 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-05-16T13:53:50.039+0000 7fd9fd3e4180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-05-16T13:53:50.057 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-05-16T13:53:50.057 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-05-16T13:53:50.116 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-05-16T13:53:50.117 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-05-16T13:53:50.135 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-05-16T13:53:50.136 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-05-16T13:53:50.196 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-05-16T13:53:50.197 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-05-16T13:53:50.256 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-05-16T13:53:50.256 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-05-16T13:53:50.316 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd new 4ce0f0ba-c4bf-4405-8c95-d2e9a62878ae 0 2023-05-16T13:53:50.488 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.483+0000 7f15653a6640 1 Processor -- start 2023-05-16T13:53:50.489 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.483+0000 7f15653a6640 1 -- start start 2023-05-16T13:53:50.490 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.483+0000 7f15653a6640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f15600d0890 0x7f15600afba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:53:50.490 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.483+0000 7f15653a6640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f156006c610 con 0x7f15600d0410 2023-05-16T13:53:50.490 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.483+0000 7f15653a6640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f156006caa0 con 0x7f15600b10a0 2023-05-16T13:53:50.491 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.483+0000 7f15653a6640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f156006ba00 con 0x7f15600d0890 2023-05-16T13:53:50.491 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.483+0000 7f155f7fe640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f15600d0890 0x7f15600afba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:53:50.491 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.483+0000 7f155effd640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f15600b10a0 0x7f15600d2990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:44090/0 (socket says 172.21.15.118:44090) 2023-05-16T13:53:50.491 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.483+0000 7f155f7fe640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f15600d0890 0x7f15600afba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41910/0 (socket says 172.21.15.118:41910) 2023-05-16T13:53:50.491 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.487+0000 7f155effd640 1 -- 172.21.15.118:0/1210885671 learned_addr learned my addr 172.21.15.118:0/1210885671 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-05-16T13:53:50.492 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.483+0000 7f155e7fc640 1 --1- 172.21.15.118:0/1210885671 >> v1:172.21.15.39:6789/0 conn(0x7f15600d0410 0x7f15600af490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.118:52102/0 (socket says 172.21.15.118:52102) 2023-05-16T13:53:50.492 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.487+0000 7f155f7fe640 1 -- 172.21.15.118:0/1210885671 >> v1:172.21.15.118:6789/0 conn(0x7f15600b10a0 legacy=0x7f15600d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:53:50.492 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.487+0000 7f155f7fe640 1 -- 172.21.15.118:0/1210885671 >> v1:172.21.15.39:6789/0 conn(0x7f15600d0410 legacy=0x7f15600af490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:53:50.492 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.487+0000 7f155f7fe640 1 -- 172.21.15.118:0/1210885671 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f156006bce0 con 0x7f15600d0890 2023-05-16T13:53:50.493 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.487+0000 7f155f7fe640 1 --2- 172.21.15.118:0/1210885671 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f15600d0890 0x7f15600afba0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1558009d90 tx=0x7f155801c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d5499f2653d4ffd server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:53:50.494 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.487+0000 7f155dffb640 1 -- 172.21.15.118:0/1210885671 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15580a59e0 con 0x7f15600d0890 2023-05-16T13:53:50.494 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.487+0000 7f155dffb640 1 -- 172.21.15.118:0/1210885671 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15580a5b40 con 0x7f15600d0890 2023-05-16T13:53:50.494 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.487+0000 7f155dffb640 1 -- 172.21.15.118:0/1210885671 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15580ad440 con 0x7f15600d0890 2023-05-16T13:53:50.495 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.491+0000 7f15653a6640 1 -- 172.21.15.118:0/1210885671 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f15600d0890 msgr2=0x7f15600afba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:53:50.495 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.491+0000 7f15653a6640 1 --2- 172.21.15.118:0/1210885671 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f15600d0890 0x7f15600afba0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1558009d90 tx=0x7f155801c920 comp rx=0 tx=0).stop 2023-05-16T13:53:50.495 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.491+0000 7f15653a6640 1 -- 172.21.15.118:0/1210885671 shutdown_connections 2023-05-16T13:53:50.495 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.491+0000 7f15653a6640 1 --2- 172.21.15.118:0/1210885671 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f15600d0890 0x7f15600afba0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:50.496 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.491+0000 7f15653a6640 1 -- 172.21.15.118:0/1210885671 >> 172.21.15.118:0/1210885671 conn(0x7f156009bba0 msgr2=0x7f1560089fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:53:50.496 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.491+0000 7f15653a6640 1 -- 172.21.15.118:0/1210885671 shutdown_connections 2023-05-16T13:53:50.496 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.491+0000 7f15653a6640 1 -- 172.21.15.118:0/1210885671 wait complete. 2023-05-16T13:53:50.497 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.491+0000 7f15653a6640 1 Processor -- start 2023-05-16T13:53:50.498 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.491+0000 7f15653a6640 1 -- start start 2023-05-16T13:53:50.499 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.495+0000 7f15653a6640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f15600b10a0 0x7f15600c92a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:53:50.500 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.495+0000 7f15653a6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f15600d0410 0x7f15600c6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:53:50.500 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.495+0000 7f15653a6640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f15600d0890 0x7f15601579e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:53:50.500 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.495+0000 7f15653a6640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15600c83b0 con 0x7f15600d0410 2023-05-16T13:53:50.500 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.495+0000 7f15653a6640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15600c7500 con 0x7f15600d0890 2023-05-16T13:53:50.500 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.495+0000 7f15653a6640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15600c77a0 con 0x7f15600b10a0 2023-05-16T13:53:50.500 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.495+0000 7f155f7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f15600d0890 0x7f15601579e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:53:50.500 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.495+0000 7f155effd640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f15600b10a0 0x7f15600c92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:53:50.501 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.495+0000 7f155f7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f15600d0890 0x7f15601579e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41920/0 (socket says 172.21.15.118:41920) 2023-05-16T13:53:50.501 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.495+0000 7f155f7fe640 1 -- 172.21.15.118:0/2175810873 learned_addr learned my addr 172.21.15.118:0/2175810873 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-05-16T13:53:50.501 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.495+0000 7f155e7fc640 1 --2- 172.21.15.118:0/2175810873 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f15600d0410 0x7f15600c6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:53:50.502 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.495+0000 7f155f7fe640 1 -- 172.21.15.118:0/2175810873 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f15600b10a0 msgr2=0x7f15600c92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:53:50.502 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.495+0000 7f155f7fe640 1 --2- 172.21.15.118:0/2175810873 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f15600b10a0 0x7f15600c92a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:50.502 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.495+0000 7f155f7fe640 1 -- 172.21.15.118:0/2175810873 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f15600d0410 msgr2=0x7f15600c6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:53:50.502 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.495+0000 7f155f7fe640 1 --2- 172.21.15.118:0/2175810873 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f15600d0410 0x7f15600c6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:50.503 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.495+0000 7f155f7fe640 1 -- 172.21.15.118:0/2175810873 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1558009a70 con 0x7f15600d0890 2023-05-16T13:53:50.503 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.495+0000 7f155effd640 1 --2- 172.21.15.118:0/2175810873 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f15600b10a0 0x7f15600c92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-16T13:53:50.503 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.495+0000 7f155f7fe640 1 --2- 172.21.15.118:0/2175810873 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f15600d0890 0x7f15601579e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f155801a550 tx=0x7f15580196c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:53:50.503 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.495+0000 7f15477fe640 1 -- 172.21.15.118:0/2175810873 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15580addc0 con 0x7f15600d0890 2023-05-16T13:53:50.503 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.495+0000 7f15477fe640 1 -- 172.21.15.118:0/2175810873 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15580b9450 con 0x7f15600d0890 2023-05-16T13:53:50.503 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.495+0000 7f15653a6640 1 -- 172.21.15.118:0/2175810873 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15600b1470 con 0x7f15600d0890 2023-05-16T13:53:50.503 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.495+0000 7f15477fe640 1 -- 172.21.15.118:0/2175810873 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15580b97e0 con 0x7f15600d0890 2023-05-16T13:53:50.503 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.495+0000 7f15653a6640 1 -- 172.21.15.118:0/2175810873 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15600b04f0 con 0x7f15600d0890 2023-05-16T13:53:50.504 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.495+0000 7f15477fe640 1 -- 172.21.15.118:0/2175810873 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f15580b9c40 con 0x7f15600d0890 2023-05-16T13:53:50.504 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.495+0000 7f15477fe640 1 -- 172.21.15.118:0/2175810873 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f15580c4be0 con 0x7f15600d0890 2023-05-16T13:53:50.504 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.495+0000 7f15653a6640 1 -- 172.21.15.118:0/2175810873 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15600d30a0 con 0x7f15600d0890 2023-05-16T13:53:50.508 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.503+0000 7f15477fe640 1 -- 172.21.15.118:0/2175810873 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f15580b2070 con 0x7f15600d0890 2023-05-16T13:53:50.567 INFO:tasks.ceph.mgr.y.smithi039.stderr:2023-05-16T13:53:50.563+0000 7f09e8dff180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-16T13:53:50.573 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.567+0000 7f15653a6640 1 -- 172.21.15.118:0/2175810873 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4ce0f0ba-c4bf-4405-8c95-d2e9a62878ae", "id": 0} v 0) v1 -- 0x7f15600c8520 con 0x7f15600d0890 2023-05-16T13:53:50.586 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.579+0000 7f15477fe640 1 -- 172.21.15.118:0/2175810873 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4ce0f0ba-c4bf-4405-8c95-d2e9a62878ae", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f15580c4da0 con 0x7f15600d0890 2023-05-16T13:53:50.586 INFO:teuthology.orchestra.run.smithi118.stdout:0 2023-05-16T13:53:50.587 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.583+0000 7f15653a6640 1 -- 172.21.15.118:0/2175810873 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f15600d0890 msgr2=0x7f15601579e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:53:50.587 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.583+0000 7f15653a6640 1 --2- 172.21.15.118:0/2175810873 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f15600d0890 0x7f15601579e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f155801a550 tx=0x7f15580196c0 comp rx=0 tx=0).stop 2023-05-16T13:53:50.588 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.583+0000 7f15653a6640 1 -- 172.21.15.118:0/2175810873 shutdown_connections 2023-05-16T13:53:50.588 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.583+0000 7f15653a6640 1 --2- 172.21.15.118:0/2175810873 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f15600d0890 0x7f15601579e0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:50.588 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.583+0000 7f15653a6640 1 --2- 172.21.15.118:0/2175810873 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f15600d0410 0x7f15600c6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:50.588 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.583+0000 7f15653a6640 1 --2- 172.21.15.118:0/2175810873 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f15600b10a0 0x7f15600c92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:50.588 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.583+0000 7f15653a6640 1 -- 172.21.15.118:0/2175810873 >> 172.21.15.118:0/2175810873 conn(0x7f156009bba0 msgr2=0x7f15600b7dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:53:50.588 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.583+0000 7f15653a6640 1 -- 172.21.15.118:0/2175810873 shutdown_connections 2023-05-16T13:53:50.589 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.583+0000 7f15653a6640 1 -- 172.21.15.118:0/2175810873 wait complete. 2023-05-16T13:53:50.605 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd new 53fdc1ac-2473-472d-af32-2760fdf6e476 1 2023-05-16T13:53:50.609 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-05-16T13:53:50.603+0000 7fd9fd3e4180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-16T13:53:50.736 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.731+0000 7f85a8474640 1 Processor -- start 2023-05-16T13:53:50.736 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.731+0000 7f85a8474640 1 -- start start 2023-05-16T13:53:50.737 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.731+0000 7f85a8474640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f85a00d0410 0x7f85a00d0860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:53:50.737 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.731+0000 7f85a8474640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85a00d0da0 con 0x7f85a00b10a0 2023-05-16T13:53:50.737 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.731+0000 7f85a8474640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85a006c610 con 0x7f85a00af490 2023-05-16T13:53:50.738 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.731+0000 7f85a8474640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85a006caa0 con 0x7f85a00d0410 2023-05-16T13:53:50.738 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.731+0000 7f85a5a0f640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f85a00d0410 0x7f85a00d0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:53:50.738 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.731+0000 7f85a6a11640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f85a00af490 0x7f85a00af8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:44092/0 (socket says 172.21.15.118:44092) 2023-05-16T13:53:50.738 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.731+0000 7f85a6a11640 1 -- 172.21.15.118:0/3096345008 learned_addr learned my addr 172.21.15.118:0/3096345008 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-05-16T13:53:50.739 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.731+0000 7f85a520e640 1 -- 172.21.15.118:0/3096345008 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3127827657 0 0) 0x7f85a006c610 con 0x7f85a00af490 2023-05-16T13:53:50.739 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.731+0000 7f85a5a0f640 1 -- 172.21.15.118:0/3096345008 >> v1:172.21.15.118:6789/0 conn(0x7f85a00af490 legacy=0x7f85a00af8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:53:50.739 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.731+0000 7f85a5a0f640 1 -- 172.21.15.118:0/3096345008 >> v1:172.21.15.39:6789/0 conn(0x7f85a00b10a0 legacy=0x7f85a00d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:53:50.739 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.731+0000 7f85a5a0f640 1 -- 172.21.15.118:0/3096345008 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a006ba00 con 0x7f85a00d0410 2023-05-16T13:53:50.741 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.735+0000 7f85a5a0f640 1 --2- 172.21.15.118:0/3096345008 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f85a00d0410 0x7f85a00d0860 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f859c0097f0 tx=0x7f859c01c320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a20781faadb1754d server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:53:50.741 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.735+0000 7f85a520e640 1 -- 172.21.15.118:0/3096345008 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f859c0ab600 con 0x7f85a00d0410 2023-05-16T13:53:50.741 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.735+0000 7f85a520e640 1 -- 172.21.15.118:0/3096345008 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f859c0a7050 con 0x7f85a00d0410 2023-05-16T13:53:50.741 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.735+0000 7f85a520e640 1 -- 172.21.15.118:0/3096345008 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f859c0ab980 con 0x7f85a00d0410 2023-05-16T13:53:50.742 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.735+0000 7f85a8474640 1 -- 172.21.15.118:0/3096345008 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f85a00d0410 msgr2=0x7f85a00d0860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:53:50.742 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.735+0000 7f85a8474640 1 --2- 172.21.15.118:0/3096345008 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f85a00d0410 0x7f85a00d0860 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f859c0097f0 tx=0x7f859c01c320 comp rx=0 tx=0).stop 2023-05-16T13:53:50.742 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.735+0000 7f85a8474640 1 -- 172.21.15.118:0/3096345008 shutdown_connections 2023-05-16T13:53:50.742 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.735+0000 7f85a8474640 1 --2- 172.21.15.118:0/3096345008 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f85a00d0410 0x7f85a00d0860 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:50.742 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.735+0000 7f85a8474640 1 -- 172.21.15.118:0/3096345008 >> 172.21.15.118:0/3096345008 conn(0x7f85a009bba0 msgr2=0x7f85a0089fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:53:50.743 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.735+0000 7f85a8474640 1 -- 172.21.15.118:0/3096345008 shutdown_connections 2023-05-16T13:53:50.743 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.735+0000 7f85a8474640 1 -- 172.21.15.118:0/3096345008 wait complete. 2023-05-16T13:53:50.743 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.739+0000 7f85a8474640 1 Processor -- start 2023-05-16T13:53:50.743 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.739+0000 7f85a8474640 1 -- start start 2023-05-16T13:53:50.744 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.739+0000 7f85a8474640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85a00af490 0x7f85a00b3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:53:50.745 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.739+0000 7f85a8474640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f85a00b10a0 0x7f85a00b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:53:50.745 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.739+0000 7f85a8474640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85a00d0410 0x7f85a015d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:53:50.745 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.739+0000 7f85a8474640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a00c4f30 con 0x7f85a00af490 2023-05-16T13:53:50.745 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.739+0000 7f85a8474640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a00c55b0 con 0x7f85a00d0410 2023-05-16T13:53:50.745 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.739+0000 7f85a8474640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85a00c43b0 con 0x7f85a00b10a0 2023-05-16T13:53:50.745 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.739+0000 7f85a5a0f640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f85a00b10a0 0x7f85a00b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:53:50.745 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.739+0000 7f85a6210640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85a00af490 0x7f85a00b3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:53:50.746 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.739+0000 7f85a5a0f640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f85a00b10a0 0x7f85a00b36a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.118:49356/0 (socket says 172.21.15.118:49356) 2023-05-16T13:53:50.746 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.739+0000 7f85a5a0f640 1 -- 172.21.15.118:0/4049321133 learned_addr learned my addr 172.21.15.118:0/4049321133 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-05-16T13:53:50.746 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.739+0000 7f85a6a11640 1 --2- 172.21.15.118:0/4049321133 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85a00d0410 0x7f85a015d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:53:50.747 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.739+0000 7f85a5a0f640 1 -- 172.21.15.118:0/4049321133 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85a00d0410 msgr2=0x7f85a015d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:53:50.747 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.739+0000 7f85a5a0f640 1 --2- 172.21.15.118:0/4049321133 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85a00d0410 0x7f85a015d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:50.747 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.739+0000 7f85a5a0f640 1 -- 172.21.15.118:0/4049321133 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85a00af490 msgr2=0x7f85a00b3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:53:50.747 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.739+0000 7f85a5a0f640 1 --2- 172.21.15.118:0/4049321133 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85a00af490 0x7f85a00b3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:50.748 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.739+0000 7f85a5a0f640 1 -- 172.21.15.118:0/4049321133 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f859c009420 con 0x7f85a00b10a0 2023-05-16T13:53:50.748 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.739+0000 7f85a5a0f640 1 --2- 172.21.15.118:0/4049321133 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f85a00b10a0 0x7f85a00b36a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f859c019f50 tx=0x7f859c01ab60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:53:50.748 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.739+0000 7f8596ffd640 1 -- 172.21.15.118:0/4049321133 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f859c0b7650 con 0x7f85a00b10a0 2023-05-16T13:53:50.748 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.739+0000 7f8596ffd640 1 -- 172.21.15.118:0/4049321133 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f859c0b77d0 con 0x7f85a00b10a0 2023-05-16T13:53:50.748 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.739+0000 7f85a8474640 1 -- 172.21.15.118:0/4049321133 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85a00b1470 con 0x7f85a00b10a0 2023-05-16T13:53:50.748 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.739+0000 7f8596ffd640 1 -- 172.21.15.118:0/4049321133 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f859c0b7b80 con 0x7f85a00b10a0 2023-05-16T13:53:50.748 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.739+0000 7f85a8474640 1 -- 172.21.15.118:0/4049321133 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85a006c2a0 con 0x7f85a00b10a0 2023-05-16T13:53:50.749 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.739+0000 7f8596ffd640 1 -- 172.21.15.118:0/4049321133 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f859c0c2460 con 0x7f85a00b10a0 2023-05-16T13:53:50.749 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.739+0000 7f8596ffd640 1 -- 172.21.15.118:0/4049321133 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f859c0b57b0 con 0x7f85a00b10a0 2023-05-16T13:53:50.749 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.743+0000 7f85a8474640 1 -- 172.21.15.118:0/4049321133 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85a00d30a0 con 0x7f85a00b10a0 2023-05-16T13:53:50.750 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.743+0000 7f8596ffd640 1 -- 172.21.15.118:0/4049321133 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f859c0b0070 con 0x7f85a00b10a0 2023-05-16T13:53:50.779 INFO:tasks.ceph.mgr.y.smithi039.stderr:2023-05-16T13:53:50.775+0000 7f09e8dff180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-16T13:53:50.804 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-05-16T13:53:50.799+0000 7fd9fd3e4180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-16T13:53:50.816 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.811+0000 7f85a8474640 1 -- 172.21.15.118:0/4049321133 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd new", "uuid": "53fdc1ac-2473-472d-af32-2760fdf6e476", "id": 1} v 0) v1 -- 0x7f85a015ad10 con 0x7f85a00b10a0 2023-05-16T13:53:50.829 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.823+0000 7f8596ffd640 1 -- 172.21.15.118:0/4049321133 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "53fdc1ac-2473-472d-af32-2760fdf6e476", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f859c0b5970 con 0x7f85a00b10a0 2023-05-16T13:53:50.829 INFO:teuthology.orchestra.run.smithi118.stdout:1 2023-05-16T13:53:50.830 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.823+0000 7f85a8474640 1 -- 172.21.15.118:0/4049321133 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f85a00b10a0 msgr2=0x7f85a00b36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:53:50.830 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.823+0000 7f85a8474640 1 --2- 172.21.15.118:0/4049321133 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f85a00b10a0 0x7f85a00b36a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f859c019f50 tx=0x7f859c01ab60 comp rx=0 tx=0).stop 2023-05-16T13:53:50.831 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.823+0000 7f85a8474640 1 -- 172.21.15.118:0/4049321133 shutdown_connections 2023-05-16T13:53:50.831 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.823+0000 7f85a8474640 1 --2- 172.21.15.118:0/4049321133 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f85a00b10a0 0x7f85a00b36a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:50.831 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.823+0000 7f85a8474640 1 --2- 172.21.15.118:0/4049321133 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85a00d0410 0x7f85a015d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:50.831 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.823+0000 7f85a8474640 1 --2- 172.21.15.118:0/4049321133 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85a00af490 0x7f85a00b3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:50.831 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.823+0000 7f85a8474640 1 -- 172.21.15.118:0/4049321133 >> 172.21.15.118:0/4049321133 conn(0x7f85a009bba0 msgr2=0x7f85a00b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:53:50.831 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.823+0000 7f85a8474640 1 -- 172.21.15.118:0/4049321133 shutdown_connections 2023-05-16T13:53:50.831 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:50.823+0000 7f85a8474640 1 -- 172.21.15.118:0/4049321133 wait complete. 2023-05-16T13:53:50.848 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd new 0b92d770-7030-42fa-a19f-4f7f1ac113c6 2 2023-05-16T13:53:51.024 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.019+0000 7fb8bba8c640 1 Processor -- start 2023-05-16T13:53:51.024 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.019+0000 7fb8bba8c640 1 -- start start 2023-05-16T13:53:51.025 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.019+0000 7fb8bba8c640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb8b40b10a0 0x7fb8b40d2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:53:51.026 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.019+0000 7fb8bba8c640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fb8b40d0b20 0x7fb8b40af490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:53:51.026 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.019+0000 7fb8bba8c640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8b406c610 con 0x7fb8b40d2ed0 2023-05-16T13:53:51.026 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.019+0000 7fb8bba8c640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8b406caa0 con 0x7fb8b40d0b20 2023-05-16T13:53:51.026 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.019+0000 7fb8bba8c640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b406ba00 con 0x7fb8b40b10a0 2023-05-16T13:53:51.026 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.019+0000 7fb8b9828640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb8b40b10a0 0x7fb8b40d2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:53:51.026 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.019+0000 7fb8b9828640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb8b40b10a0 0x7fb8b40d2990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.118:49362/0 (socket says 172.21.15.118:49362) 2023-05-16T13:53:51.026 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.019+0000 7fb8b9828640 1 -- 172.21.15.118:0/3924892143 learned_addr learned my addr 172.21.15.118:0/3924892143 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-05-16T13:53:51.027 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.019+0000 7fb8ba029640 1 --2- 172.21.15.118:0/3924892143 >> v2:172.21.15.39:3300/0 conn(0x7fb8b40d0b20 0x7fb8b40af490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:53:51.027 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.019+0000 7fb8b9828640 1 -- 172.21.15.118:0/3924892143 >> v2:172.21.15.39:3300/0 conn(0x7fb8b40d0b20 msgr2=0x7fb8b40af490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:53:51.027 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.019+0000 7fb8b9828640 1 --2- 172.21.15.118:0/3924892143 >> v2:172.21.15.39:3300/0 conn(0x7fb8b40d0b20 0x7fb8b40af490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:51.027 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.019+0000 7fb8b9828640 1 -- 172.21.15.118:0/3924892143 >> v1:172.21.15.39:6789/0 conn(0x7fb8b40d2ed0 legacy=0x7fb8b40d0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:53:51.028 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.019+0000 7fb8b9828640 1 -- 172.21.15.118:0/3924892143 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b406bce0 con 0x7fb8b40b10a0 2023-05-16T13:53:51.028 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.019+0000 7fb8ba029640 1 --2- 172.21.15.118:0/3924892143 >> v2:172.21.15.39:3300/0 conn(0x7fb8b40d0b20 0x7fb8b40af490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-16T13:53:51.029 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.023+0000 7fb8b9828640 1 --2- 172.21.15.118:0/3924892143 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb8b40b10a0 0x7fb8b40d2990 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb8b0009870 tx=0x7fb8b001c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=515ac629f7a62030 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:53:51.029 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.023+0000 7fb8b8826640 1 -- 172.21.15.118:0/3924892143 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b00aa670 con 0x7fb8b40b10a0 2023-05-16T13:53:51.029 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.023+0000 7fb8b8826640 1 -- 172.21.15.118:0/3924892143 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8b00aa7d0 con 0x7fb8b40b10a0 2023-05-16T13:53:51.029 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.023+0000 7fb8b8826640 1 -- 172.21.15.118:0/3924892143 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b00aab60 con 0x7fb8b40b10a0 2023-05-16T13:53:51.030 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.023+0000 7fb8bba8c640 1 -- 172.21.15.118:0/3924892143 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb8b40b10a0 msgr2=0x7fb8b40d2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:53:51.030 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.023+0000 7fb8bba8c640 1 --2- 172.21.15.118:0/3924892143 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb8b40b10a0 0x7fb8b40d2990 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb8b0009870 tx=0x7fb8b001c510 comp rx=0 tx=0).stop 2023-05-16T13:53:51.030 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.023+0000 7fb8bba8c640 1 -- 172.21.15.118:0/3924892143 shutdown_connections 2023-05-16T13:53:51.031 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.023+0000 7fb8bba8c640 1 --2- 172.21.15.118:0/3924892143 >> v2:172.21.15.39:3300/0 conn(0x7fb8b40d0b20 0x7fb8b40af490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:51.031 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.023+0000 7fb8bba8c640 1 --2- 172.21.15.118:0/3924892143 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb8b40b10a0 0x7fb8b40d2990 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:51.031 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.023+0000 7fb8bba8c640 1 -- 172.21.15.118:0/3924892143 >> 172.21.15.118:0/3924892143 conn(0x7fb8b409bba0 msgr2=0x7fb8b4089fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:53:51.031 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.023+0000 7fb8bba8c640 1 -- 172.21.15.118:0/3924892143 shutdown_connections 2023-05-16T13:53:51.031 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.023+0000 7fb8bba8c640 1 -- 172.21.15.118:0/3924892143 wait complete. 2023-05-16T13:53:51.032 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.027+0000 7fb8bba8c640 1 Processor -- start 2023-05-16T13:53:51.032 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.027+0000 7fb8bba8c640 1 -- start start 2023-05-16T13:53:51.033 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.027+0000 7fb8bba8c640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb8b40b10a0 0x7fb8b4154280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:53:51.033 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.027+0000 7fb8bba8c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb8b40d0b20 0x7fb8b41f8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:53:51.033 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.027+0000 7fb8bba8c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8b40d2ed0 0x7fb8b41539b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:53:51.033 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.027+0000 7fb8bba8c640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b40b4020 con 0x7fb8b40d0b20 2023-05-16T13:53:51.034 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.027+0000 7fb8bba8c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b40b5df0 con 0x7fb8b40d2ed0 2023-05-16T13:53:51.034 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.027+0000 7fb8bba8c640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b40b3d40 con 0x7fb8b40b10a0 2023-05-16T13:53:51.034 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.027+0000 7fb8b9828640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb8b40b10a0 0x7fb8b4154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:53:51.034 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.027+0000 7fb8ba029640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8b40d2ed0 0x7fb8b41539b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:53:51.034 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.027+0000 7fb8b9828640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb8b40b10a0 0x7fb8b4154280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.118:49372/0 (socket says 172.21.15.118:49372) 2023-05-16T13:53:51.034 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.027+0000 7fb8b9828640 1 -- 172.21.15.118:0/6511545 learned_addr learned my addr 172.21.15.118:0/6511545 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-05-16T13:53:51.034 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.027+0000 7fb8b9027640 1 --2- 172.21.15.118:0/6511545 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb8b40d0b20 0x7fb8b41f8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:53:51.035 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.027+0000 7fb8b9828640 1 -- 172.21.15.118:0/6511545 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8b40d2ed0 msgr2=0x7fb8b41539b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:53:51.035 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.027+0000 7fb8b9828640 1 --2- 172.21.15.118:0/6511545 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8b40d2ed0 0x7fb8b41539b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:51.036 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.027+0000 7fb8b9828640 1 -- 172.21.15.118:0/6511545 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb8b40d0b20 msgr2=0x7fb8b41f8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:53:51.036 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.027+0000 7fb8b9828640 1 --2- 172.21.15.118:0/6511545 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb8b40d0b20 0x7fb8b41f8210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:51.036 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.027+0000 7fb8b9828640 1 -- 172.21.15.118:0/6511545 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8ac009a70 con 0x7fb8b40b10a0 2023-05-16T13:53:51.036 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.027+0000 7fb8b9828640 1 --2- 172.21.15.118:0/6511545 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb8b40b10a0 0x7fb8b4154280 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb8b001a140 tx=0x7fb8b001ad50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:53:51.036 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.027+0000 7fb8aa7fc640 1 -- 172.21.15.118:0/6511545 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b00aa670 con 0x7fb8b40b10a0 2023-05-16T13:53:51.036 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.027+0000 7fb8aa7fc640 1 -- 172.21.15.118:0/6511545 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8b00b3820 con 0x7fb8b40b10a0 2023-05-16T13:53:51.036 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.027+0000 7fb8aa7fc640 1 -- 172.21.15.118:0/6511545 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b00b3bd0 con 0x7fb8b40b10a0 2023-05-16T13:53:51.037 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.027+0000 7fb8bba8c640 1 -- 172.21.15.118:0/6511545 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8b00094d0 con 0x7fb8b40b10a0 2023-05-16T13:53:51.037 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.027+0000 7fb8bba8c640 1 -- 172.21.15.118:0/6511545 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8b406b620 con 0x7fb8b40b10a0 2023-05-16T13:53:51.037 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.027+0000 7fb8aa7fc640 1 -- 172.21.15.118:0/6511545 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb8b00bd6f0 con 0x7fb8b40b10a0 2023-05-16T13:53:51.037 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.031+0000 7fb8aa7fc640 1 -- 172.21.15.118:0/6511545 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fb8b00bddc0 con 0x7fb8b40b10a0 2023-05-16T13:53:51.037 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.031+0000 7fb8bba8c640 1 -- 172.21.15.118:0/6511545 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8b40b1470 con 0x7fb8b40b10a0 2023-05-16T13:53:51.037 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.031+0000 7fb8aa7fc640 1 -- 172.21.15.118:0/6511545 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fb8b00c3060 con 0x7fb8b40b10a0 2023-05-16T13:53:51.102 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.095+0000 7fb8bba8c640 1 -- 172.21.15.118:0/6511545 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd new", "uuid": "0b92d770-7030-42fa-a19f-4f7f1ac113c6", "id": 2} v 0) v1 -- 0x7fb8b406b7b0 con 0x7fb8b40b10a0 2023-05-16T13:53:51.111 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.107+0000 7fb8aa7fc640 1 -- 172.21.15.118:0/6511545 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0b92d770-7030-42fa-a19f-4f7f1ac113c6", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb8b00cc0b0 con 0x7fb8b40b10a0 2023-05-16T13:53:51.112 INFO:teuthology.orchestra.run.smithi118.stdout:2 2023-05-16T13:53:51.112 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.107+0000 7fb8bba8c640 1 -- 172.21.15.118:0/6511545 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb8b40b10a0 msgr2=0x7fb8b4154280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:53:51.113 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.107+0000 7fb8bba8c640 1 --2- 172.21.15.118:0/6511545 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb8b40b10a0 0x7fb8b4154280 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb8b001a140 tx=0x7fb8b001ad50 comp rx=0 tx=0).stop 2023-05-16T13:53:51.113 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.107+0000 7fb8bba8c640 1 -- 172.21.15.118:0/6511545 shutdown_connections 2023-05-16T13:53:51.113 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.107+0000 7fb8bba8c640 1 --2- 172.21.15.118:0/6511545 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb8b40d2ed0 0x7fb8b41539b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:51.113 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.107+0000 7fb8bba8c640 1 --2- 172.21.15.118:0/6511545 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb8b40d0b20 0x7fb8b41f8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:51.113 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.107+0000 7fb8bba8c640 1 --2- 172.21.15.118:0/6511545 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb8b40b10a0 0x7fb8b4154280 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:51.113 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.107+0000 7fb8bba8c640 1 -- 172.21.15.118:0/6511545 >> 172.21.15.118:0/6511545 conn(0x7fb8b409bba0 msgr2=0x7fb8b40b01e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:53:51.113 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.107+0000 7fb8bba8c640 1 -- 172.21.15.118:0/6511545 shutdown_connections 2023-05-16T13:53:51.114 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.107+0000 7fb8bba8c640 1 -- 172.21.15.118:0/6511545 wait complete. 2023-05-16T13:53:51.130 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd new 000d9506-cbb2-4017-b875-deca579860ed 3 2023-05-16T13:53:51.261 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.255+0000 7f919d9cb640 1 Processor -- start 2023-05-16T13:53:51.261 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.255+0000 7f919d9cb640 1 -- start start 2023-05-16T13:53:51.262 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.255+0000 7f919d9cb640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f91980affc0 0x7f91980cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:53:51.262 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.255+0000 7f919d9cb640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9198158dc0 con 0x7f91980c92e0 2023-05-16T13:53:51.263 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.255+0000 7f919d9cb640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91981590a0 con 0x7f91980b0440 2023-05-16T13:53:51.263 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.255+0000 7f919d9cb640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9198159380 con 0x7f91980affc0 2023-05-16T13:53:51.264 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.259+0000 7f91967fc640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f91980affc0 0x7f91980cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:53:51.264 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.259+0000 7f9196ffd640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f91980c92e0 0x7f91980cacb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.118:52132/0 (socket says 172.21.15.118:52132) 2023-05-16T13:53:51.264 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.259+0000 7f9196ffd640 1 -- 172.21.15.118:0/2937259930 learned_addr learned my addr 172.21.15.118:0/2937259930 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-05-16T13:53:51.264 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.259+0000 7f91977fe640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f91980b0440 0x7f91980ce440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:44098/0 (socket says 172.21.15.118:44098) 2023-05-16T13:53:51.264 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.259+0000 7f9195ffb640 1 -- 172.21.15.118:0/2937259930 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 896265748 0 0) 0x7f9198158dc0 con 0x7f91980c92e0 2023-05-16T13:53:51.264 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.259+0000 7f9195ffb640 1 -- 172.21.15.118:0/2937259930 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9180005740 con 0x7f91980c92e0 2023-05-16T13:53:51.265 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.259+0000 7f9195ffb640 1 -- 172.21.15.118:0/2937259930 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2813892659 0 0) 0x7f91981590a0 con 0x7f91980b0440 2023-05-16T13:53:51.265 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.259+0000 7f91967fc640 1 -- 172.21.15.118:0/2937259930 >> v1:172.21.15.118:6789/0 conn(0x7f91980b0440 legacy=0x7f91980ce440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:53:51.265 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.259+0000 7f91967fc640 1 -- 172.21.15.118:0/2937259930 >> v1:172.21.15.39:6789/0 conn(0x7f91980c92e0 legacy=0x7f91980cacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:53:51.265 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.259+0000 7f91967fc640 1 -- 172.21.15.118:0/2937259930 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9198159660 con 0x7f91980affc0 2023-05-16T13:53:51.268 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.263+0000 7f91967fc640 1 --2- 172.21.15.118:0/2937259930 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91980affc0 0x7f91980cd930 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f918c0097c0 tx=0x7f918c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c43243606f07840 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:53:51.268 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.263+0000 7f9195ffb640 1 -- 172.21.15.118:0/2937259930 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f918c0ab600 con 0x7f91980affc0 2023-05-16T13:53:51.269 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.263+0000 7f9195ffb640 1 -- 172.21.15.118:0/2937259930 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f918c0a7050 con 0x7f91980affc0 2023-05-16T13:53:51.269 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.263+0000 7f9195ffb640 1 -- 172.21.15.118:0/2937259930 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f918c0ab980 con 0x7f91980affc0 2023-05-16T13:53:51.269 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.263+0000 7f919d9cb640 1 -- 172.21.15.118:0/2937259930 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91980affc0 msgr2=0x7f91980cd930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:53:51.270 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.263+0000 7f919d9cb640 1 --2- 172.21.15.118:0/2937259930 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91980affc0 0x7f91980cd930 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f918c0097c0 tx=0x7f918c01c3f0 comp rx=0 tx=0).stop 2023-05-16T13:53:51.270 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.263+0000 7f919d9cb640 1 -- 172.21.15.118:0/2937259930 shutdown_connections 2023-05-16T13:53:51.270 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.263+0000 7f919d9cb640 1 --2- 172.21.15.118:0/2937259930 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91980affc0 0x7f91980cd930 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:51.270 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.263+0000 7f919d9cb640 1 -- 172.21.15.118:0/2937259930 >> 172.21.15.118:0/2937259930 conn(0x7f9198069a50 msgr2=0x7f9198069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:53:51.270 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.263+0000 7f919d9cb640 1 -- 172.21.15.118:0/2937259930 shutdown_connections 2023-05-16T13:53:51.270 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.263+0000 7f919d9cb640 1 -- 172.21.15.118:0/2937259930 wait complete. 2023-05-16T13:53:51.271 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.267+0000 7f919d9cb640 1 Processor -- start 2023-05-16T13:53:51.271 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.267+0000 7f919d9cb640 1 -- start start 2023-05-16T13:53:51.272 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.267+0000 7f919d9cb640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91980affc0 0x7f91980b3320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:53:51.272 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.267+0000 7f919d9cb640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91980b0440 0x7f919814cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:53:51.272 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.267+0000 7f919d9cb640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f91980c92e0 0x7f919814a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:53:51.273 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.267+0000 7f919d9cb640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9198070290 con 0x7f91980affc0 2023-05-16T13:53:51.273 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.267+0000 7f919d9cb640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f919806fc60 con 0x7f91980b0440 2023-05-16T13:53:51.273 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.267+0000 7f919d9cb640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91980b1650 con 0x7f91980c92e0 2023-05-16T13:53:51.273 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.267+0000 7f91977fe640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f91980c92e0 0x7f919814a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:53:51.273 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.267+0000 7f91967fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91980b0440 0x7f919814cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:53:51.273 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.267+0000 7f9196ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91980affc0 0x7f91980b3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:53:51.274 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.267+0000 7f91977fe640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f91980c92e0 0x7f919814a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.118:49380/0 (socket says 172.21.15.118:49380) 2023-05-16T13:53:51.274 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.267+0000 7f91977fe640 1 -- 172.21.15.118:0/953763881 learned_addr learned my addr 172.21.15.118:0/953763881 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-05-16T13:53:51.275 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.267+0000 7f91977fe640 1 -- 172.21.15.118:0/953763881 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91980b0440 msgr2=0x7f919814cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:53:51.275 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.267+0000 7f91977fe640 1 --2- 172.21.15.118:0/953763881 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91980b0440 0x7f919814cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:51.276 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.267+0000 7f91977fe640 1 -- 172.21.15.118:0/953763881 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91980affc0 msgr2=0x7f91980b3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:53:51.276 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.267+0000 7f91977fe640 1 --2- 172.21.15.118:0/953763881 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91980affc0 0x7f91980b3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:51.276 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.267+0000 7f91977fe640 1 -- 172.21.15.118:0/953763881 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f918c009420 con 0x7f91980c92e0 2023-05-16T13:53:51.276 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.267+0000 7f9196ffd640 1 --2- 172.21.15.118:0/953763881 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91980affc0 0x7f91980b3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-16T13:53:51.276 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.267+0000 7f91977fe640 1 --2- 172.21.15.118:0/953763881 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f91980c92e0 0x7f919814a830 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f919000c810 tx=0x7f919000ccd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:53:51.276 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.267+0000 7f917ffff640 1 -- 172.21.15.118:0/953763881 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f919000a640 con 0x7f91980c92e0 2023-05-16T13:53:51.277 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.267+0000 7f917ffff640 1 -- 172.21.15.118:0/953763881 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f919000a7c0 con 0x7f91980c92e0 2023-05-16T13:53:51.277 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.267+0000 7f917ffff640 1 -- 172.21.15.118:0/953763881 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f919000ab70 con 0x7f91980c92e0 2023-05-16T13:53:51.277 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.267+0000 7f919d9cb640 1 -- 172.21.15.118:0/953763881 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91980cece0 con 0x7f91980c92e0 2023-05-16T13:53:51.277 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.267+0000 7f919d9cb640 1 -- 172.21.15.118:0/953763881 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91980ceb50 con 0x7f91980c92e0 2023-05-16T13:53:51.277 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.267+0000 7f917ffff640 1 -- 172.21.15.118:0/953763881 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f91900070d0 con 0x7f91980c92e0 2023-05-16T13:53:51.277 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.267+0000 7f917ffff640 1 -- 172.21.15.118:0/953763881 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f9190012a10 con 0x7f91980c92e0 2023-05-16T13:53:51.277 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.271+0000 7f919d9cb640 1 -- 172.21.15.118:0/953763881 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91980cde70 con 0x7f91980c92e0 2023-05-16T13:53:51.278 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.271+0000 7f917ffff640 1 -- 172.21.15.118:0/953763881 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f9190018070 con 0x7f91980c92e0 2023-05-16T13:53:51.341 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.335+0000 7f919d9cb640 1 -- 172.21.15.118:0/953763881 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd new", "uuid": "000d9506-cbb2-4017-b875-deca579860ed", "id": 3} v 0) v1 -- 0x7f91980703d0 con 0x7f91980c92e0 2023-05-16T13:53:51.354 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.347+0000 7f917ffff640 1 -- 172.21.15.118:0/953763881 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "000d9506-cbb2-4017-b875-deca579860ed", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9190012d60 con 0x7f91980c92e0 2023-05-16T13:53:51.355 INFO:teuthology.orchestra.run.smithi118.stdout:3 2023-05-16T13:53:51.356 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.351+0000 7f919d9cb640 1 -- 172.21.15.118:0/953763881 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f91980c92e0 msgr2=0x7f919814a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:53:51.356 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.351+0000 7f919d9cb640 1 --2- 172.21.15.118:0/953763881 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f91980c92e0 0x7f919814a830 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f919000c810 tx=0x7f919000ccd0 comp rx=0 tx=0).stop 2023-05-16T13:53:51.356 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.351+0000 7f919d9cb640 1 -- 172.21.15.118:0/953763881 shutdown_connections 2023-05-16T13:53:51.356 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.351+0000 7f919d9cb640 1 --2- 172.21.15.118:0/953763881 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f91980c92e0 0x7f919814a830 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:51.356 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.351+0000 7f919d9cb640 1 --2- 172.21.15.118:0/953763881 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91980b0440 0x7f919814cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:51.356 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.351+0000 7f919d9cb640 1 --2- 172.21.15.118:0/953763881 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91980affc0 0x7f91980b3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:51.357 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.351+0000 7f919d9cb640 1 -- 172.21.15.118:0/953763881 >> 172.21.15.118:0/953763881 conn(0x7f9198069a50 msgr2=0x7f91980af3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:53:51.357 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.351+0000 7f919d9cb640 1 -- 172.21.15.118:0/953763881 shutdown_connections 2023-05-16T13:53:51.357 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.351+0000 7f919d9cb640 1 -- 172.21.15.118:0/953763881 wait complete. 2023-05-16T13:53:51.375 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd new 70f0dacb-e960-40c5-bf6a-183e52bbe2ea 4 2023-05-16T13:53:51.438 INFO:tasks.ceph.mgr.y.smithi039.stderr:2023-05-16T13:53:51.431+0000 7f09e8dff180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-16T13:53:51.454 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-05-16T13:53:51.447+0000 7fd9fd3e4180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-16T13:53:51.503 INFO:tasks.ceph.mgr.y.smithi039.stderr:2023-05-16T13:53:51.499+0000 7f09e8dff180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-16T13:53:51.505 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.499+0000 7fba57d6d640 1 Processor -- start 2023-05-16T13:53:51.506 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.499+0000 7fba57d6d640 1 -- start start 2023-05-16T13:53:51.507 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.503+0000 7fba57d6d640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fba500d0410 0x7fba500d0890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:53:51.507 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.503+0000 7fba57d6d640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fba500af490 0x7fba500af8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:53:51.507 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.503+0000 7fba57d6d640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba5006c610 con 0x7fba500b10a0 2023-05-16T13:53:51.507 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.503+0000 7fba57d6d640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba500d0dd0 con 0x7fba500d0410 2023-05-16T13:53:51.508 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.503+0000 7fba57d6d640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba5006caa0 con 0x7fba500af490 2023-05-16T13:53:51.508 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.503+0000 7fba5630a640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fba500af490 0x7fba500af8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:53:51.508 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.503+0000 7fba5630a640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fba500af490 0x7fba500af8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41958/0 (socket says 172.21.15.118:41958) 2023-05-16T13:53:51.508 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.503+0000 7fba5630a640 1 -- 172.21.15.118:0/1223394128 learned_addr learned my addr 172.21.15.118:0/1223394128 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-05-16T13:53:51.508 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.503+0000 7fba55308640 1 --2- 172.21.15.118:0/1223394128 >> v2:172.21.15.39:3300/0 conn(0x7fba500d0410 0x7fba500d0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:53:51.509 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.503+0000 7fba5630a640 1 -- 172.21.15.118:0/1223394128 >> v2:172.21.15.39:3300/0 conn(0x7fba500d0410 msgr2=0x7fba500d0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:53:51.509 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.503+0000 7fba5630a640 1 --2- 172.21.15.118:0/1223394128 >> v2:172.21.15.39:3300/0 conn(0x7fba500d0410 0x7fba500d0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:51.509 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.503+0000 7fba5630a640 1 -- 172.21.15.118:0/1223394128 >> v1:172.21.15.39:6789/0 conn(0x7fba500b10a0 legacy=0x7fba500d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:53:51.509 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.503+0000 7fba5630a640 1 -- 172.21.15.118:0/1223394128 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba5006ba00 con 0x7fba500af490 2023-05-16T13:53:51.510 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.503+0000 7fba5630a640 1 --2- 172.21.15.118:0/1223394128 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba500af490 0x7fba500af8b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fba500d0280 tx=0x7fba4801c9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d480a55c41d18cb4 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:53:51.510 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.503+0000 7fba54b07640 1 -- 172.21.15.118:0/1223394128 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba480a5860 con 0x7fba500af490 2023-05-16T13:53:51.511 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.507+0000 7fba54b07640 1 -- 172.21.15.118:0/1223394128 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba480a59c0 con 0x7fba500af490 2023-05-16T13:53:51.511 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.507+0000 7fba54b07640 1 -- 172.21.15.118:0/1223394128 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba480a5d50 con 0x7fba500af490 2023-05-16T13:53:51.511 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.507+0000 7fba57d6d640 1 -- 172.21.15.118:0/1223394128 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba500af490 msgr2=0x7fba500af8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:53:51.512 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.507+0000 7fba57d6d640 1 --2- 172.21.15.118:0/1223394128 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba500af490 0x7fba500af8b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fba500d0280 tx=0x7fba4801c9a0 comp rx=0 tx=0).stop 2023-05-16T13:53:51.512 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.507+0000 7fba57d6d640 1 -- 172.21.15.118:0/1223394128 shutdown_connections 2023-05-16T13:53:51.512 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.507+0000 7fba57d6d640 1 --2- 172.21.15.118:0/1223394128 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba500af490 0x7fba500af8b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:51.512 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.507+0000 7fba57d6d640 1 --2- 172.21.15.118:0/1223394128 >> v2:172.21.15.39:3300/0 conn(0x7fba500d0410 0x7fba500d0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:51.512 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.507+0000 7fba57d6d640 1 -- 172.21.15.118:0/1223394128 >> 172.21.15.118:0/1223394128 conn(0x7fba5009bba0 msgr2=0x7fba50089fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:53:51.512 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.507+0000 7fba57d6d640 1 -- 172.21.15.118:0/1223394128 shutdown_connections 2023-05-16T13:53:51.513 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.507+0000 7fba57d6d640 1 -- 172.21.15.118:0/1223394128 wait complete. 2023-05-16T13:53:51.513 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.507+0000 7fba57d6d640 1 Processor -- start 2023-05-16T13:53:51.513 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.507+0000 7fba57d6d640 1 -- start start 2023-05-16T13:53:51.514 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.507+0000 7fba57d6d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba500af490 0x7fba501582a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:53:51.514 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.507+0000 7fba57d6d640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fba500b10a0 0x7fba50156e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:53:51.514 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.507+0000 7fba57d6d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba500d0410 0x7fba50158c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:53:51.514 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.507+0000 7fba57d6d640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba501595b0 con 0x7fba500af490 2023-05-16T13:53:51.515 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.507+0000 7fba57d6d640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba501577e0 con 0x7fba500d0410 2023-05-16T13:53:51.515 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.507+0000 7fba57d6d640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba50157ac0 con 0x7fba500b10a0 2023-05-16T13:53:51.516 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.507+0000 7fba5630a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba500d0410 0x7fba50158c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:53:51.516 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.507+0000 7fba55b09640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba500af490 0x7fba501582a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:53:51.516 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.507+0000 7fba55308640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fba500b10a0 0x7fba50156e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:53:51.516 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.507+0000 7fba5630a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba500d0410 0x7fba50158c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41960/0 (socket says 172.21.15.118:41960) 2023-05-16T13:53:51.517 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.507+0000 7fba55b09640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba500af490 0x7fba501582a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.118:50176/0 (socket says 172.21.15.118:50176) 2023-05-16T13:53:51.517 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.507+0000 7fba5630a640 1 -- 172.21.15.118:0/3971387006 learned_addr learned my addr 172.21.15.118:0/3971387006 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-05-16T13:53:51.517 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.511+0000 7fba5630a640 1 -- 172.21.15.118:0/3971387006 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fba500b10a0 msgr2=0x7fba50156e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:53:51.517 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.511+0000 7fba5630a640 1 --2- 172.21.15.118:0/3971387006 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fba500b10a0 0x7fba50156e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:51.517 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.511+0000 7fba5630a640 1 -- 172.21.15.118:0/3971387006 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba500af490 msgr2=0x7fba501582a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:53:51.517 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.511+0000 7fba5630a640 1 --2- 172.21.15.118:0/3971387006 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba500af490 0x7fba501582a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:51.517 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.511+0000 7fba5630a640 1 -- 172.21.15.118:0/3971387006 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba48009b30 con 0x7fba500d0410 2023-05-16T13:53:51.518 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.511+0000 7fba5630a640 1 --2- 172.21.15.118:0/3971387006 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba500d0410 0x7fba50158c60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fba480195b0 tx=0x7fba48019740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:53:51.518 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.511+0000 7fba467fc640 1 -- 172.21.15.118:0/3971387006 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba480b8670 con 0x7fba500d0410 2023-05-16T13:53:51.518 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.511+0000 7fba467fc640 1 -- 172.21.15.118:0/3971387006 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba480b87d0 con 0x7fba500d0410 2023-05-16T13:53:51.518 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.511+0000 7fba467fc640 1 -- 172.21.15.118:0/3971387006 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba480b8b80 con 0x7fba500d0410 2023-05-16T13:53:51.518 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.511+0000 7fba57d6d640 1 -- 172.21.15.118:0/3971387006 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba500b1470 con 0x7fba500d0410 2023-05-16T13:53:51.518 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.511+0000 7fba57d6d640 1 -- 172.21.15.118:0/3971387006 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba5006c2a0 con 0x7fba500d0410 2023-05-16T13:53:51.518 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.511+0000 7fba467fc640 1 -- 172.21.15.118:0/3971387006 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fba480039a0 con 0x7fba500d0410 2023-05-16T13:53:51.518 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.511+0000 7fba467fc640 1 -- 172.21.15.118:0/3971387006 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fba48004020 con 0x7fba500d0410 2023-05-16T13:53:51.519 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.511+0000 7fba57d6d640 1 -- 172.21.15.118:0/3971387006 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba500d30a0 con 0x7fba500d0410 2023-05-16T13:53:51.519 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.515+0000 7fba467fc640 1 -- 172.21.15.118:0/3971387006 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fba480041e0 con 0x7fba500d0410 2023-05-16T13:53:51.519 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-05-16T13:53:51.515+0000 7fd9fd3e4180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-16T13:53:51.567 INFO:tasks.ceph.mgr.y.smithi039.stderr:2023-05-16T13:53:51.563+0000 7f09e8dff180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-16T13:53:51.580 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-05-16T13:53:51.575+0000 7fd9fd3e4180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-16T13:53:51.584 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.579+0000 7fba57d6d640 1 -- 172.21.15.118:0/3971387006 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd new", "uuid": "70f0dacb-e960-40c5-bf6a-183e52bbe2ea", "id": 4} v 0) v1 -- 0x7fba50159890 con 0x7fba500d0410 2023-05-16T13:53:51.593 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.587+0000 7fba467fc640 1 -- 172.21.15.118:0/3971387006 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "70f0dacb-e960-40c5-bf6a-183e52bbe2ea", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fba48003c50 con 0x7fba500d0410 2023-05-16T13:53:51.593 INFO:teuthology.orchestra.run.smithi118.stdout:4 2023-05-16T13:53:51.595 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.587+0000 7fba57d6d640 1 -- 172.21.15.118:0/3971387006 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba500d0410 msgr2=0x7fba50158c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:53:51.595 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.587+0000 7fba57d6d640 1 --2- 172.21.15.118:0/3971387006 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba500d0410 0x7fba50158c60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fba480195b0 tx=0x7fba48019740 comp rx=0 tx=0).stop 2023-05-16T13:53:51.595 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.587+0000 7fba57d6d640 1 -- 172.21.15.118:0/3971387006 shutdown_connections 2023-05-16T13:53:51.596 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.587+0000 7fba57d6d640 1 --2- 172.21.15.118:0/3971387006 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fba500b10a0 0x7fba50156e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:51.596 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.587+0000 7fba57d6d640 1 --2- 172.21.15.118:0/3971387006 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba500d0410 0x7fba50158c60 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:51.596 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.587+0000 7fba57d6d640 1 --2- 172.21.15.118:0/3971387006 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba500af490 0x7fba501582a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:51.596 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.587+0000 7fba57d6d640 1 -- 172.21.15.118:0/3971387006 >> 172.21.15.118:0/3971387006 conn(0x7fba5009bba0 msgr2=0x7fba50089fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:53:51.597 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.587+0000 7fba57d6d640 1 -- 172.21.15.118:0/3971387006 shutdown_connections 2023-05-16T13:53:51.597 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.587+0000 7fba57d6d640 1 -- 172.21.15.118:0/3971387006 wait complete. 2023-05-16T13:53:51.612 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd new 756feb54-c3ae-4a2a-8f74-85c291ba707c 5 2023-05-16T13:53:51.661 INFO:tasks.ceph.mgr.y.smithi039.stderr:2023-05-16T13:53:51.655+0000 7f09e8dff180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-16T13:53:51.672 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-05-16T13:53:51.667+0000 7fd9fd3e4180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-16T13:53:51.724 INFO:tasks.ceph.mgr.y.smithi039.stderr:2023-05-16T13:53:51.719+0000 7f09e8dff180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-16T13:53:51.733 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-05-16T13:53:51.727+0000 7fd9fd3e4180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-16T13:53:51.743 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.739+0000 7f1e9a38f640 1 Processor -- start 2023-05-16T13:53:51.743 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.739+0000 7f1e9a38f640 1 -- start start 2023-05-16T13:53:51.744 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.739+0000 7f1e9a38f640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f1e940b10a0 0x7f1e940d2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:53:51.745 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.739+0000 7f1e9a38f640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1e940d2ed0 0x7f1e940d0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:53:51.745 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.739+0000 7f1e9a38f640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e940d0db0 con 0x7f1e940d0950 2023-05-16T13:53:51.745 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.739+0000 7f1e9a38f640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e9406c610 con 0x7f1e940b10a0 2023-05-16T13:53:51.745 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.739+0000 7f1e9a38f640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9406caa0 con 0x7f1e940d2ed0 2023-05-16T13:53:51.745 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.739+0000 7f1e937fe640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1e940d2ed0 0x7f1e940d0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:53:51.745 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.739+0000 7f1e9892c640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f1e940d0950 0x7f1e9415faf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:44100/0 (socket says 172.21.15.118:44100) 2023-05-16T13:53:51.745 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.739+0000 7f1e9892c640 1 -- 172.21.15.118:0/37147611 learned_addr learned my addr 172.21.15.118:0/37147611 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-05-16T13:53:51.745 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.739+0000 7f1e93fff640 1 --2- 172.21.15.118:0/37147611 >> v2:172.21.15.39:3300/0 conn(0x7f1e940b10a0 0x7f1e940d2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:53:51.746 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.739+0000 7f1e937fe640 1 -- 172.21.15.118:0/37147611 >> v2:172.21.15.39:3300/0 conn(0x7f1e940b10a0 msgr2=0x7f1e940d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:53:51.746 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.739+0000 7f1e937fe640 1 --2- 172.21.15.118:0/37147611 >> v2:172.21.15.39:3300/0 conn(0x7f1e940b10a0 0x7f1e940d2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:51.746 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.739+0000 7f1e937fe640 1 -- 172.21.15.118:0/37147611 >> v1:172.21.15.118:6789/0 conn(0x7f1e940d0950 legacy=0x7f1e9415faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:53:51.746 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.739+0000 7f1e92ffd640 1 -- 172.21.15.118:0/37147611 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1064640413 0 0) 0x7f1e940d0db0 con 0x7f1e940d0950 2023-05-16T13:53:51.747 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.739+0000 7f1e937fe640 1 -- 172.21.15.118:0/37147611 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e9406ba00 con 0x7f1e940d2ed0 2023-05-16T13:53:51.747 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.743+0000 7f1e937fe640 1 --2- 172.21.15.118:0/37147611 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1e940d2ed0 0x7f1e940d0410 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1e880097c0 tx=0x7f1e8801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d97842f3e709a617 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:53:51.748 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.743+0000 7f1e92ffd640 1 -- 172.21.15.118:0/37147611 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e880ab600 con 0x7f1e940d2ed0 2023-05-16T13:53:51.748 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.743+0000 7f1e92ffd640 1 -- 172.21.15.118:0/37147611 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e880a7050 con 0x7f1e940d2ed0 2023-05-16T13:53:51.748 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.743+0000 7f1e92ffd640 1 -- 172.21.15.118:0/37147611 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e880ab980 con 0x7f1e940d2ed0 2023-05-16T13:53:51.749 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.743+0000 7f1e9a38f640 1 -- 172.21.15.118:0/37147611 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1e940d2ed0 msgr2=0x7f1e940d0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:53:51.749 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.743+0000 7f1e9a38f640 1 --2- 172.21.15.118:0/37147611 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1e940d2ed0 0x7f1e940d0410 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1e880097c0 tx=0x7f1e8801c450 comp rx=0 tx=0).stop 2023-05-16T13:53:51.749 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.743+0000 7f1e9a38f640 1 -- 172.21.15.118:0/37147611 shutdown_connections 2023-05-16T13:53:51.750 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.743+0000 7f1e9a38f640 1 --2- 172.21.15.118:0/37147611 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1e940d2ed0 0x7f1e940d0410 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:51.750 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.743+0000 7f1e9a38f640 1 --2- 172.21.15.118:0/37147611 >> v2:172.21.15.39:3300/0 conn(0x7f1e940b10a0 0x7f1e940d2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:51.750 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.743+0000 7f1e9a38f640 1 -- 172.21.15.118:0/37147611 >> 172.21.15.118:0/37147611 conn(0x7f1e9409bba0 msgr2=0x7f1e94089fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:53:51.750 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.743+0000 7f1e9a38f640 1 -- 172.21.15.118:0/37147611 shutdown_connections 2023-05-16T13:53:51.750 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.743+0000 7f1e9a38f640 1 -- 172.21.15.118:0/37147611 wait complete. 2023-05-16T13:53:51.751 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.743+0000 7f1e9a38f640 1 Processor -- start 2023-05-16T13:53:51.751 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.743+0000 7f1e9a38f640 1 -- start start 2023-05-16T13:53:51.752 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.747+0000 7f1e9a38f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e940b10a0 0x7f1e9415db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:53:51.752 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.747+0000 7f1e9a38f640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1e940d0950 0x7f1e94157080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:53:51.752 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.747+0000 7f1e9a38f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e940d2ed0 0x7f1e94155440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:53:51.752 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.747+0000 7f1e9a38f640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e94155fc0 con 0x7f1e940d2ed0 2023-05-16T13:53:51.752 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.747+0000 7f1e9a38f640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9415d6a0 con 0x7f1e940b10a0 2023-05-16T13:53:51.752 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.747+0000 7f1e9a38f640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9415ca90 con 0x7f1e940d0950 2023-05-16T13:53:51.753 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.747+0000 7f1e937fe640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1e940d0950 0x7f1e94157080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:53:51.753 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.747+0000 7f1e93fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e940b10a0 0x7f1e9415db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:53:51.753 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.747+0000 7f1e937fe640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1e940d0950 0x7f1e94157080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.118:49406/0 (socket says 172.21.15.118:49406) 2023-05-16T13:53:51.753 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.747+0000 7f1e937fe640 1 -- 172.21.15.118:0/3770039774 learned_addr learned my addr 172.21.15.118:0/3770039774 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-05-16T13:53:51.753 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.747+0000 7f1e9892c640 1 --2- 172.21.15.118:0/3770039774 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e940d2ed0 0x7f1e94155440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:53:51.754 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.747+0000 7f1e937fe640 1 -- 172.21.15.118:0/3770039774 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e940b10a0 msgr2=0x7f1e9415db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:53:51.754 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.747+0000 7f1e937fe640 1 --2- 172.21.15.118:0/3770039774 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e940b10a0 0x7f1e9415db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:51.754 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.747+0000 7f1e937fe640 1 -- 172.21.15.118:0/3770039774 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e940d2ed0 msgr2=0x7f1e94155440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:53:51.755 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.747+0000 7f1e937fe640 1 --2- 172.21.15.118:0/3770039774 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e940d2ed0 0x7f1e94155440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:51.755 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.747+0000 7f1e937fe640 1 -- 172.21.15.118:0/3770039774 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e88009420 con 0x7f1e940d0950 2023-05-16T13:53:51.755 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.747+0000 7f1e937fe640 1 --2- 172.21.15.118:0/3770039774 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1e940d0950 0x7f1e94157080 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1e880ae040 tx=0x7f1e880191f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:53:51.755 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.747+0000 7f1e90ff9640 1 -- 172.21.15.118:0/3770039774 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e880b4430 con 0x7f1e940d0950 2023-05-16T13:53:51.755 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.747+0000 7f1e90ff9640 1 -- 172.21.15.118:0/3770039774 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e880b4590 con 0x7f1e940d0950 2023-05-16T13:53:51.755 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.747+0000 7f1e9a38f640 1 -- 172.21.15.118:0/3770039774 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e940b1470 con 0x7f1e940d0950 2023-05-16T13:53:51.755 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.747+0000 7f1e90ff9640 1 -- 172.21.15.118:0/3770039774 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e880b4940 con 0x7f1e940d0950 2023-05-16T13:53:51.756 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.747+0000 7f1e9a38f640 1 -- 172.21.15.118:0/3770039774 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e9406c2a0 con 0x7f1e940d0950 2023-05-16T13:53:51.756 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.747+0000 7f1e90ff9640 1 -- 172.21.15.118:0/3770039774 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f1e880b2040 con 0x7f1e940d0950 2023-05-16T13:53:51.756 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.747+0000 7f1e90ff9640 1 -- 172.21.15.118:0/3770039774 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f1e880b4da0 con 0x7f1e940d0950 2023-05-16T13:53:51.756 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.747+0000 7f1e9a38f640 1 -- 172.21.15.118:0/3770039774 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e940b04a0 con 0x7f1e940d0950 2023-05-16T13:53:51.756 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.751+0000 7f1e90ff9640 1 -- 172.21.15.118:0/3770039774 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f1e880b0070 con 0x7f1e940d0950 2023-05-16T13:53:51.820 INFO:tasks.ceph.mgr.y.smithi039.stderr:2023-05-16T13:53:51.815+0000 7f09e8dff180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-16T13:53:51.821 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.815+0000 7f1e9a38f640 1 -- 172.21.15.118:0/3770039774 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd new", "uuid": "756feb54-c3ae-4a2a-8f74-85c291ba707c", "id": 5} v 0) v1 -- 0x7f1e9415d830 con 0x7f1e940d0950 2023-05-16T13:53:51.827 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-05-16T13:53:51.823+0000 7fd9fd3e4180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-16T13:53:51.830 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.823+0000 7f1e90ff9640 1 -- 172.21.15.118:0/3770039774 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "756feb54-c3ae-4a2a-8f74-85c291ba707c", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1e880be460 con 0x7f1e940d0950 2023-05-16T13:53:51.830 INFO:teuthology.orchestra.run.smithi118.stdout:5 2023-05-16T13:53:51.831 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.827+0000 7f1e9a38f640 1 -- 172.21.15.118:0/3770039774 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1e940d0950 msgr2=0x7f1e94157080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:53:51.831 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.827+0000 7f1e9a38f640 1 --2- 172.21.15.118:0/3770039774 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1e940d0950 0x7f1e94157080 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1e880ae040 tx=0x7f1e880191f0 comp rx=0 tx=0).stop 2023-05-16T13:53:51.831 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.827+0000 7f1e9a38f640 1 -- 172.21.15.118:0/3770039774 shutdown_connections 2023-05-16T13:53:51.832 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.827+0000 7f1e9a38f640 1 --2- 172.21.15.118:0/3770039774 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1e940d0950 0x7f1e94157080 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:51.832 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.827+0000 7f1e9a38f640 1 --2- 172.21.15.118:0/3770039774 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e940d2ed0 0x7f1e94155440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:51.832 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.827+0000 7f1e9a38f640 1 --2- 172.21.15.118:0/3770039774 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e940b10a0 0x7f1e9415db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:51.832 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.827+0000 7f1e9a38f640 1 -- 172.21.15.118:0/3770039774 >> 172.21.15.118:0/3770039774 conn(0x7f1e9409bba0 msgr2=0x7f1e94159e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:53:51.832 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.827+0000 7f1e9a38f640 1 -- 172.21.15.118:0/3770039774 shutdown_connections 2023-05-16T13:53:51.832 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.827+0000 7f1e9a38f640 1 -- 172.21.15.118:0/3770039774 wait complete. 2023-05-16T13:53:51.849 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd new c4a982c1-f497-4b0f-8a23-c77372e4621e 6 2023-05-16T13:53:51.883 INFO:tasks.ceph.mgr.y.smithi039.stderr:2023-05-16T13:53:51.879+0000 7f09e8dff180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-16T13:53:51.890 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-05-16T13:53:51.883+0000 7fd9fd3e4180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-16T13:53:51.980 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.975+0000 7f21feaf2640 1 Processor -- start 2023-05-16T13:53:51.981 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.975+0000 7f21feaf2640 1 -- start start 2023-05-16T13:53:51.982 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.975+0000 7f21feaf2640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f21f80b10a0 0x7f21f80d2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:53:51.983 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.975+0000 7f21feaf2640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f21f80d2ed0 0x7f21f80d0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:53:51.983 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.975+0000 7f21feaf2640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21f80d0db0 con 0x7f21f80d0950 2023-05-16T13:53:51.983 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.975+0000 7f21feaf2640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21f806c610 con 0x7f21f80d2ed0 2023-05-16T13:53:51.984 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.975+0000 7f21feaf2640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21f806caa0 con 0x7f21f80b10a0 2023-05-16T13:53:51.984 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.975+0000 7f21fc88e640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f21f80b10a0 0x7f21f80d2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:53:51.984 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.975+0000 7f21f7fff640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f21f80d2ed0 0x7f21f80d0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:53:51.984 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.975+0000 7f21fc88e640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f21f80b10a0 0x7f21f80d2990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.118:49408/0 (socket says 172.21.15.118:49408) 2023-05-16T13:53:51.984 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.975+0000 7f21fc88e640 1 -- 172.21.15.118:0/1830858797 learned_addr learned my addr 172.21.15.118:0/1830858797 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-05-16T13:53:51.984 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.975+0000 7f21fc88e640 1 -- 172.21.15.118:0/1830858797 >> v2:172.21.15.118:3300/0 conn(0x7f21f80d2ed0 msgr2=0x7f21f80d0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:53:51.985 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.975+0000 7f21fc88e640 1 --2- 172.21.15.118:0/1830858797 >> v2:172.21.15.118:3300/0 conn(0x7f21f80d2ed0 0x7f21f80d0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:51.985 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.975+0000 7f21fc88e640 1 -- 172.21.15.118:0/1830858797 >> v1:172.21.15.39:6789/0 conn(0x7f21f80d0950 legacy=0x7f21f815faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:53:51.985 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.975+0000 7f21fc88e640 1 -- 172.21.15.118:0/1830858797 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f806ba00 con 0x7f21f80b10a0 2023-05-16T13:53:51.985 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.975+0000 7f21f7fff640 1 --2- 172.21.15.118:0/1830858797 >> v2:172.21.15.118:3300/0 conn(0x7f21f80d2ed0 0x7f21f80d0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-16T13:53:51.985 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.979+0000 7f21fc88e640 1 --2- 172.21.15.118:0/1830858797 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f21f80b10a0 0x7f21f80d2990 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f21ec009870 tx=0x7f21ec01c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c46d019a8f73d3d server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:53:51.986 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.979+0000 7f21f77fe640 1 -- 172.21.15.118:0/1830858797 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ec0a7070 con 0x7f21f80b10a0 2023-05-16T13:53:51.986 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.979+0000 7f21f77fe640 1 -- 172.21.15.118:0/1830858797 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21ec0ab430 con 0x7f21f80b10a0 2023-05-16T13:53:51.986 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.979+0000 7f21f77fe640 1 -- 172.21.15.118:0/1830858797 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ec0ab7c0 con 0x7f21f80b10a0 2023-05-16T13:53:51.987 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.983+0000 7f21feaf2640 1 -- 172.21.15.118:0/1830858797 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f21f80b10a0 msgr2=0x7f21f80d2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:53:51.987 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.983+0000 7f21feaf2640 1 --2- 172.21.15.118:0/1830858797 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f21f80b10a0 0x7f21f80d2990 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f21ec009870 tx=0x7f21ec01c510 comp rx=0 tx=0).stop 2023-05-16T13:53:51.987 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.983+0000 7f21feaf2640 1 -- 172.21.15.118:0/1830858797 shutdown_connections 2023-05-16T13:53:51.987 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.983+0000 7f21feaf2640 1 --2- 172.21.15.118:0/1830858797 >> v2:172.21.15.118:3300/0 conn(0x7f21f80d2ed0 0x7f21f80d0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:51.988 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.983+0000 7f21feaf2640 1 --2- 172.21.15.118:0/1830858797 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f21f80b10a0 0x7f21f80d2990 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:51.988 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.983+0000 7f21feaf2640 1 -- 172.21.15.118:0/1830858797 >> 172.21.15.118:0/1830858797 conn(0x7f21f809bba0 msgr2=0x7f21f8089fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:53:51.988 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.983+0000 7f21feaf2640 1 -- 172.21.15.118:0/1830858797 shutdown_connections 2023-05-16T13:53:51.988 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.983+0000 7f21feaf2640 1 -- 172.21.15.118:0/1830858797 wait complete. 2023-05-16T13:53:51.988 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.983+0000 7f21feaf2640 1 Processor -- start 2023-05-16T13:53:51.989 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.983+0000 7f21feaf2640 1 -- start start 2023-05-16T13:53:51.990 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.983+0000 7f21feaf2640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f21f80b10a0 0x7f21f814cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:53:51.990 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.983+0000 7f21feaf2640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21f80d0950 0x7f21f8152830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:53:51.990 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.983+0000 7f21feaf2640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f21f80d2ed0 0x7f21f8152d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:53:51.990 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.983+0000 7f21feaf2640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f8153850 con 0x7f21f80b10a0 2023-05-16T13:53:51.990 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.983+0000 7f21feaf2640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f80b65c0 con 0x7f21f80d0950 2023-05-16T13:53:51.991 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.983+0000 7f21feaf2640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21f80b68a0 con 0x7f21f80d2ed0 2023-05-16T13:53:51.991 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.983+0000 7f21fd08f640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f21f80d2ed0 0x7f21f8152d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:53:51.992 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.983+0000 7f21fd08f640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f21f80d2ed0 0x7f21f8152d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.118:49416/0 (socket says 172.21.15.118:49416) 2023-05-16T13:53:51.992 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.983+0000 7f21fd08f640 1 -- 172.21.15.118:0/4008742304 learned_addr learned my addr 172.21.15.118:0/4008742304 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-05-16T13:53:51.992 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.987+0000 7f21f7fff640 1 --2- 172.21.15.118:0/4008742304 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21f80d0950 0x7f21f8152830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:53:51.992 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.987+0000 7f21fc88e640 1 --2- 172.21.15.118:0/4008742304 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f21f80b10a0 0x7f21f814cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:53:51.992 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.987+0000 7f21fd08f640 1 -- 172.21.15.118:0/4008742304 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21f80d0950 msgr2=0x7f21f8152830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:53:51.992 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.987+0000 7f21fd08f640 1 --2- 172.21.15.118:0/4008742304 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21f80d0950 0x7f21f8152830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:51.993 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.987+0000 7f21fd08f640 1 -- 172.21.15.118:0/4008742304 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f21f80b10a0 msgr2=0x7f21f814cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:53:51.993 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.987+0000 7f21fd08f640 1 --2- 172.21.15.118:0/4008742304 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f21f80b10a0 0x7f21f814cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:51.993 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.987+0000 7f21fd08f640 1 -- 172.21.15.118:0/4008742304 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e4009420 con 0x7f21f80d2ed0 2023-05-16T13:53:51.993 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.987+0000 7f21fc88e640 1 --2- 172.21.15.118:0/4008742304 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f21f80b10a0 0x7f21f814cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:53:51.993 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.987+0000 7f21fd08f640 1 --2- 172.21.15.118:0/4008742304 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f21f80d2ed0 0x7f21f8152d70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f21f000c770 tx=0x7f21f000cc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:53:51.994 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.987+0000 7f21f57fa640 1 -- 172.21.15.118:0/4008742304 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f0003b80 con 0x7f21f80d2ed0 2023-05-16T13:53:51.994 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.987+0000 7f21f57fa640 1 -- 172.21.15.118:0/4008742304 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21f0003ce0 con 0x7f21f80d2ed0 2023-05-16T13:53:51.994 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.987+0000 7f21feaf2640 1 -- 172.21.15.118:0/4008742304 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21ec0094d0 con 0x7f21f80d2ed0 2023-05-16T13:53:51.994 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.987+0000 7f21f57fa640 1 -- 172.21.15.118:0/4008742304 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f000aa90 con 0x7f21f80d2ed0 2023-05-16T13:53:51.994 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.987+0000 7f21feaf2640 1 -- 172.21.15.118:0/4008742304 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21f80b1470 con 0x7f21f80d2ed0 2023-05-16T13:53:51.995 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.987+0000 7f21f57fa640 1 -- 172.21.15.118:0/4008742304 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f21f00050d0 con 0x7f21f80d2ed0 2023-05-16T13:53:51.995 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.987+0000 7f21f57fa640 1 -- 172.21.15.118:0/4008742304 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f21f00124c0 con 0x7f21f80d2ed0 2023-05-16T13:53:51.995 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.987+0000 7f21feaf2640 1 -- 172.21.15.118:0/4008742304 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21f806c2a0 con 0x7f21f80d2ed0 2023-05-16T13:53:51.996 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:51.991+0000 7f21f57fa640 1 -- 172.21.15.118:0/4008742304 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f21f0005380 con 0x7f21f80d2ed0 2023-05-16T13:53:52.046 INFO:tasks.ceph.mgr.y.smithi039.stderr:2023-05-16T13:53:52.039+0000 7f09e8dff180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-16T13:53:52.050 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-05-16T13:53:52.043+0000 7fd9fd3e4180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-16T13:53:52.061 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.055+0000 7f21feaf2640 1 -- 172.21.15.118:0/4008742304 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c4a982c1-f497-4b0f-8a23-c77372e4621e", "id": 6} v 0) v1 -- 0x7f21f80b04a0 con 0x7f21f80d2ed0 2023-05-16T13:53:52.074 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.067+0000 7f21f57fa640 1 -- 172.21.15.118:0/4008742304 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c4a982c1-f497-4b0f-8a23-c77372e4621e", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f21f0005520 con 0x7f21f80d2ed0 2023-05-16T13:53:52.074 INFO:teuthology.orchestra.run.smithi118.stdout:6 2023-05-16T13:53:52.075 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.071+0000 7f21feaf2640 1 -- 172.21.15.118:0/4008742304 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f21f80d2ed0 msgr2=0x7f21f8152d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:53:52.075 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.071+0000 7f21feaf2640 1 --2- 172.21.15.118:0/4008742304 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f21f80d2ed0 0x7f21f8152d70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f21f000c770 tx=0x7f21f000cc30 comp rx=0 tx=0).stop 2023-05-16T13:53:52.076 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.071+0000 7f21feaf2640 1 -- 172.21.15.118:0/4008742304 shutdown_connections 2023-05-16T13:53:52.076 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.071+0000 7f21feaf2640 1 --2- 172.21.15.118:0/4008742304 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f21f80d2ed0 0x7f21f8152d70 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:52.076 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.071+0000 7f21feaf2640 1 --2- 172.21.15.118:0/4008742304 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f21f80d0950 0x7f21f8152830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:52.077 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.071+0000 7f21feaf2640 1 --2- 172.21.15.118:0/4008742304 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f21f80b10a0 0x7f21f814cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:52.077 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.071+0000 7f21feaf2640 1 -- 172.21.15.118:0/4008742304 >> 172.21.15.118:0/4008742304 conn(0x7f21f809bba0 msgr2=0x7f21f8072980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:53:52.077 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.071+0000 7f21feaf2640 1 -- 172.21.15.118:0/4008742304 shutdown_connections 2023-05-16T13:53:52.077 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.071+0000 7f21feaf2640 1 -- 172.21.15.118:0/4008742304 wait complete. 2023-05-16T13:53:52.093 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd new 6f2888aa-a7ac-4e26-9159-e31817934f44 7 2023-05-16T13:53:52.118 INFO:tasks.ceph.mgr.y.smithi039.stderr:2023-05-16T13:53:52.111+0000 7f09e8dff180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-16T13:53:52.122 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-05-16T13:53:52.115+0000 7fd9fd3e4180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-16T13:53:52.252 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.247+0000 7fe753e41640 1 Processor -- start 2023-05-16T13:53:52.253 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.247+0000 7fe753e41640 1 -- start start 2023-05-16T13:53:52.254 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.247+0000 7fe753e41640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fe74c0b10a0 0x7fe74c0d2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:53:52.254 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.247+0000 7fe753e41640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe74c0d0b20 0x7fe74c0af490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:53:52.255 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.247+0000 7fe753e41640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe74c06c610 con 0x7fe74c0d2ed0 2023-05-16T13:53:52.255 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.247+0000 7fe753e41640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe74c06caa0 con 0x7fe74c0b10a0 2023-05-16T13:53:52.255 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.247+0000 7fe753e41640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe74c06ba00 con 0x7fe74c0d0b20 2023-05-16T13:53:52.255 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.247+0000 7fe7523de640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe74c0d0b20 0x7fe74c0af490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:53:52.255 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.247+0000 7fe7523de640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe74c0d0b20 0x7fe74c0af490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:52186/0 (socket says 172.21.15.118:52186) 2023-05-16T13:53:52.255 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.247+0000 7fe751bdd640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fe74c0b10a0 0x7fe74c0d2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:53:52.255 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.247+0000 7fe7523de640 1 -- 172.21.15.118:0/1010613536 learned_addr learned my addr 172.21.15.118:0/1010613536 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-05-16T13:53:52.256 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.247+0000 7fe7523de640 1 -- 172.21.15.118:0/1010613536 >> v2:172.21.15.39:3300/0 conn(0x7fe74c0b10a0 msgr2=0x7fe74c0d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:53:52.256 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.247+0000 7fe7523de640 1 --2- 172.21.15.118:0/1010613536 >> v2:172.21.15.39:3300/0 conn(0x7fe74c0b10a0 0x7fe74c0d2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:52.256 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.247+0000 7fe7523de640 1 -- 172.21.15.118:0/1010613536 >> v1:172.21.15.39:6789/0 conn(0x7fe74c0d2ed0 legacy=0x7fe74c0d0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:53:52.256 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.247+0000 7fe7523de640 1 -- 172.21.15.118:0/1010613536 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe74c06bce0 con 0x7fe74c0d0b20 2023-05-16T13:53:52.258 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.255+0000 7fe7523de640 1 --2- 172.21.15.118:0/1010613536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe74c0d0b20 0x7fe74c0af490 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe74c15fa30 tx=0x7fe74401c9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0f11cd1c7753184 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:53:52.259 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.255+0000 7fe750bdb640 1 -- 172.21.15.118:0/1010613536 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7440a5860 con 0x7fe74c0d0b20 2023-05-16T13:53:52.259 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.255+0000 7fe750bdb640 1 -- 172.21.15.118:0/1010613536 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7440a59c0 con 0x7fe74c0d0b20 2023-05-16T13:53:52.259 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.255+0000 7fe750bdb640 1 -- 172.21.15.118:0/1010613536 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7440a5d50 con 0x7fe74c0d0b20 2023-05-16T13:53:52.260 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.255+0000 7fe753e41640 1 -- 172.21.15.118:0/1010613536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe74c0d0b20 msgr2=0x7fe74c0af490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:53:52.260 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.255+0000 7fe753e41640 1 --2- 172.21.15.118:0/1010613536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe74c0d0b20 0x7fe74c0af490 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe74c15fa30 tx=0x7fe74401c9a0 comp rx=0 tx=0).stop 2023-05-16T13:53:52.260 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.255+0000 7fe753e41640 1 -- 172.21.15.118:0/1010613536 shutdown_connections 2023-05-16T13:53:52.260 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.255+0000 7fe753e41640 1 --2- 172.21.15.118:0/1010613536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe74c0d0b20 0x7fe74c0af490 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:52.261 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.255+0000 7fe753e41640 1 --2- 172.21.15.118:0/1010613536 >> v2:172.21.15.39:3300/0 conn(0x7fe74c0b10a0 0x7fe74c0d2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:52.261 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.255+0000 7fe753e41640 1 -- 172.21.15.118:0/1010613536 >> 172.21.15.118:0/1010613536 conn(0x7fe74c09bba0 msgr2=0x7fe74c089fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:53:52.261 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.255+0000 7fe753e41640 1 -- 172.21.15.118:0/1010613536 shutdown_connections 2023-05-16T13:53:52.261 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.255+0000 7fe753e41640 1 -- 172.21.15.118:0/1010613536 wait complete. 2023-05-16T13:53:52.261 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.255+0000 7fe753e41640 1 Processor -- start 2023-05-16T13:53:52.262 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.255+0000 7fe753e41640 1 -- start start 2023-05-16T13:53:52.263 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.259+0000 7fe753e41640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe74c0b10a0 0x7fe74c0c8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:53:52.263 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.259+0000 7fe753e41640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe74c0d0b20 0x7fe74c15b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:53:52.263 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.259+0000 7fe753e41640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe74c0d2ed0 0x7fe74c15bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:53:52.263 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.259+0000 7fe753e41640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe74c158490 con 0x7fe74c0d0b20 2023-05-16T13:53:52.264 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.259+0000 7fe753e41640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe74c1578c0 con 0x7fe74c0b10a0 2023-05-16T13:53:52.264 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.259+0000 7fe753e41640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe74c157b60 con 0x7fe74c0d2ed0 2023-05-16T13:53:52.264 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.259+0000 7fe751bdd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe74c0b10a0 0x7fe74c0c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:53:52.264 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.259+0000 7fe751bdd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe74c0b10a0 0x7fe74c0c8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:52188/0 (socket says 172.21.15.118:52188) 2023-05-16T13:53:52.264 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.259+0000 7fe751bdd640 1 -- 172.21.15.118:0/321826154 learned_addr learned my addr 172.21.15.118:0/321826154 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-05-16T13:53:52.264 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.259+0000 7fe7523de640 1 --2- 172.21.15.118:0/321826154 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe74c0d2ed0 0x7fe74c15bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:53:52.264 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.259+0000 7fe7513dc640 1 --2- 172.21.15.118:0/321826154 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe74c0d0b20 0x7fe74c15b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:53:52.265 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.259+0000 7fe751bdd640 1 -- 172.21.15.118:0/321826154 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe74c0d2ed0 msgr2=0x7fe74c15bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:53:52.266 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.259+0000 7fe751bdd640 1 --2- 172.21.15.118:0/321826154 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe74c0d2ed0 0x7fe74c15bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:52.266 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.259+0000 7fe751bdd640 1 -- 172.21.15.118:0/321826154 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe74c0d0b20 msgr2=0x7fe74c15b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:53:52.266 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.259+0000 7fe751bdd640 1 --2- 172.21.15.118:0/321826154 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe74c0d0b20 0x7fe74c15b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:52.266 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.259+0000 7fe751bdd640 1 -- 172.21.15.118:0/321826154 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe744009b30 con 0x7fe74c0b10a0 2023-05-16T13:53:52.266 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.259+0000 7fe7523de640 1 --2- 172.21.15.118:0/321826154 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe74c0d2ed0 0x7fe74c15bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:53:52.266 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.259+0000 7fe751bdd640 1 --2- 172.21.15.118:0/321826154 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe74c0b10a0 0x7fe74c0c8220 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe74800e930 tx=0x7fe74800edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:53:52.266 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.259+0000 7fe7427fc640 1 -- 172.21.15.118:0/321826154 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe748009690 con 0x7fe74c0b10a0 2023-05-16T13:53:52.266 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.259+0000 7fe7427fc640 1 -- 172.21.15.118:0/321826154 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe74800ca00 con 0x7fe74c0b10a0 2023-05-16T13:53:52.267 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.259+0000 7fe7427fc640 1 -- 172.21.15.118:0/321826154 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74800cd70 con 0x7fe74c0b10a0 2023-05-16T13:53:52.267 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.259+0000 7fe753e41640 1 -- 172.21.15.118:0/321826154 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe74c06b620 con 0x7fe74c0b10a0 2023-05-16T13:53:52.267 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.259+0000 7fe753e41640 1 -- 172.21.15.118:0/321826154 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe74c0b1470 con 0x7fe74c0b10a0 2023-05-16T13:53:52.267 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.259+0000 7fe7427fc640 1 -- 172.21.15.118:0/321826154 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe748005ca0 con 0x7fe74c0b10a0 2023-05-16T13:53:52.267 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.259+0000 7fe7427fc640 1 -- 172.21.15.118:0/321826154 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fe748013470 con 0x7fe74c0b10a0 2023-05-16T13:53:52.267 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.259+0000 7fe753e41640 1 -- 172.21.15.118:0/321826154 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe74c06b7b0 con 0x7fe74c0b10a0 2023-05-16T13:53:52.268 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.263+0000 7fe7427fc640 1 -- 172.21.15.118:0/321826154 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fe748021060 con 0x7fe74c0b10a0 2023-05-16T13:53:52.332 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.327+0000 7fe753e41640 1 -- 172.21.15.118:0/321826154 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6f2888aa-a7ac-4e26-9159-e31817934f44", "id": 7} v 0) v1 -- 0x7fe74c073c90 con 0x7fe74c0b10a0 2023-05-16T13:53:52.344 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.339+0000 7fe7427fc640 1 -- 172.21.15.118:0/321826154 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6f2888aa-a7ac-4e26-9159-e31817934f44", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe748029020 con 0x7fe74c0b10a0 2023-05-16T13:53:52.344 INFO:teuthology.orchestra.run.smithi118.stdout:7 2023-05-16T13:53:52.345 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.339+0000 7fe753e41640 1 -- 172.21.15.118:0/321826154 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe74c0b10a0 msgr2=0x7fe74c0c8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:53:52.345 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.339+0000 7fe753e41640 1 --2- 172.21.15.118:0/321826154 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe74c0b10a0 0x7fe74c0c8220 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe74800e930 tx=0x7fe74800edf0 comp rx=0 tx=0).stop 2023-05-16T13:53:52.345 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.339+0000 7fe753e41640 1 -- 172.21.15.118:0/321826154 shutdown_connections 2023-05-16T13:53:52.346 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.339+0000 7fe753e41640 1 --2- 172.21.15.118:0/321826154 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe74c0d2ed0 0x7fe74c15bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:52.346 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.339+0000 7fe753e41640 1 --2- 172.21.15.118:0/321826154 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe74c0d0b20 0x7fe74c15b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:52.346 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.339+0000 7fe753e41640 1 --2- 172.21.15.118:0/321826154 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe74c0b10a0 0x7fe74c0c8220 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:52.346 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.339+0000 7fe753e41640 1 -- 172.21.15.118:0/321826154 >> 172.21.15.118:0/321826154 conn(0x7fe74c09bba0 msgr2=0x7fe74c0b2320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:53:52.346 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.339+0000 7fe753e41640 1 -- 172.21.15.118:0/321826154 shutdown_connections 2023-05-16T13:53:52.346 INFO:teuthology.orchestra.run.smithi118.stderr:2023-05-16T13:53:52.339+0000 7fe753e41640 1 -- 172.21.15.118:0/321826154 wait complete. 2023-05-16T13:53:52.362 INFO:tasks.ceph.osd.0:Restarting daemon 2023-05-16T13:53:52.362 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-05-16T13:53:52.365 INFO:tasks.ceph.osd.0:Started 2023-05-16T13:53:52.365 INFO:tasks.ceph.osd.1:Restarting daemon 2023-05-16T13:53:52.366 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-05-16T13:53:52.368 INFO:tasks.ceph.osd.1:Started 2023-05-16T13:53:52.368 INFO:tasks.ceph.osd.2:Restarting daemon 2023-05-16T13:53:52.369 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-05-16T13:53:52.371 INFO:tasks.ceph.osd.2:Started 2023-05-16T13:53:52.371 INFO:tasks.ceph.osd.3:Restarting daemon 2023-05-16T13:53:52.372 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-05-16T13:53:52.375 INFO:tasks.ceph.osd.3:Started 2023-05-16T13:53:52.375 INFO:tasks.ceph.osd.4:Restarting daemon 2023-05-16T13:53:52.375 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-05-16T13:53:52.378 INFO:tasks.ceph.osd.4:Started 2023-05-16T13:53:52.378 INFO:tasks.ceph.osd.5:Restarting daemon 2023-05-16T13:53:52.379 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-05-16T13:53:52.381 INFO:tasks.ceph.osd.5:Started 2023-05-16T13:53:52.381 INFO:tasks.ceph.osd.6:Restarting daemon 2023-05-16T13:53:52.382 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-05-16T13:53:52.384 INFO:tasks.ceph.osd.6:Started 2023-05-16T13:53:52.385 INFO:tasks.ceph.osd.7:Restarting daemon 2023-05-16T13:53:52.385 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-05-16T13:53:52.388 INFO:tasks.ceph.osd.7:Started 2023-05-16T13:53:52.389 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-16T13:53:52.586 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:52.579+0000 7f3af10c3640 1 Processor -- start 2023-05-16T13:53:52.586 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:52.579+0000 7f3af10c3640 1 -- start start 2023-05-16T13:53:52.587 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:52.579+0000 7f3af10c3640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3aec0b1f60 0x7f3aec0b2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:53:52.587 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:52.579+0000 7f3af10c3640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f3aec06c4f0 0x7f3aec0b2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:53:52.587 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:52.583+0000 7f3af10c3640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3aec0b2db0 con 0x7f3aec0cca00 2023-05-16T13:53:52.587 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:52.583+0000 7f3af10c3640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3aec15c2e0 con 0x7f3aec06c4f0 2023-05-16T13:53:52.587 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:52.583+0000 7f3af10c3640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aec06ca60 con 0x7f3aec0b1f60 2023-05-16T13:53:52.588 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:52.583+0000 7f3ae3fff640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f3aec06c4f0 0x7f3aec0b2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:53:52.588 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:52.583+0000 7f3ae3fff640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f3aec06c4f0 0x7f3aec0b2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:37392/0 (socket says 172.21.15.39:37392) 2023-05-16T13:53:52.588 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:52.583+0000 7f3ae3fff640 1 -- 172.21.15.39:0/2646580962 learned_addr learned my addr 172.21.15.39:0/2646580962 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:53:52.588 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:52.583+0000 7f3aead9d640 1 --2- 172.21.15.39:0/2646580962 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3aec0b1f60 0x7f3aec0b2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:53:52.589 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:52.583+0000 7f3ae3fff640 1 -- 172.21.15.39:0/2646580962 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3aec0b1f60 msgr2=0x7f3aec0b2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:53:52.589 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:52.583+0000 7f3ae3fff640 1 --2- 172.21.15.39:0/2646580962 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3aec0b1f60 0x7f3aec0b2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:52.589 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:52.583+0000 7f3ae3fff640 1 -- 172.21.15.39:0/2646580962 >> v1:172.21.15.118:6789/0 conn(0x7f3aec0cca00 legacy=0x7f3aec0cce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:53:52.589 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:52.583+0000 7f3ae3fff640 1 -- 172.21.15.39:0/2646580962 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aec06ab60 con 0x7f3aec06c4f0 2023-05-16T13:53:52.590 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:52.583+0000 7f3ae3fff640 1 --2- 172.21.15.39:0/2646580962 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3aec06c4f0 0x7f3aec0b2870 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3ad4009870 tx=0x7f3ad401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68b5d79cd1e71c63 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:53:52.591 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:52.583+0000 7f3aea59c640 1 -- 172.21.15.39:0/2646580962 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad40aa610 con 0x7f3aec06c4f0 2023-05-16T13:53:52.591 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:52.587+0000 7f3aea59c640 1 -- 172.21.15.39:0/2646580962 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ad40a6040 con 0x7f3aec06c4f0 2023-05-16T13:53:52.591 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:52.587+0000 7f3aea59c640 1 -- 172.21.15.39:0/2646580962 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad40aa990 con 0x7f3aec06c4f0 2023-05-16T13:53:52.592 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:52.587+0000 7f3af10c3640 1 -- 172.21.15.39:0/2646580962 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3aec06c4f0 msgr2=0x7f3aec0b2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:53:52.592 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:52.587+0000 7f3af10c3640 1 --2- 172.21.15.39:0/2646580962 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3aec06c4f0 0x7f3aec0b2870 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3ad4009870 tx=0x7f3ad401c4b0 comp rx=0 tx=0).stop 2023-05-16T13:53:52.592 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:52.587+0000 7f3af10c3640 1 -- 172.21.15.39:0/2646580962 shutdown_connections 2023-05-16T13:53:52.592 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:52.587+0000 7f3af10c3640 1 --2- 172.21.15.39:0/2646580962 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3aec06c4f0 0x7f3aec0b2870 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:52.592 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:52.587+0000 7f3af10c3640 1 --2- 172.21.15.39:0/2646580962 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3aec0b1f60 0x7f3aec0b2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:52.592 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:52.587+0000 7f3af10c3640 1 -- 172.21.15.39:0/2646580962 >> 172.21.15.39:0/2646580962 conn(0x7f3aec06dd00 msgr2=0x7f3aec06e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:53:52.593 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:52.587+0000 7f3af10c3640 1 -- 172.21.15.39:0/2646580962 shutdown_connections 2023-05-16T13:53:52.593 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:52.587+0000 7f3af10c3640 1 -- 172.21.15.39:0/2646580962 wait complete. 2023-05-16T13:53:52.593 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:52.587+0000 7f3af10c3640 1 Processor -- start 2023-05-16T13:53:52.593 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:52.587+0000 7f3af10c3640 1 -- start start 2023-05-16T13:53:52.594 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:52.587+0000 7f3af10c3640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3aec06c4f0 0x7f3aec0af730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:53:52.594 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:52.587+0000 7f3af10c3640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3aec0b1f60 0x7f3aec154760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:53:52.595 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:52.587+0000 7f3af10c3640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3aec0cca00 0x7f3aec155030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:53:52.595 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:52.587+0000 7f3af10c3640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aec15d790 con 0x7f3aec0cca00 2023-05-16T13:53:52.595 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:52.587+0000 7f3af10c3640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aec156950 con 0x7f3aec06c4f0 2023-05-16T13:53:52.595 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:52.587+0000 7f3af10c3640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aec0afc70 con 0x7f3aec0b1f60 2023-05-16T13:53:52.595 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:52.587+0000 7f3aeb59e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3aec0cca00 0x7f3aec155030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:53:52.595 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:52.587+0000 7f3aeb59e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3aec0cca00 0x7f3aec155030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:37404/0 (socket says 172.21.15.39:37404) 2023-05-16T13:53:52.595 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:52.587+0000 7f3aeb59e640 1 -- 172.21.15.39:0/2090831013 learned_addr learned my addr 172.21.15.39:0/2090831013 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:53:52.597 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:52.591+0000 7f3ae3fff640 1 --2- 172.21.15.39:0/2090831013 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3aec0b1f60 0x7f3aec154760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:53:52.597 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:52.591+0000 7f3aead9d640 1 --2- 172.21.15.39:0/2090831013 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3aec06c4f0 0x7f3aec0af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:53:52.597 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:52.591+0000 7f3aeb59e640 1 -- 172.21.15.39:0/2090831013 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3aec0b1f60 msgr2=0x7f3aec154760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:53:52.597 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:52.591+0000 7f3aeb59e640 1 --2- 172.21.15.39:0/2090831013 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3aec0b1f60 0x7f3aec154760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:52.598 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:52.591+0000 7f3aeb59e640 1 -- 172.21.15.39:0/2090831013 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3aec06c4f0 msgr2=0x7f3aec0af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:53:52.598 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:52.591+0000 7f3aeb59e640 1 --2- 172.21.15.39:0/2090831013 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3aec06c4f0 0x7f3aec0af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:52.598 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:52.591+0000 7f3aeb59e640 1 -- 172.21.15.39:0/2090831013 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ad40094d0 con 0x7f3aec0cca00 2023-05-16T13:53:52.598 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:52.591+0000 7f3ae3fff640 1 --2- 172.21.15.39:0/2090831013 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3aec0b1f60 0x7f3aec154760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:53:52.598 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:52.591+0000 7f3aead9d640 1 --2- 172.21.15.39:0/2090831013 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3aec06c4f0 0x7f3aec0af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:53:52.598 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:52.591+0000 7f3aeb59e640 1 --2- 172.21.15.39:0/2090831013 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3aec0cca00 0x7f3aec155030 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3ae400c730 tx=0x7f3ae400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:53:52.598 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:52.591+0000 7f3ae37fe640 1 -- 172.21.15.39:0/2090831013 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae4003b80 con 0x7f3aec0cca00 2023-05-16T13:53:52.599 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:52.591+0000 7f3ae37fe640 1 -- 172.21.15.39:0/2090831013 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ae4003ce0 con 0x7f3aec0cca00 2023-05-16T13:53:52.599 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:52.591+0000 7f3af10c3640 1 -- 172.21.15.39:0/2090831013 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3aec06b920 con 0x7f3aec0cca00 2023-05-16T13:53:52.599 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:52.591+0000 7f3ae37fe640 1 -- 172.21.15.39:0/2090831013 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae400aa30 con 0x7f3aec0cca00 2023-05-16T13:53:52.599 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:52.591+0000 7f3af10c3640 1 -- 172.21.15.39:0/2090831013 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3aec06b400 con 0x7f3aec0cca00 2023-05-16T13:53:52.599 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:52.591+0000 7f3ae37fe640 1 -- 172.21.15.39:0/2090831013 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3ae40050d0 con 0x7f3aec0cca00 2023-05-16T13:53:52.599 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:52.591+0000 7f3ae37fe640 1 -- 172.21.15.39:0/2090831013 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f3ae4012af0 con 0x7f3aec0cca00 2023-05-16T13:53:52.599 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:52.591+0000 7f3af10c3640 1 -- 172.21.15.39:0/2090831013 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3aec06bf60 con 0x7f3aec0cca00 2023-05-16T13:53:52.600 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:52.595+0000 7f3ae37fe640 1 -- 172.21.15.39:0/2090831013 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f3ae4012dd0 con 0x7f3aec0cca00 2023-05-16T13:53:52.656 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:52.651+0000 7f3af10c3640 1 -- 172.21.15.39:0/2090831013 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3aec15d8d0 con 0x7f3aec0cca00 2023-05-16T13:53:52.657 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:52.651+0000 7f3ae37fe640 1 -- 172.21.15.39:0/2090831013 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f3ae4005380 con 0x7f3aec0cca00 2023-05-16T13:53:52.657 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:53:52.658 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":10,"fsid":"9c1e210b-c515-4ea4-a065-397956895c68","created":"2023-05-16T13:53:48.955290+0000","modified":"2023-05-16T13:53:52.331336+0000","last_up_change":"0.000000","last_in_change":"2023-05-16T13:53:52.331336+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"4ce0f0ba-c4bf-4405-8c95-d2e9a62878ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"53fdc1ac-2473-472d-af32-2760fdf6e476","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0b92d770-7030-42fa-a19f-4f7f1ac113c6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"000d9506-cbb2-4017-b875-deca579860ed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"70f0dacb-e960-40c5-bf6a-183e52bbe2ea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"756feb54-c3ae-4a2a-8f74-85c291ba707c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c4a982c1-f497-4b0f-8a23-c77372e4621e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"6f2888aa-a7ac-4e26-9159-e31817934f44","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-16T13:53:52.658 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:52.651+0000 7f3af10c3640 1 -- 172.21.15.39:0/2090831013 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3aec0cca00 msgr2=0x7f3aec155030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:53:52.658 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:52.651+0000 7f3af10c3640 1 --2- 172.21.15.39:0/2090831013 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3aec0cca00 0x7f3aec155030 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3ae400c730 tx=0x7f3ae400cbf0 comp rx=0 tx=0).stop 2023-05-16T13:53:52.659 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:52.651+0000 7f3af10c3640 1 -- 172.21.15.39:0/2090831013 shutdown_connections 2023-05-16T13:53:52.659 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:52.651+0000 7f3af10c3640 1 --2- 172.21.15.39:0/2090831013 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3aec0b1f60 0x7f3aec154760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:52.659 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:52.651+0000 7f3af10c3640 1 --2- 172.21.15.39:0/2090831013 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3aec0cca00 0x7f3aec155030 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:52.659 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:52.651+0000 7f3af10c3640 1 --2- 172.21.15.39:0/2090831013 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3aec06c4f0 0x7f3aec0af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:52.659 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:52.651+0000 7f3af10c3640 1 -- 172.21.15.39:0/2090831013 >> 172.21.15.39:0/2090831013 conn(0x7f3aec06dd00 msgr2=0x7f3aec0d0440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:53:52.659 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:52.651+0000 7f3af10c3640 1 -- 172.21.15.39:0/2090831013 shutdown_connections 2023-05-16T13:53:52.659 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:53:52.651+0000 7f3af10c3640 1 -- 172.21.15.39:0/2090831013 wait complete. 2023-05-16T13:53:52.676 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-05-16T13:53:52.677 INFO:tasks.ceph:Waiting for OSDs to come up 2023-05-16T13:53:52.795 INFO:tasks.ceph.mgr.y.smithi039.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-05-16T13:53:52.796 INFO:tasks.ceph.mgr.y.smithi039.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-05-16T13:53:52.796 INFO:tasks.ceph.mgr.y.smithi039.stderr: from numpy import show_config as show_numpy_config 2023-05-16T13:53:52.800 INFO:tasks.ceph.osd.1.smithi039.stderr:2023-05-16T13:53:52.795+0000 7f5fed3c6640 -1 Falling back to public interface 2023-05-16T13:53:52.820 INFO:tasks.ceph.osd.0.smithi039.stderr:2023-05-16T13:53:52.815+0000 7f23255fd640 -1 Falling back to public interface 2023-05-16T13:53:52.847 INFO:tasks.ceph.mgr.y.smithi039.stderr:2023-05-16T13:53:52.843+0000 7f09e8dff180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-16T13:53:52.848 INFO:tasks.ceph.osd.2.smithi039.stderr:2023-05-16T13:53:52.843+0000 7fa598b20640 -1 Falling back to public interface 2023-05-16T13:53:52.855 INFO:tasks.ceph.mgr.x.smithi118.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-05-16T13:53:52.855 INFO:tasks.ceph.mgr.x.smithi118.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-05-16T13:53:52.856 INFO:tasks.ceph.mgr.x.smithi118.stderr: from numpy import show_config as show_numpy_config 2023-05-16T13:53:52.906 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-05-16T13:53:52.899+0000 7fd9fd3e4180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-16T13:53:52.986 INFO:tasks.ceph.mgr.y.smithi039.stderr:2023-05-16T13:53:52.979+0000 7f09e8dff180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-16T13:53:53.020 INFO:tasks.ceph.osd.4.smithi118.stderr:2023-05-16T13:53:53.015+0000 7f3f55ef9640 -1 Falling back to public interface 2023-05-16T13:53:53.021 INFO:tasks.ceph.osd.5.smithi118.stderr:2023-05-16T13:53:53.015+0000 7fec73577640 -1 Falling back to public interface 2023-05-16T13:53:53.032 INFO:tasks.ceph.osd.3.smithi039.stderr:2023-05-16T13:53:53.027+0000 7f015d6e2640 -1 Falling back to public interface 2023-05-16T13:53:53.040 INFO:tasks.ceph.osd.7.smithi118.stderr:2023-05-16T13:53:53.035+0000 7fe14f470640 -1 Falling back to public interface 2023-05-16T13:53:53.048 INFO:tasks.ceph.osd.6.smithi118.stderr:2023-05-16T13:53:53.043+0000 7fd934596640 -1 Falling back to public interface 2023-05-16T13:53:53.048 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-05-16T13:53:53.043+0000 7fd9fd3e4180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-16T13:53:53.157 INFO:tasks.ceph.mgr.y.smithi039.stderr:2023-05-16T13:53:53.151+0000 7f09e8dff180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-16T13:53:53.233 INFO:tasks.ceph.mgr.y.smithi039.stderr:2023-05-16T13:53:53.227+0000 7f09e8dff180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-16T13:53:53.240 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-05-16T13:53:53.235+0000 7fd9fd3e4180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-16T13:53:53.311 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-05-16T13:53:53.307+0000 7fd9fd3e4180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-16T13:53:53.375 INFO:tasks.ceph.mgr.y.smithi039.stderr:2023-05-16T13:53:53.371+0000 7f09e8dff180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-16T13:53:53.448 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-05-16T13:53:53.443+0000 7fd9fd3e4180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-16T13:53:53.482 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-05-16T13:53:53.609 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:53:53.603+0000 7f271bc8c640 1 Processor -- start 2023-05-16T13:53:53.610 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:53:53.603+0000 7f271bc8c640 1 -- start start 2023-05-16T13:53:53.610 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:53:53.603+0000 7f271bc8c640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f271415fc20 0x7f271415f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:53:53.611 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:53:53.603+0000 7f271bc8c640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f271415dfc0 con 0x7f271415da00 2023-05-16T13:53:53.611 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:53:53.603+0000 7f271bc8c640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f271415e2a0 con 0x7f27140b3e40 2023-05-16T13:53:53.611 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:53:53.603+0000 7f271bc8c640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f271415e580 con 0x7f271415fc20 2023-05-16T13:53:53.612 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:53:53.607+0000 7f271a229640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f271415da00 0x7f27140d03f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:47588/0 (socket says 172.21.15.39:47588) 2023-05-16T13:53:53.612 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:53:53.607+0000 7f271a229640 1 -- 172.21.15.39:0/2632206902 learned_addr learned my addr 172.21.15.39:0/2632206902 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:53:53.612 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:53:53.607+0000 7f2719227640 1 --2- 172.21.15.39:0/2632206902 >> v2:172.21.15.118:3300/0 conn(0x7f271415fc20 0x7f271415f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:53:53.612 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:53:53.607+0000 7f2718a26640 1 -- 172.21.15.39:0/2632206902 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1136523299 0 0) 0x7f271415e2a0 con 0x7f27140b3e40 2023-05-16T13:53:53.612 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:53:53.607+0000 7f2719227640 1 -- 172.21.15.39:0/2632206902 >> v1:172.21.15.118:6789/0 conn(0x7f27140b3e40 legacy=0x7f27140b1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:53:53.612 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:53:53.607+0000 7f2719227640 1 -- 172.21.15.39:0/2632206902 >> v1:172.21.15.39:6789/0 conn(0x7f271415da00 legacy=0x7f27140d03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:53:53.612 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:53:53.607+0000 7f2719227640 1 -- 172.21.15.39:0/2632206902 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f271415e860 con 0x7f271415fc20 2023-05-16T13:53:53.614 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:53:53.607+0000 7f2719227640 1 --2- 172.21.15.39:0/2632206902 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f271415fc20 0x7f271415f060 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f27040097c0 tx=0x7f270401c310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72133539cdcbce06 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:53:53.614 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:53:53.607+0000 7f2718a26640 1 -- 172.21.15.39:0/2632206902 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27040ab600 con 0x7f271415fc20 2023-05-16T13:53:53.615 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:53:53.607+0000 7f2718a26640 1 -- 172.21.15.39:0/2632206902 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27040a7050 con 0x7f271415fc20 2023-05-16T13:53:53.615 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:53:53.607+0000 7f2718a26640 1 -- 172.21.15.39:0/2632206902 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27040ab980 con 0x7f271415fc20 2023-05-16T13:53:53.615 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:53:53.611+0000 7f271bc8c640 1 -- 172.21.15.39:0/2632206902 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f271415fc20 msgr2=0x7f271415f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:53:53.616 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:53:53.611+0000 7f271bc8c640 1 --2- 172.21.15.39:0/2632206902 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f271415fc20 0x7f271415f060 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f27040097c0 tx=0x7f270401c310 comp rx=0 tx=0).stop 2023-05-16T13:53:53.616 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:53:53.611+0000 7f271bc8c640 1 -- 172.21.15.39:0/2632206902 shutdown_connections 2023-05-16T13:53:53.616 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:53:53.611+0000 7f271bc8c640 1 --2- 172.21.15.39:0/2632206902 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f271415fc20 0x7f271415f060 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:53.616 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:53:53.611+0000 7f271bc8c640 1 -- 172.21.15.39:0/2632206902 >> 172.21.15.39:0/2632206902 conn(0x7f271409bb60 msgr2=0x7f27140d2820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:53:53.616 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:53:53.611+0000 7f271bc8c640 1 -- 172.21.15.39:0/2632206902 shutdown_connections 2023-05-16T13:53:53.616 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:53:53.611+0000 7f271bc8c640 1 -- 172.21.15.39:0/2632206902 wait complete. 2023-05-16T13:53:53.617 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:53:53.611+0000 7f271bc8c640 1 Processor -- start 2023-05-16T13:53:53.617 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:53:53.611+0000 7f271bc8c640 1 -- start start 2023-05-16T13:53:53.618 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:53:53.611+0000 7f271bc8c640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f27140b3e40 0x7f27140b6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:53:53.618 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:53:53.611+0000 7f271bc8c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f271415da00 0x7f27140c8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:53:53.618 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:53:53.611+0000 7f271bc8c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f271415fc20 0x7f27140c9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:53:53.619 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:53:53.611+0000 7f271bc8c640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27140c9570 con 0x7f271415fc20 2023-05-16T13:53:53.619 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:53:53.611+0000 7f271bc8c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27141f61d0 con 0x7f271415da00 2023-05-16T13:53:53.619 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:53:53.611+0000 7f271bc8c640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27141f5650 con 0x7f27140b3e40 2023-05-16T13:53:53.619 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:53:53.611+0000 7f271a229640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f271415fc20 0x7f27140c9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:53:53.619 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:53:53.611+0000 7f271a229640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f271415fc20 0x7f27140c9030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:37412/0 (socket says 172.21.15.39:37412) 2023-05-16T13:53:53.619 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:53:53.611+0000 7f2719227640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f271415da00 0x7f27140c8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:53:53.619 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:53:53.611+0000 7f271a229640 1 -- 172.21.15.39:0/2105528251 learned_addr learned my addr 172.21.15.39:0/2105528251 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:53:53.619 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:53:53.611+0000 7f2719a28640 1 --2- 172.21.15.39:0/2105528251 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f27140b3e40 0x7f27140b6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:53:53.621 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:53:53.611+0000 7f271a229640 1 -- 172.21.15.39:0/2105528251 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f27140b3e40 msgr2=0x7f27140b6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:53:53.621 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:53:53.611+0000 7f271a229640 1 --2- 172.21.15.39:0/2105528251 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f27140b3e40 0x7f27140b6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:53.621 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:53:53.611+0000 7f271a229640 1 -- 172.21.15.39:0/2105528251 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f271415da00 msgr2=0x7f27140c8af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:53:53.621 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:53:53.611+0000 7f271a229640 1 --2- 172.21.15.39:0/2105528251 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f271415da00 0x7f27140c8af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:53.621 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:53:53.611+0000 7f271a229640 1 -- 172.21.15.39:0/2105528251 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2704009420 con 0x7f271415fc20 2023-05-16T13:53:53.621 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:53:53.615+0000 7f271a229640 1 --2- 172.21.15.39:0/2105528251 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f271415fc20 0x7f27140c9030 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f270c00e550 tx=0x7f270c00ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:53:53.621 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:53:53.615+0000 7f270a7fc640 1 -- 172.21.15.39:0/2105528251 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270c012870 con 0x7f271415fc20 2023-05-16T13:53:53.622 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:53:53.615+0000 7f270a7fc640 1 -- 172.21.15.39:0/2105528251 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f270c0129d0 con 0x7f271415fc20 2023-05-16T13:53:53.622 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:53:53.615+0000 7f271bc8c640 1 -- 172.21.15.39:0/2105528251 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27140d3670 con 0x7f271415fc20 2023-05-16T13:53:53.622 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:53:53.615+0000 7f270a7fc640 1 -- 172.21.15.39:0/2105528251 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270c012d60 con 0x7f271415fc20 2023-05-16T13:53:53.622 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:53:53.615+0000 7f271bc8c640 1 -- 172.21.15.39:0/2105528251 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f271415eb40 con 0x7f271415fc20 2023-05-16T13:53:53.622 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:53:53.615+0000 7f270a7fc640 1 -- 172.21.15.39:0/2105528251 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f270c01c760 con 0x7f271415fc20 2023-05-16T13:53:53.622 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:53:53.615+0000 7f270a7fc640 1 -- 172.21.15.39:0/2105528251 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f270c009ab0 con 0x7f271415fc20 2023-05-16T13:53:53.622 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:53:53.615+0000 7f271bc8c640 1 -- 172.21.15.39:0/2105528251 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27140b2300 con 0x7f271415fc20 2023-05-16T13:53:53.623 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:53:53.615+0000 7f270a7fc640 1 -- 172.21.15.39:0/2105528251 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f270c0093e0 con 0x7f271415fc20 2023-05-16T13:53:53.681 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:53:53.675+0000 7f271bc8c640 1 -- 172.21.15.39:0/2105528251 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f271404de80 con 0x7f271415fc20 2023-05-16T13:53:53.682 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:53:53.675+0000 7f270a7fc640 1 -- 172.21.15.39:0/2105528251 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f270c009580 con 0x7f271415fc20 2023-05-16T13:53:53.682 INFO:teuthology.misc.health.smithi039.stdout: 2023-05-16T13:53:53.682 INFO:teuthology.misc.health.smithi039.stdout:{"epoch":10,"fsid":"9c1e210b-c515-4ea4-a065-397956895c68","created":"2023-05-16T13:53:48.955290+0000","modified":"2023-05-16T13:53:52.331336+0000","last_up_change":"0.000000","last_in_change":"2023-05-16T13:53:52.331336+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"4ce0f0ba-c4bf-4405-8c95-d2e9a62878ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"53fdc1ac-2473-472d-af32-2760fdf6e476","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0b92d770-7030-42fa-a19f-4f7f1ac113c6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"000d9506-cbb2-4017-b875-deca579860ed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"70f0dacb-e960-40c5-bf6a-183e52bbe2ea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"756feb54-c3ae-4a2a-8f74-85c291ba707c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c4a982c1-f497-4b0f-8a23-c77372e4621e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"6f2888aa-a7ac-4e26-9159-e31817934f44","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-16T13:53:53.683 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:53:53.679+0000 7f271bc8c640 1 -- 172.21.15.39:0/2105528251 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f271415fc20 msgr2=0x7f27140c9030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:53:53.683 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:53:53.679+0000 7f271bc8c640 1 --2- 172.21.15.39:0/2105528251 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f271415fc20 0x7f27140c9030 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f270c00e550 tx=0x7f270c00ea10 comp rx=0 tx=0).stop 2023-05-16T13:53:53.683 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:53:53.679+0000 7f271bc8c640 1 -- 172.21.15.39:0/2105528251 shutdown_connections 2023-05-16T13:53:53.684 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:53:53.679+0000 7f271bc8c640 1 --2- 172.21.15.39:0/2105528251 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f271415fc20 0x7f27140c9030 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:53.684 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:53:53.679+0000 7f271bc8c640 1 --2- 172.21.15.39:0/2105528251 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f271415da00 0x7f27140c8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:53.684 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:53:53.679+0000 7f271bc8c640 1 --2- 172.21.15.39:0/2105528251 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f27140b3e40 0x7f27140b6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:53:53.684 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:53:53.679+0000 7f271bc8c640 1 -- 172.21.15.39:0/2105528251 >> 172.21.15.39:0/2105528251 conn(0x7f271409bb60 msgr2=0x7f271415bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:53:53.684 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:53:53.679+0000 7f271bc8c640 1 -- 172.21.15.39:0/2105528251 shutdown_connections 2023-05-16T13:53:53.684 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:53:53.679+0000 7f271bc8c640 1 -- 172.21.15.39:0/2105528251 wait complete. 2023-05-16T13:53:53.699 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-05-16T13:53:54.074 INFO:tasks.ceph.mgr.y.smithi039.stderr:2023-05-16T13:53:54.067+0000 7f09e8dff180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-16T13:53:54.115 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-05-16T13:53:54.111+0000 7fd9fd3e4180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-16T13:53:54.164 INFO:tasks.ceph.mgr.y.smithi039.stderr:2023-05-16T13:53:54.159+0000 7f09e8dff180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-16T13:53:54.200 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-05-16T13:53:54.195+0000 7fd9fd3e4180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-16T13:53:54.362 INFO:tasks.ceph.mgr.y.smithi039.stderr:2023-05-16T13:53:54.355+0000 7f09e8dff180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-16T13:53:54.389 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-05-16T13:53:54.383+0000 7fd9fd3e4180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-16T13:53:54.450 INFO:tasks.ceph.mgr.y.smithi039.stderr:2023-05-16T13:53:54.443+0000 7f09e8dff180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-05-16T13:53:54.472 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-05-16T13:53:54.467+0000 7fd9fd3e4180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-05-16T13:53:54.745 INFO:tasks.ceph.mgr.y.smithi039.stderr:2023-05-16T13:53:54.739+0000 7f09e8dff180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-16T13:53:54.748 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-05-16T13:53:54.743+0000 7fd9fd3e4180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-16T13:53:54.816 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-05-16T13:53:54.811+0000 7fd9fd3e4180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-16T13:53:54.817 INFO:tasks.ceph.mgr.y.smithi039.stderr:2023-05-16T13:53:54.811+0000 7f09e8dff180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-16T13:53:55.836 INFO:tasks.ceph.mgr.y.smithi039.stderr:2023-05-16T13:53:55.831+0000 7f09908ad640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-05-16T13:53:55.839 INFO:tasks.ceph.mgr.y.smithi039.stderr:2023-05-16T13:53:55.835+0000 7f09908ad640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-05-16T13:53:56.742 INFO:tasks.ceph.osd.0.smithi039.stderr:2023-05-16T13:53:56.735+0000 7f23255fd640 -1 osd.0 0 log_to_monitors true 2023-05-16T13:53:56.757 INFO:tasks.ceph.osd.1.smithi039.stderr:2023-05-16T13:53:56.751+0000 7f5fed3c6640 -1 osd.1 0 log_to_monitors true 2023-05-16T13:53:56.787 INFO:tasks.ceph.osd.2.smithi039.stderr:2023-05-16T13:53:56.783+0000 7fa598b20640 -1 osd.2 0 log_to_monitors true 2023-05-16T13:53:56.926 INFO:tasks.ceph.osd.5.smithi118.stderr:2023-05-16T13:53:56.919+0000 7fec73577640 -1 osd.5 0 log_to_monitors true 2023-05-16T13:53:56.927 INFO:tasks.ceph.osd.7.smithi118.stderr:2023-05-16T13:53:56.919+0000 7fe14f470640 -1 osd.7 0 log_to_monitors true 2023-05-16T13:53:57.013 INFO:tasks.ceph.osd.6.smithi118.stderr:2023-05-16T13:53:57.007+0000 7fd934596640 -1 osd.6 0 log_to_monitors true 2023-05-16T13:53:57.051 INFO:tasks.ceph.osd.4.smithi118.stderr:2023-05-16T13:53:57.047+0000 7f3f55ef9640 -1 osd.4 0 log_to_monitors true 2023-05-16T13:53:57.087 INFO:tasks.ceph.osd.3.smithi039.stderr:2023-05-16T13:53:57.079+0000 7f015d6e2640 -1 osd.3 0 log_to_monitors true 2023-05-16T13:53:59.565 INFO:tasks.ceph.osd.0.smithi039.stderr:2023-05-16T13:53:59.558+0000 7f2320d7f640 -1 osd.0 0 waiting for initial osdmap 2023-05-16T13:53:59.596 INFO:tasks.ceph.osd.0.smithi039.stderr:2023-05-16T13:53:59.590+0000 7f23193c4640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-16T13:53:59.693 INFO:tasks.ceph.osd.2.smithi039.stderr:2023-05-16T13:53:59.686+0000 7fa5942a4640 -1 osd.2 0 waiting for initial osdmap 2023-05-16T13:53:59.724 INFO:tasks.ceph.osd.2.smithi039.stderr:2023-05-16T13:53:59.718+0000 7fa58c8e9640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-16T13:53:59.732 INFO:tasks.ceph.osd.1.smithi039.stderr:2023-05-16T13:53:59.726+0000 7f5fe8b48640 -1 osd.1 0 waiting for initial osdmap 2023-05-16T13:53:59.767 INFO:tasks.ceph.osd.1.smithi039.stderr:2023-05-16T13:53:59.762+0000 7f5fe118d640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-16T13:54:00.250 INFO:tasks.ceph.osd.3.smithi039.stderr:2023-05-16T13:54:00.242+0000 7f0158e64640 -1 osd.3 0 waiting for initial osdmap 2023-05-16T13:54:00.280 INFO:tasks.ceph.osd.3.smithi039.stderr:2023-05-16T13:54:00.274+0000 7f01514a9640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-16T13:54:00.506 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-05-16T13:54:00.637 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.630+0000 7fbfc4266640 1 Processor -- start 2023-05-16T13:54:00.638 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.630+0000 7fbfc4266640 1 -- start start 2023-05-16T13:54:00.639 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.630+0000 7fbfc4266640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fbfbc066a30 0x7fbfbc06c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:00.639 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.630+0000 7fbfc4266640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbfbc0cb990 0x7fbfbc158070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:00.639 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.630+0000 7fbfc4266640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfbc06c7d0 con 0x7fbfbc06d870 2023-05-16T13:54:00.639 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.630+0000 7fbfc4266640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfbc1585b0 con 0x7fbfbc066a30 2023-05-16T13:54:00.639 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.630+0000 7fbfc4266640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfbc06cab0 con 0x7fbfbc0cb990 2023-05-16T13:54:00.640 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.634+0000 7fbfc2002640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fbfbc06d870 0x7fbfbc0cb280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:40904/0 (socket says 172.21.15.39:40904) 2023-05-16T13:54:00.640 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.634+0000 7fbfc2002640 1 -- 172.21.15.39:0/2874869419 learned_addr learned my addr 172.21.15.39:0/2874869419 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:00.640 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.634+0000 7fbfc1801640 1 --2- 172.21.15.39:0/2874869419 >> v2:172.21.15.39:3300/0 conn(0x7fbfbc066a30 0x7fbfbc06c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:00.641 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.634+0000 7fbfc2803640 1 --2- 172.21.15.39:0/2874869419 >> v2:172.21.15.118:3300/0 conn(0x7fbfbc0cb990 0x7fbfbc158070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:00.641 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.634+0000 7fbfc1000640 1 -- 172.21.15.39:0/2874869419 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1944261962 0 0) 0x7fbfbc06c7d0 con 0x7fbfbc06d870 2023-05-16T13:54:00.641 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.634+0000 7fbfc1000640 1 -- 172.21.15.39:0/2874869419 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfa8003530 con 0x7fbfbc06d870 2023-05-16T13:54:00.641 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.634+0000 7fbfc1801640 1 -- 172.21.15.39:0/2874869419 >> v2:172.21.15.118:3300/0 conn(0x7fbfbc0cb990 msgr2=0x7fbfbc158070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:00.641 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.634+0000 7fbfc1801640 1 --2- 172.21.15.39:0/2874869419 >> v2:172.21.15.118:3300/0 conn(0x7fbfbc0cb990 0x7fbfbc158070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:00.641 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.634+0000 7fbfc1801640 1 -- 172.21.15.39:0/2874869419 >> v1:172.21.15.39:6789/0 conn(0x7fbfbc06d870 legacy=0x7fbfbc0cb280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:00.641 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.634+0000 7fbfc1801640 1 -- 172.21.15.39:0/2874869419 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfbc06cd90 con 0x7fbfbc066a30 2023-05-16T13:54:00.642 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.634+0000 7fbfc2803640 1 --2- 172.21.15.39:0/2874869419 >> v2:172.21.15.118:3300/0 conn(0x7fbfbc0cb990 0x7fbfbc158070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:54:00.642 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.634+0000 7fbfc1801640 1 --2- 172.21.15.39:0/2874869419 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbfbc066a30 0x7fbfbc06c160 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc06fe10 tx=0x7fbfac01c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55e08f453c3b5947 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:00.643 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.634+0000 7fbfc1000640 1 -- 172.21.15.39:0/2874869419 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfac0ac600 con 0x7fbfbc066a30 2023-05-16T13:54:00.643 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.634+0000 7fbfc1000640 1 -- 172.21.15.39:0/2874869419 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfac0a8050 con 0x7fbfbc066a30 2023-05-16T13:54:00.643 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.634+0000 7fbfc1000640 1 -- 172.21.15.39:0/2874869419 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfac0ac980 con 0x7fbfbc066a30 2023-05-16T13:54:00.644 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.638+0000 7fbfc4266640 1 -- 172.21.15.39:0/2874869419 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbfbc066a30 msgr2=0x7fbfbc06c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:00.644 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.638+0000 7fbfc4266640 1 --2- 172.21.15.39:0/2874869419 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbfbc066a30 0x7fbfbc06c160 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc06fe10 tx=0x7fbfac01c3a0 comp rx=0 tx=0).stop 2023-05-16T13:54:00.644 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.638+0000 7fbfc4266640 1 -- 172.21.15.39:0/2874869419 shutdown_connections 2023-05-16T13:54:00.645 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.638+0000 7fbfc4266640 1 --2- 172.21.15.39:0/2874869419 >> v2:172.21.15.118:3300/0 conn(0x7fbfbc0cb990 0x7fbfbc158070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:00.645 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.638+0000 7fbfc4266640 1 --2- 172.21.15.39:0/2874869419 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbfbc066a30 0x7fbfbc06c160 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:00.645 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.638+0000 7fbfc4266640 1 -- 172.21.15.39:0/2874869419 >> 172.21.15.39:0/2874869419 conn(0x7fbfbc069a50 msgr2=0x7fbfbc069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:00.645 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.638+0000 7fbfc4266640 1 -- 172.21.15.39:0/2874869419 shutdown_connections 2023-05-16T13:54:00.645 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.638+0000 7fbfc4266640 1 -- 172.21.15.39:0/2874869419 wait complete. 2023-05-16T13:54:00.646 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.638+0000 7fbfc4266640 1 Processor -- start 2023-05-16T13:54:00.646 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.638+0000 7fbfc4266640 1 -- start start 2023-05-16T13:54:00.647 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.638+0000 7fbfc4266640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbfbc066a30 0x7fbfbc160f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:00.647 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.638+0000 7fbfc4266640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbfbc06d870 0x7fbfbc14fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:00.647 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.638+0000 7fbfc4266640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbfbc0cb990 0x7fbfbc14ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:00.647 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.638+0000 7fbfc4266640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfbc158880 con 0x7fbfbc066a30 2023-05-16T13:54:00.648 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.638+0000 7fbfc4266640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfbc14bfc0 con 0x7fbfbc0cb990 2023-05-16T13:54:00.648 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.638+0000 7fbfc4266640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfbc14c4b0 con 0x7fbfbc06d870 2023-05-16T13:54:00.648 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.638+0000 7fbfc2002640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbfbc066a30 0x7fbfbc160f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:00.648 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.638+0000 7fbfc2002640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbfbc066a30 0x7fbfbc160f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:51360/0 (socket says 172.21.15.39:51360) 2023-05-16T13:54:00.648 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.638+0000 7fbfc2002640 1 -- 172.21.15.39:0/741584113 learned_addr learned my addr 172.21.15.39:0/741584113 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:00.648 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.642+0000 7fbfc2803640 1 --2- 172.21.15.39:0/741584113 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbfbc0cb990 0x7fbfbc14ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:00.649 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.642+0000 7fbfc1801640 1 --2- 172.21.15.39:0/741584113 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbfbc06d870 0x7fbfbc14fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:00.649 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.642+0000 7fbfc2002640 1 -- 172.21.15.39:0/741584113 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbfbc06d870 msgr2=0x7fbfbc14fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:00.649 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.642+0000 7fbfc2002640 1 --2- 172.21.15.39:0/741584113 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbfbc06d870 0x7fbfbc14fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:00.649 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.642+0000 7fbfc2002640 1 -- 172.21.15.39:0/741584113 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbfbc0cb990 msgr2=0x7fbfbc14ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:00.649 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.642+0000 7fbfc2002640 1 --2- 172.21.15.39:0/741584113 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbfbc0cb990 0x7fbfbc14ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:00.649 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.642+0000 7fbfc2002640 1 -- 172.21.15.39:0/741584113 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfac009420 con 0x7fbfbc066a30 2023-05-16T13:54:00.650 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.642+0000 7fbfc2002640 1 --2- 172.21.15.39:0/741584113 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbfbc066a30 0x7fbfbc160f50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fbfb800c4d0 tx=0x7fbfb800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:00.650 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.642+0000 7fbfb27fc640 1 -- 172.21.15.39:0/741584113 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb8005cf0 con 0x7fbfbc066a30 2023-05-16T13:54:00.651 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.642+0000 7fbfb27fc640 1 -- 172.21.15.39:0/741584113 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfb8005e50 con 0x7fbfbc066a30 2023-05-16T13:54:00.651 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.642+0000 7fbfc4266640 1 -- 172.21.15.39:0/741584113 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfbc0b2080 con 0x7fbfbc066a30 2023-05-16T13:54:00.651 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.642+0000 7fbfb27fc640 1 -- 172.21.15.39:0/741584113 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb8007270 con 0x7fbfbc066a30 2023-05-16T13:54:00.651 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.642+0000 7fbfc4266640 1 -- 172.21.15.39:0/741584113 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfbc0b1140 con 0x7fbfbc066a30 2023-05-16T13:54:00.651 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.642+0000 7fbfc4266640 1 -- 172.21.15.39:0/741584113 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfbc0b2210 con 0x7fbfbc066a30 2023-05-16T13:54:00.651 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.642+0000 7fbfb27fc640 1 -- 172.21.15.39:0/741584113 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 4) v1 ==== 85602+0+0 (secure 0 0 0) 0x7fbfb80073d0 con 0x7fbfbc066a30 2023-05-16T13:54:00.652 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.646+0000 7fbfb27fc640 1 --2- 172.21.15.39:0/741584113 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fbfa0066220 0x7fbfa00686d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:00.652 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.646+0000 7fbfb27fc640 1 -- 172.21.15.39:0/741584113 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3351+0+0 (secure 0 0 0) 0x7fbfb8082670 con 0x7fbfbc066a30 2023-05-16T13:54:00.652 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.646+0000 7fbfc1801640 1 --2- 172.21.15.39:0/741584113 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fbfa0066220 0x7fbfa00686d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:00.652 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.646+0000 7fbfc1801640 1 --2- 172.21.15.39:0/741584113 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fbfa0066220 0x7fbfa00686d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fbfac0ae000 tx=0x7fbfac008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:00.656 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.650+0000 7fbfb27fc640 1 -- 172.21.15.39:0/741584113 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fbfb8050700 con 0x7fbfbc066a30 2023-05-16T13:54:00.721 INFO:tasks.ceph.osd.4.smithi118.stderr:2023-05-16T13:54:00.714+0000 7f3f5167b640 -1 osd.4 0 waiting for initial osdmap 2023-05-16T13:54:00.751 INFO:tasks.ceph.osd.4.smithi118.stderr:2023-05-16T13:54:00.746+0000 7f3f49cc0640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-16T13:54:00.772 INFO:tasks.ceph.osd.6.smithi118.stderr:2023-05-16T13:54:00.766+0000 7fd92fd18640 -1 osd.6 0 waiting for initial osdmap 2023-05-16T13:54:00.777 INFO:tasks.ceph.osd.7.smithi118.stderr:2023-05-16T13:54:00.770+0000 7fe14abf2640 -1 osd.7 0 waiting for initial osdmap 2023-05-16T13:54:00.783 INFO:tasks.ceph.osd.5.smithi118.stderr:2023-05-16T13:54:00.774+0000 7fec6ecf9640 -1 osd.5 0 waiting for initial osdmap 2023-05-16T13:54:00.795 INFO:tasks.ceph.osd.6.smithi118.stderr:2023-05-16T13:54:00.790+0000 7fd92835d640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-16T13:54:00.814 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.806+0000 7fbfc4266640 1 -- 172.21.15.39:0/741584113 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbfbc04de80 con 0x7fbfbc066a30 2023-05-16T13:54:00.815 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.806+0000 7fbfb27fc640 1 -- 172.21.15.39:0/741584113 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+8964 (secure 0 0 0) 0x7fbfb8053d20 con 0x7fbfbc066a30 2023-05-16T13:54:00.815 INFO:teuthology.misc.health.smithi039.stdout: 2023-05-16T13:54:00.816 INFO:teuthology.misc.health.smithi039.stdout:{"epoch":14,"fsid":"9c1e210b-c515-4ea4-a065-397956895c68","created":"2023-05-16T13:53:48.955290+0000","modified":"2023-05-16T13:54:00.573235+0000","last_up_change":"2023-05-16T13:54:00.573235+0000","last_in_change":"2023-05-16T13:53:52.331336+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"4ce0f0ba-c4bf-4405-8c95-d2e9a62878ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6809","nonce":3462013698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6811","nonce":3462013698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6815","nonce":3462013698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6813","nonce":3462013698}]},"public_addr":"172.21.15.39:6809/3462013698","cluster_addr":"172.21.15.39:6811/3462013698","heartbeat_back_addr":"172.21.15.39:6815/3462013698","heartbeat_front_addr":"172.21.15.39:6813/3462013698","state":["exists","up"]},{"osd":1,"uuid":"53fdc1ac-2473-472d-af32-2760fdf6e476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6801","nonce":2829970892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6803","nonce":2829970892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6807","nonce":2829970892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6805","nonce":2829970892}]},"public_addr":"172.21.15.39:6801/2829970892","cluster_addr":"172.21.15.39:6803/2829970892","heartbeat_back_addr":"172.21.15.39:6807/2829970892","heartbeat_front_addr":"172.21.15.39:6805/2829970892","state":["exists","up"]},{"osd":2,"uuid":"0b92d770-7030-42fa-a19f-4f7f1ac113c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6817","nonce":3888067413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6819","nonce":3888067413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6823","nonce":3888067413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6821","nonce":3888067413}]},"public_addr":"172.21.15.39:6817/3888067413","cluster_addr":"172.21.15.39:6819/3888067413","heartbeat_back_addr":"172.21.15.39:6823/3888067413","heartbeat_front_addr":"172.21.15.39:6821/3888067413","state":["exists","up"]},{"osd":3,"uuid":"000d9506-cbb2-4017-b875-deca579860ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6825","nonce":405003958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6827","nonce":405003958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6831","nonce":405003958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6829","nonce":405003958}]},"public_addr":"172.21.15.39:6825/405003958","cluster_addr":"172.21.15.39:6827/405003958","heartbeat_back_addr":"172.21.15.39:6831/405003958","heartbeat_front_addr":"172.21.15.39:6829/405003958","state":["exists","up"]},{"osd":4,"uuid":"70f0dacb-e960-40c5-bf6a-183e52bbe2ea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"756feb54-c3ae-4a2a-8f74-85c291ba707c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c4a982c1-f497-4b0f-8a23-c77372e4621e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"6f2888aa-a7ac-4e26-9159-e31817934f44","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-16T13:54:00.816 INFO:tasks.ceph.osd.7.smithi118.stderr:2023-05-16T13:54:00.810+0000 7fe143237640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-16T13:54:00.817 INFO:tasks.ceph.osd.5.smithi118.stderr:2023-05-16T13:54:00.810+0000 7fec6733e640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-16T13:54:00.818 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.810+0000 7fbfc4266640 1 -- 172.21.15.39:0/741584113 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fbfa0066220 msgr2=0x7fbfa00686d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:00.818 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.810+0000 7fbfc4266640 1 --2- 172.21.15.39:0/741584113 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fbfa0066220 0x7fbfa00686d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fbfac0ae000 tx=0x7fbfac008040 comp rx=0 tx=0).stop 2023-05-16T13:54:00.818 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.810+0000 7fbfc4266640 1 -- 172.21.15.39:0/741584113 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbfbc066a30 msgr2=0x7fbfbc160f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:00.819 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.810+0000 7fbfc4266640 1 --2- 172.21.15.39:0/741584113 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbfbc066a30 0x7fbfbc160f50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fbfb800c4d0 tx=0x7fbfb800c990 comp rx=0 tx=0).stop 2023-05-16T13:54:00.819 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.810+0000 7fbfc4266640 1 -- 172.21.15.39:0/741584113 shutdown_connections 2023-05-16T13:54:00.819 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.810+0000 7fbfc4266640 1 --2- 172.21.15.39:0/741584113 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fbfa0066220 0x7fbfa00686d0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:00.819 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.810+0000 7fbfc4266640 1 --2- 172.21.15.39:0/741584113 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbfbc06d870 0x7fbfbc14fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:00.820 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.810+0000 7fbfc4266640 1 --2- 172.21.15.39:0/741584113 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbfbc0cb990 0x7fbfbc14ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:00.820 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.810+0000 7fbfc4266640 1 --2- 172.21.15.39:0/741584113 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbfbc066a30 0x7fbfbc160f50 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:00.820 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.810+0000 7fbfc4266640 1 -- 172.21.15.39:0/741584113 >> 172.21.15.39:0/741584113 conn(0x7fbfbc069a50 msgr2=0x7fbfbc0ced50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:00.820 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.810+0000 7fbfc4266640 1 -- 172.21.15.39:0/741584113 shutdown_connections 2023-05-16T13:54:00.820 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:00.810+0000 7fbfc4266640 1 -- 172.21.15.39:0/741584113 wait complete. 2023-05-16T13:54:00.835 DEBUG:teuthology.misc:4 of 8 OSDs are up 2023-05-16T13:54:05.993 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T13:54:05.997 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T13:54:07.641 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-05-16T13:54:07.780 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.774+0000 7f1becfbc640 1 Processor -- start 2023-05-16T13:54:07.781 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.774+0000 7f1becfbc640 1 -- start start 2023-05-16T13:54:07.781 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.774+0000 7f1becfbc640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1be80cff60 0x7f1be815c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:07.782 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.774+0000 7f1becfbc640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1be80d0b00 0x7f1be815e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:07.782 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.774+0000 7f1becfbc640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1be815d640 con 0x7f1be80cf230 2023-05-16T13:54:07.782 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.774+0000 7f1becfbc640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1be815dbc0 con 0x7f1be80cff60 2023-05-16T13:54:07.782 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.774+0000 7f1becfbc640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1be815cb40 con 0x7f1be80d0b00 2023-05-16T13:54:07.782 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.774+0000 7f1bdffff640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f1be80cf230 0x7f1be80d03f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:40906/0 (socket says 172.21.15.39:40906) 2023-05-16T13:54:07.782 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.774+0000 7f1bdffff640 1 -- 172.21.15.39:0/4138334768 learned_addr learned my addr 172.21.15.39:0/4138334768 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:07.784 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.774+0000 7f1be659c640 1 --2- 172.21.15.39:0/4138334768 >> v2:172.21.15.118:3300/0 conn(0x7f1be80cff60 0x7f1be815c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:07.784 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.774+0000 7f1be6d9d640 1 --2- 172.21.15.39:0/4138334768 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1be80d0b00 0x7f1be815e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:07.784 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.774+0000 7f1be5d9b640 1 -- 172.21.15.39:0/4138334768 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1931501281 0 0) 0x7f1be815d640 con 0x7f1be80cf230 2023-05-16T13:54:07.784 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.774+0000 7f1be5d9b640 1 -- 172.21.15.39:0/4138334768 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bd4003530 con 0x7f1be80cf230 2023-05-16T13:54:07.784 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.774+0000 7f1be5d9b640 1 -- 172.21.15.39:0/4138334768 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2732047718 0 0) 0x7f1bd4003530 con 0x7f1be80cf230 2023-05-16T13:54:07.785 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.774+0000 7f1be5d9b640 1 -- 172.21.15.39:0/4138334768 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1be80d0b00 msgr2=0x7f1be815e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:07.785 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.774+0000 7f1be5d9b640 1 --2- 172.21.15.39:0/4138334768 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1be80d0b00 0x7f1be815e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:07.785 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.774+0000 7f1be5d9b640 1 -- 172.21.15.39:0/4138334768 >> v2:172.21.15.118:3300/0 conn(0x7f1be80cff60 msgr2=0x7f1be815c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:07.785 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.774+0000 7f1be5d9b640 1 --2- 172.21.15.39:0/4138334768 >> v2:172.21.15.118:3300/0 conn(0x7f1be80cff60 0x7f1be815c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:07.785 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.774+0000 7f1be5d9b640 1 -- 172.21.15.39:0/4138334768 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1be80d3700 con 0x7f1be80cf230 2023-05-16T13:54:07.785 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.774+0000 7f1be5d9b640 1 -- 172.21.15.39:0/4138334768 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1738805496 0 0) 0x7f1bd0001680 con 0x7f1be80cf230 2023-05-16T13:54:07.785 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.774+0000 7f1be5d9b640 1 -- 172.21.15.39:0/4138334768 >> v1:172.21.15.39:6789/0 conn(0x7f1be80cf230 legacy=0x7f1be80d03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:07.786 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.774+0000 7f1be5d9b640 1 --2- 172.21.15.39:0/4138334768 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1be80d0b00 0x7f1bd4003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:07.786 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.774+0000 7f1be5d9b640 1 --2- 172.21.15.39:0/4138334768 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1bd4003f00 0x7f1bd40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:07.786 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.774+0000 7f1be5d9b640 1 --2- 172.21.15.39:0/4138334768 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1bd4004d10 0x7f1bd4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:07.786 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.774+0000 7f1be5d9b640 1 -- 172.21.15.39:0/4138334768 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be815dbc0 con 0x7f1bd4004d10 2023-05-16T13:54:07.786 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.774+0000 7f1be5d9b640 1 -- 172.21.15.39:0/4138334768 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be815cb40 con 0x7f1bd4003f00 2023-05-16T13:54:07.786 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.774+0000 7f1be5d9b640 1 -- 172.21.15.39:0/4138334768 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd400b9c0 con 0x7f1be80d0b00 2023-05-16T13:54:07.786 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.774+0000 7f1be6d9d640 1 --2- 172.21.15.39:0/4138334768 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1bd4004d10 0x7f1bd4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:07.787 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.774+0000 7f1bdffff640 1 --2- 172.21.15.39:0/4138334768 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1bd4003f00 0x7f1bd40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:07.787 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.774+0000 7f1be659c640 1 --2- 172.21.15.39:0/4138334768 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1be80d0b00 0x7f1bd4003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:07.787 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.774+0000 7f1be6d9d640 1 -- 172.21.15.39:0/4138334768 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1be80d0b00 msgr2=0x7f1bd4003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:07.787 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.774+0000 7f1be6d9d640 1 --2- 172.21.15.39:0/4138334768 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1be80d0b00 0x7f1bd4003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:07.787 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.774+0000 7f1be6d9d640 1 -- 172.21.15.39:0/4138334768 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1bd4003f00 msgr2=0x7f1bd40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:07.787 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.774+0000 7f1be6d9d640 1 --2- 172.21.15.39:0/4138334768 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1bd4003f00 0x7f1bd40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:07.787 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.774+0000 7f1be6d9d640 1 -- 172.21.15.39:0/4138334768 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd4003530 con 0x7f1bd4004d10 2023-05-16T13:54:07.788 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.778+0000 7f1be6d9d640 1 --2- 172.21.15.39:0/4138334768 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1bd4004d10 0x7f1bd4005180 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1be80736b0 tx=0x7f1be001cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=980c5e5847dcf697 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:07.789 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.778+0000 7f1be5d9b640 1 -- 172.21.15.39:0/4138334768 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be00a5c10 con 0x7f1bd4004d10 2023-05-16T13:54:07.789 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.778+0000 7f1be5d9b640 1 -- 172.21.15.39:0/4138334768 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1be000f040 con 0x7f1bd4004d10 2023-05-16T13:54:07.789 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.778+0000 7f1be5d9b640 1 -- 172.21.15.39:0/4138334768 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be00ad440 con 0x7f1bd4004d10 2023-05-16T13:54:07.789 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.778+0000 7f1becfbc640 1 -- 172.21.15.39:0/4138334768 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1bd4004d10 msgr2=0x7f1bd4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:07.789 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.778+0000 7f1becfbc640 1 --2- 172.21.15.39:0/4138334768 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1bd4004d10 0x7f1bd4005180 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1be80736b0 tx=0x7f1be001cba0 comp rx=0 tx=0).stop 2023-05-16T13:54:07.789 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.778+0000 7f1be6d9d640 1 -- 172.21.15.39:0/4138334768 reap_dead start 2023-05-16T13:54:07.789 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.778+0000 7f1becfbc640 1 -- 172.21.15.39:0/4138334768 shutdown_connections 2023-05-16T13:54:07.789 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.778+0000 7f1becfbc640 1 -- 172.21.15.39:0/4138334768 >> 172.21.15.39:0/4138334768 conn(0x7f1be809bb60 msgr2=0x7f1be80d2820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:07.790 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.778+0000 7f1becfbc640 1 -- 172.21.15.39:0/4138334768 shutdown_connections 2023-05-16T13:54:07.790 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.778+0000 7f1becfbc640 1 -- 172.21.15.39:0/4138334768 wait complete. 2023-05-16T13:54:07.790 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.782+0000 7f1becfbc640 1 Processor -- start 2023-05-16T13:54:07.790 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.782+0000 7f1becfbc640 1 -- start start 2023-05-16T13:54:07.791 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.782+0000 7f1becfbc640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1bd4004d10 0x7f1be81f1160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:07.792 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.782+0000 7f1becfbc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1be809eae0 0x7f1be80b3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:07.792 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.782+0000 7f1becfbc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1be80b4100 0x7f1be806baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:07.792 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.782+0000 7f1becfbc640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be81f16a0 con 0x7f1be809eae0 2023-05-16T13:54:07.792 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.782+0000 7f1becfbc640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be80b3070 con 0x7f1be80b4100 2023-05-16T13:54:07.792 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.782+0000 7f1becfbc640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1be80b4580 con 0x7f1bd4004d10 2023-05-16T13:54:07.792 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.782+0000 7f1bdffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1be809eae0 0x7f1be80b3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:07.792 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.782+0000 7f1bdffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1be809eae0 0x7f1be80b3bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:51424/0 (socket says 172.21.15.39:51424) 2023-05-16T13:54:07.793 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.782+0000 7f1bdffff640 1 -- 172.21.15.39:0/1809430374 learned_addr learned my addr 172.21.15.39:0/1809430374 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:07.793 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.782+0000 7f1be659c640 1 --2- 172.21.15.39:0/1809430374 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1bd4004d10 0x7f1be81f1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:07.793 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.782+0000 7f1be6d9d640 1 --2- 172.21.15.39:0/1809430374 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1be80b4100 0x7f1be806baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:07.793 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.782+0000 7f1bdffff640 1 -- 172.21.15.39:0/1809430374 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1bd4004d10 msgr2=0x7f1be81f1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:07.793 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.782+0000 7f1bdffff640 1 --2- 172.21.15.39:0/1809430374 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1bd4004d10 0x7f1be81f1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:07.793 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.782+0000 7f1bdffff640 1 -- 172.21.15.39:0/1809430374 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1be80b4100 msgr2=0x7f1be806baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:07.793 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.782+0000 7f1bdffff640 1 --2- 172.21.15.39:0/1809430374 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1be80b4100 0x7f1be806baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:07.794 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.782+0000 7f1bdffff640 1 -- 172.21.15.39:0/1809430374 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1be815d080 con 0x7f1be809eae0 2023-05-16T13:54:07.794 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.782+0000 7f1be6d9d640 1 --2- 172.21.15.39:0/1809430374 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1be80b4100 0x7f1be806baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:54:07.794 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.782+0000 7f1bdffff640 1 --2- 172.21.15.39:0/1809430374 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1be809eae0 0x7f1be80b3bc0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1bd00124f0 tx=0x7f1bd00129b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:07.794 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.782+0000 7f1bdeffd640 1 -- 172.21.15.39:0/1809430374 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd0014810 con 0x7f1be809eae0 2023-05-16T13:54:07.794 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.782+0000 7f1bdeffd640 1 -- 172.21.15.39:0/1809430374 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bd0014970 con 0x7f1be809eae0 2023-05-16T13:54:07.794 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.782+0000 7f1becfbc640 1 -- 172.21.15.39:0/1809430374 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1be815cda0 con 0x7f1be809eae0 2023-05-16T13:54:07.794 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.782+0000 7f1bdeffd640 1 -- 172.21.15.39:0/1809430374 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd0014d20 con 0x7f1be809eae0 2023-05-16T13:54:07.794 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.782+0000 7f1becfbc640 1 -- 172.21.15.39:0/1809430374 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1be815d360 con 0x7f1be809eae0 2023-05-16T13:54:07.795 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.786+0000 7f1becfbc640 1 -- 172.21.15.39:0/1809430374 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1be804de80 con 0x7f1be809eae0 2023-05-16T13:54:07.795 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.786+0000 7f1bdeffd640 1 -- 172.21.15.39:0/1809430374 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1bd0016480 con 0x7f1be809eae0 2023-05-16T13:54:07.796 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.786+0000 7f1bdeffd640 1 --2- 172.21.15.39:0/1809430374 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f1bc8066280 0x7f1bc8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:07.796 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.786+0000 7f1bdeffd640 1 -- 172.21.15.39:0/1809430374 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1bd0086df0 con 0x7f1be809eae0 2023-05-16T13:54:07.796 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.786+0000 7f1be659c640 1 --2- 172.21.15.39:0/1809430374 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f1bc8066280 0x7f1bc8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:07.796 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.786+0000 7f1be659c640 1 --2- 172.21.15.39:0/1809430374 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f1bc8066280 0x7f1bc8068730 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1bd8009b60 tx=0x7f1bd8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:07.798 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.790+0000 7f1bdeffd640 1 -- 172.21.15.39:0/1809430374 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f1bd0058110 con 0x7f1be809eae0 2023-05-16T13:54:07.957 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.950+0000 7f1becfbc640 1 -- 172.21.15.39:0/1809430374 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1be806c9d0 con 0x7f1be809eae0 2023-05-16T13:54:07.958 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.950+0000 7f1bdeffd640 1 -- 172.21.15.39:0/1809430374 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12850 (secure 0 0 0) 0x7f1bd0057ca0 con 0x7f1be809eae0 2023-05-16T13:54:07.958 INFO:teuthology.misc.health.smithi039.stdout: 2023-05-16T13:54:07.958 INFO:teuthology.misc.health.smithi039.stdout:{"epoch":17,"fsid":"9c1e210b-c515-4ea4-a065-397956895c68","created":"2023-05-16T13:53:48.955290+0000","modified":"2023-05-16T13:54:03.728267+0000","last_up_change":"2023-05-16T13:54:01.722051+0000","last_in_change":"2023-05-16T13:53:52.331336+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-16T13:54:00.885009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4ce0f0ba-c4bf-4405-8c95-d2e9a62878ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6809","nonce":3462013698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6811","nonce":3462013698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6815","nonce":3462013698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6813","nonce":3462013698}]},"public_addr":"172.21.15.39:6809/3462013698","cluster_addr":"172.21.15.39:6811/3462013698","heartbeat_back_addr":"172.21.15.39:6815/3462013698","heartbeat_front_addr":"172.21.15.39:6813/3462013698","state":["exists","up"]},{"osd":1,"uuid":"53fdc1ac-2473-472d-af32-2760fdf6e476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6801","nonce":2829970892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6803","nonce":2829970892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6807","nonce":2829970892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6805","nonce":2829970892}]},"public_addr":"172.21.15.39:6801/2829970892","cluster_addr":"172.21.15.39:6803/2829970892","heartbeat_back_addr":"172.21.15.39:6807/2829970892","heartbeat_front_addr":"172.21.15.39:6805/2829970892","state":["exists","up"]},{"osd":2,"uuid":"0b92d770-7030-42fa-a19f-4f7f1ac113c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6817","nonce":3888067413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6819","nonce":3888067413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6823","nonce":3888067413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6821","nonce":3888067413}]},"public_addr":"172.21.15.39:6817/3888067413","cluster_addr":"172.21.15.39:6819/3888067413","heartbeat_back_addr":"172.21.15.39:6823/3888067413","heartbeat_front_addr":"172.21.15.39:6821/3888067413","state":["exists","up"]},{"osd":3,"uuid":"000d9506-cbb2-4017-b875-deca579860ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6825","nonce":405003958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6827","nonce":405003958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6831","nonce":405003958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6829","nonce":405003958}]},"public_addr":"172.21.15.39:6825/405003958","cluster_addr":"172.21.15.39:6827/405003958","heartbeat_back_addr":"172.21.15.39:6831/405003958","heartbeat_front_addr":"172.21.15.39:6829/405003958","state":["exists","up"]},{"osd":4,"uuid":"70f0dacb-e960-40c5-bf6a-183e52bbe2ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6801","nonce":3895278838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6805","nonce":3895278838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6813","nonce":3895278838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6809","nonce":3895278838}]},"public_addr":"172.21.15.118:6801/3895278838","cluster_addr":"172.21.15.118:6805/3895278838","heartbeat_back_addr":"172.21.15.118:6813/3895278838","heartbeat_front_addr":"172.21.15.118:6809/3895278838","state":["exists","up"]},{"osd":5,"uuid":"756feb54-c3ae-4a2a-8f74-85c291ba707c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6804","nonce":3513592808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6808","nonce":3513592808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6815","nonce":3513592808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6812","nonce":3513592808}]},"public_addr":"172.21.15.118:6804/3513592808","cluster_addr":"172.21.15.118:6808/3513592808","heartbeat_back_addr":"172.21.15.118:6815/3513592808","heartbeat_front_addr":"172.21.15.118:6812/3513592808","state":["exists","up"]},{"osd":6,"uuid":"c4a982c1-f497-4b0f-8a23-c77372e4621e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6824","nonce":1863656053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6827","nonce":1863656053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6831","nonce":1863656053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6829","nonce":1863656053}]},"public_addr":"172.21.15.118:6824/1863656053","cluster_addr":"172.21.15.118:6827/1863656053","heartbeat_back_addr":"172.21.15.118:6831/1863656053","heartbeat_front_addr":"172.21.15.118:6829/1863656053","state":["exists","up"]},{"osd":7,"uuid":"6f2888aa-a7ac-4e26-9159-e31817934f44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6817","nonce":3636642904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6819","nonce":3636642904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6825","nonce":3636642904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6821","nonce":3636642904}]},"public_addr":"172.21.15.118:6817/3636642904","cluster_addr":"172.21.15.118:6819/3636642904","heartbeat_back_addr":"172.21.15.118:6825/3636642904","heartbeat_front_addr":"172.21.15.118:6821/3636642904","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.717636+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.724036+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.739144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:58.079275+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:58.073921+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.930466+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.987813+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.941098+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-16T13:54:07.960 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.954+0000 7f1becfbc640 1 -- 172.21.15.39:0/1809430374 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f1bc8066280 msgr2=0x7f1bc8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:07.960 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.954+0000 7f1becfbc640 1 --2- 172.21.15.39:0/1809430374 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f1bc8066280 0x7f1bc8068730 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1bd8009b60 tx=0x7f1bd8008040 comp rx=0 tx=0).stop 2023-05-16T13:54:07.960 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.954+0000 7f1becfbc640 1 -- 172.21.15.39:0/1809430374 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1be809eae0 msgr2=0x7f1be80b3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:07.960 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.954+0000 7f1becfbc640 1 --2- 172.21.15.39:0/1809430374 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1be809eae0 0x7f1be80b3bc0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1bd00124f0 tx=0x7f1bd00129b0 comp rx=0 tx=0).stop 2023-05-16T13:54:07.960 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.954+0000 7f1becfbc640 1 -- 172.21.15.39:0/1809430374 shutdown_connections 2023-05-16T13:54:07.960 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.954+0000 7f1becfbc640 1 --2- 172.21.15.39:0/1809430374 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1be80b4100 0x7f1be806baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:07.961 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.954+0000 7f1becfbc640 1 --2- 172.21.15.39:0/1809430374 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1be809eae0 0x7f1be80b3bc0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:07.961 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.954+0000 7f1becfbc640 1 --2- 172.21.15.39:0/1809430374 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f1bc8066280 0x7f1bc8068730 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:07.961 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.954+0000 7f1becfbc640 1 --2- 172.21.15.39:0/1809430374 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1bd4004d10 0x7f1be81f1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:07.961 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.954+0000 7f1becfbc640 1 -- 172.21.15.39:0/1809430374 >> 172.21.15.39:0/1809430374 conn(0x7f1be809bb60 msgr2=0x7f1be80af350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:07.961 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.954+0000 7f1becfbc640 1 -- 172.21.15.39:0/1809430374 shutdown_connections 2023-05-16T13:54:07.961 INFO:teuthology.misc.health.smithi039.stderr:2023-05-16T13:54:07.954+0000 7f1becfbc640 1 -- 172.21.15.39:0/1809430374 wait complete. 2023-05-16T13:54:07.977 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-05-16T13:54:07.977 INFO:tasks.ceph:Creating RBD pool 2023-05-16T13:54:07.978 DEBUG:teuthology.orchestra.run.smithi039:> sudo ceph --cluster ceph osd pool create rbd 8 2023-05-16T13:54:08.113 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.106+0000 7fbb82b6d640 1 Processor -- start 2023-05-16T13:54:08.114 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.106+0000 7fbb82b6d640 1 -- start start 2023-05-16T13:54:08.115 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.106+0000 7fbb82b6d640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb7c0b0710 0x7fbb7c15d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:08.115 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.106+0000 7fbb82b6d640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb7c15de40 con 0x7fbb7c0b4030 2023-05-16T13:54:08.115 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.106+0000 7fbb82b6d640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb7c0b0ae0 con 0x7fbb7c071b70 2023-05-16T13:54:08.115 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.106+0000 7fbb82b6d640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7c15e910 con 0x7fbb7c0b0710 2023-05-16T13:54:08.115 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.106+0000 7fbb7bfff640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fbb7c0b4030 0x7fbb7c071460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:40916/0 (socket says 172.21.15.39:40916) 2023-05-16T13:54:08.115 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.106+0000 7fbb7bfff640 1 -- 172.21.15.39:0/1899427057 learned_addr learned my addr 172.21.15.39:0/1899427057 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:08.116 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.106+0000 7fbb80909640 1 --2- 172.21.15.39:0/1899427057 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb7c0b0710 0x7fbb7c15d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:08.116 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.106+0000 7fbb7b7fe640 1 -- 172.21.15.39:0/1899427057 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3036222408 0 0) 0x7fbb7c15de40 con 0x7fbb7c0b4030 2023-05-16T13:54:08.116 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.106+0000 7fbb7b7fe640 1 -- 172.21.15.39:0/1899427057 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb6c003530 con 0x7fbb7c0b4030 2023-05-16T13:54:08.118 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.106+0000 7fbb7b7fe640 1 -- 172.21.15.39:0/1899427057 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2218422847 0 0) 0x7fbb6c003530 con 0x7fbb7c0b4030 2023-05-16T13:54:08.118 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.106+0000 7fbb7b7fe640 1 -- 172.21.15.39:0/1899427057 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb7c0b0710 msgr2=0x7fbb7c15d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:08.118 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.106+0000 7fbb7b7fe640 1 --2- 172.21.15.39:0/1899427057 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb7c0b0710 0x7fbb7c15d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:08.118 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.106+0000 7fbb7b7fe640 1 -- 172.21.15.39:0/1899427057 >> v1:172.21.15.118:6789/0 conn(0x7fbb7c071b70 legacy=0x7fbb7c0c91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:08.118 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.106+0000 7fbb7b7fe640 1 -- 172.21.15.39:0/1899427057 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb7c15e070 con 0x7fbb7c0b4030 2023-05-16T13:54:08.118 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.106+0000 7fbb7b7fe640 1 -- 172.21.15.39:0/1899427057 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1738805496 0 0) 0x7fbb68001680 con 0x7fbb7c0b4030 2023-05-16T13:54:08.118 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.110+0000 7fbb7b7fe640 1 -- 172.21.15.39:0/1899427057 >> v1:172.21.15.39:6789/0 conn(0x7fbb7c0b4030 legacy=0x7fbb7c071460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:08.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.110+0000 7fbb7b7fe640 1 --2- 172.21.15.39:0/1899427057 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb6c0039b0 0x7fbb6c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:08.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.110+0000 7fbb7b7fe640 1 --2- 172.21.15.39:0/1899427057 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb6c0047d0 0x7fbb6c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:08.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.110+0000 7fbb7b7fe640 1 --2- 172.21.15.39:0/1899427057 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb7c0b0710 0x7fbb6c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:08.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.110+0000 7fbb7b7fe640 1 -- 172.21.15.39:0/1899427057 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7c15e910 con 0x7fbb6c0039b0 2023-05-16T13:54:08.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.110+0000 7fbb7b7fe640 1 -- 172.21.15.39:0/1899427057 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6c00ba40 con 0x7fbb6c0047d0 2023-05-16T13:54:08.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.110+0000 7fbb7b7fe640 1 -- 172.21.15.39:0/1899427057 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6c00bbd0 con 0x7fbb7c0b0710 2023-05-16T13:54:08.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.110+0000 7fbb80909640 1 --2- 172.21.15.39:0/1899427057 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb6c0039b0 0x7fbb6c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:08.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.110+0000 7fbb7bfff640 1 --2- 172.21.15.39:0/1899427057 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb6c0047d0 0x7fbb6c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:08.120 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.110+0000 7fbb8110a640 1 --2- 172.21.15.39:0/1899427057 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb7c0b0710 0x7fbb6c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:08.120 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.110+0000 7fbb80909640 1 -- 172.21.15.39:0/1899427057 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb7c0b0710 msgr2=0x7fbb6c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:08.120 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.110+0000 7fbb80909640 1 --2- 172.21.15.39:0/1899427057 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb7c0b0710 0x7fbb6c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:08.120 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.110+0000 7fbb80909640 1 -- 172.21.15.39:0/1899427057 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb6c0047d0 msgr2=0x7fbb6c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:08.120 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.110+0000 7fbb80909640 1 --2- 172.21.15.39:0/1899427057 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb6c0047d0 0x7fbb6c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:08.120 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.110+0000 7fbb80909640 1 -- 172.21.15.39:0/1899427057 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb6c003530 con 0x7fbb6c0039b0 2023-05-16T13:54:08.121 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.110+0000 7fbb80909640 1 --2- 172.21.15.39:0/1899427057 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb6c0039b0 0x7fbb6c003dc0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbb70009ae0 tx=0x7fbb7001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc202e7f791ddcd server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:08.122 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.110+0000 7fbb7b7fe640 1 -- 172.21.15.39:0/1899427057 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb700a5640 con 0x7fbb6c0039b0 2023-05-16T13:54:08.122 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.110+0000 7fbb7b7fe640 1 -- 172.21.15.39:0/1899427057 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb700a57a0 con 0x7fbb6c0039b0 2023-05-16T13:54:08.122 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.110+0000 7fbb7b7fe640 1 -- 172.21.15.39:0/1899427057 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb700a5b50 con 0x7fbb6c0039b0 2023-05-16T13:54:08.122 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.114+0000 7fbb82b6d640 1 -- 172.21.15.39:0/1899427057 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb6c0039b0 msgr2=0x7fbb6c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:08.122 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.114+0000 7fbb82b6d640 1 --2- 172.21.15.39:0/1899427057 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb6c0039b0 0x7fbb6c003dc0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbb70009ae0 tx=0x7fbb7001ca50 comp rx=0 tx=0).stop 2023-05-16T13:54:08.122 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.114+0000 7fbb8110a640 1 -- 172.21.15.39:0/1899427057 reap_dead start 2023-05-16T13:54:08.122 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.114+0000 7fbb82b6d640 1 -- 172.21.15.39:0/1899427057 shutdown_connections 2023-05-16T13:54:08.122 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.114+0000 7fbb82b6d640 1 -- 172.21.15.39:0/1899427057 >> 172.21.15.39:0/1899427057 conn(0x7fbb7c069a50 msgr2=0x7fbb7c069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:08.123 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.114+0000 7fbb82b6d640 1 -- 172.21.15.39:0/1899427057 shutdown_connections 2023-05-16T13:54:08.123 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.114+0000 7fbb82b6d640 1 -- 172.21.15.39:0/1899427057 wait complete. 2023-05-16T13:54:08.123 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.114+0000 7fbb82b6d640 1 Processor -- start 2023-05-16T13:54:08.123 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.114+0000 7fbb82b6d640 1 -- start start 2023-05-16T13:54:08.124 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.114+0000 7fbb82b6d640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb6c0039b0 0x7fbb7c0ccd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:08.125 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.114+0000 7fbb82b6d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb7c158b00 0x7fbb7c1f4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:08.125 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.114+0000 7fbb82b6d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb7c159fd0 0x7fbb7c0c38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:08.125 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.114+0000 7fbb82b6d640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7c1f4960 con 0x7fbb7c158b00 2023-05-16T13:54:08.125 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.114+0000 7fbb82b6d640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7c0cd320 con 0x7fbb7c159fd0 2023-05-16T13:54:08.125 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.114+0000 7fbb82b6d640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7c0c2b00 con 0x7fbb6c0039b0 2023-05-16T13:54:08.125 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.114+0000 7fbb7bfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb7c158b00 0x7fbb7c1f4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:08.125 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.114+0000 7fbb7bfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb7c158b00 0x7fbb7c1f4420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:51450/0 (socket says 172.21.15.39:51450) 2023-05-16T13:54:08.126 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.114+0000 7fbb7bfff640 1 -- 172.21.15.39:0/4035633092 learned_addr learned my addr 172.21.15.39:0/4035633092 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:08.126 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.114+0000 7fbb80909640 1 --2- 172.21.15.39:0/4035633092 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb6c0039b0 0x7fbb7c0ccd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:08.126 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.114+0000 7fbb8110a640 1 --2- 172.21.15.39:0/4035633092 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb7c159fd0 0x7fbb7c0c38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:08.126 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.118+0000 7fbb7bfff640 1 -- 172.21.15.39:0/4035633092 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb6c0039b0 msgr2=0x7fbb7c0ccd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:08.126 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.118+0000 7fbb7bfff640 1 --2- 172.21.15.39:0/4035633092 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb6c0039b0 0x7fbb7c0ccd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:08.126 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.118+0000 7fbb7bfff640 1 -- 172.21.15.39:0/4035633092 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb7c159fd0 msgr2=0x7fbb7c0c38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:08.126 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.118+0000 7fbb7bfff640 1 --2- 172.21.15.39:0/4035633092 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb7c159fd0 0x7fbb7c0c38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:08.126 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.118+0000 7fbb7bfff640 1 -- 172.21.15.39:0/4035633092 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb7c0ca0e0 con 0x7fbb7c158b00 2023-05-16T13:54:08.127 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.118+0000 7fbb7bfff640 1 --2- 172.21.15.39:0/4035633092 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb7c158b00 0x7fbb7c1f4420 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbb68007290 tx=0x7fbb68007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:08.127 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.118+0000 7fbb797fa640 1 -- 172.21.15.39:0/4035633092 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb6800f940 con 0x7fbb7c158b00 2023-05-16T13:54:08.127 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.118+0000 7fbb797fa640 1 -- 172.21.15.39:0/4035633092 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb6800fae0 con 0x7fbb7c158b00 2023-05-16T13:54:08.127 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.118+0000 7fbb82b6d640 1 -- 172.21.15.39:0/4035633092 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb7c0c8ca0 con 0x7fbb7c158b00 2023-05-16T13:54:08.127 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.118+0000 7fbb797fa640 1 -- 172.21.15.39:0/4035633092 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb6800fe90 con 0x7fbb7c158b00 2023-05-16T13:54:08.127 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.118+0000 7fbb82b6d640 1 -- 172.21.15.39:0/4035633092 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb7c0ca270 con 0x7fbb7c158b00 2023-05-16T13:54:08.127 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.118+0000 7fbb82b6d640 1 -- 172.21.15.39:0/4035633092 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb7c0b02e0 con 0x7fbb7c158b00 2023-05-16T13:54:08.128 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.118+0000 7fbb797fa640 1 -- 172.21.15.39:0/4035633092 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbb6801d460 con 0x7fbb7c158b00 2023-05-16T13:54:08.128 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.118+0000 7fbb797fa640 1 --2- 172.21.15.39:0/4035633092 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fbb60066280 0x7fbb60068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:08.128 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.118+0000 7fbb797fa640 1 -- 172.21.15.39:0/4035633092 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbb68083b70 con 0x7fbb7c158b00 2023-05-16T13:54:08.129 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.122+0000 7fbb80909640 1 --2- 172.21.15.39:0/4035633092 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fbb60066280 0x7fbb60068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:08.129 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.122+0000 7fbb80909640 1 --2- 172.21.15.39:0/4035633092 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fbb60066280 0x7fbb60068730 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbb700af000 tx=0x7fbb700046d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:08.131 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.126+0000 7fbb797fa640 1 -- 172.21.15.39:0/4035633092 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fbb680514b0 con 0x7fbb7c158b00 2023-05-16T13:54:08.288 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.282+0000 7fbb82b6d640 1 -- 172.21.15.39:0/4035633092 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fbb7c073c90 con 0x7fbb7c158b00 2023-05-16T13:54:08.761 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.754+0000 7fbb797fa640 1 -- 172.21.15.39:0/4035633092 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v18) v1 ==== 109+0+0 (secure 0 0 0) 0x7fbb68054ad0 con 0x7fbb7c158b00 2023-05-16T13:54:08.761 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'rbd' created 2023-05-16T13:54:08.763 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.754+0000 7fbb82b6d640 1 -- 172.21.15.39:0/4035633092 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fbb60066280 msgr2=0x7fbb60068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:08.763 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.754+0000 7fbb82b6d640 1 --2- 172.21.15.39:0/4035633092 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fbb60066280 0x7fbb60068730 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbb700af000 tx=0x7fbb700046d0 comp rx=0 tx=0).stop 2023-05-16T13:54:08.764 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.754+0000 7fbb82b6d640 1 -- 172.21.15.39:0/4035633092 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb7c158b00 msgr2=0x7fbb7c1f4420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:08.764 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.754+0000 7fbb82b6d640 1 --2- 172.21.15.39:0/4035633092 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb7c158b00 0x7fbb7c1f4420 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbb68007290 tx=0x7fbb68007750 comp rx=0 tx=0).stop 2023-05-16T13:54:08.764 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.758+0000 7fbb82b6d640 1 -- 172.21.15.39:0/4035633092 shutdown_connections 2023-05-16T13:54:08.764 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.758+0000 7fbb82b6d640 1 --2- 172.21.15.39:0/4035633092 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb7c159fd0 0x7fbb7c0c38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:08.764 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.758+0000 7fbb82b6d640 1 --2- 172.21.15.39:0/4035633092 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb7c158b00 0x7fbb7c1f4420 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:08.765 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.758+0000 7fbb82b6d640 1 --2- 172.21.15.39:0/4035633092 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fbb60066280 0x7fbb60068730 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:08.765 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.758+0000 7fbb82b6d640 1 --2- 172.21.15.39:0/4035633092 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb6c0039b0 0x7fbb7c0ccd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:08.765 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.758+0000 7fbb82b6d640 1 -- 172.21.15.39:0/4035633092 >> 172.21.15.39:0/4035633092 conn(0x7fbb7c069a50 msgr2=0x7fbb7c0cda40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:08.765 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.758+0000 7fbb82b6d640 1 -- 172.21.15.39:0/4035633092 shutdown_connections 2023-05-16T13:54:08.765 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.758+0000 7fbb82b6d640 1 -- 172.21.15.39:0/4035633092 wait complete. 2023-05-16T13:54:08.786 DEBUG:teuthology.orchestra.run.smithi039:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-05-16T13:54:08.925 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.918+0000 7fb87777b640 1 Processor -- start 2023-05-16T13:54:08.926 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.918+0000 7fb87777b640 1 -- start start 2023-05-16T13:54:08.930 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.918+0000 7fb87777b640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb8701606b0 0x7fb8700c8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:08.931 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.918+0000 7fb87777b640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb870160a80 con 0x7fb87006bcb0 2023-05-16T13:54:08.931 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.918+0000 7fb87777b640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb870164f60 con 0x7fb870071100 2023-05-16T13:54:08.931 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.918+0000 7fb87777b640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb87006fca0 con 0x7fb8701606b0 2023-05-16T13:54:08.932 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.918+0000 7fb874d16640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fb87006bcb0 0x7fb870164140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:40924/0 (socket says 172.21.15.39:40924) 2023-05-16T13:54:08.932 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.918+0000 7fb874d16640 1 -- 172.21.15.39:0/3080364628 learned_addr learned my addr 172.21.15.39:0/3080364628 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:08.932 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.918+0000 7fb875517640 1 --2- 172.21.15.39:0/3080364628 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb8701606b0 0x7fb8700c8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:08.932 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.918+0000 7fb867fff640 1 -- 172.21.15.39:0/3080364628 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1225852913 0 0) 0x7fb870160a80 con 0x7fb87006bcb0 2023-05-16T13:54:08.933 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.918+0000 7fb867fff640 1 -- 172.21.15.39:0/3080364628 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb85c003530 con 0x7fb87006bcb0 2023-05-16T13:54:08.933 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.922+0000 7fb867fff640 1 -- 172.21.15.39:0/3080364628 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3116567976 0 0) 0x7fb85c003530 con 0x7fb87006bcb0 2023-05-16T13:54:08.933 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.922+0000 7fb867fff640 1 -- 172.21.15.39:0/3080364628 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb8701606b0 msgr2=0x7fb8700c8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:08.933 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.922+0000 7fb867fff640 1 --2- 172.21.15.39:0/3080364628 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb8701606b0 0x7fb8700c8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:08.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.922+0000 7fb867fff640 1 -- 172.21.15.39:0/3080364628 >> v1:172.21.15.118:6789/0 conn(0x7fb870071100 legacy=0x7fb870164850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:08.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.922+0000 7fb867fff640 1 -- 172.21.15.39:0/3080364628 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8700ccd80 con 0x7fb87006bcb0 2023-05-16T13:54:08.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.922+0000 7fb867fff640 1 -- 172.21.15.39:0/3080364628 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1738805496 0 0) 0x7fb860001680 con 0x7fb87006bcb0 2023-05-16T13:54:08.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.922+0000 7fb867fff640 1 -- 172.21.15.39:0/3080364628 >> v1:172.21.15.39:6789/0 conn(0x7fb87006bcb0 legacy=0x7fb870164140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:08.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.922+0000 7fb867fff640 1 --2- 172.21.15.39:0/3080364628 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb85c003a20 0x7fb85c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:08.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.922+0000 7fb867fff640 1 --2- 172.21.15.39:0/3080364628 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb8701606b0 0x7fb85c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:08.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.922+0000 7fb867fff640 1 --2- 172.21.15.39:0/3080364628 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb85c004d10 0x7fb85c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:08.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.922+0000 7fb867fff640 1 -- 172.21.15.39:0/3080364628 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb87006fca0 con 0x7fb85c004d10 2023-05-16T13:54:08.936 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.922+0000 7fb867fff640 1 -- 172.21.15.39:0/3080364628 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85c00bc10 con 0x7fb85c003a20 2023-05-16T13:54:08.936 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.922+0000 7fb867fff640 1 -- 172.21.15.39:0/3080364628 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb85c00bdd0 con 0x7fb8701606b0 2023-05-16T13:54:08.936 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.922+0000 7fb875d18640 1 --2- 172.21.15.39:0/3080364628 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb85c004d10 0x7fb85c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:08.937 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.922+0000 7fb874d16640 1 --2- 172.21.15.39:0/3080364628 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb8701606b0 0x7fb85c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:08.937 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.922+0000 7fb875517640 1 --2- 172.21.15.39:0/3080364628 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb85c003a20 0x7fb85c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:08.937 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.922+0000 7fb875d18640 1 -- 172.21.15.39:0/3080364628 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb8701606b0 msgr2=0x7fb85c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:08.937 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.922+0000 7fb875d18640 1 --2- 172.21.15.39:0/3080364628 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb8701606b0 0x7fb85c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:08.938 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.922+0000 7fb875d18640 1 -- 172.21.15.39:0/3080364628 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb85c003a20 msgr2=0x7fb85c003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:08.938 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.922+0000 7fb875d18640 1 --2- 172.21.15.39:0/3080364628 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb85c003a20 0x7fb85c003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:08.938 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.922+0000 7fb875d18640 1 -- 172.21.15.39:0/3080364628 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb85c003530 con 0x7fb85c004d10 2023-05-16T13:54:08.942 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.922+0000 7fb875d18640 1 --2- 172.21.15.39:0/3080364628 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb85c004d10 0x7fb85c005180 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb868001e70 tx=0x7fb86801c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84bbc42c73abce0f server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:08.943 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.922+0000 7fb867fff640 1 -- 172.21.15.39:0/3080364628 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb868003b80 con 0x7fb85c004d10 2023-05-16T13:54:08.943 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.922+0000 7fb867fff640 1 -- 172.21.15.39:0/3080364628 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb868003ce0 con 0x7fb85c004d10 2023-05-16T13:54:08.943 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.922+0000 7fb867fff640 1 -- 172.21.15.39:0/3080364628 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8680052c0 con 0x7fb85c004d10 2023-05-16T13:54:08.943 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.926+0000 7fb87777b640 1 -- 172.21.15.39:0/3080364628 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb85c004d10 msgr2=0x7fb85c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:08.944 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.926+0000 7fb87777b640 1 --2- 172.21.15.39:0/3080364628 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb85c004d10 0x7fb85c005180 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb868001e70 tx=0x7fb86801c730 comp rx=0 tx=0).stop 2023-05-16T13:54:08.944 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.926+0000 7fb875d18640 1 -- 172.21.15.39:0/3080364628 reap_dead start 2023-05-16T13:54:08.944 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.926+0000 7fb87777b640 1 -- 172.21.15.39:0/3080364628 shutdown_connections 2023-05-16T13:54:08.945 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.926+0000 7fb87777b640 1 -- 172.21.15.39:0/3080364628 >> 172.21.15.39:0/3080364628 conn(0x7fb870069a50 msgr2=0x7fb870069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:08.945 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.926+0000 7fb87777b640 1 -- 172.21.15.39:0/3080364628 shutdown_connections 2023-05-16T13:54:08.945 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.926+0000 7fb87777b640 1 -- 172.21.15.39:0/3080364628 wait complete. 2023-05-16T13:54:08.945 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.926+0000 7fb87777b640 1 Processor -- start 2023-05-16T13:54:08.946 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.926+0000 7fb87777b640 1 -- start start 2023-05-16T13:54:08.946 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.926+0000 7fb87777b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb85c004d10 0x7fb8700c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:08.946 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.926+0000 7fb87777b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb8700c3cc0 0x7fb87015f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:08.946 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.926+0000 7fb87777b640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb8700b3800 0x7fb8700b3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:08.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.926+0000 7fb87777b640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8700c85f0 con 0x7fb8700c3cc0 2023-05-16T13:54:08.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.926+0000 7fb87777b640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8700c7620 con 0x7fb85c004d10 2023-05-16T13:54:08.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.926+0000 7fb87777b640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8700b41b0 con 0x7fb8700b3800 2023-05-16T13:54:08.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.926+0000 7fb874d16640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb8700c3cc0 0x7fb87015f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:08.948 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.926+0000 7fb874d16640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb8700c3cc0 0x7fb87015f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:51468/0 (socket says 172.21.15.39:51468) 2023-05-16T13:54:08.948 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.926+0000 7fb874d16640 1 -- 172.21.15.39:0/4094102688 learned_addr learned my addr 172.21.15.39:0/4094102688 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:08.948 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.926+0000 7fb875517640 1 --2- 172.21.15.39:0/4094102688 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb85c004d10 0x7fb8700c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:08.948 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.930+0000 7fb875d18640 1 --2- 172.21.15.39:0/4094102688 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb8700b3800 0x7fb8700b3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:08.949 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.930+0000 7fb874d16640 1 -- 172.21.15.39:0/4094102688 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb8700b3800 msgr2=0x7fb8700b3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:08.949 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.930+0000 7fb874d16640 1 --2- 172.21.15.39:0/4094102688 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb8700b3800 0x7fb8700b3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:08.949 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.930+0000 7fb874d16640 1 -- 172.21.15.39:0/4094102688 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb85c004d10 msgr2=0x7fb8700c5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:08.949 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.930+0000 7fb874d16640 1 --2- 172.21.15.39:0/4094102688 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb85c004d10 0x7fb8700c5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:08.950 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.930+0000 7fb874d16640 1 -- 172.21.15.39:0/4094102688 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8700c1a30 con 0x7fb8700c3cc0 2023-05-16T13:54:08.950 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.930+0000 7fb875d18640 1 --2- 172.21.15.39:0/4094102688 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb8700b3800 0x7fb8700b3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:54:08.950 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.930+0000 7fb874d16640 1 --2- 172.21.15.39:0/4094102688 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb8700c3cc0 0x7fb87015f3f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb860004f80 tx=0x7fb860007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:08.950 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.930+0000 7fb865ffb640 1 -- 172.21.15.39:0/4094102688 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86000f750 con 0x7fb8700c3cc0 2023-05-16T13:54:08.951 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.930+0000 7fb865ffb640 1 -- 172.21.15.39:0/4094102688 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb86000f8f0 con 0x7fb8700c3cc0 2023-05-16T13:54:08.951 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.930+0000 7fb865ffb640 1 -- 172.21.15.39:0/4094102688 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86000fca0 con 0x7fb8700c3cc0 2023-05-16T13:54:08.951 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.930+0000 7fb87777b640 1 -- 172.21.15.39:0/4094102688 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8700caa10 con 0x7fb8700c3cc0 2023-05-16T13:54:08.951 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.930+0000 7fb87777b640 1 -- 172.21.15.39:0/4094102688 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8700ca3e0 con 0x7fb8700c3cc0 2023-05-16T13:54:08.952 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.930+0000 7fb87777b640 1 -- 172.21.15.39:0/4094102688 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb870073c90 con 0x7fb8700c3cc0 2023-05-16T13:54:08.952 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.930+0000 7fb865ffb640 1 -- 172.21.15.39:0/4094102688 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb86001d460 con 0x7fb8700c3cc0 2023-05-16T13:54:08.952 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.930+0000 7fb865ffb640 1 --2- 172.21.15.39:0/4094102688 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fb854066280 0x7fb854068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:08.952 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.930+0000 7fb865ffb640 1 -- 172.21.15.39:0/4094102688 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5199+0+0 (secure 0 0 0) 0x7fb8600839f0 con 0x7fb8700c3cc0 2023-05-16T13:54:08.953 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.934+0000 7fb875517640 1 --2- 172.21.15.39:0/4094102688 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fb854066280 0x7fb854068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:08.953 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.934+0000 7fb875517640 1 --2- 172.21.15.39:0/4094102688 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fb854066280 0x7fb854068730 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb87006ce70 tx=0x7fb86c009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:08.954 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:08.938+0000 7fb865ffb640 1 -- 172.21.15.39:0/4094102688 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fb860051130 con 0x7fb8700c3cc0 2023-05-16T13:54:09.099 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.090+0000 7fb87777b640 1 -- 172.21.15.39:0/4094102688 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb8700cb570 con 0x7fb8700c3cc0 2023-05-16T13:54:09.765 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.758+0000 7fb865ffb640 1 -- 172.21.15.39:0/4094102688 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v19) v1 ==== 173+0+0 (secure 0 0 0) 0x7fb860054750 con 0x7fb8700c3cc0 2023-05-16T13:54:09.766 INFO:teuthology.orchestra.run.smithi039.stderr:enabled application 'rbd' on pool 'rbd' 2023-05-16T13:54:09.769 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.762+0000 7fb87777b640 1 -- 172.21.15.39:0/4094102688 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fb854066280 msgr2=0x7fb854068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:09.769 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.762+0000 7fb87777b640 1 --2- 172.21.15.39:0/4094102688 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fb854066280 0x7fb854068730 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb87006ce70 tx=0x7fb86c009190 comp rx=0 tx=0).stop 2023-05-16T13:54:09.769 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.762+0000 7fb87777b640 1 -- 172.21.15.39:0/4094102688 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb8700c3cc0 msgr2=0x7fb87015f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:09.770 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.762+0000 7fb87777b640 1 --2- 172.21.15.39:0/4094102688 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb8700c3cc0 0x7fb87015f3f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb860004f80 tx=0x7fb860007430 comp rx=0 tx=0).stop 2023-05-16T13:54:09.770 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.762+0000 7fb87777b640 1 -- 172.21.15.39:0/4094102688 shutdown_connections 2023-05-16T13:54:09.770 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.762+0000 7fb87777b640 1 --2- 172.21.15.39:0/4094102688 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fb854066280 0x7fb854068730 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:09.770 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.762+0000 7fb87777b640 1 --2- 172.21.15.39:0/4094102688 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb8700b3800 0x7fb8700b3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:09.770 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.762+0000 7fb87777b640 1 --2- 172.21.15.39:0/4094102688 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb8700c3cc0 0x7fb87015f3f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:09.771 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.762+0000 7fb87777b640 1 --2- 172.21.15.39:0/4094102688 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb85c004d10 0x7fb8700c5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:09.771 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.762+0000 7fb87777b640 1 -- 172.21.15.39:0/4094102688 >> 172.21.15.39:0/4094102688 conn(0x7fb870069a50 msgr2=0x7fb87016ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:09.771 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.762+0000 7fb87777b640 1 -- 172.21.15.39:0/4094102688 shutdown_connections 2023-05-16T13:54:09.771 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.762+0000 7fb87777b640 1 -- 172.21.15.39:0/4094102688 wait complete. 2023-05-16T13:54:09.793 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-05-16T13:54:09.794 INFO:tasks.ceph.mds.a:Restarting daemon 2023-05-16T13:54:09.794 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-05-16T13:54:09.797 INFO:tasks.ceph.mds.a:Started 2023-05-16T13:54:09.797 INFO:tasks.ceph.mds.c:Restarting daemon 2023-05-16T13:54:09.798 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-05-16T13:54:09.800 INFO:tasks.ceph.mds.c:Started 2023-05-16T13:54:09.801 INFO:tasks.ceph.mds.b:Restarting daemon 2023-05-16T13:54:09.801 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-05-16T13:54:09.804 INFO:tasks.ceph.mds.b:Started 2023-05-16T13:54:09.804 INFO:tasks.ceph.mds.d:Restarting daemon 2023-05-16T13:54:09.804 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-05-16T13:54:09.807 INFO:tasks.ceph.mds.d:Started 2023-05-16T13:54:09.807 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-05-16T13:54:09.808 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-16T13:54:09.906 INFO:tasks.ceph.mds.b.smithi118.stdout:starting mds.b at 2023-05-16T13:54:09.907 INFO:tasks.ceph.mds.d.smithi118.stdout:starting mds.d at 2023-05-16T13:54:09.912 INFO:tasks.ceph.mds.a.smithi039.stdout:starting mds.a at 2023-05-16T13:54:09.912 INFO:tasks.ceph.mds.c.smithi039.stdout:starting mds.c at 2023-05-16T13:54:09.960 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.954+0000 7f5c6918e640 1 Processor -- start 2023-05-16T13:54:09.961 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.954+0000 7f5c6918e640 1 -- start start 2023-05-16T13:54:09.962 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.954+0000 7f5c6918e640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5c641598b0 0x7f5c6415cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:09.962 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.954+0000 7f5c6918e640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f5c640b4b00 0x7f5c640d01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:09.962 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.954+0000 7f5c6918e640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c64159c80 con 0x7f5c640d06f0 2023-05-16T13:54:09.962 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.954+0000 7f5c6918e640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c6415d270 con 0x7f5c640b4b00 2023-05-16T13:54:09.962 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.954+0000 7f5c6918e640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c640cd390 con 0x7f5c641598b0 2023-05-16T13:54:09.962 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.954+0000 7f5c637fe640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f5c640b4b00 0x7f5c640d01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:09.962 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.954+0000 7f5c6898d640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f5c640d06f0 0x7f5c640cf000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:40962/0 (socket says 172.21.15.39:40962) 2023-05-16T13:54:09.963 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.954+0000 7f5c6898d640 1 -- 172.21.15.39:0/1051889492 learned_addr learned my addr 172.21.15.39:0/1051889492 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:09.963 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.954+0000 7f5c637fe640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f5c640b4b00 0x7f5c640d01b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:51494/0 (socket says 172.21.15.39:51494) 2023-05-16T13:54:09.963 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.954+0000 7f5c63fff640 1 --2- 172.21.15.39:0/1051889492 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5c641598b0 0x7f5c6415cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:09.963 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.954+0000 7f5c637fe640 1 -- 172.21.15.39:0/1051889492 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5c641598b0 msgr2=0x7f5c6415cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:09.964 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.954+0000 7f5c637fe640 1 --2- 172.21.15.39:0/1051889492 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5c641598b0 0x7f5c6415cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:09.964 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.954+0000 7f5c637fe640 1 -- 172.21.15.39:0/1051889492 >> v1:172.21.15.39:6789/0 conn(0x7f5c640d06f0 legacy=0x7f5c640cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:09.964 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.954+0000 7f5c637fe640 1 -- 172.21.15.39:0/1051889492 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c640ccdd0 con 0x7f5c640b4b00 2023-05-16T13:54:09.965 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.958+0000 7f5c637fe640 1 --2- 172.21.15.39:0/1051889492 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c640b4b00 0x7f5c640d01b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5c580097c0 tx=0x7f5c5801c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fa9bc0da24bf897 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:09.965 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.958+0000 7f5c62ffd640 1 -- 172.21.15.39:0/1051889492 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c580ab600 con 0x7f5c640b4b00 2023-05-16T13:54:09.965 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.958+0000 7f5c62ffd640 1 -- 172.21.15.39:0/1051889492 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c580a7050 con 0x7f5c640b4b00 2023-05-16T13:54:09.966 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.958+0000 7f5c62ffd640 1 -- 172.21.15.39:0/1051889492 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c580ab980 con 0x7f5c640b4b00 2023-05-16T13:54:09.966 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.958+0000 7f5c6918e640 1 -- 172.21.15.39:0/1051889492 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c640b4b00 msgr2=0x7f5c640d01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:09.966 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.958+0000 7f5c6918e640 1 --2- 172.21.15.39:0/1051889492 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c640b4b00 0x7f5c640d01b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5c580097c0 tx=0x7f5c5801c310 comp rx=0 tx=0).stop 2023-05-16T13:54:09.967 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.958+0000 7f5c6918e640 1 -- 172.21.15.39:0/1051889492 shutdown_connections 2023-05-16T13:54:09.967 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.958+0000 7f5c6918e640 1 --2- 172.21.15.39:0/1051889492 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c640b4b00 0x7f5c640d01b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:09.967 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.958+0000 7f5c6918e640 1 --2- 172.21.15.39:0/1051889492 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5c641598b0 0x7f5c6415cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:09.967 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.958+0000 7f5c6918e640 1 -- 172.21.15.39:0/1051889492 >> 172.21.15.39:0/1051889492 conn(0x7f5c6406aad0 msgr2=0x7f5c6406aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:09.967 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.958+0000 7f5c6918e640 1 -- 172.21.15.39:0/1051889492 shutdown_connections 2023-05-16T13:54:09.967 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.958+0000 7f5c6918e640 1 -- 172.21.15.39:0/1051889492 wait complete. 2023-05-16T13:54:09.968 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.962+0000 7f5c6918e640 1 Processor -- start 2023-05-16T13:54:09.968 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.962+0000 7f5c6918e640 1 -- start start 2023-05-16T13:54:09.969 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.962+0000 7f5c6918e640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5c640b4b00 0x7f5c640d13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:09.969 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.962+0000 7f5c6918e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c640d06f0 0x7f5c64151ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:09.969 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.962+0000 7f5c6918e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c641598b0 0x7f5c64151ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:09.969 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.962+0000 7f5c6918e640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c640c8df0 con 0x7f5c640d06f0 2023-05-16T13:54:09.969 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.962+0000 7f5c6918e640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c641f4f90 con 0x7f5c641598b0 2023-05-16T13:54:09.970 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.962+0000 7f5c6918e640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c64152530 con 0x7f5c640b4b00 2023-05-16T13:54:09.970 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.962+0000 7f5c637fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c640d06f0 0x7f5c64151ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:09.970 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.962+0000 7f5c637fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c640d06f0 0x7f5c64151ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:51498/0 (socket says 172.21.15.39:51498) 2023-05-16T13:54:09.970 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.962+0000 7f5c637fe640 1 -- 172.21.15.39:0/1633428686 learned_addr learned my addr 172.21.15.39:0/1633428686 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:09.970 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.962+0000 7f5c63fff640 1 --2- 172.21.15.39:0/1633428686 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5c640b4b00 0x7f5c640d13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:09.970 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.962+0000 7f5c6898d640 1 --2- 172.21.15.39:0/1633428686 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c641598b0 0x7f5c64151ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:09.971 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.962+0000 7f5c637fe640 1 -- 172.21.15.39:0/1633428686 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5c640b4b00 msgr2=0x7f5c640d13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:09.971 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.962+0000 7f5c637fe640 1 --2- 172.21.15.39:0/1633428686 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5c640b4b00 0x7f5c640d13d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:09.971 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.962+0000 7f5c637fe640 1 -- 172.21.15.39:0/1633428686 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c641598b0 msgr2=0x7f5c64151ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:09.972 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.962+0000 7f5c637fe640 1 --2- 172.21.15.39:0/1633428686 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c641598b0 0x7f5c64151ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:09.972 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.962+0000 7f5c637fe640 1 -- 172.21.15.39:0/1633428686 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c58009420 con 0x7f5c640d06f0 2023-05-16T13:54:09.972 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.962+0000 7f5c6898d640 1 --2- 172.21.15.39:0/1633428686 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c641598b0 0x7f5c64151ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:54:09.972 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.962+0000 7f5c637fe640 1 --2- 172.21.15.39:0/1633428686 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c640d06f0 0x7f5c64151ab0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5c5801a9c0 tx=0x7f5c580190b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:09.972 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.962+0000 7f5c60ff9640 1 -- 172.21.15.39:0/1633428686 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c580b4820 con 0x7f5c640d06f0 2023-05-16T13:54:09.972 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.962+0000 7f5c60ff9640 1 -- 172.21.15.39:0/1633428686 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c580b49a0 con 0x7f5c640d06f0 2023-05-16T13:54:09.972 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.962+0000 7f5c60ff9640 1 -- 172.21.15.39:0/1633428686 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c580b4d50 con 0x7f5c640d06f0 2023-05-16T13:54:09.973 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.962+0000 7f5c6918e640 1 -- 172.21.15.39:0/1633428686 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c640ceae0 con 0x7f5c640d06f0 2023-05-16T13:54:09.973 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.962+0000 7f5c6918e640 1 -- 172.21.15.39:0/1633428686 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c640cd0b0 con 0x7f5c640d06f0 2023-05-16T13:54:09.973 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.962+0000 7f5c6918e640 1 -- 172.21.15.39:0/1633428686 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c640b4f70 con 0x7f5c640d06f0 2023-05-16T13:54:09.973 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.966+0000 7f5c60ff9640 1 -- 172.21.15.39:0/1633428686 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5c580b2040 con 0x7f5c640d06f0 2023-05-16T13:54:09.974 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.966+0000 7f5c60ff9640 1 --2- 172.21.15.39:0/1633428686 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f5c50066280 0x7f5c50068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:09.974 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.966+0000 7f5c60ff9640 1 -- 172.21.15.39:0/1633428686 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f5c5811e910 con 0x7f5c640d06f0 2023-05-16T13:54:09.974 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.966+0000 7f5c63fff640 1 --2- 172.21.15.39:0/1633428686 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f5c50066280 0x7f5c50068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:09.974 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.966+0000 7f5c63fff640 1 --2- 172.21.15.39:0/1633428686 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f5c50066280 0x7f5c50068730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5c54009ac0 tx=0x7f5c54009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:09.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:09.970+0000 7f5c60ff9640 1 -- 172.21.15.39:0/1633428686 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f5c580ec270 con 0x7f5c640d06f0 2023-05-16T13:54:10.130 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.122+0000 7f5c6918e640 1 -- 172.21.15.39:0/1633428686 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5c6404ed20 con 0x7f5c640d06f0 2023-05-16T13:54:10.131 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.122+0000 7f5c60ff9640 1 -- 172.21.15.39:0/1633428686 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+14649 (secure 0 0 0) 0x7f5c580b0070 con 0x7f5c640d06f0 2023-05-16T13:54:10.131 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:54:10.132 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":19,"fsid":"9c1e210b-c515-4ea4-a065-397956895c68","created":"2023-05-16T13:53:48.955290+0000","modified":"2023-05-16T13:54:09.756792+0000","last_up_change":"2023-05-16T13:54:01.722051+0000","last_in_change":"2023-05-16T13:53:52.331336+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-16T13:54:00.885009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-16T13:54:08.327895+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4ce0f0ba-c4bf-4405-8c95-d2e9a62878ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6809","nonce":3462013698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6811","nonce":3462013698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6815","nonce":3462013698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6813","nonce":3462013698}]},"public_addr":"172.21.15.39:6809/3462013698","cluster_addr":"172.21.15.39:6811/3462013698","heartbeat_back_addr":"172.21.15.39:6815/3462013698","heartbeat_front_addr":"172.21.15.39:6813/3462013698","state":["exists","up"]},{"osd":1,"uuid":"53fdc1ac-2473-472d-af32-2760fdf6e476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6801","nonce":2829970892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6803","nonce":2829970892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6807","nonce":2829970892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6805","nonce":2829970892}]},"public_addr":"172.21.15.39:6801/2829970892","cluster_addr":"172.21.15.39:6803/2829970892","heartbeat_back_addr":"172.21.15.39:6807/2829970892","heartbeat_front_addr":"172.21.15.39:6805/2829970892","state":["exists","up"]},{"osd":2,"uuid":"0b92d770-7030-42fa-a19f-4f7f1ac113c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6817","nonce":3888067413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6819","nonce":3888067413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6823","nonce":3888067413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6821","nonce":3888067413}]},"public_addr":"172.21.15.39:6817/3888067413","cluster_addr":"172.21.15.39:6819/3888067413","heartbeat_back_addr":"172.21.15.39:6823/3888067413","heartbeat_front_addr":"172.21.15.39:6821/3888067413","state":["exists","up"]},{"osd":3,"uuid":"000d9506-cbb2-4017-b875-deca579860ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6825","nonce":405003958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6827","nonce":405003958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6831","nonce":405003958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6829","nonce":405003958}]},"public_addr":"172.21.15.39:6825/405003958","cluster_addr":"172.21.15.39:6827/405003958","heartbeat_back_addr":"172.21.15.39:6831/405003958","heartbeat_front_addr":"172.21.15.39:6829/405003958","state":["exists","up"]},{"osd":4,"uuid":"70f0dacb-e960-40c5-bf6a-183e52bbe2ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6801","nonce":3895278838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6805","nonce":3895278838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6813","nonce":3895278838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6809","nonce":3895278838}]},"public_addr":"172.21.15.118:6801/3895278838","cluster_addr":"172.21.15.118:6805/3895278838","heartbeat_back_addr":"172.21.15.118:6813/3895278838","heartbeat_front_addr":"172.21.15.118:6809/3895278838","state":["exists","up"]},{"osd":5,"uuid":"756feb54-c3ae-4a2a-8f74-85c291ba707c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6804","nonce":3513592808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6808","nonce":3513592808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6815","nonce":3513592808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6812","nonce":3513592808}]},"public_addr":"172.21.15.118:6804/3513592808","cluster_addr":"172.21.15.118:6808/3513592808","heartbeat_back_addr":"172.21.15.118:6815/3513592808","heartbeat_front_addr":"172.21.15.118:6812/3513592808","state":["exists","up"]},{"osd":6,"uuid":"c4a982c1-f497-4b0f-8a23-c77372e4621e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6824","nonce":1863656053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6827","nonce":1863656053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6831","nonce":1863656053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6829","nonce":1863656053}]},"public_addr":"172.21.15.118:6824/1863656053","cluster_addr":"172.21.15.118:6827/1863656053","heartbeat_back_addr":"172.21.15.118:6831/1863656053","heartbeat_front_addr":"172.21.15.118:6829/1863656053","state":["exists","up"]},{"osd":7,"uuid":"6f2888aa-a7ac-4e26-9159-e31817934f44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6817","nonce":3636642904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6819","nonce":3636642904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6825","nonce":3636642904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6821","nonce":3636642904}]},"public_addr":"172.21.15.118:6817/3636642904","cluster_addr":"172.21.15.118:6819/3636642904","heartbeat_back_addr":"172.21.15.118:6825/3636642904","heartbeat_front_addr":"172.21.15.118:6821/3636642904","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.717636+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.724036+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.739144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:58.079275+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:58.073921+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.930466+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.987813+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.941098+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-16T13:54:10.133 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.126+0000 7f5c6918e640 1 -- 172.21.15.39:0/1633428686 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f5c50066280 msgr2=0x7f5c50068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:10.133 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.126+0000 7f5c6918e640 1 --2- 172.21.15.39:0/1633428686 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f5c50066280 0x7f5c50068730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5c54009ac0 tx=0x7f5c54009190 comp rx=0 tx=0).stop 2023-05-16T13:54:10.133 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.126+0000 7f5c6918e640 1 -- 172.21.15.39:0/1633428686 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c640d06f0 msgr2=0x7f5c64151ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:10.134 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.126+0000 7f5c6918e640 1 --2- 172.21.15.39:0/1633428686 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c640d06f0 0x7f5c64151ab0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5c5801a9c0 tx=0x7f5c580190b0 comp rx=0 tx=0).stop 2023-05-16T13:54:10.134 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.126+0000 7f5c6918e640 1 -- 172.21.15.39:0/1633428686 shutdown_connections 2023-05-16T13:54:10.134 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.126+0000 7f5c6918e640 1 --2- 172.21.15.39:0/1633428686 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c641598b0 0x7f5c64151ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:10.134 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.126+0000 7f5c6918e640 1 --2- 172.21.15.39:0/1633428686 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c640d06f0 0x7f5c64151ab0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:10.134 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.126+0000 7f5c6918e640 1 --2- 172.21.15.39:0/1633428686 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f5c50066280 0x7f5c50068730 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:10.134 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.126+0000 7f5c6918e640 1 --2- 172.21.15.39:0/1633428686 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5c640b4b00 0x7f5c640d13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:10.134 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.126+0000 7f5c6918e640 1 -- 172.21.15.39:0/1633428686 >> 172.21.15.39:0/1633428686 conn(0x7f5c6406aad0 msgr2=0x7f5c6415f790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:10.134 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.126+0000 7f5c6918e640 1 -- 172.21.15.39:0/1633428686 shutdown_connections 2023-05-16T13:54:10.135 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.126+0000 7f5c6918e640 1 -- 172.21.15.39:0/1633428686 wait complete. 2023-05-16T13:54:10.152 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-16T13:54:00.885009+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-16T13:54:08.327895+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-16T13:54:10.152 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-16T13:54:10.293 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.286+0000 7f19a6e8c640 1 Processor -- start 2023-05-16T13:54:10.293 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.286+0000 7f19a6e8c640 1 -- start start 2023-05-16T13:54:10.294 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.286+0000 7f19a6e8c640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19a0158e00 0x7f19a00c9530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:10.294 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.286+0000 7f19a6e8c640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f19a00c9a70 0x7f19a00aff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:10.294 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.286+0000 7f19a6e8c640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19a00ca030 con 0x7f19a00b0490 2023-05-16T13:54:10.295 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.286+0000 7f19a6e8c640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19a00b0910 con 0x7f19a00c9a70 2023-05-16T13:54:10.295 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.286+0000 7f19a6e8c640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19a015c890 con 0x7f19a0158e00 2023-05-16T13:54:10.295 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.286+0000 7f19a5429640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f19a00b0490 0x7f19a00caec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:40972/0 (socket says 172.21.15.39:40972) 2023-05-16T13:54:10.295 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.286+0000 7f19a5429640 1 -- 172.21.15.39:0/227307693 learned_addr learned my addr 172.21.15.39:0/227307693 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:10.296 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.286+0000 7f19a4c28640 1 --2- 172.21.15.39:0/227307693 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19a0158e00 0x7f19a00c9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:10.296 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.286+0000 7f1997fff640 1 --2- 172.21.15.39:0/227307693 >> v2:172.21.15.118:3300/0 conn(0x7f19a00c9a70 0x7f19a00aff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:10.296 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.286+0000 7f19a4c28640 1 -- 172.21.15.39:0/227307693 >> v2:172.21.15.118:3300/0 conn(0x7f19a00c9a70 msgr2=0x7f19a00aff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:10.296 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.286+0000 7f19a4c28640 1 --2- 172.21.15.39:0/227307693 >> v2:172.21.15.118:3300/0 conn(0x7f19a00c9a70 0x7f19a00aff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:10.296 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.286+0000 7f19a4c28640 1 -- 172.21.15.39:0/227307693 >> v1:172.21.15.39:6789/0 conn(0x7f19a00b0490 legacy=0x7f19a00caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:10.296 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.286+0000 7f19a4c28640 1 -- 172.21.15.39:0/227307693 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a015cb70 con 0x7f19a0158e00 2023-05-16T13:54:10.296 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.286+0000 7f19977fe640 1 -- 172.21.15.39:0/227307693 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4105308866 0 0) 0x7f19a00ca030 con 0x7f19a00b0490 2023-05-16T13:54:10.298 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.290+0000 7f19a4c28640 1 --2- 172.21.15.39:0/227307693 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19a0158e00 0x7f19a00c9530 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f199c0097c0 tx=0x7f199c020e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3685ee40cba2dd04 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:10.298 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.290+0000 7f19977fe640 1 -- 172.21.15.39:0/227307693 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199c0aab80 con 0x7f19a0158e00 2023-05-16T13:54:10.298 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.290+0000 7f19977fe640 1 -- 172.21.15.39:0/227307693 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f199c0aace0 con 0x7f19a0158e00 2023-05-16T13:54:10.299 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.290+0000 7f19977fe640 1 -- 172.21.15.39:0/227307693 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199c0b2660 con 0x7f19a0158e00 2023-05-16T13:54:10.299 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.290+0000 7f19a6e8c640 1 -- 172.21.15.39:0/227307693 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19a0158e00 msgr2=0x7f19a00c9530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:10.299 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.290+0000 7f19a6e8c640 1 --2- 172.21.15.39:0/227307693 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19a0158e00 0x7f19a00c9530 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f199c0097c0 tx=0x7f199c020e80 comp rx=0 tx=0).stop 2023-05-16T13:54:10.300 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.290+0000 7f19a6e8c640 1 -- 172.21.15.39:0/227307693 shutdown_connections 2023-05-16T13:54:10.300 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.290+0000 7f19a6e8c640 1 --2- 172.21.15.39:0/227307693 >> v2:172.21.15.118:3300/0 conn(0x7f19a00c9a70 0x7f19a00aff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:10.300 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.290+0000 7f19a6e8c640 1 --2- 172.21.15.39:0/227307693 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19a0158e00 0x7f19a00c9530 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:10.300 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.290+0000 7f19a6e8c640 1 -- 172.21.15.39:0/227307693 >> 172.21.15.39:0/227307693 conn(0x7f19a0069a50 msgr2=0x7f19a0069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:10.300 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.290+0000 7f19a6e8c640 1 -- 172.21.15.39:0/227307693 shutdown_connections 2023-05-16T13:54:10.300 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.290+0000 7f19a6e8c640 1 -- 172.21.15.39:0/227307693 wait complete. 2023-05-16T13:54:10.301 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.294+0000 7f19a6e8c640 1 Processor -- start 2023-05-16T13:54:10.301 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.294+0000 7f19a6e8c640 1 -- start start 2023-05-16T13:54:10.302 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.294+0000 7f19a6e8c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19a00b0490 0x7f19a01f2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:10.302 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.294+0000 7f19a6e8c640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19a00c9a70 0x7f19a015adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:10.302 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.294+0000 7f19a6e8c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19a0158e00 0x7f19a00b3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:10.302 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.294+0000 7f19a6e8c640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a01f2850 con 0x7f19a00b0490 2023-05-16T13:54:10.302 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.294+0000 7f19a6e8c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a015b2f0 con 0x7f19a0158e00 2023-05-16T13:54:10.302 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.294+0000 7f19a6e8c640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19a015b570 con 0x7f19a00c9a70 2023-05-16T13:54:10.303 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.294+0000 7f19a4c28640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19a00b0490 0x7f19a01f2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:10.303 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.294+0000 7f19a4c28640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19a00b0490 0x7f19a01f2310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:51506/0 (socket says 172.21.15.39:51506) 2023-05-16T13:54:10.303 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.294+0000 7f19a4c28640 1 -- 172.21.15.39:0/2256192452 learned_addr learned my addr 172.21.15.39:0/2256192452 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:10.304 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.294+0000 7f1997fff640 1 --2- 172.21.15.39:0/2256192452 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19a00c9a70 0x7f19a015adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:10.304 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.294+0000 7f19a5429640 1 --2- 172.21.15.39:0/2256192452 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19a0158e00 0x7f19a00b3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:10.304 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.294+0000 7f19a4c28640 1 -- 172.21.15.39:0/2256192452 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19a00c9a70 msgr2=0x7f19a015adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:10.304 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.294+0000 7f19a4c28640 1 --2- 172.21.15.39:0/2256192452 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19a00c9a70 0x7f19a015adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:10.304 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.294+0000 7f19a4c28640 1 -- 172.21.15.39:0/2256192452 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19a0158e00 msgr2=0x7f19a00b3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:10.305 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.294+0000 7f19a4c28640 1 --2- 172.21.15.39:0/2256192452 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19a0158e00 0x7f19a00b3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:10.305 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.294+0000 7f19a4c28640 1 -- 172.21.15.39:0/2256192452 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f199c009420 con 0x7f19a00b0490 2023-05-16T13:54:10.305 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.294+0000 7f19a4c28640 1 --2- 172.21.15.39:0/2256192452 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19a00b0490 0x7f19a01f2310 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f199c0b5040 tx=0x7f199c01dc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:10.305 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.294+0000 7f19957fa640 1 -- 172.21.15.39:0/2256192452 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199c0ba5f0 con 0x7f19a00b0490 2023-05-16T13:54:10.305 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.294+0000 7f19957fa640 1 -- 172.21.15.39:0/2256192452 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f199c0ba770 con 0x7f19a00b0490 2023-05-16T13:54:10.305 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.294+0000 7f19957fa640 1 -- 172.21.15.39:0/2256192452 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199c0bab20 con 0x7f19a00b0490 2023-05-16T13:54:10.305 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.294+0000 7f19a6e8c640 1 -- 172.21.15.39:0/2256192452 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19a015d130 con 0x7f19a00b0490 2023-05-16T13:54:10.306 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.294+0000 7f19a6e8c640 1 -- 172.21.15.39:0/2256192452 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19a015ce50 con 0x7f19a00b0490 2023-05-16T13:54:10.306 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.298+0000 7f19a6e8c640 1 -- 172.21.15.39:0/2256192452 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19a00cc730 con 0x7f19a00b0490 2023-05-16T13:54:10.306 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.298+0000 7f19957fa640 1 -- 172.21.15.39:0/2256192452 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f199c0bac80 con 0x7f19a00b0490 2023-05-16T13:54:10.306 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.298+0000 7f19957fa640 1 --2- 172.21.15.39:0/2256192452 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f198c066280 0x7f198c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:10.307 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.298+0000 7f19957fa640 1 -- 172.21.15.39:0/2256192452 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f199c121aa0 con 0x7f19a00b0490 2023-05-16T13:54:10.307 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.298+0000 7f1997fff640 1 --2- 172.21.15.39:0/2256192452 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f198c066280 0x7f198c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:10.307 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.298+0000 7f1997fff640 1 --2- 172.21.15.39:0/2256192452 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f198c066280 0x7f198c068730 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f19a0158190 tx=0x7f1990008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:10.310 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.302+0000 7f19957fa640 1 -- 172.21.15.39:0/2256192452 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f199c0ef260 con 0x7f19a00b0490 2023-05-16T13:54:10.463 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.454+0000 7f19a6e8c640 1 -- 172.21.15.39:0/2256192452 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f19a0073c90 con 0x7f19a00b0490 2023-05-16T13:54:10.464 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.458+0000 7f19957fa640 1 -- 172.21.15.39:0/2256192452 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7f199c0b7020 con 0x7f19a00b0490 2023-05-16T13:54:10.464 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2023-05-16T13:54:10.465 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.458+0000 7f19a6e8c640 1 -- 172.21.15.39:0/2256192452 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f198c066280 msgr2=0x7f198c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:10.466 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.458+0000 7f19a6e8c640 1 --2- 172.21.15.39:0/2256192452 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f198c066280 0x7f198c068730 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f19a0158190 tx=0x7f1990008040 comp rx=0 tx=0).stop 2023-05-16T13:54:10.466 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.458+0000 7f19a6e8c640 1 -- 172.21.15.39:0/2256192452 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19a00b0490 msgr2=0x7f19a01f2310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:10.466 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.458+0000 7f19a6e8c640 1 --2- 172.21.15.39:0/2256192452 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19a00b0490 0x7f19a01f2310 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f199c0b5040 tx=0x7f199c01dc20 comp rx=0 tx=0).stop 2023-05-16T13:54:10.466 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.458+0000 7f19a6e8c640 1 -- 172.21.15.39:0/2256192452 shutdown_connections 2023-05-16T13:54:10.466 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.458+0000 7f19a6e8c640 1 --2- 172.21.15.39:0/2256192452 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f198c066280 0x7f198c068730 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:10.466 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.458+0000 7f19a6e8c640 1 --2- 172.21.15.39:0/2256192452 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19a00c9a70 0x7f19a015adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:10.467 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.458+0000 7f19a6e8c640 1 --2- 172.21.15.39:0/2256192452 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19a0158e00 0x7f19a00b3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:10.467 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.458+0000 7f19a6e8c640 1 --2- 172.21.15.39:0/2256192452 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19a00b0490 0x7f19a01f2310 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:10.467 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.458+0000 7f19a6e8c640 1 -- 172.21.15.39:0/2256192452 >> 172.21.15.39:0/2256192452 conn(0x7f19a0069a50 msgr2=0x7f19a00703a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:10.467 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.458+0000 7f19a6e8c640 1 -- 172.21.15.39:0/2256192452 shutdown_connections 2023-05-16T13:54:10.467 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.458+0000 7f19a6e8c640 1 -- 172.21.15.39:0/2256192452 wait complete. 2023-05-16T13:54:10.484 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-16T13:54:10.623 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.618+0000 7f3ae8420640 1 Processor -- start 2023-05-16T13:54:10.624 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.618+0000 7f3ae8420640 1 -- start start 2023-05-16T13:54:10.625 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.618+0000 7f3ae8420640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f3ae0158e00 0x7f3ae00c9530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:10.625 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.618+0000 7f3ae8420640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3ae00b0660 0x7f3ae0070420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:10.625 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.618+0000 7f3ae8420640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ae00ca030 con 0x7f3ae00c9a70 2023-05-16T13:54:10.625 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.618+0000 7f3ae8420640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ae015c890 con 0x7f3ae0158e00 2023-05-16T13:54:10.626 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.618+0000 7f3ae8420640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ae015cb70 con 0x7f3ae00b0660 2023-05-16T13:54:10.626 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.618+0000 7f3ae61bc640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f3ae0158e00 0x7f3ae00c9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:10.626 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.618+0000 7f3ae59bb640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f3ae00c9a70 0x7f3ae00aff50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:38162/0 (socket says 172.21.15.39:38162) 2023-05-16T13:54:10.626 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.618+0000 7f3ae59bb640 1 -- 172.21.15.39:0/2047967382 learned_addr learned my addr 172.21.15.39:0/2047967382 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:10.627 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.618+0000 7f3ae69bd640 1 --2- 172.21.15.39:0/2047967382 >> v2:172.21.15.118:3300/0 conn(0x7f3ae00b0660 0x7f3ae0070420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:10.627 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.618+0000 7f3ae61bc640 1 -- 172.21.15.39:0/2047967382 >> v2:172.21.15.118:3300/0 conn(0x7f3ae00b0660 msgr2=0x7f3ae0070420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:10.627 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.618+0000 7f3ae61bc640 1 --2- 172.21.15.39:0/2047967382 >> v2:172.21.15.118:3300/0 conn(0x7f3ae00b0660 0x7f3ae0070420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:10.627 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.618+0000 7f3ae61bc640 1 -- 172.21.15.39:0/2047967382 >> v1:172.21.15.39:6789/0 conn(0x7f3ae00c9a70 legacy=0x7f3ae00aff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:10.627 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.618+0000 7f3ae61bc640 1 -- 172.21.15.39:0/2047967382 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ae015ce50 con 0x7f3ae0158e00 2023-05-16T13:54:10.627 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.618+0000 7f3ae51ba640 1 -- 172.21.15.39:0/2047967382 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1744107611 0 0) 0x7f3ae00ca030 con 0x7f3ae00c9a70 2023-05-16T13:54:10.628 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.622+0000 7f3ae61bc640 1 --2- 172.21.15.39:0/2047967382 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ae0158e00 0x7f3ae00c9530 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3ae00adec0 tx=0x7f3adc01ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb3f4a80036dd642 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:10.629 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.622+0000 7f3ae51ba640 1 -- 172.21.15.39:0/2047967382 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3adc0a8950 con 0x7f3ae0158e00 2023-05-16T13:54:10.629 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.622+0000 7f3ae51ba640 1 -- 172.21.15.39:0/2047967382 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3adc0a8ab0 con 0x7f3ae0158e00 2023-05-16T13:54:10.629 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.622+0000 7f3ae51ba640 1 -- 172.21.15.39:0/2047967382 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3adc0a8e40 con 0x7f3ae0158e00 2023-05-16T13:54:10.630 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.622+0000 7f3ae8420640 1 -- 172.21.15.39:0/2047967382 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ae0158e00 msgr2=0x7f3ae00c9530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:10.630 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.622+0000 7f3ae8420640 1 --2- 172.21.15.39:0/2047967382 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ae0158e00 0x7f3ae00c9530 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3ae00adec0 tx=0x7f3adc01ec50 comp rx=0 tx=0).stop 2023-05-16T13:54:10.630 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.622+0000 7f3ae8420640 1 -- 172.21.15.39:0/2047967382 shutdown_connections 2023-05-16T13:54:10.630 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.622+0000 7f3ae8420640 1 --2- 172.21.15.39:0/2047967382 >> v2:172.21.15.118:3300/0 conn(0x7f3ae00b0660 0x7f3ae0070420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:10.630 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.622+0000 7f3ae8420640 1 --2- 172.21.15.39:0/2047967382 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ae0158e00 0x7f3ae00c9530 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:10.630 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.622+0000 7f3ae8420640 1 -- 172.21.15.39:0/2047967382 >> 172.21.15.39:0/2047967382 conn(0x7f3ae0069a50 msgr2=0x7f3ae0069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:10.630 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.622+0000 7f3ae8420640 1 -- 172.21.15.39:0/2047967382 shutdown_connections 2023-05-16T13:54:10.631 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.622+0000 7f3ae8420640 1 -- 172.21.15.39:0/2047967382 wait complete. 2023-05-16T13:54:10.631 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.622+0000 7f3ae8420640 1 Processor -- start 2023-05-16T13:54:10.631 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.626+0000 7f3ae8420640 1 -- start start 2023-05-16T13:54:10.632 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.626+0000 7f3ae8420640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3ae00b0660 0x7f3ae01551d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:10.633 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.626+0000 7f3ae8420640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ae00c9a70 0x7f3ae0147920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:10.633 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.626+0000 7f3ae8420640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ae0158e00 0x7f3ae0159af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:10.633 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.626+0000 7f3ae8420640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae0147e60 con 0x7f3ae0158e00 2023-05-16T13:54:10.633 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.626+0000 7f3ae8420640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae01557b0 con 0x7f3ae00c9a70 2023-05-16T13:54:10.633 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.626+0000 7f3ae8420640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae0155a90 con 0x7f3ae00b0660 2023-05-16T13:54:10.633 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.626+0000 7f3ae69bd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ae0158e00 0x7f3ae0159af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:10.633 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.626+0000 7f3ae69bd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ae0158e00 0x7f3ae0159af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:37872/0 (socket says 172.21.15.39:37872) 2023-05-16T13:54:10.633 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.626+0000 7f3ae69bd640 1 -- 172.21.15.39:0/2548953275 learned_addr learned my addr 172.21.15.39:0/2548953275 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:10.634 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.626+0000 7f3ae61bc640 1 --2- 172.21.15.39:0/2548953275 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3ae00b0660 0x7f3ae01551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:10.634 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.626+0000 7f3ae59bb640 1 --2- 172.21.15.39:0/2548953275 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ae00c9a70 0x7f3ae0147920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:10.635 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.626+0000 7f3ae69bd640 1 -- 172.21.15.39:0/2548953275 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3ae00b0660 msgr2=0x7f3ae01551d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:10.635 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.626+0000 7f3ae69bd640 1 --2- 172.21.15.39:0/2548953275 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3ae00b0660 0x7f3ae01551d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:10.635 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.626+0000 7f3ae69bd640 1 -- 172.21.15.39:0/2548953275 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ae00c9a70 msgr2=0x7f3ae0147920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:10.635 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.626+0000 7f3ae69bd640 1 --2- 172.21.15.39:0/2548953275 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ae00c9a70 0x7f3ae0147920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:10.635 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.626+0000 7f3ae69bd640 1 -- 172.21.15.39:0/2548953275 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3adc009420 con 0x7f3ae0158e00 2023-05-16T13:54:10.635 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.626+0000 7f3ae61bc640 1 --2- 172.21.15.39:0/2548953275 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3ae00b0660 0x7f3ae01551d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:54:10.636 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.626+0000 7f3ae69bd640 1 --2- 172.21.15.39:0/2548953275 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ae0158e00 0x7f3ae0159af0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3ad8007e30 tx=0x7f3ad800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:10.636 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.626+0000 7f3ad6ffd640 1 -- 172.21.15.39:0/2548953275 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad8014620 con 0x7f3ae0158e00 2023-05-16T13:54:10.636 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.626+0000 7f3ad6ffd640 1 -- 172.21.15.39:0/2548953275 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ad800ee90 con 0x7f3ae0158e00 2023-05-16T13:54:10.636 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.626+0000 7f3ad6ffd640 1 -- 172.21.15.39:0/2548953275 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad80149c0 con 0x7f3ae0158e00 2023-05-16T13:54:10.636 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.626+0000 7f3ae8420640 1 -- 172.21.15.39:0/2548953275 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ae00cc730 con 0x7f3ae0158e00 2023-05-16T13:54:10.636 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.626+0000 7f3ae8420640 1 -- 172.21.15.39:0/2548953275 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ae015d130 con 0x7f3ae0158e00 2023-05-16T13:54:10.636 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.626+0000 7f3ae8420640 1 -- 172.21.15.39:0/2548953275 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ae015d650 con 0x7f3ae0158e00 2023-05-16T13:54:10.637 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.630+0000 7f3ad6ffd640 1 -- 172.21.15.39:0/2548953275 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3ad8014b20 con 0x7f3ae0158e00 2023-05-16T13:54:10.637 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.630+0000 7f3ad6ffd640 1 --2- 172.21.15.39:0/2548953275 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f3ac4066280 0x7f3ac4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:10.637 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.630+0000 7f3ad6ffd640 1 -- 172.21.15.39:0/2548953275 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f3ad8084400 con 0x7f3ae0158e00 2023-05-16T13:54:10.637 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.630+0000 7f3ae61bc640 1 --2- 172.21.15.39:0/2548953275 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f3ac4066280 0x7f3ac4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:10.638 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.630+0000 7f3ae61bc640 1 --2- 172.21.15.39:0/2548953275 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f3ac4066280 0x7f3ac4068730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3adc0b2000 tx=0x7f3adc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:10.640 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.634+0000 7f3ad6ffd640 1 -- 172.21.15.39:0/2548953275 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f3ad8055650 con 0x7f3ae0158e00 2023-05-16T13:54:10.794 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.786+0000 7f3ae8420640 1 -- 172.21.15.39:0/2548953275 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3ae0156570 con 0x7f3ae0158e00 2023-05-16T13:54:10.794 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.786+0000 7f3ad6ffd640 1 -- 172.21.15.39:0/2548953275 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3ad80551e0 con 0x7f3ae0158e00 2023-05-16T13:54:10.795 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 8 2023-05-16T13:54:10.796 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.790+0000 7f3ae8420640 1 -- 172.21.15.39:0/2548953275 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f3ac4066280 msgr2=0x7f3ac4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:10.796 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.790+0000 7f3ae8420640 1 --2- 172.21.15.39:0/2548953275 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f3ac4066280 0x7f3ac4068730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3adc0b2000 tx=0x7f3adc008040 comp rx=0 tx=0).stop 2023-05-16T13:54:10.797 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.790+0000 7f3ae8420640 1 -- 172.21.15.39:0/2548953275 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ae0158e00 msgr2=0x7f3ae0159af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:10.797 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.790+0000 7f3ae8420640 1 --2- 172.21.15.39:0/2548953275 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ae0158e00 0x7f3ae0159af0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3ad8007e30 tx=0x7f3ad800e4b0 comp rx=0 tx=0).stop 2023-05-16T13:54:10.797 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.790+0000 7f3ae8420640 1 -- 172.21.15.39:0/2548953275 shutdown_connections 2023-05-16T13:54:10.797 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.790+0000 7f3ae8420640 1 --2- 172.21.15.39:0/2548953275 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ae0158e00 0x7f3ae0159af0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:10.797 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.790+0000 7f3ae8420640 1 --2- 172.21.15.39:0/2548953275 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ae00c9a70 0x7f3ae0147920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:10.797 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.790+0000 7f3ae8420640 1 --2- 172.21.15.39:0/2548953275 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f3ac4066280 0x7f3ac4068730 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:10.797 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.790+0000 7f3ae8420640 1 --2- 172.21.15.39:0/2548953275 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3ae00b0660 0x7f3ae01551d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:10.797 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.790+0000 7f3ae8420640 1 -- 172.21.15.39:0/2548953275 >> 172.21.15.39:0/2548953275 conn(0x7f3ae0069a50 msgr2=0x7f3ae0069e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:10.798 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.790+0000 7f3ae8420640 1 -- 172.21.15.39:0/2548953275 shutdown_connections 2023-05-16T13:54:10.798 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.790+0000 7f3ae8420640 1 -- 172.21.15.39:0/2548953275 wait complete. 2023-05-16T13:54:10.814 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-16T13:54:10.954 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.946+0000 7faf0d2d1640 1 Processor -- start 2023-05-16T13:54:10.955 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.946+0000 7faf0d2d1640 1 -- start start 2023-05-16T13:54:10.956 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.950+0000 7faf0d2d1640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7faf080b5670 0x7faf080b42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:10.956 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.950+0000 7faf0d2d1640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf080ce150 con 0x7faf080b5b10 2023-05-16T13:54:10.956 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.950+0000 7faf0d2d1640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf080cd890 con 0x7faf0815c470 2023-05-16T13:54:10.956 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.950+0000 7faf0d2d1640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf080cdb00 con 0x7faf080b5670 2023-05-16T13:54:10.957 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.950+0000 7faf067fc640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7faf080b5670 0x7faf080b42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:10.957 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.950+0000 7faf067fc640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7faf080b5670 0x7faf080b42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:37880/0 (socket says 172.21.15.39:37880) 2023-05-16T13:54:10.957 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.950+0000 7faf077fe640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7faf080b5b10 0x7faf080ce5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:38172/0 (socket says 172.21.15.39:38172) 2023-05-16T13:54:10.958 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.950+0000 7faf067fc640 1 -- 172.21.15.39:0/919785261 learned_addr learned my addr 172.21.15.39:0/919785261 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:10.958 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.950+0000 7faf06ffd640 1 --1- 172.21.15.39:0/919785261 >> v1:172.21.15.118:6789/0 conn(0x7faf0815c470 0x7faf080d0720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.39:49530/0 (socket says 172.21.15.39:49530) 2023-05-16T13:54:10.958 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.950+0000 7faf067fc640 1 -- 172.21.15.39:0/919785261 >> v1:172.21.15.118:6789/0 conn(0x7faf0815c470 legacy=0x7faf080d0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:10.958 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.950+0000 7faf067fc640 1 -- 172.21.15.39:0/919785261 >> v1:172.21.15.39:6789/0 conn(0x7faf080b5b10 legacy=0x7faf080ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:10.958 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.950+0000 7faf067fc640 1 -- 172.21.15.39:0/919785261 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf080cdde0 con 0x7faf080b5670 2023-05-16T13:54:10.959 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.950+0000 7faf067fc640 1 --2- 172.21.15.39:0/919785261 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faf080b5670 0x7faf080b42a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7faefc009870 tx=0x7faefc01c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10a2d22da09e5c5e server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:10.959 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.954+0000 7faf05ffb640 1 -- 172.21.15.39:0/919785261 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faefc0ab680 con 0x7faf080b5670 2023-05-16T13:54:10.960 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.954+0000 7faf05ffb640 1 -- 172.21.15.39:0/919785261 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faefc0ab7e0 con 0x7faf080b5670 2023-05-16T13:54:10.960 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.954+0000 7faf05ffb640 1 -- 172.21.15.39:0/919785261 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faefc0abb70 con 0x7faf080b5670 2023-05-16T13:54:10.960 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.954+0000 7faf0d2d1640 1 -- 172.21.15.39:0/919785261 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faf080b5670 msgr2=0x7faf080b42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:10.961 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.954+0000 7faf0d2d1640 1 --2- 172.21.15.39:0/919785261 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faf080b5670 0x7faf080b42a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7faefc009870 tx=0x7faefc01c4e0 comp rx=0 tx=0).stop 2023-05-16T13:54:10.961 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.954+0000 7faf0d2d1640 1 -- 172.21.15.39:0/919785261 shutdown_connections 2023-05-16T13:54:10.961 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.954+0000 7faf0d2d1640 1 --2- 172.21.15.39:0/919785261 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faf080b5670 0x7faf080b42a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:10.961 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.954+0000 7faf0d2d1640 1 -- 172.21.15.39:0/919785261 >> 172.21.15.39:0/919785261 conn(0x7faf0809bae0 msgr2=0x7faf080d2820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:10.961 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.954+0000 7faf0d2d1640 1 -- 172.21.15.39:0/919785261 shutdown_connections 2023-05-16T13:54:10.961 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.954+0000 7faf0d2d1640 1 -- 172.21.15.39:0/919785261 wait complete. 2023-05-16T13:54:10.962 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.954+0000 7faf0d2d1640 1 Processor -- start 2023-05-16T13:54:10.962 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.954+0000 7faf0d2d1640 1 -- start start 2023-05-16T13:54:10.963 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.954+0000 7faf0d2d1640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faf080b5670 0x7faf08153b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:10.963 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.954+0000 7faf0d2d1640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf080b5b10 0x7faf08154130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:10.963 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.954+0000 7faf0d2d1640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faf0815c470 0x7faf080c6770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:10.964 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.954+0000 7faf0d2d1640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf080cc470 con 0x7faf080b5670 2023-05-16T13:54:10.964 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.954+0000 7faf0d2d1640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf080ca270 con 0x7faf080b5b10 2023-05-16T13:54:10.964 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.954+0000 7faf0d2d1640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf080cc930 con 0x7faf0815c470 2023-05-16T13:54:10.964 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.954+0000 7faf06ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faf080b5670 0x7faf08153b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:10.964 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.954+0000 7faf06ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faf080b5670 0x7faf08153b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:37892/0 (socket says 172.21.15.39:37892) 2023-05-16T13:54:10.965 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.954+0000 7faf06ffd640 1 -- 172.21.15.39:0/1524973499 learned_addr learned my addr 172.21.15.39:0/1524973499 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:10.965 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.954+0000 7faf077fe640 1 --2- 172.21.15.39:0/1524973499 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faf0815c470 0x7faf080c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:10.965 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.954+0000 7faf067fc640 1 --2- 172.21.15.39:0/1524973499 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf080b5b10 0x7faf08154130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:10.966 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.958+0000 7faf06ffd640 1 -- 172.21.15.39:0/1524973499 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faf0815c470 msgr2=0x7faf080c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:10.966 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.958+0000 7faf06ffd640 1 --2- 172.21.15.39:0/1524973499 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faf0815c470 0x7faf080c6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:10.966 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.958+0000 7faf06ffd640 1 -- 172.21.15.39:0/1524973499 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf080b5b10 msgr2=0x7faf08154130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:10.967 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.958+0000 7faf06ffd640 1 --2- 172.21.15.39:0/1524973499 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf080b5b10 0x7faf08154130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:10.967 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.958+0000 7faf06ffd640 1 -- 172.21.15.39:0/1524973499 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faefc0094d0 con 0x7faf080b5670 2023-05-16T13:54:10.967 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.958+0000 7faf077fe640 1 --2- 172.21.15.39:0/1524973499 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faf0815c470 0x7faf080c6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:54:10.967 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.958+0000 7faf06ffd640 1 --2- 172.21.15.39:0/1524973499 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faf080b5670 0x7faf08153b90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7faef800c500 tx=0x7faef800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:10.967 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.958+0000 7faeef7fe640 1 -- 172.21.15.39:0/1524973499 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef8005c80 con 0x7faf080b5670 2023-05-16T13:54:10.967 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.958+0000 7faeef7fe640 1 -- 172.21.15.39:0/1524973499 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faef8005de0 con 0x7faf080b5670 2023-05-16T13:54:10.967 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.958+0000 7faeef7fe640 1 -- 172.21.15.39:0/1524973499 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef80072f0 con 0x7faf080b5670 2023-05-16T13:54:10.968 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.958+0000 7faf0d2d1640 1 -- 172.21.15.39:0/1524973499 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf080d0ee0 con 0x7faf080b5670 2023-05-16T13:54:10.968 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.958+0000 7faf0d2d1640 1 -- 172.21.15.39:0/1524973499 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf080b4bf0 con 0x7faf080b5670 2023-05-16T13:54:10.968 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.958+0000 7faf0d2d1640 1 -- 172.21.15.39:0/1524973499 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf08073c90 con 0x7faf080b5670 2023-05-16T13:54:10.969 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.958+0000 7faeef7fe640 1 -- 172.21.15.39:0/1524973499 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7faef8007450 con 0x7faf080b5670 2023-05-16T13:54:10.969 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.962+0000 7faeef7fe640 1 --2- 172.21.15.39:0/1524973499 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7faef4066280 0x7faef4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:10.969 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.962+0000 7faeef7fe640 1 -- 172.21.15.39:0/1524973499 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7faef8082f20 con 0x7faf080b5670 2023-05-16T13:54:10.969 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.962+0000 7faf067fc640 1 --2- 172.21.15.39:0/1524973499 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7faef4066280 0x7faef4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:10.969 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.962+0000 7faf067fc640 1 --2- 172.21.15.39:0/1524973499 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7faef4066280 0x7faef4068730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7faefc0af000 tx=0x7faefc0b6040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:10.971 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:10.966+0000 7faeef7fe640 1 -- 172.21.15.39:0/1524973499 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7faef8050710 con 0x7faf080b5670 2023-05-16T13:54:11.158 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.150+0000 7faf0d2d1640 1 -- 172.21.15.39:0/1524973499 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faf080c6550 con 0x7faf080b5670 2023-05-16T13:54:11.158 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.150+0000 7faeef7fe640 1 -- 172.21.15.39:0/1524973499 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3527 (secure 0 0 0) 0x7faef8017de0 con 0x7faf080b5670 2023-05-16T13:54:11.158 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:54:11.159 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2374269620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":2374269620},{"type":"v1","addr":"172.21.15.118:6835","nonce":2374269620}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/3803055359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3803055359},{"type":"v1","addr":"172.21.15.118:6833","nonce":3803055359}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4308,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6836/3259535605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":3259535605},{"type":"v1","addr":"172.21.15.39:6836","nonce":3259535605}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4311,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/616280162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6835","nonce":616280162},{"type":"v1","addr":"172.21.15.39:6837","nonce":616280162}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-05-16T13:54:11.159 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 3 2023-05-16T13:54:11.160 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.154+0000 7faf0d2d1640 1 -- 172.21.15.39:0/1524973499 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7faef4066280 msgr2=0x7faef4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:11.160 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.154+0000 7faf0d2d1640 1 --2- 172.21.15.39:0/1524973499 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7faef4066280 0x7faef4068730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7faefc0af000 tx=0x7faefc0b6040 comp rx=0 tx=0).stop 2023-05-16T13:54:11.160 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.154+0000 7faf0d2d1640 1 -- 172.21.15.39:0/1524973499 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faf080b5670 msgr2=0x7faf08153b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:11.160 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.154+0000 7faf0d2d1640 1 --2- 172.21.15.39:0/1524973499 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faf080b5670 0x7faf08153b90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7faef800c500 tx=0x7faef800c9c0 comp rx=0 tx=0).stop 2023-05-16T13:54:11.161 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.154+0000 7faf0d2d1640 1 -- 172.21.15.39:0/1524973499 shutdown_connections 2023-05-16T13:54:11.161 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.154+0000 7faf0d2d1640 1 --2- 172.21.15.39:0/1524973499 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7faef4066280 0x7faef4068730 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:11.161 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.154+0000 7faf0d2d1640 1 --2- 172.21.15.39:0/1524973499 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faf0815c470 0x7faf080c6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:11.161 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.154+0000 7faf0d2d1640 1 --2- 172.21.15.39:0/1524973499 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf080b5b10 0x7faf08154130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:11.161 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.154+0000 7faf0d2d1640 1 --2- 172.21.15.39:0/1524973499 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faf080b5670 0x7faf08153b90 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:11.161 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.154+0000 7faf0d2d1640 1 -- 172.21.15.39:0/1524973499 >> 172.21.15.39:0/1524973499 conn(0x7faf0809bae0 msgr2=0x7faf0806c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:11.161 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.154+0000 7faf0d2d1640 1 -- 172.21.15.39:0/1524973499 shutdown_connections 2023-05-16T13:54:11.162 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.154+0000 7faf0d2d1640 1 -- 172.21.15.39:0/1524973499 wait complete. 2023-05-16T13:54:11.178 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-16T13:54:11.315 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.306+0000 7f69ff68c640 1 Processor -- start 2023-05-16T13:54:11.315 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.306+0000 7f69ff68c640 1 -- start start 2023-05-16T13:54:11.316 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.310+0000 7f69ff68c640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f69f8160670 0x7f69f8071330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:11.317 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.310+0000 7f69ff68c640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f69f80c89f0 0x7f69f80cac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:11.317 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.310+0000 7f69ff68c640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69f80ca3c0 con 0x7f69f81602a0 2023-05-16T13:54:11.317 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.310+0000 7f69ff68c640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69f8164c70 con 0x7f69f80c89f0 2023-05-16T13:54:11.317 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.310+0000 7f69ff68c640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69f80ca640 con 0x7f69f8160670 2023-05-16T13:54:11.317 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.310+0000 7f69fd428640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f69f81602a0 0x7f69f8070c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:38178/0 (socket says 172.21.15.39:38178) 2023-05-16T13:54:11.317 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.310+0000 7f69fd428640 1 -- 172.21.15.39:0/1089073997 learned_addr learned my addr 172.21.15.39:0/1089073997 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:11.317 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.310+0000 7f69fdc29640 1 --2- 172.21.15.39:0/1089073997 >> v2:172.21.15.39:3300/0 conn(0x7f69f80c89f0 0x7f69f80cac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:11.318 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.310+0000 7f69fcc27640 1 --2- 172.21.15.39:0/1089073997 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f69f8160670 0x7f69f8071330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:11.318 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.310+0000 7f69effff640 1 -- 172.21.15.39:0/1089073997 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 969994128 0 0) 0x7f69f80ca3c0 con 0x7f69f81602a0 2023-05-16T13:54:11.318 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.310+0000 7f69effff640 1 -- 172.21.15.39:0/1089073997 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69e4003530 con 0x7f69f81602a0 2023-05-16T13:54:11.319 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.310+0000 7f69fdc29640 1 -- 172.21.15.39:0/1089073997 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f69f8160670 msgr2=0x7f69f8071330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:11.319 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.310+0000 7f69fdc29640 1 --2- 172.21.15.39:0/1089073997 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f69f8160670 0x7f69f8071330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:11.319 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.310+0000 7f69fdc29640 1 -- 172.21.15.39:0/1089073997 >> v1:172.21.15.39:6789/0 conn(0x7f69f81602a0 legacy=0x7f69f8070c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:11.319 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.310+0000 7f69fdc29640 1 -- 172.21.15.39:0/1089073997 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f80ca920 con 0x7f69f80c89f0 2023-05-16T13:54:11.320 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.314+0000 7f69fdc29640 1 --2- 172.21.15.39:0/1089073997 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69f80c89f0 0x7f69f80cac00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f69f0009d90 tx=0x7f69f001f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d17a0127fbdf34ec server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:11.320 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.314+0000 7f69effff640 1 -- 172.21.15.39:0/1089073997 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f00af600 con 0x7f69f80c89f0 2023-05-16T13:54:11.320 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.314+0000 7f69effff640 1 -- 172.21.15.39:0/1089073997 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69f00ab050 con 0x7f69f80c89f0 2023-05-16T13:54:11.321 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.314+0000 7f69effff640 1 -- 172.21.15.39:0/1089073997 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f00af980 con 0x7f69f80c89f0 2023-05-16T13:54:11.321 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.314+0000 7f69ff68c640 1 -- 172.21.15.39:0/1089073997 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69f80c89f0 msgr2=0x7f69f80cac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:11.321 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.314+0000 7f69ff68c640 1 --2- 172.21.15.39:0/1089073997 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69f80c89f0 0x7f69f80cac00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f69f0009d90 tx=0x7f69f001f130 comp rx=0 tx=0).stop 2023-05-16T13:54:11.322 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.314+0000 7f69ff68c640 1 -- 172.21.15.39:0/1089073997 shutdown_connections 2023-05-16T13:54:11.322 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.314+0000 7f69ff68c640 1 --2- 172.21.15.39:0/1089073997 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69f80c89f0 0x7f69f80cac00 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:11.322 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.314+0000 7f69ff68c640 1 --2- 172.21.15.39:0/1089073997 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f69f8160670 0x7f69f8071330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:11.322 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.314+0000 7f69ff68c640 1 -- 172.21.15.39:0/1089073997 >> 172.21.15.39:0/1089073997 conn(0x7f69f8069a50 msgr2=0x7f69f8069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:11.322 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.314+0000 7f69ff68c640 1 -- 172.21.15.39:0/1089073997 shutdown_connections 2023-05-16T13:54:11.322 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.314+0000 7f69ff68c640 1 -- 172.21.15.39:0/1089073997 wait complete. 2023-05-16T13:54:11.323 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.314+0000 7f69ff68c640 1 Processor -- start 2023-05-16T13:54:11.323 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.314+0000 7f69ff68c640 1 -- start start 2023-05-16T13:54:11.324 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.318+0000 7f69ff68c640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f69f80c89f0 0x7f69f8154b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:11.324 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.318+0000 7f69ff68c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69f81602a0 0x7f69f80adea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:11.324 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.318+0000 7f69ff68c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f69f8160670 0x7f69f80ae3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:11.324 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.318+0000 7f69ff68c640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f8155080 con 0x7f69f81602a0 2023-05-16T13:54:11.324 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.318+0000 7f69ff68c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f80c28f0 con 0x7f69f8160670 2023-05-16T13:54:11.325 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.318+0000 7f69ff68c640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69f80c2000 con 0x7f69f80c89f0 2023-05-16T13:54:11.325 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.318+0000 7f69fcc27640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69f81602a0 0x7f69f80adea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:11.325 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.318+0000 7f69fcc27640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69f81602a0 0x7f69f80adea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:37912/0 (socket says 172.21.15.39:37912) 2023-05-16T13:54:11.325 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.318+0000 7f69fcc27640 1 -- 172.21.15.39:0/3906150659 learned_addr learned my addr 172.21.15.39:0/3906150659 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:11.325 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.318+0000 7f69fd428640 1 --2- 172.21.15.39:0/3906150659 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f69f80c89f0 0x7f69f8154b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:11.325 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.318+0000 7f69fdc29640 1 --2- 172.21.15.39:0/3906150659 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f69f8160670 0x7f69f80ae3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:11.326 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.318+0000 7f69fcc27640 1 -- 172.21.15.39:0/3906150659 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f69f80c89f0 msgr2=0x7f69f8154b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:11.326 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.318+0000 7f69fcc27640 1 --2- 172.21.15.39:0/3906150659 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f69f80c89f0 0x7f69f8154b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:11.326 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.318+0000 7f69fcc27640 1 -- 172.21.15.39:0/3906150659 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f69f8160670 msgr2=0x7f69f80ae3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:11.327 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.318+0000 7f69fcc27640 1 --2- 172.21.15.39:0/3906150659 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f69f8160670 0x7f69f80ae3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:11.327 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.318+0000 7f69fcc27640 1 -- 172.21.15.39:0/3906150659 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f0009a70 con 0x7f69f81602a0 2023-05-16T13:54:11.327 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.318+0000 7f69fd428640 1 --2- 172.21.15.39:0/3906150659 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f69f80c89f0 0x7f69f8154b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:54:11.327 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.318+0000 7f69fcc27640 1 --2- 172.21.15.39:0/3906150659 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69f81602a0 0x7f69f80adea0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f69e800d800 tx=0x7f69e800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:11.327 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.318+0000 7f69edffb640 1 -- 172.21.15.39:0/3906150659 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e800b6c0 con 0x7f69f81602a0 2023-05-16T13:54:11.327 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.318+0000 7f69edffb640 1 -- 172.21.15.39:0/3906150659 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69e800b820 con 0x7f69f81602a0 2023-05-16T13:54:11.327 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.318+0000 7f69ff68c640 1 -- 172.21.15.39:0/3906150659 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69f8071870 con 0x7f69f81602a0 2023-05-16T13:54:11.327 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.318+0000 7f69edffb640 1 -- 172.21.15.39:0/3906150659 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e800bb90 con 0x7f69f81602a0 2023-05-16T13:54:11.328 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.318+0000 7f69ff68c640 1 -- 172.21.15.39:0/3906150659 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69f8164960 con 0x7f69f81602a0 2023-05-16T13:54:11.328 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.318+0000 7f69ff68c640 1 -- 172.21.15.39:0/3906150659 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69f8071a00 con 0x7f69f81602a0 2023-05-16T13:54:11.328 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.318+0000 7f69edffb640 1 -- 172.21.15.39:0/3906150659 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f69e800bcf0 con 0x7f69f81602a0 2023-05-16T13:54:11.329 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.322+0000 7f69edffb640 1 --2- 172.21.15.39:0/3906150659 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f69dc066280 0x7f69dc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:11.329 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.322+0000 7f69edffb640 1 -- 172.21.15.39:0/3906150659 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f69e8083f60 con 0x7f69f81602a0 2023-05-16T13:54:11.329 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.322+0000 7f69fd428640 1 --2- 172.21.15.39:0/3906150659 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f69dc066280 0x7f69dc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:11.329 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.322+0000 7f69fd428640 1 --2- 172.21.15.39:0/3906150659 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f69dc066280 0x7f69dc068730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f69f40011f0 tx=0x7f69f4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:11.332 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.326+0000 7f69edffb640 1 -- 172.21.15.39:0/3906150659 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f69e80551b0 con 0x7f69f81602a0 2023-05-16T13:54:11.488 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.482+0000 7f69ff68c640 1 -- 172.21.15.39:0/3906150659 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f69f80c2a60 con 0x7f69f81602a0 2023-05-16T13:54:11.489 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.482+0000 7f69edffb640 1 -- 172.21.15.39:0/3906150659 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+14636 (secure 0 0 0) 0x7f69e8054d40 con 0x7f69f81602a0 2023-05-16T13:54:11.490 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:54:11.490 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":20,"fsid":"9c1e210b-c515-4ea4-a065-397956895c68","created":"2023-05-16T13:53:48.955290+0000","modified":"2023-05-16T13:54:10.766386+0000","last_up_change":"2023-05-16T13:54:01.722051+0000","last_in_change":"2023-05-16T13:53:52.331336+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-16T13:54:00.885009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-16T13:54:08.327895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4ce0f0ba-c4bf-4405-8c95-d2e9a62878ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6809","nonce":3462013698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6811","nonce":3462013698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6815","nonce":3462013698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6813","nonce":3462013698}]},"public_addr":"172.21.15.39:6809/3462013698","cluster_addr":"172.21.15.39:6811/3462013698","heartbeat_back_addr":"172.21.15.39:6815/3462013698","heartbeat_front_addr":"172.21.15.39:6813/3462013698","state":["exists","up"]},{"osd":1,"uuid":"53fdc1ac-2473-472d-af32-2760fdf6e476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6801","nonce":2829970892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6803","nonce":2829970892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6807","nonce":2829970892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6805","nonce":2829970892}]},"public_addr":"172.21.15.39:6801/2829970892","cluster_addr":"172.21.15.39:6803/2829970892","heartbeat_back_addr":"172.21.15.39:6807/2829970892","heartbeat_front_addr":"172.21.15.39:6805/2829970892","state":["exists","up"]},{"osd":2,"uuid":"0b92d770-7030-42fa-a19f-4f7f1ac113c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6817","nonce":3888067413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6819","nonce":3888067413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6823","nonce":3888067413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6821","nonce":3888067413}]},"public_addr":"172.21.15.39:6817/3888067413","cluster_addr":"172.21.15.39:6819/3888067413","heartbeat_back_addr":"172.21.15.39:6823/3888067413","heartbeat_front_addr":"172.21.15.39:6821/3888067413","state":["exists","up"]},{"osd":3,"uuid":"000d9506-cbb2-4017-b875-deca579860ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6825","nonce":405003958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6827","nonce":405003958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6831","nonce":405003958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6829","nonce":405003958}]},"public_addr":"172.21.15.39:6825/405003958","cluster_addr":"172.21.15.39:6827/405003958","heartbeat_back_addr":"172.21.15.39:6831/405003958","heartbeat_front_addr":"172.21.15.39:6829/405003958","state":["exists","up"]},{"osd":4,"uuid":"70f0dacb-e960-40c5-bf6a-183e52bbe2ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6801","nonce":3895278838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6805","nonce":3895278838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6813","nonce":3895278838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6809","nonce":3895278838}]},"public_addr":"172.21.15.118:6801/3895278838","cluster_addr":"172.21.15.118:6805/3895278838","heartbeat_back_addr":"172.21.15.118:6813/3895278838","heartbeat_front_addr":"172.21.15.118:6809/3895278838","state":["exists","up"]},{"osd":5,"uuid":"756feb54-c3ae-4a2a-8f74-85c291ba707c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6804","nonce":3513592808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6808","nonce":3513592808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6815","nonce":3513592808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6812","nonce":3513592808}]},"public_addr":"172.21.15.118:6804/3513592808","cluster_addr":"172.21.15.118:6808/3513592808","heartbeat_back_addr":"172.21.15.118:6815/3513592808","heartbeat_front_addr":"172.21.15.118:6812/3513592808","state":["exists","up"]},{"osd":6,"uuid":"c4a982c1-f497-4b0f-8a23-c77372e4621e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6824","nonce":1863656053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6827","nonce":1863656053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6831","nonce":1863656053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6829","nonce":1863656053}]},"public_addr":"172.21.15.118:6824/1863656053","cluster_addr":"172.21.15.118:6827/1863656053","heartbeat_back_addr":"172.21.15.118:6831/1863656053","heartbeat_front_addr":"172.21.15.118:6829/1863656053","state":["exists","up"]},{"osd":7,"uuid":"6f2888aa-a7ac-4e26-9159-e31817934f44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6817","nonce":3636642904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6819","nonce":3636642904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6825","nonce":3636642904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6821","nonce":3636642904}]},"public_addr":"172.21.15.118:6817/3636642904","cluster_addr":"172.21.15.118:6819/3636642904","heartbeat_back_addr":"172.21.15.118:6825/3636642904","heartbeat_front_addr":"172.21.15.118:6821/3636642904","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.717636+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.724036+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.739144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:58.079275+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:58.073921+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.930466+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.987813+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.941098+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-16T13:54:11.492 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.486+0000 7f69ff68c640 1 -- 172.21.15.39:0/3906150659 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f69dc066280 msgr2=0x7f69dc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:11.492 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.486+0000 7f69ff68c640 1 --2- 172.21.15.39:0/3906150659 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f69dc066280 0x7f69dc068730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f69f40011f0 tx=0x7f69f4009040 comp rx=0 tx=0).stop 2023-05-16T13:54:11.492 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.486+0000 7f69ff68c640 1 -- 172.21.15.39:0/3906150659 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69f81602a0 msgr2=0x7f69f80adea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:11.492 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.486+0000 7f69ff68c640 1 --2- 172.21.15.39:0/3906150659 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69f81602a0 0x7f69f80adea0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f69e800d800 tx=0x7f69e800dcc0 comp rx=0 tx=0).stop 2023-05-16T13:54:11.492 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.486+0000 7f69ff68c640 1 -- 172.21.15.39:0/3906150659 shutdown_connections 2023-05-16T13:54:11.492 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.486+0000 7f69ff68c640 1 --2- 172.21.15.39:0/3906150659 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f69f8160670 0x7f69f80ae3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:11.492 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.486+0000 7f69ff68c640 1 --2- 172.21.15.39:0/3906150659 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69f81602a0 0x7f69f80adea0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:11.493 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.486+0000 7f69ff68c640 1 --2- 172.21.15.39:0/3906150659 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f69dc066280 0x7f69dc068730 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:11.493 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.486+0000 7f69ff68c640 1 --2- 172.21.15.39:0/3906150659 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f69f80c89f0 0x7f69f8154b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:11.493 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.486+0000 7f69ff68c640 1 -- 172.21.15.39:0/3906150659 >> 172.21.15.39:0/3906150659 conn(0x7f69f8069a50 msgr2=0x7f69f80cd3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:11.493 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.486+0000 7f69ff68c640 1 -- 172.21.15.39:0/3906150659 shutdown_connections 2023-05-16T13:54:11.493 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.486+0000 7f69ff68c640 1 -- 172.21.15.39:0/3906150659 wait complete. 2023-05-16T13:54:11.510 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-16T13:54:00.885009+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-16T13:54:08.327895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-16T13:54:11.511 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-16T13:54:11.653 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.646+0000 7f6ee3e41640 1 Processor -- start 2023-05-16T13:54:11.653 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.646+0000 7f6ee3e41640 1 -- start start 2023-05-16T13:54:11.654 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.646+0000 7f6ee3e41640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f6edc0d12b0 0x7f6edc0b0560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:11.654 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.646+0000 7f6ee3e41640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6edc0aed20 con 0x7f6edc15a500 2023-05-16T13:54:11.654 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.646+0000 7f6ee3e41640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6edc0af550 con 0x7f6edc0cd770 2023-05-16T13:54:11.655 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.646+0000 7f6ee3e41640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6edc15a8d0 con 0x7f6edc0d12b0 2023-05-16T13:54:11.655 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.646+0000 7f6ee23de640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f6edc0d12b0 0x7f6edc0b0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:11.655 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.646+0000 7f6ee23de640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f6edc0d12b0 0x7f6edc0b0560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:37924/0 (socket says 172.21.15.39:37924) 2023-05-16T13:54:11.655 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.646+0000 7f6ee23de640 1 -- 172.21.15.39:0/2313828550 learned_addr learned my addr 172.21.15.39:0/2313828550 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:11.655 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.646+0000 7f6ee1bdd640 1 --1- 172.21.15.39:0/2313828550 >> v1:172.21.15.39:6789/0 conn(0x7f6edc15a500 0x7f6edc0cd060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:38190/0 (socket says 172.21.15.39:38190) 2023-05-16T13:54:11.656 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.646+0000 7f6ee23de640 1 -- 172.21.15.39:0/2313828550 >> v1:172.21.15.118:6789/0 conn(0x7f6edc0cd770 legacy=0x7f6edc0afe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:11.656 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.646+0000 7f6ee23de640 1 -- 172.21.15.39:0/2313828550 >> v1:172.21.15.39:6789/0 conn(0x7f6edc15a500 legacy=0x7f6edc0cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:11.656 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.646+0000 7f6ee23de640 1 -- 172.21.15.39:0/2313828550 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6edc0aef70 con 0x7f6edc0d12b0 2023-05-16T13:54:11.656 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.646+0000 7f6ee0bdb640 1 -- 172.21.15.39:0/2313828550 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1385610087 0 0) 0x7f6edc0aed20 con 0x7f6edc15a500 2023-05-16T13:54:11.657 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.650+0000 7f6ee23de640 1 --2- 172.21.15.39:0/2313828550 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6edc0d12b0 0x7f6edc0b0560 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6ed4009e50 tx=0x7f6ed401c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a249e3f9b9074647 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:11.658 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.650+0000 7f6ee0bdb640 1 -- 172.21.15.39:0/2313828550 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed40a5870 con 0x7f6edc0d12b0 2023-05-16T13:54:11.658 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.650+0000 7f6ee0bdb640 1 -- 172.21.15.39:0/2313828550 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed40a59d0 con 0x7f6edc0d12b0 2023-05-16T13:54:11.658 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.650+0000 7f6ee0bdb640 1 -- 172.21.15.39:0/2313828550 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed40a5d60 con 0x7f6edc0d12b0 2023-05-16T13:54:11.659 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.650+0000 7f6ee3e41640 1 -- 172.21.15.39:0/2313828550 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6edc0d12b0 msgr2=0x7f6edc0b0560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:11.659 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.650+0000 7f6ee3e41640 1 --2- 172.21.15.39:0/2313828550 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6edc0d12b0 0x7f6edc0b0560 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6ed4009e50 tx=0x7f6ed401c9e0 comp rx=0 tx=0).stop 2023-05-16T13:54:11.659 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.650+0000 7f6ee3e41640 1 -- 172.21.15.39:0/2313828550 shutdown_connections 2023-05-16T13:54:11.659 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.650+0000 7f6ee3e41640 1 --2- 172.21.15.39:0/2313828550 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6edc0d12b0 0x7f6edc0b0560 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:11.659 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.650+0000 7f6ee3e41640 1 -- 172.21.15.39:0/2313828550 >> 172.21.15.39:0/2313828550 conn(0x7f6edc0999a0 msgr2=0x7f6edc0d0670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:11.659 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.650+0000 7f6ee3e41640 1 -- 172.21.15.39:0/2313828550 shutdown_connections 2023-05-16T13:54:11.660 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.650+0000 7f6ee3e41640 1 -- 172.21.15.39:0/2313828550 wait complete. 2023-05-16T13:54:11.660 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.654+0000 7f6ee3e41640 1 Processor -- start 2023-05-16T13:54:11.660 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.654+0000 7f6ee3e41640 1 -- start start 2023-05-16T13:54:11.661 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.654+0000 7f6ee3e41640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6edc0cd770 0x7f6edc0c7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:11.662 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.654+0000 7f6ee3e41640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6edc0d12b0 0x7f6edc155590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:11.662 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.654+0000 7f6ee3e41640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6edc15a500 0x7f6edc14ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:11.662 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.654+0000 7f6ee3e41640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6edc0af250 con 0x7f6edc15a500 2023-05-16T13:54:11.662 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.654+0000 7f6ee3e41640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6edc0c7d20 con 0x7f6edc0d12b0 2023-05-16T13:54:11.662 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.654+0000 7f6ee3e41640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6edc0c8000 con 0x7f6edc0cd770 2023-05-16T13:54:11.662 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.654+0000 7f6ee23de640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6edc15a500 0x7f6edc14ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:11.663 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.654+0000 7f6ee23de640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6edc15a500 0x7f6edc14ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:37932/0 (socket says 172.21.15.39:37932) 2023-05-16T13:54:11.663 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.654+0000 7f6ee23de640 1 -- 172.21.15.39:0/1010956556 learned_addr learned my addr 172.21.15.39:0/1010956556 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:11.663 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.654+0000 7f6ee1bdd640 1 --2- 172.21.15.39:0/1010956556 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6edc0cd770 0x7f6edc0c7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:11.664 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.654+0000 7f6ee13dc640 1 --2- 172.21.15.39:0/1010956556 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6edc0d12b0 0x7f6edc155590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:11.664 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.654+0000 7f6ee23de640 1 -- 172.21.15.39:0/1010956556 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6edc0cd770 msgr2=0x7f6edc0c7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:11.664 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.654+0000 7f6ee23de640 1 --2- 172.21.15.39:0/1010956556 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6edc0cd770 0x7f6edc0c7740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:11.665 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.654+0000 7f6ee23de640 1 -- 172.21.15.39:0/1010956556 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6edc0d12b0 msgr2=0x7f6edc155590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:11.665 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.654+0000 7f6ee23de640 1 --2- 172.21.15.39:0/1010956556 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6edc0d12b0 0x7f6edc155590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:11.665 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.654+0000 7f6ee23de640 1 -- 172.21.15.39:0/1010956556 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ed4009b30 con 0x7f6edc15a500 2023-05-16T13:54:11.665 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.654+0000 7f6ee1bdd640 1 --2- 172.21.15.39:0/1010956556 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6edc0cd770 0x7f6edc0c7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:54:11.665 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.654+0000 7f6ee23de640 1 --2- 172.21.15.39:0/1010956556 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6edc15a500 0x7f6edc14ebe0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6ed40195f0 tx=0x7f6ed4019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:11.665 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.654+0000 7f6ed27fc640 1 -- 172.21.15.39:0/1010956556 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed40b8670 con 0x7f6edc15a500 2023-05-16T13:54:11.665 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.654+0000 7f6ed27fc640 1 -- 172.21.15.39:0/1010956556 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed40b87d0 con 0x7f6edc15a500 2023-05-16T13:54:11.666 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.654+0000 7f6ed27fc640 1 -- 172.21.15.39:0/1010956556 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed40b8b80 con 0x7f6edc15a500 2023-05-16T13:54:11.666 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.654+0000 7f6ee3e41640 1 -- 172.21.15.39:0/1010956556 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6edc0cec30 con 0x7f6edc15a500 2023-05-16T13:54:11.666 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.654+0000 7f6ee3e41640 1 -- 172.21.15.39:0/1010956556 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6edc0b0eb0 con 0x7f6edc15a500 2023-05-16T13:54:11.666 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.658+0000 7f6ee3e41640 1 -- 172.21.15.39:0/1010956556 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6edc0cedc0 con 0x7f6edc15a500 2023-05-16T13:54:11.667 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.658+0000 7f6ed27fc640 1 -- 172.21.15.39:0/1010956556 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6ed40b8ce0 con 0x7f6edc15a500 2023-05-16T13:54:11.667 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.658+0000 7f6ed27fc640 1 --2- 172.21.15.39:0/1010956556 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f6ec0066280 0x7f6ec0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:11.667 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.658+0000 7f6ed27fc640 1 -- 172.21.15.39:0/1010956556 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6ed411f1a0 con 0x7f6edc15a500 2023-05-16T13:54:11.667 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.658+0000 7f6ee1bdd640 1 --2- 172.21.15.39:0/1010956556 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f6ec0066280 0x7f6ec0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:11.668 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.658+0000 7f6ee1bdd640 1 --2- 172.21.15.39:0/1010956556 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f6ec0066280 0x7f6ec0068730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6ed8007fd0 tx=0x7f6ed8007c80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:11.670 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.662+0000 7f6ed27fc640 1 -- 172.21.15.39:0/1010956556 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f6edc0cedc0 con 0x7f6edc15a500 2023-05-16T13:54:11.831 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.822+0000 7f6ee3e41640 1 -- 172.21.15.39:0/1010956556 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6edc0cedc0 con 0x7f6edc15a500 2023-05-16T13:54:11.832 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.826+0000 7f6ed27fc640 1 -- 172.21.15.39:0/1010956556 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6edc0cedc0 con 0x7f6edc15a500 2023-05-16T13:54:11.832 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2023-05-16T13:54:11.833 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.826+0000 7f6ee3e41640 1 -- 172.21.15.39:0/1010956556 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f6ec0066280 msgr2=0x7f6ec0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:11.834 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.826+0000 7f6ee3e41640 1 --2- 172.21.15.39:0/1010956556 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f6ec0066280 0x7f6ec0068730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6ed8007fd0 tx=0x7f6ed8007c80 comp rx=0 tx=0).stop 2023-05-16T13:54:11.834 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.826+0000 7f6ee3e41640 1 -- 172.21.15.39:0/1010956556 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6edc15a500 msgr2=0x7f6edc14ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:11.834 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.826+0000 7f6ee3e41640 1 --2- 172.21.15.39:0/1010956556 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6edc15a500 0x7f6edc14ebe0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6ed40195f0 tx=0x7f6ed4019780 comp rx=0 tx=0).stop 2023-05-16T13:54:11.834 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.826+0000 7f6ee3e41640 1 -- 172.21.15.39:0/1010956556 shutdown_connections 2023-05-16T13:54:11.834 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.826+0000 7f6ee3e41640 1 --2- 172.21.15.39:0/1010956556 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6edc15a500 0x7f6edc14ebe0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:11.834 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.826+0000 7f6ee3e41640 1 --2- 172.21.15.39:0/1010956556 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6edc0d12b0 0x7f6edc155590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:11.835 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.826+0000 7f6ee3e41640 1 --2- 172.21.15.39:0/1010956556 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f6ec0066280 0x7f6ec0068730 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:11.835 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.826+0000 7f6ee3e41640 1 --2- 172.21.15.39:0/1010956556 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6edc0cd770 0x7f6edc0c7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:11.835 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.826+0000 7f6ee3e41640 1 -- 172.21.15.39:0/1010956556 >> 172.21.15.39:0/1010956556 conn(0x7f6edc0999a0 msgr2=0x7f6edc0adc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:11.835 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.826+0000 7f6ee3e41640 1 -- 172.21.15.39:0/1010956556 shutdown_connections 2023-05-16T13:54:11.835 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.826+0000 7f6ee3e41640 1 -- 172.21.15.39:0/1010956556 wait complete. 2023-05-16T13:54:11.852 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-16T13:54:11.992 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.986+0000 7fd179c74640 1 Processor -- start 2023-05-16T13:54:11.992 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.986+0000 7fd179c74640 1 -- start start 2023-05-16T13:54:11.993 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.986+0000 7fd179c74640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd1740cd840 0x7fd1740c8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:11.993 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.986+0000 7fd179c74640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd17406fc80 0x7fd1740aff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:11.993 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.986+0000 7fd179c74640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1740c9040 con 0x7fd17415cf50 2023-05-16T13:54:11.993 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.986+0000 7fd179c74640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd17415d480 con 0x7fd1740cd840 2023-05-16T13:54:11.993 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.986+0000 7fd179c74640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1740ca460 con 0x7fd17406fc80 2023-05-16T13:54:11.994 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.986+0000 7fd173fff640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fd17415cf50 0x7fd174159110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:38194/0 (socket says 172.21.15.39:38194) 2023-05-16T13:54:11.994 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.986+0000 7fd173fff640 1 -- 172.21.15.39:0/2225377155 learned_addr learned my addr 172.21.15.39:0/2225377155 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:11.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.986+0000 7fd1737fe640 1 --2- 172.21.15.39:0/2225377155 >> v2:172.21.15.118:3300/0 conn(0x7fd1740cd840 0x7fd1740c8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:11.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.986+0000 7fd172ffd640 1 --2- 172.21.15.39:0/2225377155 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd17406fc80 0x7fd1740aff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:11.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.986+0000 7fd1727fc640 1 -- 172.21.15.39:0/2225377155 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 337296064 0 0) 0x7fd16c0014a0 con 0x7fd17415cf50 2023-05-16T13:54:11.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.986+0000 7fd1727fc640 1 -- 172.21.15.39:0/2225377155 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd15c003530 con 0x7fd17415cf50 2023-05-16T13:54:11.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.986+0000 7fd1737fe640 1 -- 172.21.15.39:0/2225377155 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd17406fc80 msgr2=0x7fd1740aff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:11.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.986+0000 7fd1737fe640 1 --2- 172.21.15.39:0/2225377155 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd17406fc80 0x7fd1740aff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:11.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.986+0000 7fd1737fe640 1 -- 172.21.15.39:0/2225377155 >> v1:172.21.15.39:6789/0 conn(0x7fd17415cf50 legacy=0x7fd174159110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:11.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.986+0000 7fd1737fe640 1 -- 172.21.15.39:0/2225377155 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1740cbd00 con 0x7fd1740cd840 2023-05-16T13:54:11.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.990+0000 7fd1737fe640 1 --2- 172.21.15.39:0/2225377155 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1740cd840 0x7fd1740c8b00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd1640097c0 tx=0x7fd16401c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1f43d58ec02110c server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:11.997 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.990+0000 7fd1727fc640 1 -- 172.21.15.39:0/2225377155 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1640ab600 con 0x7fd1740cd840 2023-05-16T13:54:11.997 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.990+0000 7fd1727fc640 1 -- 172.21.15.39:0/2225377155 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1640a7050 con 0x7fd1740cd840 2023-05-16T13:54:11.997 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.990+0000 7fd1727fc640 1 -- 172.21.15.39:0/2225377155 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1640ab960 con 0x7fd1740cd840 2023-05-16T13:54:11.998 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.990+0000 7fd179c74640 1 -- 172.21.15.39:0/2225377155 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1740cd840 msgr2=0x7fd1740c8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:11.998 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.990+0000 7fd179c74640 1 --2- 172.21.15.39:0/2225377155 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1740cd840 0x7fd1740c8b00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd1640097c0 tx=0x7fd16401c3f0 comp rx=0 tx=0).stop 2023-05-16T13:54:11.999 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.990+0000 7fd179c74640 1 -- 172.21.15.39:0/2225377155 shutdown_connections 2023-05-16T13:54:11.999 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.990+0000 7fd179c74640 1 --2- 172.21.15.39:0/2225377155 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd17406fc80 0x7fd1740aff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:11.999 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.990+0000 7fd179c74640 1 --2- 172.21.15.39:0/2225377155 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1740cd840 0x7fd1740c8b00 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:11.999 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.990+0000 7fd179c74640 1 -- 172.21.15.39:0/2225377155 >> 172.21.15.39:0/2225377155 conn(0x7fd174069a50 msgr2=0x7fd174069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:11.999 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.990+0000 7fd179c74640 1 -- 172.21.15.39:0/2225377155 shutdown_connections 2023-05-16T13:54:11.999 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.990+0000 7fd179c74640 1 -- 172.21.15.39:0/2225377155 wait complete. 2023-05-16T13:54:12.000 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.994+0000 7fd179c74640 1 Processor -- start 2023-05-16T13:54:12.000 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.994+0000 7fd179c74640 1 -- start start 2023-05-16T13:54:12.002 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.994+0000 7fd179c74640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd17406fc80 0x7fd17414d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:12.002 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.994+0000 7fd179c74640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd1740cd840 0x7fd174153700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:12.002 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.994+0000 7fd179c74640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd17415cf50 0x7fd174151c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:12.002 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.994+0000 7fd179c74640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1741473b0 con 0x7fd17406fc80 2023-05-16T13:54:12.002 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.994+0000 7fd179c74640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1740ac9a0 con 0x7fd17415cf50 2023-05-16T13:54:12.002 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.994+0000 7fd179c74640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1741f89b0 con 0x7fd1740cd840 2023-05-16T13:54:12.003 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.994+0000 7fd1737fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd17406fc80 0x7fd17414d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:12.003 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.994+0000 7fd1737fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd17406fc80 0x7fd17414d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:37940/0 (socket says 172.21.15.39:37940) 2023-05-16T13:54:12.003 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.994+0000 7fd1737fe640 1 -- 172.21.15.39:0/448959574 learned_addr learned my addr 172.21.15.39:0/448959574 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:12.003 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.994+0000 7fd172ffd640 1 --2- 172.21.15.39:0/448959574 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd1740cd840 0x7fd174153700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:12.003 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.994+0000 7fd173fff640 1 --2- 172.21.15.39:0/448959574 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd17415cf50 0x7fd174151c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:12.003 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.994+0000 7fd1737fe640 1 -- 172.21.15.39:0/448959574 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd1740cd840 msgr2=0x7fd174153700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:12.003 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.994+0000 7fd1737fe640 1 --2- 172.21.15.39:0/448959574 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd1740cd840 0x7fd174153700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:12.004 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.994+0000 7fd1737fe640 1 -- 172.21.15.39:0/448959574 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd17415cf50 msgr2=0x7fd174151c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:12.004 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.994+0000 7fd1737fe640 1 --2- 172.21.15.39:0/448959574 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd17415cf50 0x7fd174151c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:12.004 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.994+0000 7fd1737fe640 1 -- 172.21.15.39:0/448959574 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd164009420 con 0x7fd17406fc80 2023-05-16T13:54:12.004 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.994+0000 7fd1737fe640 1 --2- 172.21.15.39:0/448959574 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd17406fc80 0x7fd17414d510 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd16401a020 tx=0x7fd164019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:12.004 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.994+0000 7fd15bfff640 1 -- 172.21.15.39:0/448959574 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1640b4400 con 0x7fd17406fc80 2023-05-16T13:54:12.004 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.994+0000 7fd15bfff640 1 -- 172.21.15.39:0/448959574 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1640b4560 con 0x7fd17406fc80 2023-05-16T13:54:12.004 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.994+0000 7fd15bfff640 1 -- 172.21.15.39:0/448959574 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1640b48d0 con 0x7fd17406fc80 2023-05-16T13:54:12.005 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.994+0000 7fd179c74640 1 -- 172.21.15.39:0/448959574 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1740cdee0 con 0x7fd17406fc80 2023-05-16T13:54:12.005 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.994+0000 7fd179c74640 1 -- 172.21.15.39:0/448959574 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1740ca9a0 con 0x7fd17406fc80 2023-05-16T13:54:12.006 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.994+0000 7fd179c74640 1 -- 172.21.15.39:0/448959574 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1740ce400 con 0x7fd17406fc80 2023-05-16T13:54:12.006 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.998+0000 7fd15bfff640 1 -- 172.21.15.39:0/448959574 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd1640b2040 con 0x7fd17406fc80 2023-05-16T13:54:12.006 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.998+0000 7fd15bfff640 1 --2- 172.21.15.39:0/448959574 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd160066280 0x7fd160068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:12.006 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.998+0000 7fd15bfff640 1 -- 172.21.15.39:0/448959574 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd16411d6c0 con 0x7fd17406fc80 2023-05-16T13:54:12.006 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.998+0000 7fd172ffd640 1 --2- 172.21.15.39:0/448959574 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd160066280 0x7fd160068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:12.006 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:11.998+0000 7fd172ffd640 1 --2- 172.21.15.39:0/448959574 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd160066280 0x7fd160068730 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd1741518b0 tx=0x7fd168009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:12.009 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.002+0000 7fd15bfff640 1 -- 172.21.15.39:0/448959574 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fd1640eaea0 con 0x7fd17406fc80 2023-05-16T13:54:12.162 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.154+0000 7fd179c74640 1 -- 172.21.15.39:0/448959574 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd174073c90 con 0x7fd17406fc80 2023-05-16T13:54:12.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.154+0000 7fd15bfff640 1 -- 172.21.15.39:0/448959574 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd1640ee4c0 con 0x7fd17406fc80 2023-05-16T13:54:12.163 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 8 2023-05-16T13:54:12.165 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.158+0000 7fd179c74640 1 -- 172.21.15.39:0/448959574 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd160066280 msgr2=0x7fd160068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:12.165 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.158+0000 7fd179c74640 1 --2- 172.21.15.39:0/448959574 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd160066280 0x7fd160068730 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd1741518b0 tx=0x7fd168009190 comp rx=0 tx=0).stop 2023-05-16T13:54:12.165 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.158+0000 7fd179c74640 1 -- 172.21.15.39:0/448959574 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd17406fc80 msgr2=0x7fd17414d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:12.165 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.158+0000 7fd179c74640 1 --2- 172.21.15.39:0/448959574 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd17406fc80 0x7fd17414d510 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd16401a020 tx=0x7fd164019190 comp rx=0 tx=0).stop 2023-05-16T13:54:12.165 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.158+0000 7fd179c74640 1 -- 172.21.15.39:0/448959574 shutdown_connections 2023-05-16T13:54:12.165 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.158+0000 7fd179c74640 1 --2- 172.21.15.39:0/448959574 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd160066280 0x7fd160068730 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:12.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.158+0000 7fd179c74640 1 --2- 172.21.15.39:0/448959574 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd1740cd840 0x7fd174153700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:12.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.158+0000 7fd179c74640 1 --2- 172.21.15.39:0/448959574 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd17415cf50 0x7fd174151c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:12.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.158+0000 7fd179c74640 1 --2- 172.21.15.39:0/448959574 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd17406fc80 0x7fd17414d510 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:12.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.158+0000 7fd179c74640 1 -- 172.21.15.39:0/448959574 >> 172.21.15.39:0/448959574 conn(0x7fd174069a50 msgr2=0x7fd174069e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:12.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.158+0000 7fd179c74640 1 -- 172.21.15.39:0/448959574 shutdown_connections 2023-05-16T13:54:12.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.158+0000 7fd179c74640 1 -- 172.21.15.39:0/448959574 wait complete. 2023-05-16T13:54:12.183 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-05-16T13:54:12.319 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.310+0000 7fe166b36640 1 Processor -- start 2023-05-16T13:54:12.320 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.314+0000 7fe166b36640 1 -- start start 2023-05-16T13:54:12.321 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.314+0000 7fe166b36640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1600b16a0 0x7fe1600afd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:12.321 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.314+0000 7fe166b36640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe16006b940 con 0x7fe1600d0960 2023-05-16T13:54:12.321 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.314+0000 7fe166b36640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe16006bc20 con 0x7fe1600cf7f0 2023-05-16T13:54:12.321 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.314+0000 7fe166b36640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1600af240 con 0x7fe1600b16a0 2023-05-16T13:54:12.321 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.314+0000 7fe166335640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fe1600d0960 0x7fe1600b0260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:38204/0 (socket says 172.21.15.39:38204) 2023-05-16T13:54:12.321 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.314+0000 7fe166335640 1 -- 172.21.15.39:0/1036883446 learned_addr learned my addr 172.21.15.39:0/1036883446 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:12.322 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.314+0000 7fe165333640 1 --2- 172.21.15.39:0/1036883446 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1600b16a0 0x7fe1600afd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:12.322 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.314+0000 7fe164b32640 1 -- 172.21.15.39:0/1036883446 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 900032982 0 0) 0x7fe16006b940 con 0x7fe1600d0960 2023-05-16T13:54:12.322 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.314+0000 7fe164b32640 1 -- 172.21.15.39:0/1036883446 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe14c003530 con 0x7fe1600d0960 2023-05-16T13:54:12.322 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.314+0000 7fe164b32640 1 -- 172.21.15.39:0/1036883446 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 928266412 0 0) 0x7fe16006bc20 con 0x7fe1600cf7f0 2023-05-16T13:54:12.323 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.314+0000 7fe165333640 1 -- 172.21.15.39:0/1036883446 >> v1:172.21.15.118:6789/0 conn(0x7fe1600cf7f0 legacy=0x7fe1600d0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:12.323 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.314+0000 7fe165333640 1 -- 172.21.15.39:0/1036883446 >> v1:172.21.15.39:6789/0 conn(0x7fe1600d0960 legacy=0x7fe1600b0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:12.323 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.314+0000 7fe165333640 1 -- 172.21.15.39:0/1036883446 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1600af520 con 0x7fe1600b16a0 2023-05-16T13:54:12.324 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.318+0000 7fe165333640 1 --2- 172.21.15.39:0/1036883446 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1600b16a0 0x7fe1600afd20 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe1500097f0 tx=0x7fe1600b1180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74a24d5ec483ba58 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:12.325 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.318+0000 7fe164b32640 1 -- 172.21.15.39:0/1036883446 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe158001a00 con 0x7fe1600b16a0 2023-05-16T13:54:12.325 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.318+0000 7fe164b32640 1 -- 172.21.15.39:0/1036883446 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1500a7050 con 0x7fe1600b16a0 2023-05-16T13:54:12.325 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.318+0000 7fe164b32640 1 -- 172.21.15.39:0/1036883446 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1500ab600 con 0x7fe1600b16a0 2023-05-16T13:54:12.326 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.318+0000 7fe166b36640 1 -- 172.21.15.39:0/1036883446 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1600b16a0 msgr2=0x7fe1600afd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:12.326 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.318+0000 7fe166b36640 1 --2- 172.21.15.39:0/1036883446 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1600b16a0 0x7fe1600afd20 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe1500097f0 tx=0x7fe1600b1180 comp rx=0 tx=0).stop 2023-05-16T13:54:12.326 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.318+0000 7fe166b36640 1 -- 172.21.15.39:0/1036883446 shutdown_connections 2023-05-16T13:54:12.326 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.318+0000 7fe166b36640 1 --2- 172.21.15.39:0/1036883446 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1600b16a0 0x7fe1600afd20 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:12.326 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.318+0000 7fe166b36640 1 -- 172.21.15.39:0/1036883446 >> 172.21.15.39:0/1036883446 conn(0x7fe160071aa0 msgr2=0x7fe16009b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:12.326 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.318+0000 7fe166b36640 1 -- 172.21.15.39:0/1036883446 shutdown_connections 2023-05-16T13:54:12.327 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.318+0000 7fe166b36640 1 -- 172.21.15.39:0/1036883446 wait complete. 2023-05-16T13:54:12.327 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.318+0000 7fe166b36640 1 Processor -- start 2023-05-16T13:54:12.327 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.318+0000 7fe166b36640 1 -- start start 2023-05-16T13:54:12.328 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.322+0000 7fe166b36640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1600b16a0 0x7fe1601578f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:12.328 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.322+0000 7fe166b36640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1600cf7f0 0x7fe1600b3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:12.328 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.322+0000 7fe166b36640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1600d0960 0x7fe1600b39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:12.329 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.322+0000 7fe166b36640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe160155690 con 0x7fe1600cf7f0 2023-05-16T13:54:12.329 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.322+0000 7fe166b36640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1600c6dd0 con 0x7fe1600b16a0 2023-05-16T13:54:12.329 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.322+0000 7fe166b36640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1600c8ec0 con 0x7fe1600d0960 2023-05-16T13:54:12.329 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.322+0000 7fe165333640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1600cf7f0 0x7fe1600b3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:12.329 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.322+0000 7fe165333640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1600cf7f0 0x7fe1600b3460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:37956/0 (socket says 172.21.15.39:37956) 2023-05-16T13:54:12.329 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.322+0000 7fe165333640 1 -- 172.21.15.39:0/393828171 learned_addr learned my addr 172.21.15.39:0/393828171 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:12.329 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.322+0000 7fe166335640 1 --2- 172.21.15.39:0/393828171 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1600d0960 0x7fe1600b39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:12.330 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.322+0000 7fe165b34640 1 --2- 172.21.15.39:0/393828171 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1600b16a0 0x7fe1601578f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:12.330 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.322+0000 7fe165333640 1 -- 172.21.15.39:0/393828171 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1600d0960 msgr2=0x7fe1600b39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:12.331 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.322+0000 7fe165333640 1 --2- 172.21.15.39:0/393828171 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1600d0960 0x7fe1600b39a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:12.331 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.322+0000 7fe165333640 1 -- 172.21.15.39:0/393828171 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1600b16a0 msgr2=0x7fe1601578f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:12.331 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.322+0000 7fe165333640 1 --2- 172.21.15.39:0/393828171 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1600b16a0 0x7fe1601578f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:12.331 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.322+0000 7fe165333640 1 -- 172.21.15.39:0/393828171 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe150009420 con 0x7fe1600cf7f0 2023-05-16T13:54:12.331 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.322+0000 7fe165b34640 1 --2- 172.21.15.39:0/393828171 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1600b16a0 0x7fe1601578f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:54:12.331 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.322+0000 7fe165333640 1 --2- 172.21.15.39:0/393828171 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1600cf7f0 0x7fe1600b3460 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe1500097f0 tx=0x7fe150019070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:12.332 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.322+0000 7fe1567fc640 1 -- 172.21.15.39:0/393828171 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1500b4400 con 0x7fe1600cf7f0 2023-05-16T13:54:12.332 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.322+0000 7fe1567fc640 1 -- 172.21.15.39:0/393828171 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1500b4560 con 0x7fe1600cf7f0 2023-05-16T13:54:12.332 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.322+0000 7fe1567fc640 1 -- 172.21.15.39:0/393828171 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1500b48d0 con 0x7fe1600cf7f0 2023-05-16T13:54:12.332 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.322+0000 7fe166b36640 1 -- 172.21.15.39:0/393828171 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe160169eb0 con 0x7fe1600cf7f0 2023-05-16T13:54:12.332 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.322+0000 7fe166b36640 1 -- 172.21.15.39:0/393828171 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe160169d20 con 0x7fe1600cf7f0 2023-05-16T13:54:12.332 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.322+0000 7fe166b36640 1 -- 172.21.15.39:0/393828171 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe16016a040 con 0x7fe1600cf7f0 2023-05-16T13:54:12.333 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.326+0000 7fe1567fc640 1 -- 172.21.15.39:0/393828171 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe1500b2040 con 0x7fe1600cf7f0 2023-05-16T13:54:12.333 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.326+0000 7fe1567fc640 1 --2- 172.21.15.39:0/393828171 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fe144066280 0x7fe144068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:12.333 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.326+0000 7fe1567fc640 1 -- 172.21.15.39:0/393828171 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fe15011d7f0 con 0x7fe1600cf7f0 2023-05-16T13:54:12.333 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.326+0000 7fe165b34640 1 --2- 172.21.15.39:0/393828171 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fe144066280 0x7fe144068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:12.334 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.326+0000 7fe165b34640 1 --2- 172.21.15.39:0/393828171 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fe144066280 0x7fe144068730 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe160154ef0 tx=0x7fe15c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:12.336 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.330+0000 7fe1567fc640 1 -- 172.21.15.39:0/393828171 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fe1500eaf20 con 0x7fe1600cf7f0 2023-05-16T13:54:12.492 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.486+0000 7fe166b36640 1 -- 172.21.15.39:0/393828171 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe16004ed20 con 0x7fe1600cf7f0 2023-05-16T13:54:12.492 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.486+0000 7fe1567fc640 1 -- 172.21.15.39:0/393828171 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v20) v1 ==== 84+0+126 (secure 0 0 0) 0x7fe1500b0090 con 0x7fe1600cf7f0 2023-05-16T13:54:12.492 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:54:12.493 INFO:teuthology.orchestra.run.smithi039.stdout:[ 2023-05-16T13:54:12.493 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-05-16T13:54:12.493 INFO:teuthology.orchestra.run.smithi039.stdout: "poolnum": 1, 2023-05-16T13:54:12.493 INFO:teuthology.orchestra.run.smithi039.stdout: "poolname": ".mgr" 2023-05-16T13:54:12.493 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-05-16T13:54:12.493 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-05-16T13:54:12.493 INFO:teuthology.orchestra.run.smithi039.stdout: "poolnum": 2, 2023-05-16T13:54:12.494 INFO:teuthology.orchestra.run.smithi039.stdout: "poolname": "rbd" 2023-05-16T13:54:12.494 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-05-16T13:54:12.494 INFO:teuthology.orchestra.run.smithi039.stdout:] 2023-05-16T13:54:12.495 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.486+0000 7fe166b36640 1 -- 172.21.15.39:0/393828171 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fe144066280 msgr2=0x7fe144068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:12.495 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.486+0000 7fe166b36640 1 --2- 172.21.15.39:0/393828171 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fe144066280 0x7fe144068730 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe160154ef0 tx=0x7fe15c009040 comp rx=0 tx=0).stop 2023-05-16T13:54:12.495 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.486+0000 7fe166b36640 1 -- 172.21.15.39:0/393828171 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1600cf7f0 msgr2=0x7fe1600b3460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:12.495 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.486+0000 7fe166b36640 1 --2- 172.21.15.39:0/393828171 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1600cf7f0 0x7fe1600b3460 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe1500097f0 tx=0x7fe150019070 comp rx=0 tx=0).stop 2023-05-16T13:54:12.495 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.486+0000 7fe166b36640 1 -- 172.21.15.39:0/393828171 shutdown_connections 2023-05-16T13:54:12.495 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.486+0000 7fe166b36640 1 --2- 172.21.15.39:0/393828171 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fe144066280 0x7fe144068730 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:12.496 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.486+0000 7fe166b36640 1 --2- 172.21.15.39:0/393828171 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe1600d0960 0x7fe1600b39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:12.496 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.486+0000 7fe166b36640 1 --2- 172.21.15.39:0/393828171 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1600cf7f0 0x7fe1600b3460 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:12.496 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.486+0000 7fe166b36640 1 --2- 172.21.15.39:0/393828171 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1600b16a0 0x7fe1601578f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:12.496 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.486+0000 7fe166b36640 1 -- 172.21.15.39:0/393828171 >> 172.21.15.39:0/393828171 conn(0x7fe160071aa0 msgr2=0x7fe1600d3090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:12.496 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.486+0000 7fe166b36640 1 -- 172.21.15.39:0/393828171 shutdown_connections 2023-05-16T13:54:12.496 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.486+0000 7fe166b36640 1 -- 172.21.15.39:0/393828171 wait complete. 2023-05-16T13:54:12.512 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-05-16T13:54:12.512 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-05-16T13:54:12.653 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.646+0000 7f9ec5fa2640 1 Processor -- start 2023-05-16T13:54:12.654 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.646+0000 7f9ec5fa2640 1 -- start start 2023-05-16T13:54:12.654 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.646+0000 7f9ec5fa2640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9ec006c710 0x7f9ec0167160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:12.655 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.646+0000 7f9ec5fa2640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ec00b1e80 con 0x7f9ec00cf010 2023-05-16T13:54:12.655 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.646+0000 7f9ec5fa2640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ec006b270 con 0x7f9ec015c0e0 2023-05-16T13:54:12.655 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.646+0000 7f9ec5fa2640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ec00b1ba0 con 0x7f9ec006c710 2023-05-16T13:54:12.655 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.646+0000 7f9ec57a1640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9ec006c710 0x7f9ec0167160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:12.655 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.646+0000 7f9ec57a1640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9ec006c710 0x7f9ec0167160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:37958/0 (socket says 172.21.15.39:37958) 2023-05-16T13:54:12.655 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.646+0000 7f9ec57a1640 1 -- 172.21.15.39:0/2385438996 learned_addr learned my addr 172.21.15.39:0/2385438996 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:12.656 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.646+0000 7f9ec4fa0640 1 --1- 172.21.15.39:0/2385438996 >> v1:172.21.15.39:6789/0 conn(0x7f9ec00cf010 0x7f9ec00cf3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:38206/0 (socket says 172.21.15.39:38206) 2023-05-16T13:54:12.656 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.646+0000 7f9ec57a1640 1 -- 172.21.15.39:0/2385438996 >> v1:172.21.15.118:6789/0 conn(0x7f9ec015c0e0 legacy=0x7f9ec0163a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:12.656 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.646+0000 7f9ec57a1640 1 -- 172.21.15.39:0/2385438996 >> v1:172.21.15.39:6789/0 conn(0x7f9ec00cf010 legacy=0x7f9ec00cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:12.656 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.646+0000 7f9ec57a1640 1 -- 172.21.15.39:0/2385438996 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec006ac20 con 0x7f9ec006c710 2023-05-16T13:54:12.657 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.646+0000 7f9ebf7fe640 1 -- 172.21.15.39:0/2385438996 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1949429169 0 0) 0x7f9ec00b1e80 con 0x7f9ec00cf010 2023-05-16T13:54:12.658 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.650+0000 7f9ec57a1640 1 --2- 172.21.15.39:0/2385438996 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9ec006c710 0x7f9ec0167160 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9eb8009e50 tx=0x7f9eb801c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bed34679462ccc6 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:12.658 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.650+0000 7f9ebf7fe640 1 -- 172.21.15.39:0/2385438996 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb80a57a0 con 0x7f9ec006c710 2023-05-16T13:54:12.658 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.650+0000 7f9ebf7fe640 1 -- 172.21.15.39:0/2385438996 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eb80a5900 con 0x7f9ec006c710 2023-05-16T13:54:12.658 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.650+0000 7f9ebf7fe640 1 -- 172.21.15.39:0/2385438996 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb80a5c90 con 0x7f9ec006c710 2023-05-16T13:54:12.659 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.650+0000 7f9ec5fa2640 1 -- 172.21.15.39:0/2385438996 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9ec006c710 msgr2=0x7f9ec0167160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:12.659 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.650+0000 7f9ec5fa2640 1 --2- 172.21.15.39:0/2385438996 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9ec006c710 0x7f9ec0167160 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9eb8009e50 tx=0x7f9eb801c8c0 comp rx=0 tx=0).stop 2023-05-16T13:54:12.659 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.650+0000 7f9ec5fa2640 1 -- 172.21.15.39:0/2385438996 shutdown_connections 2023-05-16T13:54:12.659 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.650+0000 7f9ec5fa2640 1 --2- 172.21.15.39:0/2385438996 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9ec006c710 0x7f9ec0167160 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:12.660 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.650+0000 7f9ec5fa2640 1 -- 172.21.15.39:0/2385438996 >> 172.21.15.39:0/2385438996 conn(0x7f9ec009b980 msgr2=0x7f9ec00d2600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:12.660 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.650+0000 7f9ec5fa2640 1 -- 172.21.15.39:0/2385438996 shutdown_connections 2023-05-16T13:54:12.660 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.650+0000 7f9ec5fa2640 1 -- 172.21.15.39:0/2385438996 wait complete. 2023-05-16T13:54:12.660 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.654+0000 7f9ec5fa2640 1 Processor -- start 2023-05-16T13:54:12.661 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.654+0000 7f9ec5fa2640 1 -- start start 2023-05-16T13:54:12.662 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.654+0000 7f9ec5fa2640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9ec006c710 0x7f9ec014bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:12.662 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.654+0000 7f9ec5fa2640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ec00cf010 0x7f9ec00b2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:12.662 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.654+0000 7f9ec5fa2640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9ec015c0e0 0x7f9ec00b59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:12.662 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.654+0000 7f9ec5fa2640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec015db80 con 0x7f9ec006c710 2023-05-16T13:54:12.662 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.654+0000 7f9ec5fa2640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec00b63d0 con 0x7f9ec00cf010 2023-05-16T13:54:12.662 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.654+0000 7f9ec5fa2640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec00b66b0 con 0x7f9ec015c0e0 2023-05-16T13:54:12.662 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.654+0000 7f9ec4fa0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9ec006c710 0x7f9ec014bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:12.663 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.654+0000 7f9ec4fa0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9ec006c710 0x7f9ec014bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:37960/0 (socket says 172.21.15.39:37960) 2023-05-16T13:54:12.663 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.654+0000 7f9ec4fa0640 1 -- 172.21.15.39:0/1225573366 learned_addr learned my addr 172.21.15.39:0/1225573366 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:12.663 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.654+0000 7f9ec57a1640 1 --2- 172.21.15.39:0/1225573366 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9ec015c0e0 0x7f9ec00b59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:12.663 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.654+0000 7f9ebffff640 1 --2- 172.21.15.39:0/1225573366 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ec00cf010 0x7f9ec00b2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:12.664 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.654+0000 7f9ec4fa0640 1 -- 172.21.15.39:0/1225573366 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9ec015c0e0 msgr2=0x7f9ec00b59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:12.664 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.654+0000 7f9ec4fa0640 1 --2- 172.21.15.39:0/1225573366 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9ec015c0e0 0x7f9ec00b59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:12.664 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.654+0000 7f9ec4fa0640 1 -- 172.21.15.39:0/1225573366 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ec00cf010 msgr2=0x7f9ec00b2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:12.664 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.654+0000 7f9ec4fa0640 1 --2- 172.21.15.39:0/1225573366 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ec00cf010 0x7f9ec00b2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:12.665 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.654+0000 7f9ec4fa0640 1 -- 172.21.15.39:0/1225573366 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb8009b30 con 0x7f9ec006c710 2023-05-16T13:54:12.665 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.654+0000 7f9ec57a1640 1 --2- 172.21.15.39:0/1225573366 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9ec015c0e0 0x7f9ec00b59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:54:12.665 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.654+0000 7f9ec4fa0640 1 --2- 172.21.15.39:0/1225573366 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9ec006c710 0x7f9ec014bdd0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9eb400c410 tx=0x7f9eb400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:12.665 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.654+0000 7f9ebd7fa640 1 -- 172.21.15.39:0/1225573366 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb40074e0 con 0x7f9ec006c710 2023-05-16T13:54:12.665 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.654+0000 7f9ebd7fa640 1 -- 172.21.15.39:0/1225573366 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eb4007640 con 0x7f9ec006c710 2023-05-16T13:54:12.665 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.654+0000 7f9ebd7fa640 1 -- 172.21.15.39:0/1225573366 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb4004a30 con 0x7f9ec006c710 2023-05-16T13:54:12.665 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.654+0000 7f9ec5fa2640 1 -- 172.21.15.39:0/1225573366 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ec016a050 con 0x7f9ec006c710 2023-05-16T13:54:12.665 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.654+0000 7f9ec5fa2640 1 -- 172.21.15.39:0/1225573366 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ec0169ec0 con 0x7f9ec006c710 2023-05-16T13:54:12.666 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.658+0000 7f9ec5fa2640 1 -- 172.21.15.39:0/1225573366 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ec016a1e0 con 0x7f9ec006c710 2023-05-16T13:54:12.666 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.658+0000 7f9ebd7fa640 1 -- 172.21.15.39:0/1225573366 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9eb4004b90 con 0x7f9ec006c710 2023-05-16T13:54:12.667 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.658+0000 7f9ebd7fa640 1 --2- 172.21.15.39:0/1225573366 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f9ea40662b0 0x7f9ea4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:12.667 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.658+0000 7f9ebd7fa640 1 -- 172.21.15.39:0/1225573366 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f9eb4083850 con 0x7f9ec006c710 2023-05-16T13:54:12.667 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.658+0000 7f9ebffff640 1 --2- 172.21.15.39:0/1225573366 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f9ea40662b0 0x7f9ea4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:12.667 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.658+0000 7f9ebffff640 1 --2- 172.21.15.39:0/1225573366 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f9ea40662b0 0x7f9ea4068760 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9ec0153600 tx=0x7f9eac009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:12.669 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.662+0000 7f9ebd7fa640 1 -- 172.21.15.39:0/1225573366 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f9eb4050f80 con 0x7f9ec006c710 2023-05-16T13:54:12.824 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:12.818+0000 7f9ec5fa2640 1 -- 172.21.15.39:0/1225573366 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f9ec0066e00 con 0x7f9ec006c710 2023-05-16T13:54:13.793 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:13.786+0000 7f9ebd7fa640 1 -- 172.21.15.39:0/1225573366 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v21) v1 ==== 138+0+0 (secure 0 0 0) 0x7f9eb4058e60 con 0x7f9ec006c710 2023-05-16T13:54:13.793 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'cephfs_metadata' created 2023-05-16T13:54:13.797 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:13.790+0000 7f9ec5fa2640 1 -- 172.21.15.39:0/1225573366 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f9ea40662b0 msgr2=0x7f9ea4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:13.798 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:13.790+0000 7f9ec5fa2640 1 --2- 172.21.15.39:0/1225573366 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f9ea40662b0 0x7f9ea4068760 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9ec0153600 tx=0x7f9eac009040 comp rx=0 tx=0).stop 2023-05-16T13:54:13.798 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:13.790+0000 7f9ec5fa2640 1 -- 172.21.15.39:0/1225573366 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9ec006c710 msgr2=0x7f9ec014bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:13.798 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:13.790+0000 7f9ec5fa2640 1 --2- 172.21.15.39:0/1225573366 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9ec006c710 0x7f9ec014bdd0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9eb400c410 tx=0x7f9eb400c8d0 comp rx=0 tx=0).stop 2023-05-16T13:54:13.799 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:13.790+0000 7f9ec5fa2640 1 -- 172.21.15.39:0/1225573366 shutdown_connections 2023-05-16T13:54:13.800 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:13.790+0000 7f9ec5fa2640 1 --2- 172.21.15.39:0/1225573366 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f9ea40662b0 0x7f9ea4068760 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:13.800 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:13.790+0000 7f9ec5fa2640 1 --2- 172.21.15.39:0/1225573366 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9ec015c0e0 0x7f9ec00b59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:13.800 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:13.790+0000 7f9ec5fa2640 1 --2- 172.21.15.39:0/1225573366 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ec00cf010 0x7f9ec00b2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:13.800 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:13.790+0000 7f9ec5fa2640 1 --2- 172.21.15.39:0/1225573366 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9ec006c710 0x7f9ec014bdd0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:13.800 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:13.790+0000 7f9ec5fa2640 1 -- 172.21.15.39:0/1225573366 >> 172.21.15.39:0/1225573366 conn(0x7f9ec009b980 msgr2=0x7f9ec00af270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:13.800 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:13.790+0000 7f9ec5fa2640 1 -- 172.21.15.39:0/1225573366 shutdown_connections 2023-05-16T13:54:13.801 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:13.794+0000 7f9ec5fa2640 1 -- 172.21.15.39:0/1225573366 wait complete. 2023-05-16T13:54:13.823 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-05-16T13:54:13.970 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:13.962+0000 7fd1f8b25640 1 Processor -- start 2023-05-16T13:54:13.970 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:13.962+0000 7fd1f8b25640 1 -- start start 2023-05-16T13:54:13.971 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:13.962+0000 7fd1f8b25640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd1f406b5b0 0x7fd1f4160920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:13.971 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:13.962+0000 7fd1f8b25640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1f40c9bc0 con 0x7fd1f415c430 2023-05-16T13:54:13.971 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:13.962+0000 7fd1f8b25640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1f40ceaa0 con 0x7fd1f40b1700 2023-05-16T13:54:13.971 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:13.962+0000 7fd1f8b25640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1f406b9c0 con 0x7fd1f406b5b0 2023-05-16T13:54:13.972 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:13.962+0000 7fd1f2d9d640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd1f406b5b0 0x7fd1f4160920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:13.972 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:13.962+0000 7fd1f2d9d640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd1f406b5b0 0x7fd1f4160920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:37966/0 (socket says 172.21.15.39:37966) 2023-05-16T13:54:13.972 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:13.962+0000 7fd1f2d9d640 1 -- 172.21.15.39:0/376036940 learned_addr learned my addr 172.21.15.39:0/376036940 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:13.972 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:13.962+0000 7fd1f259c640 1 --1- 172.21.15.39:0/376036940 >> v1:172.21.15.39:6789/0 conn(0x7fd1f415c430 0x7fd1f40b0ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:38208/0 (socket says 172.21.15.39:38208) 2023-05-16T13:54:13.973 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:13.966+0000 7fd1f2d9d640 1 -- 172.21.15.39:0/376036940 >> v1:172.21.15.118:6789/0 conn(0x7fd1f40b1700 legacy=0x7fd1f4070d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:13.973 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:13.966+0000 7fd1f2d9d640 1 -- 172.21.15.39:0/376036940 >> v1:172.21.15.39:6789/0 conn(0x7fd1f415c430 legacy=0x7fd1f40b0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:13.973 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:13.966+0000 7fd1f2d9d640 1 -- 172.21.15.39:0/376036940 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1f415c800 con 0x7fd1f406b5b0 2023-05-16T13:54:13.974 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:13.966+0000 7fd1f2d9d640 1 --2- 172.21.15.39:0/376036940 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd1f406b5b0 0x7fd1f4160920 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec009e50 tx=0x7fd1ec01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e820922bc43a4350 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:13.975 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:13.966+0000 7fd1f1d9b640 1 -- 172.21.15.39:0/376036940 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ec0a5690 con 0x7fd1f406b5b0 2023-05-16T13:54:13.975 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:13.966+0000 7fd1f1d9b640 1 -- 172.21.15.39:0/376036940 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1ec0a57f0 con 0x7fd1f406b5b0 2023-05-16T13:54:13.975 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:13.966+0000 7fd1f1d9b640 1 -- 172.21.15.39:0/376036940 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ec0a5b80 con 0x7fd1f406b5b0 2023-05-16T13:54:13.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:13.966+0000 7fd1f8b25640 1 -- 172.21.15.39:0/376036940 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd1f406b5b0 msgr2=0x7fd1f4160920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:13.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:13.966+0000 7fd1f8b25640 1 --2- 172.21.15.39:0/376036940 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd1f406b5b0 0x7fd1f4160920 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec009e50 tx=0x7fd1ec01c9d0 comp rx=0 tx=0).stop 2023-05-16T13:54:13.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:13.966+0000 7fd1f8b25640 1 -- 172.21.15.39:0/376036940 shutdown_connections 2023-05-16T13:54:13.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:13.966+0000 7fd1f8b25640 1 --2- 172.21.15.39:0/376036940 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd1f406b5b0 0x7fd1f4160920 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:13.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:13.966+0000 7fd1f8b25640 1 -- 172.21.15.39:0/376036940 >> 172.21.15.39:0/376036940 conn(0x7fd1f406da10 msgr2=0x7fd1f40cbff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:13.977 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:13.966+0000 7fd1f8b25640 1 -- 172.21.15.39:0/376036940 shutdown_connections 2023-05-16T13:54:13.977 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:13.966+0000 7fd1f8b25640 1 -- 172.21.15.39:0/376036940 wait complete. 2023-05-16T13:54:13.977 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:13.970+0000 7fd1f8b25640 1 Processor -- start 2023-05-16T13:54:13.977 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:13.970+0000 7fd1f8b25640 1 -- start start 2023-05-16T13:54:13.978 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:13.970+0000 7fd1f8b25640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd1f406b5b0 0x7fd1f4154a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:13.979 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:13.970+0000 7fd1f8b25640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd1f40b1700 0x7fd1f415b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:13.979 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:13.970+0000 7fd1f8b25640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1f415c430 0x7fd1f4139b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:13.979 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:13.970+0000 7fd1f8b25640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f41382e0 con 0x7fd1f40b1700 2023-05-16T13:54:13.979 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:13.970+0000 7fd1f8b25640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f413a610 con 0x7fd1f415c430 2023-05-16T13:54:13.979 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:13.970+0000 7fd1f8b25640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f413a8f0 con 0x7fd1f406b5b0 2023-05-16T13:54:13.979 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:13.970+0000 7fd1ebfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd1f40b1700 0x7fd1f415b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:13.979 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:13.970+0000 7fd1ebfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd1f40b1700 0x7fd1f415b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:37978/0 (socket says 172.21.15.39:37978) 2023-05-16T13:54:13.980 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:13.970+0000 7fd1ebfff640 1 -- 172.21.15.39:0/3639391507 learned_addr learned my addr 172.21.15.39:0/3639391507 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:13.980 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:13.970+0000 7fd1f259c640 1 --2- 172.21.15.39:0/3639391507 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd1f406b5b0 0x7fd1f4154a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:13.980 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:13.970+0000 7fd1f2d9d640 1 --2- 172.21.15.39:0/3639391507 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1f415c430 0x7fd1f4139b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:13.981 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:13.970+0000 7fd1ebfff640 1 -- 172.21.15.39:0/3639391507 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd1f406b5b0 msgr2=0x7fd1f4154a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:13.981 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:13.970+0000 7fd1ebfff640 1 --2- 172.21.15.39:0/3639391507 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd1f406b5b0 0x7fd1f4154a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:13.981 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:13.970+0000 7fd1ebfff640 1 -- 172.21.15.39:0/3639391507 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1f415c430 msgr2=0x7fd1f4139b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:13.982 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:13.970+0000 7fd1ebfff640 1 --2- 172.21.15.39:0/3639391507 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1f415c430 0x7fd1f4139b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:13.982 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:13.970+0000 7fd1ebfff640 1 -- 172.21.15.39:0/3639391507 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1ec009b30 con 0x7fd1f40b1700 2023-05-16T13:54:13.982 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:13.970+0000 7fd1ebfff640 1 --2- 172.21.15.39:0/3639391507 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd1f40b1700 0x7fd1f415b560 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc00c450 tx=0x7fd1dc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:13.982 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:13.974+0000 7fd1eaffd640 1 -- 172.21.15.39:0/3639391507 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc012830 con 0x7fd1f40b1700 2023-05-16T13:54:13.982 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:13.974+0000 7fd1eaffd640 1 -- 172.21.15.39:0/3639391507 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1dc0129b0 con 0x7fd1f40b1700 2023-05-16T13:54:13.982 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:13.974+0000 7fd1eaffd640 1 -- 172.21.15.39:0/3639391507 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc012d60 con 0x7fd1f40b1700 2023-05-16T13:54:13.982 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:13.974+0000 7fd1f8b25640 1 -- 172.21.15.39:0/3639391507 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1f406a160 con 0x7fd1f40b1700 2023-05-16T13:54:13.983 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:13.974+0000 7fd1f8b25640 1 -- 172.21.15.39:0/3639391507 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1f4069fd0 con 0x7fd1f40b1700 2023-05-16T13:54:13.983 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:13.974+0000 7fd1f8b25640 1 -- 172.21.15.39:0/3639391507 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1f416a2c0 con 0x7fd1f40b1700 2023-05-16T13:54:13.983 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:13.974+0000 7fd1eaffd640 1 -- 172.21.15.39:0/3639391507 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd1dc01c460 con 0x7fd1f40b1700 2023-05-16T13:54:13.984 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:13.974+0000 7fd1eaffd640 1 --2- 172.21.15.39:0/3639391507 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd1d4066280 0x7fd1d4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:13.984 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:13.974+0000 7fd1eaffd640 1 -- 172.21.15.39:0/3639391507 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5580+0+0 (secure 0 0 0) 0x7fd1dc0838d0 con 0x7fd1f40b1700 2023-05-16T13:54:13.984 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:13.974+0000 7fd1f259c640 1 --2- 172.21.15.39:0/3639391507 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd1d4066280 0x7fd1d4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:13.984 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:13.974+0000 7fd1f259c640 1 --2- 172.21.15.39:0/3639391507 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd1d4066280 0x7fd1d4068730 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd1e4000f70 tx=0x7fd1e4007e50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:13.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:13.978+0000 7fd1eaffd640 1 -- 172.21.15.39:0/3639391507 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fd1dc050fd0 con 0x7fd1f40b1700 2023-05-16T13:54:14.140 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:14.134+0000 7fd1f8b25640 1 -- 172.21.15.39:0/3639391507 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fd1f4073c90 con 0x7fd1f40b1700 2023-05-16T13:54:14.799 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:14.790+0000 7fd1eaffd640 1 -- 172.21.15.39:0/3639391507 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v22) v1 ==== 170+0+0 (secure 0 0 0) 0x7fd1dc0545f0 con 0x7fd1f40b1700 2023-05-16T13:54:14.799 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'cephfs_data' created 2023-05-16T13:54:14.807 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:14.798+0000 7fd1f8b25640 1 -- 172.21.15.39:0/3639391507 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd1d4066280 msgr2=0x7fd1d4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:14.807 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:14.798+0000 7fd1f8b25640 1 --2- 172.21.15.39:0/3639391507 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd1d4066280 0x7fd1d4068730 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd1e4000f70 tx=0x7fd1e4007e50 comp rx=0 tx=0).stop 2023-05-16T13:54:14.807 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:14.798+0000 7fd1f8b25640 1 -- 172.21.15.39:0/3639391507 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd1f40b1700 msgr2=0x7fd1f415b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:14.808 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:14.798+0000 7fd1f8b25640 1 --2- 172.21.15.39:0/3639391507 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd1f40b1700 0x7fd1f415b560 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc00c450 tx=0x7fd1dc00c910 comp rx=0 tx=0).stop 2023-05-16T13:54:14.812 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:14.806+0000 7fd1f8b25640 1 -- 172.21.15.39:0/3639391507 shutdown_connections 2023-05-16T13:54:14.812 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:14.806+0000 7fd1f8b25640 1 --2- 172.21.15.39:0/3639391507 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1f415c430 0x7fd1f4139b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:14.812 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:14.806+0000 7fd1f8b25640 1 --2- 172.21.15.39:0/3639391507 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd1f40b1700 0x7fd1f415b560 secure :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc00c450 tx=0x7fd1dc00c910 comp rx=0 tx=0).stop 2023-05-16T13:54:14.812 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:14.806+0000 7fd1f8b25640 1 --2- 172.21.15.39:0/3639391507 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd1d4066280 0x7fd1d4068730 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:14.812 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:14.806+0000 7fd1f8b25640 1 --2- 172.21.15.39:0/3639391507 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd1f406b5b0 0x7fd1f4154a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:14.812 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:14.806+0000 7fd1f8b25640 1 -- 172.21.15.39:0/3639391507 >> 172.21.15.39:0/3639391507 conn(0x7fd1f406da10 msgr2=0x7fd1f40c9d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:14.823 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:14.814+0000 7fd1f8b25640 1 -- 172.21.15.39:0/3639391507 shutdown_connections 2023-05-16T13:54:14.824 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:14.818+0000 7fd1f8b25640 1 -- 172.21.15.39:0/3639391507 wait complete. 2023-05-16T13:54:14.846 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-05-16T13:54:14.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:14.982+0000 7fc6523f3640 1 Processor -- start 2023-05-16T13:54:14.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:14.982+0000 7fc6523f3640 1 -- start start 2023-05-16T13:54:14.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:14.982+0000 7fc6523f3640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc64c158e00 0x7fc64c0c9530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:14.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:14.982+0000 7fc6523f3640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc64c0ca030 con 0x7fc64c0b0660 2023-05-16T13:54:14.990 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:14.982+0000 7fc6523f3640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc64c15c890 con 0x7fc64c0c9a70 2023-05-16T13:54:14.990 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:14.982+0000 7fc6523f3640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc64c15cb70 con 0x7fc64c158e00 2023-05-16T13:54:14.990 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:14.982+0000 7fc64bfff640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc64c158e00 0x7fc64c0c9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:14.990 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:14.982+0000 7fc64bfff640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc64c158e00 0x7fc64c0c9530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:37986/0 (socket says 172.21.15.39:37986) 2023-05-16T13:54:14.990 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:14.982+0000 7fc64bfff640 1 -- 172.21.15.39:0/1110083028 learned_addr learned my addr 172.21.15.39:0/1110083028 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:14.990 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:14.982+0000 7fc650990640 1 --1- 172.21.15.39:0/1110083028 >> v1:172.21.15.39:6789/0 conn(0x7fc64c0b0660 0x7fc64c070420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:38214/0 (socket says 172.21.15.39:38214) 2023-05-16T13:54:14.991 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:14.982+0000 7fc64bfff640 1 -- 172.21.15.39:0/1110083028 >> v1:172.21.15.118:6789/0 conn(0x7fc64c0c9a70 legacy=0x7fc64c0aff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:14.991 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:14.982+0000 7fc64bfff640 1 -- 172.21.15.39:0/1110083028 >> v1:172.21.15.39:6789/0 conn(0x7fc64c0b0660 legacy=0x7fc64c070420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:14.991 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:14.982+0000 7fc64bfff640 1 -- 172.21.15.39:0/1110083028 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc64c15ce50 con 0x7fc64c158e00 2023-05-16T13:54:14.993 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:14.986+0000 7fc64bfff640 1 --2- 172.21.15.39:0/1110083028 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc64c158e00 0x7fc64c0c9530 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc63c009870 tx=0x7fc63c01ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a9f3024a7a943d8 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:14.993 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:14.986+0000 7fc64affd640 1 -- 172.21.15.39:0/1110083028 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63c0a89f0 con 0x7fc64c158e00 2023-05-16T13:54:14.993 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:14.986+0000 7fc64affd640 1 -- 172.21.15.39:0/1110083028 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc63c0a8b50 con 0x7fc64c158e00 2023-05-16T13:54:14.993 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:14.986+0000 7fc64affd640 1 -- 172.21.15.39:0/1110083028 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63c0b0440 con 0x7fc64c158e00 2023-05-16T13:54:14.994 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:14.986+0000 7fc6523f3640 1 -- 172.21.15.39:0/1110083028 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc64c158e00 msgr2=0x7fc64c0c9530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:14.994 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:14.986+0000 7fc6523f3640 1 --2- 172.21.15.39:0/1110083028 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc64c158e00 0x7fc64c0c9530 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc63c009870 tx=0x7fc63c01ecf0 comp rx=0 tx=0).stop 2023-05-16T13:54:14.994 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:14.986+0000 7fc6523f3640 1 -- 172.21.15.39:0/1110083028 shutdown_connections 2023-05-16T13:54:14.994 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:14.986+0000 7fc6523f3640 1 --2- 172.21.15.39:0/1110083028 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc64c158e00 0x7fc64c0c9530 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:14.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:14.986+0000 7fc6523f3640 1 -- 172.21.15.39:0/1110083028 >> 172.21.15.39:0/1110083028 conn(0x7fc64c069a50 msgr2=0x7fc64c069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:14.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:14.986+0000 7fc6523f3640 1 -- 172.21.15.39:0/1110083028 shutdown_connections 2023-05-16T13:54:14.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:14.986+0000 7fc6523f3640 1 -- 172.21.15.39:0/1110083028 wait complete. 2023-05-16T13:54:14.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:14.990+0000 7fc6523f3640 1 Processor -- start 2023-05-16T13:54:14.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:14.990+0000 7fc6523f3640 1 -- start start 2023-05-16T13:54:14.998 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:14.990+0000 7fc6523f3640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc64c0b0660 0x7fc64c151a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:14.999 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:14.990+0000 7fc6523f3640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc64c0c9a70 0x7fc64c155160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:14.999 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:14.990+0000 7fc6523f3640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc64c158e00 0x7fc64c0b12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:14.999 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:14.990+0000 7fc6523f3640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc64c0c5c70 con 0x7fc64c0c9a70 2023-05-16T13:54:14.999 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:14.990+0000 7fc6523f3640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc64c151fd0 con 0x7fc64c158e00 2023-05-16T13:54:15.000 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:14.990+0000 7fc6523f3640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc64c155c20 con 0x7fc64c0b0660 2023-05-16T13:54:15.000 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:14.990+0000 7fc64b7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc64c0c9a70 0x7fc64c155160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:15.000 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:14.990+0000 7fc64b7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc64c0c9a70 0x7fc64c155160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:37992/0 (socket says 172.21.15.39:37992) 2023-05-16T13:54:15.001 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:14.990+0000 7fc64b7fe640 1 -- 172.21.15.39:0/980763473 learned_addr learned my addr 172.21.15.39:0/980763473 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:15.001 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:14.990+0000 7fc64b7fe640 1 -- 172.21.15.39:0/980763473 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc64c0b0660 msgr2=0x7fc64c151a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:15.001 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:14.990+0000 7fc64b7fe640 1 --2- 172.21.15.39:0/980763473 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc64c0b0660 0x7fc64c151a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:15.001 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:14.990+0000 7fc64b7fe640 1 -- 172.21.15.39:0/980763473 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc64c158e00 msgr2=0x7fc64c0b12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:15.001 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:14.990+0000 7fc64b7fe640 1 --2- 172.21.15.39:0/980763473 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc64c158e00 0x7fc64c0b12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:15.001 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:14.990+0000 7fc64b7fe640 1 -- 172.21.15.39:0/980763473 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc63c0094d0 con 0x7fc64c0c9a70 2023-05-16T13:54:15.002 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:14.990+0000 7fc64b7fe640 1 --2- 172.21.15.39:0/980763473 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc64c0c9a70 0x7fc64c155160 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc64000c480 tx=0x7fc64000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:15.002 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:14.990+0000 7fc648ff9640 1 -- 172.21.15.39:0/980763473 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc640012830 con 0x7fc64c0c9a70 2023-05-16T13:54:15.002 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:14.990+0000 7fc648ff9640 1 -- 172.21.15.39:0/980763473 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6400129b0 con 0x7fc64c0c9a70 2023-05-16T13:54:15.002 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:14.990+0000 7fc648ff9640 1 -- 172.21.15.39:0/980763473 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc640012d60 con 0x7fc64c0c9a70 2023-05-16T13:54:15.002 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:14.990+0000 7fc6523f3640 1 -- 172.21.15.39:0/980763473 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc64c0cc730 con 0x7fc64c0c9a70 2023-05-16T13:54:15.002 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:14.990+0000 7fc6523f3640 1 -- 172.21.15.39:0/980763473 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc64c15d130 con 0x7fc64c0c9a70 2023-05-16T13:54:15.003 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:14.990+0000 7fc6523f3640 1 -- 172.21.15.39:0/980763473 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc64c15d650 con 0x7fc64c0c9a70 2023-05-16T13:54:15.003 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:14.994+0000 7fc648ff9640 1 -- 172.21.15.39:0/980763473 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc64001c460 con 0x7fc64c0c9a70 2023-05-16T13:54:15.003 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:14.994+0000 7fc648ff9640 1 --2- 172.21.15.39:0/980763473 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc638066280 0x7fc638068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:15.004 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:14.994+0000 7fc648ff9640 1 -- 172.21.15.39:0/980763473 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5962+0+0 (secure 0 0 0) 0x7fc640083bc0 con 0x7fc64c0c9a70 2023-05-16T13:54:15.004 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:14.994+0000 7fc64bfff640 1 --2- 172.21.15.39:0/980763473 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc638066280 0x7fc638068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:15.004 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:14.994+0000 7fc64bfff640 1 --2- 172.21.15.39:0/980763473 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc638066280 0x7fc638068730 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc63c0b2000 tx=0x7fc63c004740 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:15.005 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:14.998+0000 7fc648ff9640 1 -- 172.21.15.39:0/980763473 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fc640051090 con 0x7fc64c0c9a70 2023-05-16T13:54:15.193 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.186+0000 7fc6523f3640 1 -- 172.21.15.39:0/980763473 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fc64c0c5a20 con 0x7fc64c0c9a70 2023-05-16T13:54:15.201 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.194+0000 7fc648ff9640 1 -- 172.21.15.39:0/980763473 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fc6400546b0 con 0x7fc64c0c9a70 2023-05-16T13:54:15.206 INFO:teuthology.orchestra.run.smithi039.stderr:new fs with metadata pool 3 and data pool 4 2023-05-16T13:54:15.212 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.206+0000 7fc6523f3640 1 -- 172.21.15.39:0/980763473 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc638066280 msgr2=0x7fc638068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:15.213 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.206+0000 7fc6523f3640 1 --2- 172.21.15.39:0/980763473 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc638066280 0x7fc638068730 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc63c0b2000 tx=0x7fc63c004740 comp rx=0 tx=0).stop 2023-05-16T13:54:15.213 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.206+0000 7fc6523f3640 1 -- 172.21.15.39:0/980763473 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc64c0c9a70 msgr2=0x7fc64c155160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:15.213 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.206+0000 7fc6523f3640 1 --2- 172.21.15.39:0/980763473 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc64c0c9a70 0x7fc64c155160 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc64000c480 tx=0x7fc64000c940 comp rx=0 tx=0).stop 2023-05-16T13:54:15.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.206+0000 7fc6523f3640 1 -- 172.21.15.39:0/980763473 shutdown_connections 2023-05-16T13:54:15.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.206+0000 7fc6523f3640 1 --2- 172.21.15.39:0/980763473 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc64c158e00 0x7fc64c0b12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:15.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.206+0000 7fc6523f3640 1 --2- 172.21.15.39:0/980763473 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc64c0c9a70 0x7fc64c155160 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:15.215 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.206+0000 7fc6523f3640 1 --2- 172.21.15.39:0/980763473 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc638066280 0x7fc638068730 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:15.215 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.206+0000 7fc6523f3640 1 --2- 172.21.15.39:0/980763473 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc64c0b0660 0x7fc64c151a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:15.215 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.206+0000 7fc6523f3640 1 -- 172.21.15.39:0/980763473 >> 172.21.15.39:0/980763473 conn(0x7fc64c069a50 msgr2=0x7fc64c0ac5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:15.215 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.206+0000 7fc6523f3640 1 -- 172.21.15.39:0/980763473 shutdown_connections 2023-05-16T13:54:15.215 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.206+0000 7fc6523f3640 1 -- 172.21.15.39:0/980763473 wait complete. 2023-05-16T13:54:15.252 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-16T13:54:15.388 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.382+0000 7f4eb05bc640 1 Processor -- start 2023-05-16T13:54:15.388 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.382+0000 7f4eb05bc640 1 -- start start 2023-05-16T13:54:15.389 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.382+0000 7f4eb05bc640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f4ea815c470 0x7f4ea80d0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:15.390 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.382+0000 7f4eb05bc640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4ea80b5670 0x7f4ea80b42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:15.390 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.382+0000 7f4eb05bc640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ea80ce150 con 0x7f4ea80b5ae0 2023-05-16T13:54:15.390 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.382+0000 7f4eb05bc640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ea80cd890 con 0x7f4ea815c470 2023-05-16T13:54:15.390 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.382+0000 7f4eb05bc640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea80d0c60 con 0x7f4ea80b5670 2023-05-16T13:54:15.391 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.382+0000 7f4eadb57640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4ea80b5670 0x7f4ea80b42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:15.391 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.382+0000 7f4eadb57640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4ea80b5670 0x7f4ea80b42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.39:54304/0 (socket says 172.21.15.39:54304) 2023-05-16T13:54:15.391 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.382+0000 7f4eadb57640 1 -- 172.21.15.39:0/2515087354 learned_addr learned my addr 172.21.15.39:0/2515087354 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:15.391 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.382+0000 7f4eae358640 1 --2- 172.21.15.39:0/2515087354 >> v2:172.21.15.118:3300/0 conn(0x7f4ea815c470 0x7f4ea80d0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:15.392 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.382+0000 7f4eadb57640 1 -- 172.21.15.39:0/2515087354 >> v2:172.21.15.118:3300/0 conn(0x7f4ea815c470 msgr2=0x7f4ea80d0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:15.392 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.382+0000 7f4eadb57640 1 --2- 172.21.15.39:0/2515087354 >> v2:172.21.15.118:3300/0 conn(0x7f4ea815c470 0x7f4ea80d0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:15.392 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.382+0000 7f4eadb57640 1 -- 172.21.15.39:0/2515087354 >> v1:172.21.15.118:6789/0 conn(0x7f4ea80b5ae0 legacy=0x7f4ea80ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:15.392 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.382+0000 7f4eadb57640 1 -- 172.21.15.39:0/2515087354 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ea80cdb00 con 0x7f4ea80b5670 2023-05-16T13:54:15.392 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.382+0000 7f4eae358640 1 --2- 172.21.15.39:0/2515087354 >> v2:172.21.15.118:3300/0 conn(0x7f4ea815c470 0x7f4ea80d0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-16T13:54:15.393 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.386+0000 7f4eadb57640 1 --2- 172.21.15.39:0/2515087354 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4ea80b5670 0x7f4ea80b42a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4e98009870 tx=0x7f4e9801c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6403da04e1e5e27 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:15.394 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.386+0000 7f4ead356640 1 -- 172.21.15.39:0/2515087354 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e980aa430 con 0x7f4ea80b5670 2023-05-16T13:54:15.394 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.386+0000 7f4ead356640 1 -- 172.21.15.39:0/2515087354 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e980aa590 con 0x7f4ea80b5670 2023-05-16T13:54:15.394 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.386+0000 7f4ead356640 1 -- 172.21.15.39:0/2515087354 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e980aa920 con 0x7f4ea80b5670 2023-05-16T13:54:15.395 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.386+0000 7f4eb05bc640 1 -- 172.21.15.39:0/2515087354 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4ea80b5670 msgr2=0x7f4ea80b42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:15.395 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.386+0000 7f4eb05bc640 1 --2- 172.21.15.39:0/2515087354 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4ea80b5670 0x7f4ea80b42a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4e98009870 tx=0x7f4e9801c510 comp rx=0 tx=0).stop 2023-05-16T13:54:15.395 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.386+0000 7f4eb05bc640 1 -- 172.21.15.39:0/2515087354 shutdown_connections 2023-05-16T13:54:15.395 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.386+0000 7f4eb05bc640 1 --2- 172.21.15.39:0/2515087354 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4ea80b5670 0x7f4ea80b42a0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:15.395 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.386+0000 7f4eb05bc640 1 --2- 172.21.15.39:0/2515087354 >> v2:172.21.15.118:3300/0 conn(0x7f4ea815c470 0x7f4ea80d0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:15.395 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.386+0000 7f4eb05bc640 1 -- 172.21.15.39:0/2515087354 >> 172.21.15.39:0/2515087354 conn(0x7f4ea809bae0 msgr2=0x7f4ea80d2820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:15.396 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.386+0000 7f4eb05bc640 1 -- 172.21.15.39:0/2515087354 shutdown_connections 2023-05-16T13:54:15.396 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.386+0000 7f4eb05bc640 1 -- 172.21.15.39:0/2515087354 wait complete. 2023-05-16T13:54:15.396 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.390+0000 7f4eb05bc640 1 Processor -- start 2023-05-16T13:54:15.397 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.390+0000 7f4eb05bc640 1 -- start start 2023-05-16T13:54:15.399 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.390+0000 7f4eb05bc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4ea80b5670 0x7f4ea815bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:15.400 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.390+0000 7f4eb05bc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ea80b5ae0 0x7f4ea80c8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:15.400 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.390+0000 7f4eb05bc640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4ea815c470 0x7f4ea814cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:15.400 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.390+0000 7f4eb05bc640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea815b4d0 con 0x7f4ea80b5ae0 2023-05-16T13:54:15.401 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.390+0000 7f4eb05bc640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea815b770 con 0x7f4ea80b5670 2023-05-16T13:54:15.401 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.390+0000 7f4eb05bc640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea815ba50 con 0x7f4ea815c470 2023-05-16T13:54:15.401 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.390+0000 7f4eadb57640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ea80b5ae0 0x7f4ea80c8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:15.401 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.390+0000 7f4eadb57640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ea80b5ae0 0x7f4ea80c8b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:37998/0 (socket says 172.21.15.39:37998) 2023-05-16T13:54:15.401 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.390+0000 7f4eadb57640 1 -- 172.21.15.39:0/431660596 learned_addr learned my addr 172.21.15.39:0/431660596 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:15.401 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.390+0000 7f4eae358640 1 --2- 172.21.15.39:0/431660596 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4ea80b5670 0x7f4ea815bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:15.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.390+0000 7f4eaeb59640 1 --2- 172.21.15.39:0/431660596 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4ea815c470 0x7f4ea814cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:15.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.390+0000 7f4eadb57640 1 -- 172.21.15.39:0/431660596 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4ea815c470 msgr2=0x7f4ea814cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:15.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.390+0000 7f4eadb57640 1 --2- 172.21.15.39:0/431660596 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4ea815c470 0x7f4ea814cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:15.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.390+0000 7f4eadb57640 1 -- 172.21.15.39:0/431660596 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4ea80b5670 msgr2=0x7f4ea815bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:15.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.390+0000 7f4eadb57640 1 --2- 172.21.15.39:0/431660596 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4ea80b5670 0x7f4ea815bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:15.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.390+0000 7f4eadb57640 1 -- 172.21.15.39:0/431660596 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ea40093b0 con 0x7f4ea80b5ae0 2023-05-16T13:54:15.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.390+0000 7f4eaeb59640 1 --2- 172.21.15.39:0/431660596 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4ea815c470 0x7f4ea814cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:54:15.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.390+0000 7f4eadb57640 1 --2- 172.21.15.39:0/431660596 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ea80b5ae0 0x7f4ea80c8b20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4e980ac040 tx=0x7f4e9801ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:15.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.390+0000 7f4e9effd640 1 -- 172.21.15.39:0/431660596 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e980aa430 con 0x7f4ea80b5ae0 2023-05-16T13:54:15.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.390+0000 7f4e9effd640 1 -- 172.21.15.39:0/431660596 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e980b3820 con 0x7f4ea80b5ae0 2023-05-16T13:54:15.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.390+0000 7f4e9effd640 1 -- 172.21.15.39:0/431660596 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e980b3bd0 con 0x7f4ea80b5ae0 2023-05-16T13:54:15.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.390+0000 7f4eb05bc640 1 -- 172.21.15.39:0/431660596 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e980094d0 con 0x7f4ea80b5ae0 2023-05-16T13:54:15.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.390+0000 7f4eb05bc640 1 -- 172.21.15.39:0/431660596 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ea809bf70 con 0x7f4ea80b5ae0 2023-05-16T13:54:15.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.390+0000 7f4eb05bc640 1 -- 172.21.15.39:0/431660596 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ea80b4bf0 con 0x7f4ea80b5ae0 2023-05-16T13:54:15.404 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.394+0000 7f4e9effd640 1 -- 172.21.15.39:0/431660596 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4e980b3d30 con 0x7f4ea80b5ae0 2023-05-16T13:54:15.404 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.394+0000 7f4e9effd640 1 --2- 172.21.15.39:0/431660596 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f4e8c0662b0 0x7f4e8c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:15.404 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.394+0000 7f4e9effd640 1 -- 172.21.15.39:0/431660596 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4e9811e170 con 0x7f4ea80b5ae0 2023-05-16T13:54:15.405 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.394+0000 7f4eae358640 1 --2- 172.21.15.39:0/431660596 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f4e8c0662b0 0x7f4e8c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:15.405 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.394+0000 7f4eae358640 1 --2- 172.21.15.39:0/431660596 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f4e8c0662b0 0x7f4e8c068760 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4ea80c5f80 tx=0x7f4ea4006f90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:15.405 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.398+0000 7f4e9effd640 1 -- 172.21.15.39:0/431660596 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f4e980eb600 con 0x7f4ea80b5ae0 2023-05-16T13:54:15.560 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.554+0000 7f4eb05bc640 1 -- 172.21.15.39:0/431660596 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ea80d0ee0 con 0x7f4ea80b5ae0 2023-05-16T13:54:15.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.554+0000 7f4e9effd640 1 -- 172.21.15.39:0/431660596 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18292 (secure 0 0 0) 0x7f4e980eec20 con 0x7f4ea80b5ae0 2023-05-16T13:54:15.562 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:54:15.562 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":23,"fsid":"9c1e210b-c515-4ea4-a065-397956895c68","created":"2023-05-16T13:53:48.955290+0000","modified":"2023-05-16T13:54:15.191549+0000","last_up_change":"2023-05-16T13:54:01.722051+0000","last_in_change":"2023-05-16T13:53:52.331336+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-16T13:54:00.885009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-16T13:54:08.327895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-16T13:54:12.864823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-16T13:54:14.180225+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4ce0f0ba-c4bf-4405-8c95-d2e9a62878ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6809","nonce":3462013698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6811","nonce":3462013698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6815","nonce":3462013698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6813","nonce":3462013698}]},"public_addr":"172.21.15.39:6809/3462013698","cluster_addr":"172.21.15.39:6811/3462013698","heartbeat_back_addr":"172.21.15.39:6815/3462013698","heartbeat_front_addr":"172.21.15.39:6813/3462013698","state":["exists","up"]},{"osd":1,"uuid":"53fdc1ac-2473-472d-af32-2760fdf6e476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6801","nonce":2829970892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6803","nonce":2829970892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6807","nonce":2829970892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6805","nonce":2829970892}]},"public_addr":"172.21.15.39:6801/2829970892","cluster_addr":"172.21.15.39:6803/2829970892","heartbeat_back_addr":"172.21.15.39:6807/2829970892","heartbeat_front_addr":"172.21.15.39:6805/2829970892","state":["exists","up"]},{"osd":2,"uuid":"0b92d770-7030-42fa-a19f-4f7f1ac113c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6817","nonce":3888067413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6819","nonce":3888067413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6823","nonce":3888067413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6821","nonce":3888067413}]},"public_addr":"172.21.15.39:6817/3888067413","cluster_addr":"172.21.15.39:6819/3888067413","heartbeat_back_addr":"172.21.15.39:6823/3888067413","heartbeat_front_addr":"172.21.15.39:6821/3888067413","state":["exists","up"]},{"osd":3,"uuid":"000d9506-cbb2-4017-b875-deca579860ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6825","nonce":405003958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6827","nonce":405003958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6831","nonce":405003958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6829","nonce":405003958}]},"public_addr":"172.21.15.39:6825/405003958","cluster_addr":"172.21.15.39:6827/405003958","heartbeat_back_addr":"172.21.15.39:6831/405003958","heartbeat_front_addr":"172.21.15.39:6829/405003958","state":["exists","up"]},{"osd":4,"uuid":"70f0dacb-e960-40c5-bf6a-183e52bbe2ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6801","nonce":3895278838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6805","nonce":3895278838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6813","nonce":3895278838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6809","nonce":3895278838}]},"public_addr":"172.21.15.118:6801/3895278838","cluster_addr":"172.21.15.118:6805/3895278838","heartbeat_back_addr":"172.21.15.118:6813/3895278838","heartbeat_front_addr":"172.21.15.118:6809/3895278838","state":["exists","up"]},{"osd":5,"uuid":"756feb54-c3ae-4a2a-8f74-85c291ba707c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6804","nonce":3513592808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6808","nonce":3513592808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6815","nonce":3513592808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6812","nonce":3513592808}]},"public_addr":"172.21.15.118:6804/3513592808","cluster_addr":"172.21.15.118:6808/3513592808","heartbeat_back_addr":"172.21.15.118:6815/3513592808","heartbeat_front_addr":"172.21.15.118:6812/3513592808","state":["exists","up"]},{"osd":6,"uuid":"c4a982c1-f497-4b0f-8a23-c77372e4621e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6824","nonce":1863656053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6827","nonce":1863656053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6831","nonce":1863656053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6829","nonce":1863656053}]},"public_addr":"172.21.15.118:6824/1863656053","cluster_addr":"172.21.15.118:6827/1863656053","heartbeat_back_addr":"172.21.15.118:6831/1863656053","heartbeat_front_addr":"172.21.15.118:6829/1863656053","state":["exists","up"]},{"osd":7,"uuid":"6f2888aa-a7ac-4e26-9159-e31817934f44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6817","nonce":3636642904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6819","nonce":3636642904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6825","nonce":3636642904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6821","nonce":3636642904}]},"public_addr":"172.21.15.118:6817/3636642904","cluster_addr":"172.21.15.118:6819/3636642904","heartbeat_back_addr":"172.21.15.118:6825/3636642904","heartbeat_front_addr":"172.21.15.118:6821/3636642904","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.717636+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.724036+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.739144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:58.079275+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:58.073921+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.930466+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.987813+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.941098+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-16T13:54:15.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.554+0000 7f4eb05bc640 1 -- 172.21.15.39:0/431660596 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f4e8c0662b0 msgr2=0x7f4e8c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:15.564 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.554+0000 7f4eb05bc640 1 --2- 172.21.15.39:0/431660596 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f4e8c0662b0 0x7f4e8c068760 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4ea80c5f80 tx=0x7f4ea4006f90 comp rx=0 tx=0).stop 2023-05-16T13:54:15.564 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.554+0000 7f4eb05bc640 1 -- 172.21.15.39:0/431660596 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ea80b5ae0 msgr2=0x7f4ea80c8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:15.564 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.554+0000 7f4eb05bc640 1 --2- 172.21.15.39:0/431660596 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ea80b5ae0 0x7f4ea80c8b20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4e980ac040 tx=0x7f4e9801ad50 comp rx=0 tx=0).stop 2023-05-16T13:54:15.564 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.558+0000 7f4eb05bc640 1 -- 172.21.15.39:0/431660596 shutdown_connections 2023-05-16T13:54:15.564 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.558+0000 7f4eb05bc640 1 --2- 172.21.15.39:0/431660596 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f4e8c0662b0 0x7f4e8c068760 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:15.564 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.558+0000 7f4eb05bc640 1 --2- 172.21.15.39:0/431660596 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4ea815c470 0x7f4ea814cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:15.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.558+0000 7f4eb05bc640 1 --2- 172.21.15.39:0/431660596 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ea80b5ae0 0x7f4ea80c8b20 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:15.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.558+0000 7f4eb05bc640 1 --2- 172.21.15.39:0/431660596 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4ea80b5670 0x7f4ea815bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:15.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.558+0000 7f4eb05bc640 1 -- 172.21.15.39:0/431660596 >> 172.21.15.39:0/431660596 conn(0x7f4ea809bae0 msgr2=0x7f4ea80b79f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:15.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.558+0000 7f4eb05bc640 1 -- 172.21.15.39:0/431660596 shutdown_connections 2023-05-16T13:54:15.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.558+0000 7f4eb05bc640 1 -- 172.21.15.39:0/431660596 wait complete. 2023-05-16T13:54:15.582 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-16T13:54:15.719 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.710+0000 7f5b61939640 1 Processor -- start 2023-05-16T13:54:15.719 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.710+0000 7f5b61939640 1 -- start start 2023-05-16T13:54:15.720 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.714+0000 7f5b61939640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5b5c15a1e0 0x7f5b5c0ce4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:15.720 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.714+0000 7f5b61939640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b5c0c65a0 con 0x7f5b5c15a5b0 2023-05-16T13:54:15.720 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.714+0000 7f5b61939640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b5c0d03c0 con 0x7f5b5c08a3e0 2023-05-16T13:54:15.720 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.714+0000 7f5b61939640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b5c0ceba0 con 0x7f5b5c15a1e0 2023-05-16T13:54:15.722 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.714+0000 7f5b53fff640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f5b5c15a5b0 0x7f5b5c0c6a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:38228/0 (socket says 172.21.15.39:38228) 2023-05-16T13:54:15.722 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.714+0000 7f5b53fff640 1 -- 172.21.15.39:0/1996604570 learned_addr learned my addr 172.21.15.39:0/1996604570 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:15.722 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.714+0000 7f5b5affd640 1 --2- 172.21.15.39:0/1996604570 >> v2:172.21.15.118:3300/0 conn(0x7f5b5c15a1e0 0x7f5b5c0ce4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:15.722 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.714+0000 7f5b5a7fc640 1 -- 172.21.15.39:0/1996604570 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4039534282 0 0) 0x7f5b5c0c65a0 con 0x7f5b5c15a5b0 2023-05-16T13:54:15.723 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.714+0000 7f5b5a7fc640 1 -- 172.21.15.39:0/1996604570 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b48003530 con 0x7f5b5c15a5b0 2023-05-16T13:54:15.723 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.714+0000 7f5b5a7fc640 1 -- 172.21.15.39:0/1996604570 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1171559107 0 0) 0x7f5b48003530 con 0x7f5b5c15a5b0 2023-05-16T13:54:15.723 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.714+0000 7f5b5a7fc640 1 -- 172.21.15.39:0/1996604570 >> v2:172.21.15.118:3300/0 conn(0x7f5b5c15a1e0 msgr2=0x7f5b5c0ce4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:15.723 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.714+0000 7f5b5a7fc640 1 --2- 172.21.15.39:0/1996604570 >> v2:172.21.15.118:3300/0 conn(0x7f5b5c15a1e0 0x7f5b5c0ce4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:15.723 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.714+0000 7f5b5a7fc640 1 -- 172.21.15.39:0/1996604570 >> v1:172.21.15.118:6789/0 conn(0x7f5b5c08a3e0 legacy=0x7f5b5c0c5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:15.723 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.714+0000 7f5b5a7fc640 1 -- 172.21.15.39:0/1996604570 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b5c0c5f50 con 0x7f5b5c15a5b0 2023-05-16T13:54:15.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.714+0000 7f5b5a7fc640 1 -- 172.21.15.39:0/1996604570 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1738805496 0 0) 0x7f5b44001680 con 0x7f5b5c15a5b0 2023-05-16T13:54:15.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.714+0000 7f5b5a7fc640 1 -- 172.21.15.39:0/1996604570 >> v1:172.21.15.39:6789/0 conn(0x7f5b5c15a5b0 legacy=0x7f5b5c0c6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:15.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.714+0000 7f5b5a7fc640 1 --2- 172.21.15.39:0/1996604570 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b480039f0 0x7f5b48003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:15.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.714+0000 7f5b5a7fc640 1 --2- 172.21.15.39:0/1996604570 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5b480047d0 0x7f5b48004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:15.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.714+0000 7f5b5a7fc640 1 --2- 172.21.15.39:0/1996604570 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b48005180 0x7f5b4800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:15.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.714+0000 7f5b5a7fc640 1 -- 172.21.15.39:0/1996604570 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b5c0ceba0 con 0x7f5b480047d0 2023-05-16T13:54:15.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.714+0000 7f5b5a7fc640 1 -- 172.21.15.39:0/1996604570 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4800bfe0 con 0x7f5b48005180 2023-05-16T13:54:15.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.714+0000 7f5b5a7fc640 1 -- 172.21.15.39:0/1996604570 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4800c1a0 con 0x7f5b480039f0 2023-05-16T13:54:15.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.714+0000 7f5b5affd640 1 --2- 172.21.15.39:0/1996604570 >> v2:172.21.15.118:3300/0 conn(0x7f5b5c15a1e0 0x7f5b5c0ce4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-16T13:54:15.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.714+0000 7f5b53fff640 1 --2- 172.21.15.39:0/1996604570 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5b480047d0 0x7f5b48004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:15.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.714+0000 7f5b5b7fe640 1 --2- 172.21.15.39:0/1996604570 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b48005180 0x7f5b4800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:15.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.714+0000 7f5b5affd640 1 --2- 172.21.15.39:0/1996604570 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b480039f0 0x7f5b48003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:15.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.714+0000 7f5b53fff640 1 -- 172.21.15.39:0/1996604570 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b480039f0 msgr2=0x7f5b48003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:15.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.714+0000 7f5b53fff640 1 --2- 172.21.15.39:0/1996604570 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b480039f0 0x7f5b48003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:15.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.714+0000 7f5b53fff640 1 -- 172.21.15.39:0/1996604570 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b48005180 msgr2=0x7f5b4800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:15.726 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.714+0000 7f5b53fff640 1 --2- 172.21.15.39:0/1996604570 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b48005180 0x7f5b4800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:15.726 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.714+0000 7f5b53fff640 1 -- 172.21.15.39:0/1996604570 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b48003530 con 0x7f5b480047d0 2023-05-16T13:54:15.726 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.714+0000 7f5b5b7fe640 1 -- 172.21.15.39:0/1996604570 reap_dead start 2023-05-16T13:54:15.726 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.714+0000 7f5b5affd640 1 --2- 172.21.15.39:0/1996604570 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b480039f0 0x7f5b48003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:54:15.727 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.718+0000 7f5b53fff640 1 --2- 172.21.15.39:0/1996604570 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5b480047d0 0x7f5b48004c40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5b4400c210 tx=0x7f5b4401cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=585b151da623d5e7 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:15.727 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.718+0000 7f5b5a7fc640 1 -- 172.21.15.39:0/1996604570 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b44005ae0 con 0x7f5b480047d0 2023-05-16T13:54:15.727 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.718+0000 7f5b5a7fc640 1 -- 172.21.15.39:0/1996604570 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b44005c60 con 0x7f5b480047d0 2023-05-16T13:54:15.728 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.718+0000 7f5b5a7fc640 1 -- 172.21.15.39:0/1996604570 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b440072b0 con 0x7f5b480047d0 2023-05-16T13:54:15.728 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.718+0000 7f5b61939640 1 -- 172.21.15.39:0/1996604570 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5b480047d0 msgr2=0x7f5b48004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:15.728 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.718+0000 7f5b61939640 1 --2- 172.21.15.39:0/1996604570 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5b480047d0 0x7f5b48004c40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5b4400c210 tx=0x7f5b4401cc10 comp rx=0 tx=0).stop 2023-05-16T13:54:15.728 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.718+0000 7f5b61939640 1 -- 172.21.15.39:0/1996604570 shutdown_connections 2023-05-16T13:54:15.728 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.718+0000 7f5b61939640 1 --2- 172.21.15.39:0/1996604570 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5b480047d0 0x7f5b48004c40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:15.728 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.718+0000 7f5b61939640 1 -- 172.21.15.39:0/1996604570 >> 172.21.15.39:0/1996604570 conn(0x7f5b5c089fe0 msgr2=0x7f5b5c0d05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:15.728 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.718+0000 7f5b61939640 1 -- 172.21.15.39:0/1996604570 shutdown_connections 2023-05-16T13:54:15.729 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.718+0000 7f5b61939640 1 -- 172.21.15.39:0/1996604570 wait complete. 2023-05-16T13:54:15.729 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.718+0000 7f5b61939640 1 Processor -- start 2023-05-16T13:54:15.729 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.718+0000 7f5b61939640 1 -- start start 2023-05-16T13:54:15.730 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.722+0000 7f5b61939640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b480047d0 0x7f5b5c154a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:15.731 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.722+0000 7f5b61939640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b5c1e3970 0x7f5b5c1e4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:15.731 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.722+0000 7f5b61939640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5b5c1e4540 0x7f5b5c1e4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:15.731 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.722+0000 7f5b61939640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b5c0b54e0 con 0x7f5b5c1e4540 2023-05-16T13:54:15.731 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.722+0000 7f5b61939640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b5c1e49b0 con 0x7f5b480047d0 2023-05-16T13:54:15.731 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.722+0000 7f5b61939640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b5c154f80 con 0x7f5b5c1e3970 2023-05-16T13:54:15.731 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.722+0000 7f5b5b7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5b5c1e4540 0x7f5b5c1e4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:15.732 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.722+0000 7f5b5b7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5b5c1e4540 0x7f5b5c1e4c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38026/0 (socket says 172.21.15.39:38026) 2023-05-16T13:54:15.732 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.722+0000 7f5b5b7fe640 1 -- 172.21.15.39:0/502600040 learned_addr learned my addr 172.21.15.39:0/502600040 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:15.732 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.722+0000 7f5b5affd640 1 --2- 172.21.15.39:0/502600040 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b480047d0 0x7f5b5c154a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:15.732 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.722+0000 7f5b53fff640 1 --2- 172.21.15.39:0/502600040 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b5c1e3970 0x7f5b5c1e4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:15.732 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.722+0000 7f5b5b7fe640 1 -- 172.21.15.39:0/502600040 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b5c1e3970 msgr2=0x7f5b5c1e4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:15.732 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.722+0000 7f5b5b7fe640 1 --2- 172.21.15.39:0/502600040 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b5c1e3970 0x7f5b5c1e4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:15.732 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.722+0000 7f5b5b7fe640 1 -- 172.21.15.39:0/502600040 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b480047d0 msgr2=0x7f5b5c154a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:15.733 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.722+0000 7f5b5b7fe640 1 --2- 172.21.15.39:0/502600040 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b480047d0 0x7f5b5c154a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:15.733 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.722+0000 7f5b5b7fe640 1 -- 172.21.15.39:0/502600040 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b5c0c6e20 con 0x7f5b5c1e4540 2023-05-16T13:54:15.733 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.722+0000 7f5b53fff640 1 --2- 172.21.15.39:0/502600040 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b5c1e3970 0x7f5b5c1e4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:54:15.733 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.722+0000 7f5b5b7fe640 1 --2- 172.21.15.39:0/502600040 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5b5c1e4540 0x7f5b5c1e4c50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5b54007fd0 tx=0x7f5b54011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:15.733 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.722+0000 7f5b58ff9640 1 -- 172.21.15.39:0/502600040 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b54016070 con 0x7f5b5c1e4540 2023-05-16T13:54:15.733 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.722+0000 7f5b58ff9640 1 -- 172.21.15.39:0/502600040 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b54003e50 con 0x7f5b5c1e4540 2023-05-16T13:54:15.733 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.722+0000 7f5b58ff9640 1 -- 172.21.15.39:0/502600040 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b54005290 con 0x7f5b5c1e4540 2023-05-16T13:54:15.734 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.722+0000 7f5b61939640 1 -- 172.21.15.39:0/502600040 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b5c06cb70 con 0x7f5b5c1e4540 2023-05-16T13:54:15.734 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.722+0000 7f5b61939640 1 -- 172.21.15.39:0/502600040 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b5c0c6fb0 con 0x7f5b5c1e4540 2023-05-16T13:54:15.734 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.722+0000 7f5b61939640 1 -- 172.21.15.39:0/502600040 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b5c073c90 con 0x7f5b5c1e4540 2023-05-16T13:54:15.734 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.726+0000 7f5b58ff9640 1 -- 172.21.15.39:0/502600040 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5b540053f0 con 0x7f5b5c1e4540 2023-05-16T13:54:15.735 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.726+0000 7f5b58ff9640 1 --2- 172.21.15.39:0/502600040 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f5b3c0662b0 0x7f5b3c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:15.735 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.726+0000 7f5b58ff9640 1 -- 172.21.15.39:0/502600040 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5b540873c0 con 0x7f5b5c1e4540 2023-05-16T13:54:15.735 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.726+0000 7f5b5affd640 1 --2- 172.21.15.39:0/502600040 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f5b3c0662b0 0x7f5b3c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:15.735 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.726+0000 7f5b5affd640 1 --2- 172.21.15.39:0/502600040 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f5b3c0662b0 0x7f5b3c068760 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c0636a0 tx=0x7f5b4c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:15.736 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.730+0000 7f5b58ff9640 1 -- 172.21.15.39:0/502600040 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f5b54054840 con 0x7f5b5c1e4540 2023-05-16T13:54:15.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.886+0000 7f5b61939640 1 -- 172.21.15.39:0/502600040 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5b5c06f020 con 0x7f5b5c1e4540 2023-05-16T13:54:15.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.890+0000 7f5b58ff9640 1 -- 172.21.15.39:0/502600040 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18292 (secure 0 0 0) 0x7f5b54057e60 con 0x7f5b5c1e4540 2023-05-16T13:54:15.897 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:54:15.897 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":23,"fsid":"9c1e210b-c515-4ea4-a065-397956895c68","created":"2023-05-16T13:53:48.955290+0000","modified":"2023-05-16T13:54:15.191549+0000","last_up_change":"2023-05-16T13:54:01.722051+0000","last_in_change":"2023-05-16T13:53:52.331336+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-16T13:54:00.885009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-16T13:54:08.327895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-16T13:54:12.864823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-16T13:54:14.180225+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4ce0f0ba-c4bf-4405-8c95-d2e9a62878ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6809","nonce":3462013698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6811","nonce":3462013698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6815","nonce":3462013698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6813","nonce":3462013698}]},"public_addr":"172.21.15.39:6809/3462013698","cluster_addr":"172.21.15.39:6811/3462013698","heartbeat_back_addr":"172.21.15.39:6815/3462013698","heartbeat_front_addr":"172.21.15.39:6813/3462013698","state":["exists","up"]},{"osd":1,"uuid":"53fdc1ac-2473-472d-af32-2760fdf6e476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6801","nonce":2829970892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6803","nonce":2829970892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6807","nonce":2829970892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6805","nonce":2829970892}]},"public_addr":"172.21.15.39:6801/2829970892","cluster_addr":"172.21.15.39:6803/2829970892","heartbeat_back_addr":"172.21.15.39:6807/2829970892","heartbeat_front_addr":"172.21.15.39:6805/2829970892","state":["exists","up"]},{"osd":2,"uuid":"0b92d770-7030-42fa-a19f-4f7f1ac113c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6817","nonce":3888067413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6819","nonce":3888067413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6823","nonce":3888067413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6821","nonce":3888067413}]},"public_addr":"172.21.15.39:6817/3888067413","cluster_addr":"172.21.15.39:6819/3888067413","heartbeat_back_addr":"172.21.15.39:6823/3888067413","heartbeat_front_addr":"172.21.15.39:6821/3888067413","state":["exists","up"]},{"osd":3,"uuid":"000d9506-cbb2-4017-b875-deca579860ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6825","nonce":405003958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6827","nonce":405003958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6831","nonce":405003958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6829","nonce":405003958}]},"public_addr":"172.21.15.39:6825/405003958","cluster_addr":"172.21.15.39:6827/405003958","heartbeat_back_addr":"172.21.15.39:6831/405003958","heartbeat_front_addr":"172.21.15.39:6829/405003958","state":["exists","up"]},{"osd":4,"uuid":"70f0dacb-e960-40c5-bf6a-183e52bbe2ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6801","nonce":3895278838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6805","nonce":3895278838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6813","nonce":3895278838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6809","nonce":3895278838}]},"public_addr":"172.21.15.118:6801/3895278838","cluster_addr":"172.21.15.118:6805/3895278838","heartbeat_back_addr":"172.21.15.118:6813/3895278838","heartbeat_front_addr":"172.21.15.118:6809/3895278838","state":["exists","up"]},{"osd":5,"uuid":"756feb54-c3ae-4a2a-8f74-85c291ba707c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6804","nonce":3513592808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6808","nonce":3513592808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6815","nonce":3513592808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6812","nonce":3513592808}]},"public_addr":"172.21.15.118:6804/3513592808","cluster_addr":"172.21.15.118:6808/3513592808","heartbeat_back_addr":"172.21.15.118:6815/3513592808","heartbeat_front_addr":"172.21.15.118:6812/3513592808","state":["exists","up"]},{"osd":6,"uuid":"c4a982c1-f497-4b0f-8a23-c77372e4621e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6824","nonce":1863656053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6827","nonce":1863656053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6831","nonce":1863656053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6829","nonce":1863656053}]},"public_addr":"172.21.15.118:6824/1863656053","cluster_addr":"172.21.15.118:6827/1863656053","heartbeat_back_addr":"172.21.15.118:6831/1863656053","heartbeat_front_addr":"172.21.15.118:6829/1863656053","state":["exists","up"]},{"osd":7,"uuid":"6f2888aa-a7ac-4e26-9159-e31817934f44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6817","nonce":3636642904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6819","nonce":3636642904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6825","nonce":3636642904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6821","nonce":3636642904}]},"public_addr":"172.21.15.118:6817/3636642904","cluster_addr":"172.21.15.118:6819/3636642904","heartbeat_back_addr":"172.21.15.118:6825/3636642904","heartbeat_front_addr":"172.21.15.118:6821/3636642904","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.717636+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.724036+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.739144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:58.079275+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:58.073921+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.930466+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.987813+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.941098+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-16T13:54:15.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.890+0000 7f5b61939640 1 -- 172.21.15.39:0/502600040 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f5b3c0662b0 msgr2=0x7f5b3c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:15.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.890+0000 7f5b61939640 1 --2- 172.21.15.39:0/502600040 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f5b3c0662b0 0x7f5b3c068760 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c0636a0 tx=0x7f5b4c008040 comp rx=0 tx=0).stop 2023-05-16T13:54:15.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.890+0000 7f5b61939640 1 -- 172.21.15.39:0/502600040 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5b5c1e4540 msgr2=0x7f5b5c1e4c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:15.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.890+0000 7f5b61939640 1 --2- 172.21.15.39:0/502600040 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5b5c1e4540 0x7f5b5c1e4c50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5b54007fd0 tx=0x7f5b54011e70 comp rx=0 tx=0).stop 2023-05-16T13:54:15.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.890+0000 7f5b61939640 1 -- 172.21.15.39:0/502600040 shutdown_connections 2023-05-16T13:54:15.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.890+0000 7f5b61939640 1 --2- 172.21.15.39:0/502600040 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f5b3c0662b0 0x7f5b3c068760 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:15.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.890+0000 7f5b61939640 1 --2- 172.21.15.39:0/502600040 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b5c1e3970 0x7f5b5c1e4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:15.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.890+0000 7f5b61939640 1 --2- 172.21.15.39:0/502600040 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5b5c1e4540 0x7f5b5c1e4c50 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:15.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.890+0000 7f5b61939640 1 --2- 172.21.15.39:0/502600040 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b480047d0 0x7f5b5c154a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:15.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.890+0000 7f5b61939640 1 -- 172.21.15.39:0/502600040 >> 172.21.15.39:0/502600040 conn(0x7f5b5c089fe0 msgr2=0x7f5b5c156b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:15.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.890+0000 7f5b61939640 1 -- 172.21.15.39:0/502600040 shutdown_connections 2023-05-16T13:54:15.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:15.890+0000 7f5b61939640 1 -- 172.21.15.39:0/502600040 wait complete. 2023-05-16T13:54:15.917 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-05-16T13:54:16.057 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:16.050+0000 7ff472ec4640 1 Processor -- start 2023-05-16T13:54:16.058 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:16.050+0000 7ff472ec4640 1 -- start start 2023-05-16T13:54:16.059 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:16.050+0000 7ff472ec4640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff46c0aff50 0x7ff46c0b0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:16.059 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:16.050+0000 7ff472ec4640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff46c0b08c0 con 0x7ff46c158e00 2023-05-16T13:54:16.059 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:16.050+0000 7ff472ec4640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff46c0ca030 con 0x7ff46c070420 2023-05-16T13:54:16.059 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:16.050+0000 7ff472ec4640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff46c15c890 con 0x7ff46c0aff50 2023-05-16T13:54:16.059 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:16.050+0000 7ff470c60640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7ff46c158e00 0x7ff46c0c9530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:38236/0 (socket says 172.21.15.39:38236) 2023-05-16T13:54:16.059 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:16.050+0000 7ff470c60640 1 -- 172.21.15.39:0/3914340518 learned_addr learned my addr 172.21.15.39:0/3914340518 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:16.060 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:16.050+0000 7ff46bfff640 1 --2- 172.21.15.39:0/3914340518 >> v2:172.21.15.118:3300/0 conn(0x7ff46c0aff50 0x7ff46c0b0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:16.060 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:16.054+0000 7ff46b7fe640 1 -- 172.21.15.39:0/3914340518 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1949294474 0 0) 0x7ff46c0b08c0 con 0x7ff46c158e00 2023-05-16T13:54:16.060 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:16.054+0000 7ff46b7fe640 1 -- 172.21.15.39:0/3914340518 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff45c003530 con 0x7ff46c158e00 2023-05-16T13:54:16.061 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:16.054+0000 7ff46bfff640 1 -- 172.21.15.39:0/3914340518 >> v1:172.21.15.118:6789/0 conn(0x7ff46c070420 legacy=0x7ff46c070880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:16.061 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:16.054+0000 7ff46b7fe640 1 -- 172.21.15.39:0/3914340518 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2800831244 0 0) 0x7ff46c0ca030 con 0x7ff46c070420 2023-05-16T13:54:16.061 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:16.054+0000 7ff46bfff640 1 -- 172.21.15.39:0/3914340518 >> v1:172.21.15.39:6789/0 conn(0x7ff46c158e00 legacy=0x7ff46c0c9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:16.061 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:16.054+0000 7ff46bfff640 1 -- 172.21.15.39:0/3914340518 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff46c15cb70 con 0x7ff46c0aff50 2023-05-16T13:54:16.062 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:16.054+0000 7ff46bfff640 1 --2- 172.21.15.39:0/3914340518 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff46c0aff50 0x7ff46c0b0380 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff4580097c0 tx=0x7ff45801ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7de0fb5383a62a00 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:16.063 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:16.054+0000 7ff46b7fe640 1 -- 172.21.15.39:0/3914340518 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4580a8970 con 0x7ff46c0aff50 2023-05-16T13:54:16.063 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:16.054+0000 7ff46b7fe640 1 -- 172.21.15.39:0/3914340518 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4580a8ad0 con 0x7ff46c0aff50 2023-05-16T13:54:16.063 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:16.054+0000 7ff46b7fe640 1 -- 172.21.15.39:0/3914340518 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4580a8e60 con 0x7ff46c0aff50 2023-05-16T13:54:16.064 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:16.058+0000 7ff472ec4640 1 -- 172.21.15.39:0/3914340518 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff46c0aff50 msgr2=0x7ff46c0b0380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:16.064 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:16.058+0000 7ff472ec4640 1 --2- 172.21.15.39:0/3914340518 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff46c0aff50 0x7ff46c0b0380 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff4580097c0 tx=0x7ff45801ec70 comp rx=0 tx=0).stop 2023-05-16T13:54:16.064 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:16.058+0000 7ff472ec4640 1 -- 172.21.15.39:0/3914340518 shutdown_connections 2023-05-16T13:54:16.064 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:16.058+0000 7ff472ec4640 1 --2- 172.21.15.39:0/3914340518 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff46c0aff50 0x7ff46c0b0380 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:16.064 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:16.058+0000 7ff472ec4640 1 -- 172.21.15.39:0/3914340518 >> 172.21.15.39:0/3914340518 conn(0x7ff46c069a50 msgr2=0x7ff46c069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:16.065 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:16.058+0000 7ff472ec4640 1 -- 172.21.15.39:0/3914340518 shutdown_connections 2023-05-16T13:54:16.065 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:16.058+0000 7ff472ec4640 1 -- 172.21.15.39:0/3914340518 wait complete. 2023-05-16T13:54:16.065 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:16.058+0000 7ff472ec4640 1 Processor -- start 2023-05-16T13:54:16.066 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:16.058+0000 7ff472ec4640 1 -- start start 2023-05-16T13:54:16.067 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:16.058+0000 7ff472ec4640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff46c070420 0x7ff46c15bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:16.067 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:16.058+0000 7ff472ec4640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff46c0aff50 0x7ff46c14c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:16.067 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:16.058+0000 7ff472ec4640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff46c158e00 0x7ff46c0c69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:16.067 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:16.058+0000 7ff472ec4640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff46c0b12e0 con 0x7ff46c158e00 2023-05-16T13:54:16.068 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:16.058+0000 7ff472ec4640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff46c15c110 con 0x7ff46c0aff50 2023-05-16T13:54:16.068 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:16.058+0000 7ff472ec4640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff46c0b14f0 con 0x7ff46c070420 2023-05-16T13:54:16.068 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:16.058+0000 7ff471461640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff46c158e00 0x7ff46c0c69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:16.068 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:16.058+0000 7ff471461640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff46c158e00 0x7ff46c0c69d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38028/0 (socket says 172.21.15.39:38028) 2023-05-16T13:54:16.068 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:16.058+0000 7ff471461640 1 -- 172.21.15.39:0/2040932881 learned_addr learned my addr 172.21.15.39:0/2040932881 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:16.068 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:16.058+0000 7ff470c60640 1 --2- 172.21.15.39:0/2040932881 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff46c070420 0x7ff46c15bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:16.069 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:16.058+0000 7ff46bfff640 1 --2- 172.21.15.39:0/2040932881 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff46c0aff50 0x7ff46c14c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:16.070 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:16.062+0000 7ff471461640 1 -- 172.21.15.39:0/2040932881 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff46c070420 msgr2=0x7ff46c15bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:16.070 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:16.062+0000 7ff471461640 1 --2- 172.21.15.39:0/2040932881 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff46c070420 0x7ff46c15bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:16.070 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:16.062+0000 7ff471461640 1 -- 172.21.15.39:0/2040932881 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff46c0aff50 msgr2=0x7ff46c14c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:16.070 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:16.062+0000 7ff471461640 1 --2- 172.21.15.39:0/2040932881 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff46c0aff50 0x7ff46c14c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:16.070 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:16.062+0000 7ff471461640 1 -- 172.21.15.39:0/2040932881 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff458009420 con 0x7ff46c158e00 2023-05-16T13:54:16.070 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:16.062+0000 7ff471461640 1 --2- 172.21.15.39:0/2040932881 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff46c158e00 0x7ff46c0c69d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff464002240 tx=0x7ff46400cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:16.071 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:16.062+0000 7ff4697fa640 1 -- 172.21.15.39:0/2040932881 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff464003db0 con 0x7ff46c158e00 2023-05-16T13:54:16.071 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:16.062+0000 7ff4697fa640 1 -- 172.21.15.39:0/2040932881 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff46400ce30 con 0x7ff46c158e00 2023-05-16T13:54:16.071 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:16.062+0000 7ff4697fa640 1 -- 172.21.15.39:0/2040932881 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff464005270 con 0x7ff46c158e00 2023-05-16T13:54:16.071 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:16.062+0000 7ff472ec4640 1 -- 172.21.15.39:0/2040932881 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff46c15d130 con 0x7ff46c158e00 2023-05-16T13:54:16.071 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:16.062+0000 7ff472ec4640 1 -- 172.21.15.39:0/2040932881 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff46c15ce50 con 0x7ff46c158e00 2023-05-16T13:54:16.071 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:16.062+0000 7ff472ec4640 1 -- 172.21.15.39:0/2040932881 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff46c0cc730 con 0x7ff46c158e00 2023-05-16T13:54:16.072 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:16.062+0000 7ff4697fa640 1 -- 172.21.15.39:0/2040932881 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff4640053d0 con 0x7ff46c158e00 2023-05-16T13:54:16.072 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:16.062+0000 7ff4697fa640 1 --2- 172.21.15.39:0/2040932881 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ff450066280 0x7ff450068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:16.072 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:16.062+0000 7ff4697fa640 1 -- 172.21.15.39:0/2040932881 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff464083440 con 0x7ff46c158e00 2023-05-16T13:54:16.072 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:16.062+0000 7ff470c60640 1 --2- 172.21.15.39:0/2040932881 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ff450066280 0x7ff450068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:16.072 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:16.066+0000 7ff470c60640 1 --2- 172.21.15.39:0/2040932881 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ff450066280 0x7ff450068730 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff460007fd0 tx=0x7ff460000bd0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:16.074 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:16.066+0000 7ff4697fa640 1 -- 172.21.15.39:0/2040932881 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ff464050960 con 0x7ff46c158e00 2023-05-16T13:54:16.264 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:16.258+0000 7ff472ec4640 1 -- 172.21.15.39:0/2040932881 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ff46c073c90 con 0x7ff46c158e00 2023-05-16T13:54:17.215 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.206+0000 7ff4697fa640 1 -- 172.21.15.39:0/2040932881 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7ff464053f80 con 0x7ff46c158e00 2023-05-16T13:54:17.217 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.210+0000 7ff472ec4640 1 -- 172.21.15.39:0/2040932881 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ff450066280 msgr2=0x7ff450068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:17.218 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.210+0000 7ff472ec4640 1 --2- 172.21.15.39:0/2040932881 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ff450066280 0x7ff450068730 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff460007fd0 tx=0x7ff460000bd0 comp rx=0 tx=0).stop 2023-05-16T13:54:17.218 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.210+0000 7ff472ec4640 1 -- 172.21.15.39:0/2040932881 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff46c158e00 msgr2=0x7ff46c0c69d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:17.218 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.210+0000 7ff472ec4640 1 --2- 172.21.15.39:0/2040932881 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff46c158e00 0x7ff46c0c69d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff464002240 tx=0x7ff46400cbe0 comp rx=0 tx=0).stop 2023-05-16T13:54:17.218 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.210+0000 7ff472ec4640 1 -- 172.21.15.39:0/2040932881 shutdown_connections 2023-05-16T13:54:17.218 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.210+0000 7ff472ec4640 1 --2- 172.21.15.39:0/2040932881 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff46c158e00 0x7ff46c0c69d0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:17.218 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.210+0000 7ff472ec4640 1 --2- 172.21.15.39:0/2040932881 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff46c0aff50 0x7ff46c14c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:17.219 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.210+0000 7ff472ec4640 1 --2- 172.21.15.39:0/2040932881 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ff450066280 0x7ff450068730 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:17.219 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.210+0000 7ff472ec4640 1 --2- 172.21.15.39:0/2040932881 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff46c070420 0x7ff46c15bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:17.219 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.210+0000 7ff472ec4640 1 -- 172.21.15.39:0/2040932881 >> 172.21.15.39:0/2040932881 conn(0x7ff46c069a50 msgr2=0x7ff46c0cee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:17.219 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.210+0000 7ff472ec4640 1 -- 172.21.15.39:0/2040932881 shutdown_connections 2023-05-16T13:54:17.219 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.210+0000 7ff472ec4640 1 -- 172.21.15.39:0/2040932881 wait complete. 2023-05-16T13:54:17.239 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-05-16T13:54:17.240 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-05-16T13:54:17.384 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.378+0000 7f409b6c3640 1 Processor -- start 2023-05-16T13:54:17.385 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.378+0000 7f409b6c3640 1 -- start start 2023-05-16T13:54:17.386 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.378+0000 7f409b6c3640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f40940b0710 0x7f409415d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:17.386 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.378+0000 7f409b6c3640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4094071b70 0x7f40940c91c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:17.386 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.378+0000 7f409b6c3640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f409415de40 con 0x7f40940b4030 2023-05-16T13:54:17.386 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.378+0000 7f409b6c3640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f409415e910 con 0x7f40940b0710 2023-05-16T13:54:17.386 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.378+0000 7f409b6c3640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40940b0ae0 con 0x7f4094071b70 2023-05-16T13:54:17.387 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.378+0000 7f4099c60640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4094071b70 0x7f40940c91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:17.387 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.378+0000 7f4098c5e640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f40940b4030 0x7f4094071460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.39:49604/0 (socket says 172.21.15.39:49604) 2023-05-16T13:54:17.388 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.378+0000 7f4098c5e640 1 -- 172.21.15.39:0/1065622741 learned_addr learned my addr 172.21.15.39:0/1065622741 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:17.388 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.378+0000 7f409945f640 1 --2- 172.21.15.39:0/1065622741 >> v2:172.21.15.118:3300/0 conn(0x7f40940b0710 0x7f409415d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:17.388 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.378+0000 7f408bfff640 1 -- 172.21.15.39:0/1065622741 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1324797961 0 0) 0x7f409415de40 con 0x7f40940b4030 2023-05-16T13:54:17.388 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.378+0000 7f408bfff640 1 -- 172.21.15.39:0/1065622741 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4080003530 con 0x7f40940b4030 2023-05-16T13:54:17.388 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.378+0000 7f409945f640 1 -- 172.21.15.39:0/1065622741 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4094071b70 msgr2=0x7f40940c91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:17.388 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.378+0000 7f409945f640 1 --2- 172.21.15.39:0/1065622741 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4094071b70 0x7f40940c91c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:17.388 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.378+0000 7f409945f640 1 -- 172.21.15.39:0/1065622741 >> v1:172.21.15.118:6789/0 conn(0x7f40940b4030 legacy=0x7f4094071460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:17.389 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.378+0000 7f409945f640 1 -- 172.21.15.39:0/1065622741 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f409415e070 con 0x7f40940b0710 2023-05-16T13:54:17.389 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.378+0000 7f4099c60640 1 --2- 172.21.15.39:0/1065622741 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4094071b70 0x7f40940c91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-16T13:54:17.390 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.382+0000 7f409945f640 1 --2- 172.21.15.39:0/1065622741 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f40940b0710 0x7f409415d900 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f40900097c0 tx=0x7f409001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1471758e77f43d50 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:17.390 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.382+0000 7f408bfff640 1 -- 172.21.15.39:0/1065622741 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40900a6040 con 0x7f40940b0710 2023-05-16T13:54:17.390 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.382+0000 7f408bfff640 1 -- 172.21.15.39:0/1065622741 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40900aa600 con 0x7f40940b0710 2023-05-16T13:54:17.390 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.382+0000 7f408bfff640 1 -- 172.21.15.39:0/1065622741 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40900aa990 con 0x7f40940b0710 2023-05-16T13:54:17.391 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.382+0000 7f409b6c3640 1 -- 172.21.15.39:0/1065622741 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f40940b0710 msgr2=0x7f409415d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:17.391 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.382+0000 7f409b6c3640 1 --2- 172.21.15.39:0/1065622741 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f40940b0710 0x7f409415d900 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f40900097c0 tx=0x7f409001c480 comp rx=0 tx=0).stop 2023-05-16T13:54:17.391 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.382+0000 7f409b6c3640 1 -- 172.21.15.39:0/1065622741 shutdown_connections 2023-05-16T13:54:17.392 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.382+0000 7f409b6c3640 1 --2- 172.21.15.39:0/1065622741 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4094071b70 0x7f40940c91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:17.392 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.382+0000 7f409b6c3640 1 --2- 172.21.15.39:0/1065622741 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f40940b0710 0x7f409415d900 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:17.392 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.382+0000 7f409b6c3640 1 -- 172.21.15.39:0/1065622741 >> 172.21.15.39:0/1065622741 conn(0x7f4094069a50 msgr2=0x7f4094069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:17.392 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.382+0000 7f409b6c3640 1 -- 172.21.15.39:0/1065622741 shutdown_connections 2023-05-16T13:54:17.392 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.382+0000 7f409b6c3640 1 -- 172.21.15.39:0/1065622741 wait complete. 2023-05-16T13:54:17.393 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.386+0000 7f409b6c3640 1 Processor -- start 2023-05-16T13:54:17.393 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.386+0000 7f409b6c3640 1 -- start start 2023-05-16T13:54:17.394 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.386+0000 7f409b6c3640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4094071b70 0x7f4094157180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:17.394 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.386+0000 7f409b6c3640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40940b0710 0x7f40940b2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:17.394 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.386+0000 7f409b6c3640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f40940b4030 0x7f40940aca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:17.394 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.386+0000 7f409b6c3640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40940c8030 con 0x7f40940b0710 2023-05-16T13:54:17.394 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.386+0000 7f409b6c3640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40940c6570 con 0x7f4094071b70 2023-05-16T13:54:17.394 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.386+0000 7f409b6c3640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40940c5960 con 0x7f40940b4030 2023-05-16T13:54:17.395 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.386+0000 7f4098c5e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40940b0710 0x7f40940b2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:17.395 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.386+0000 7f4098c5e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40940b0710 0x7f40940b2df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38036/0 (socket says 172.21.15.39:38036) 2023-05-16T13:54:17.395 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.386+0000 7f4098c5e640 1 -- 172.21.15.39:0/3808847520 learned_addr learned my addr 172.21.15.39:0/3808847520 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:17.396 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.386+0000 7f409945f640 1 --2- 172.21.15.39:0/3808847520 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4094071b70 0x7f4094157180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:17.396 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.386+0000 7f4099c60640 1 --2- 172.21.15.39:0/3808847520 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f40940b4030 0x7f40940aca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:17.396 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.386+0000 7f4098c5e640 1 -- 172.21.15.39:0/3808847520 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f40940b4030 msgr2=0x7f40940aca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:17.396 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.386+0000 7f4098c5e640 1 --2- 172.21.15.39:0/3808847520 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f40940b4030 0x7f40940aca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:17.397 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.386+0000 7f4098c5e640 1 -- 172.21.15.39:0/3808847520 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4094071b70 msgr2=0x7f4094157180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:17.397 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.386+0000 7f4098c5e640 1 --2- 172.21.15.39:0/3808847520 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4094071b70 0x7f4094157180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:17.397 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.386+0000 7f4098c5e640 1 -- 172.21.15.39:0/3808847520 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f408c009a70 con 0x7f40940b0710 2023-05-16T13:54:17.397 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.386+0000 7f4098c5e640 1 --2- 172.21.15.39:0/3808847520 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40940b0710 0x7f40940b2df0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f408400c420 tx=0x7f408400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:17.397 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.386+0000 7f4089ffb640 1 -- 172.21.15.39:0/3808847520 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4084005cf0 con 0x7f40940b0710 2023-05-16T13:54:17.397 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.386+0000 7f4089ffb640 1 -- 172.21.15.39:0/3808847520 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4084005e50 con 0x7f40940b0710 2023-05-16T13:54:17.397 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.386+0000 7f4089ffb640 1 -- 172.21.15.39:0/3808847520 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40840072d0 con 0x7f40940b0710 2023-05-16T13:54:17.397 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.386+0000 7f409b6c3640 1 -- 172.21.15.39:0/3808847520 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4090009420 con 0x7f40940b0710 2023-05-16T13:54:17.398 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.386+0000 7f409b6c3640 1 -- 172.21.15.39:0/3808847520 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40940c9f10 con 0x7f40940b0710 2023-05-16T13:54:17.398 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.390+0000 7f409b6c3640 1 -- 172.21.15.39:0/3808847520 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40940c8ca0 con 0x7f40940b0710 2023-05-16T13:54:17.398 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.390+0000 7f4089ffb640 1 -- 172.21.15.39:0/3808847520 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4084007430 con 0x7f40940b0710 2023-05-16T13:54:17.398 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.390+0000 7f4089ffb640 1 --2- 172.21.15.39:0/3808847520 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f40780662b0 0x7f4078068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:17.399 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.390+0000 7f4089ffb640 1 -- 172.21.15.39:0/3808847520 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f40840832a0 con 0x7f40940b0710 2023-05-16T13:54:17.399 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.390+0000 7f409945f640 1 --2- 172.21.15.39:0/3808847520 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f40780662b0 0x7f4078068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:17.399 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.390+0000 7f409945f640 1 --2- 172.21.15.39:0/3808847520 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f40780662b0 0x7f4078068760 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f40900ae000 tx=0x7f40900a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:17.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.394+0000 7f4089ffb640 1 -- 172.21.15.39:0/3808847520 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f4084050730 con 0x7f40940b0710 2023-05-16T13:54:17.588 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:17.582+0000 7f409b6c3640 1 -- 172.21.15.39:0/3808847520 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f40940ca0a0 con 0x7f40940b0710 2023-05-16T13:54:18.224 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.218+0000 7f4089ffb640 1 -- 172.21.15.39:0/3808847520 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4084053d50 con 0x7f40940b0710 2023-05-16T13:54:18.226 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.218+0000 7f409b6c3640 1 -- 172.21.15.39:0/3808847520 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f40780662b0 msgr2=0x7f4078068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:18.227 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.218+0000 7f409b6c3640 1 --2- 172.21.15.39:0/3808847520 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f40780662b0 0x7f4078068760 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f40900ae000 tx=0x7f40900a7000 comp rx=0 tx=0).stop 2023-05-16T13:54:18.227 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.218+0000 7f409b6c3640 1 -- 172.21.15.39:0/3808847520 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40940b0710 msgr2=0x7f40940b2df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:18.227 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.218+0000 7f409b6c3640 1 --2- 172.21.15.39:0/3808847520 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40940b0710 0x7f40940b2df0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f408400c420 tx=0x7f408400c8e0 comp rx=0 tx=0).stop 2023-05-16T13:54:18.227 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.218+0000 7f409b6c3640 1 -- 172.21.15.39:0/3808847520 shutdown_connections 2023-05-16T13:54:18.227 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.218+0000 7f409b6c3640 1 --2- 172.21.15.39:0/3808847520 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f40780662b0 0x7f4078068760 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:18.227 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.218+0000 7f409b6c3640 1 --2- 172.21.15.39:0/3808847520 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f40940b4030 0x7f40940aca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:18.227 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.218+0000 7f409b6c3640 1 --2- 172.21.15.39:0/3808847520 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40940b0710 0x7f40940b2df0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:18.228 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.218+0000 7f409b6c3640 1 --2- 172.21.15.39:0/3808847520 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4094071b70 0x7f4094157180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:18.228 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.218+0000 7f409b6c3640 1 -- 172.21.15.39:0/3808847520 >> 172.21.15.39:0/3808847520 conn(0x7f4094069a50 msgr2=0x7f40940ccaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:18.228 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.218+0000 7f409b6c3640 1 -- 172.21.15.39:0/3808847520 shutdown_connections 2023-05-16T13:54:18.228 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.218+0000 7f409b6c3640 1 -- 172.21.15.39:0/3808847520 wait complete. 2023-05-16T13:54:18.249 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-05-16T13:54:18.249 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-16T13:54:18.391 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.382+0000 7f6a953f0640 1 Processor -- start 2023-05-16T13:54:18.391 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.382+0000 7f6a953f0640 1 -- start start 2023-05-16T13:54:18.392 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.386+0000 7f6a953f0640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f6a9015c470 0x7f6a900d0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:18.392 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.386+0000 7f6a953f0640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6a900b5670 0x7f6a900b42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:18.393 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.386+0000 7f6a953f0640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a900ce150 con 0x7f6a900b5ae0 2023-05-16T13:54:18.393 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.386+0000 7f6a953f0640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a900cd890 con 0x7f6a9015c470 2023-05-16T13:54:18.393 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.386+0000 7f6a953f0640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a900d0c60 con 0x7f6a900b5670 2023-05-16T13:54:18.393 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.386+0000 7f6a8effd640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f6a9015c470 0x7f6a900d0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:18.393 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.386+0000 7f6a8effd640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f6a9015c470 0x7f6a900d0720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38046/0 (socket says 172.21.15.39:38046) 2023-05-16T13:54:18.393 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.386+0000 7f6a8effd640 1 -- 172.21.15.39:0/43895085 learned_addr learned my addr 172.21.15.39:0/43895085 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:18.394 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.386+0000 7f6a87fff640 1 --2- 172.21.15.39:0/43895085 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6a900b5670 0x7f6a900b42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:18.394 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.386+0000 7f6a8effd640 1 -- 172.21.15.39:0/43895085 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6a900b5670 msgr2=0x7f6a900b42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:18.394 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.386+0000 7f6a8effd640 1 --2- 172.21.15.39:0/43895085 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6a900b5670 0x7f6a900b42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:18.394 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.386+0000 7f6a8effd640 1 -- 172.21.15.39:0/43895085 >> v1:172.21.15.118:6789/0 conn(0x7f6a900b5ae0 legacy=0x7f6a900ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:18.394 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.386+0000 7f6a8effd640 1 -- 172.21.15.39:0/43895085 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a900cdb00 con 0x7f6a9015c470 2023-05-16T13:54:18.395 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.390+0000 7f6a8effd640 1 --2- 172.21.15.39:0/43895085 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a9015c470 0x7f6a900d0720 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6a80009ea0 tx=0x7f6a8001ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b42d2bedb28c42ce server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:18.396 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.390+0000 7f6a8e7fc640 1 -- 172.21.15.39:0/43895085 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a800a58b0 con 0x7f6a9015c470 2023-05-16T13:54:18.396 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.390+0000 7f6a8e7fc640 1 -- 172.21.15.39:0/43895085 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a800a5a10 con 0x7f6a9015c470 2023-05-16T13:54:18.396 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.390+0000 7f6a8e7fc640 1 -- 172.21.15.39:0/43895085 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a800a5da0 con 0x7f6a9015c470 2023-05-16T13:54:18.397 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.390+0000 7f6a953f0640 1 -- 172.21.15.39:0/43895085 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a9015c470 msgr2=0x7f6a900d0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:18.397 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.390+0000 7f6a953f0640 1 --2- 172.21.15.39:0/43895085 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a9015c470 0x7f6a900d0720 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6a80009ea0 tx=0x7f6a8001ca20 comp rx=0 tx=0).stop 2023-05-16T13:54:18.397 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.390+0000 7f6a953f0640 1 -- 172.21.15.39:0/43895085 shutdown_connections 2023-05-16T13:54:18.397 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.390+0000 7f6a953f0640 1 --2- 172.21.15.39:0/43895085 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6a900b5670 0x7f6a900b42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:18.398 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.390+0000 7f6a953f0640 1 --2- 172.21.15.39:0/43895085 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a9015c470 0x7f6a900d0720 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:18.398 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.390+0000 7f6a953f0640 1 -- 172.21.15.39:0/43895085 >> 172.21.15.39:0/43895085 conn(0x7f6a9009bae0 msgr2=0x7f6a900d2820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:18.398 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.390+0000 7f6a953f0640 1 -- 172.21.15.39:0/43895085 shutdown_connections 2023-05-16T13:54:18.398 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.390+0000 7f6a953f0640 1 -- 172.21.15.39:0/43895085 wait complete. 2023-05-16T13:54:18.398 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.390+0000 7f6a953f0640 1 Processor -- start 2023-05-16T13:54:18.399 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.390+0000 7f6a953f0640 1 -- start start 2023-05-16T13:54:18.399 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.390+0000 7f6a953f0640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6a900b5670 0x7f6a9014d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:18.399 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.390+0000 7f6a953f0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a900b5ae0 0x7f6a9014e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:18.399 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.390+0000 7f6a953f0640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a9015c470 0x7f6a90153b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:18.400 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.390+0000 7f6a953f0640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9014fb90 con 0x7f6a900b5ae0 2023-05-16T13:54:18.400 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.390+0000 7f6a953f0640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9014db20 con 0x7f6a9015c470 2023-05-16T13:54:18.400 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.390+0000 7f6a953f0640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9014ef10 con 0x7f6a900b5670 2023-05-16T13:54:18.401 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.394+0000 7f6a8effd640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6a900b5670 0x7f6a9014d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:18.401 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.394+0000 7f6a87fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a900b5ae0 0x7f6a9014e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:18.401 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.394+0000 7f6a8effd640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6a900b5670 0x7f6a9014d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.39:54386/0 (socket says 172.21.15.39:54386) 2023-05-16T13:54:18.401 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.394+0000 7f6a8effd640 1 -- 172.21.15.39:0/3242965612 learned_addr learned my addr 172.21.15.39:0/3242965612 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:18.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.394+0000 7f6a8f7fe640 1 --2- 172.21.15.39:0/3242965612 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a9015c470 0x7f6a90153b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:18.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.394+0000 7f6a87fff640 1 -- 172.21.15.39:0/3242965612 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6a900b5670 msgr2=0x7f6a9014d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:18.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.394+0000 7f6a87fff640 1 --2- 172.21.15.39:0/3242965612 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6a900b5670 0x7f6a9014d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:18.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.394+0000 7f6a87fff640 1 -- 172.21.15.39:0/3242965612 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a9015c470 msgr2=0x7f6a90153b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:18.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.394+0000 7f6a87fff640 1 --2- 172.21.15.39:0/3242965612 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a9015c470 0x7f6a90153b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:18.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.394+0000 7f6a87fff640 1 -- 172.21.15.39:0/3242965612 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a80009b30 con 0x7f6a900b5ae0 2023-05-16T13:54:18.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.394+0000 7f6a87fff640 1 --2- 172.21.15.39:0/3242965612 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a900b5ae0 0x7f6a9014e650 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6a7800d5d0 tx=0x7f6a7800da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:18.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.394+0000 7f6a877fe640 1 -- 172.21.15.39:0/3242965612 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a780125f0 con 0x7f6a900b5ae0 2023-05-16T13:54:18.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.394+0000 7f6a877fe640 1 -- 172.21.15.39:0/3242965612 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a78012750 con 0x7f6a900b5ae0 2023-05-16T13:54:18.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.394+0000 7f6a953f0640 1 -- 172.21.15.39:0/3242965612 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a9009bf70 con 0x7f6a900b5ae0 2023-05-16T13:54:18.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.394+0000 7f6a877fe640 1 -- 172.21.15.39:0/3242965612 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a78012ae0 con 0x7f6a900b5ae0 2023-05-16T13:54:18.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.394+0000 7f6a953f0640 1 -- 172.21.15.39:0/3242965612 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a900b4bf0 con 0x7f6a900b5ae0 2023-05-16T13:54:18.404 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.394+0000 7f6a953f0640 1 -- 172.21.15.39:0/3242965612 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a900d0ee0 con 0x7f6a900b5ae0 2023-05-16T13:54:18.404 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.394+0000 7f6a877fe640 1 -- 172.21.15.39:0/3242965612 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6a78012c40 con 0x7f6a900b5ae0 2023-05-16T13:54:18.404 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.398+0000 7f6a877fe640 1 --2- 172.21.15.39:0/3242965612 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f6a70066280 0x7f6a70068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:18.404 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.398+0000 7f6a877fe640 1 -- 172.21.15.39:0/3242965612 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6a780840f0 con 0x7f6a900b5ae0 2023-05-16T13:54:18.405 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.398+0000 7f6a8effd640 1 --2- 172.21.15.39:0/3242965612 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f6a70066280 0x7f6a70068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:18.405 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.398+0000 7f6a8effd640 1 --2- 172.21.15.39:0/3242965612 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f6a70066280 0x7f6a70068730 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6a80009ea0 tx=0x7f6a800a7070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:18.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.402+0000 7f6a877fe640 1 -- 172.21.15.39:0/3242965612 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f6a78051590 con 0x7f6a900b5ae0 2023-05-16T13:54:18.598 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.590+0000 7f6a953f0640 1 -- 172.21.15.39:0/3242965612 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6a90073c90 con 0x7f6a900b5ae0 2023-05-16T13:54:18.598 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.590+0000 7f6a877fe640 1 -- 172.21.15.39:0/3242965612 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4668 (secure 0 0 0) 0x7f6a78054bb0 con 0x7f6a900b5ae0 2023-05-16T13:54:18.599 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:54:18.599 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2374269620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":2374269620},{"type":"v1","addr":"172.21.15.118:6835","nonce":2374269620}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/3803055359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3803055359},{"type":"v1","addr":"172.21.15.118:6833","nonce":3803055359}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4308,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6836/3259535605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":3259535605},{"type":"v1","addr":"172.21.15.39:6836","nonce":3259535605}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-16T13:54:15.191894+0000","modified":"2023-05-16T13:54:18.210603+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4311},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4311":{"gid":4311,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.39:6837/616280162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6835","nonce":616280162},{"type":"v1","addr":"172.21.15.39:6837","nonce":616280162}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-16T13:54:18.599 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 8 2023-05-16T13:54:18.600 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.594+0000 7f6a953f0640 1 -- 172.21.15.39:0/3242965612 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f6a70066280 msgr2=0x7f6a70068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:18.600 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.594+0000 7f6a953f0640 1 --2- 172.21.15.39:0/3242965612 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f6a70066280 0x7f6a70068730 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6a80009ea0 tx=0x7f6a800a7070 comp rx=0 tx=0).stop 2023-05-16T13:54:18.601 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.594+0000 7f6a953f0640 1 -- 172.21.15.39:0/3242965612 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a900b5ae0 msgr2=0x7f6a9014e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:18.601 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.594+0000 7f6a953f0640 1 --2- 172.21.15.39:0/3242965612 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a900b5ae0 0x7f6a9014e650 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6a7800d5d0 tx=0x7f6a7800da90 comp rx=0 tx=0).stop 2023-05-16T13:54:18.601 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.594+0000 7f6a953f0640 1 -- 172.21.15.39:0/3242965612 shutdown_connections 2023-05-16T13:54:18.601 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.594+0000 7f6a953f0640 1 --2- 172.21.15.39:0/3242965612 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a9015c470 0x7f6a90153b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:18.601 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.594+0000 7f6a953f0640 1 --2- 172.21.15.39:0/3242965612 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a900b5ae0 0x7f6a9014e650 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:18.601 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.594+0000 7f6a953f0640 1 --2- 172.21.15.39:0/3242965612 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f6a70066280 0x7f6a70068730 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:18.601 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.594+0000 7f6a953f0640 1 --2- 172.21.15.39:0/3242965612 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6a900b5670 0x7f6a9014d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:18.602 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.594+0000 7f6a953f0640 1 -- 172.21.15.39:0/3242965612 >> 172.21.15.39:0/3242965612 conn(0x7f6a9009bae0 msgr2=0x7f6a900b6400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:18.602 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.594+0000 7f6a953f0640 1 -- 172.21.15.39:0/3242965612 shutdown_connections 2023-05-16T13:54:18.602 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.594+0000 7f6a953f0640 1 -- 172.21.15.39:0/3242965612 wait complete. 2023-05-16T13:54:18.619 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-16T13:54:18.757 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.750+0000 7fbe75f11640 1 Processor -- start 2023-05-16T13:54:18.757 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.750+0000 7fbe75f11640 1 -- start start 2023-05-16T13:54:18.759 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.750+0000 7fbe75f11640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fbe7015c470 0x7fbe700d0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:18.759 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.750+0000 7fbe75f11640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbe700b5670 0x7fbe700b42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:18.759 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.750+0000 7fbe75f11640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe700ce150 con 0x7fbe700b5b10 2023-05-16T13:54:18.759 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.750+0000 7fbe75f11640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe700cd890 con 0x7fbe7015c470 2023-05-16T13:54:18.759 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.750+0000 7fbe75f11640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe700d0c60 con 0x7fbe700b5670 2023-05-16T13:54:18.759 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.750+0000 7fbe6f7fe640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fbe7015c470 0x7fbe700d0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:18.759 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.750+0000 7fbe6ffff640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fbe700b5b10 0x7fbe700ce5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:38250/0 (socket says 172.21.15.39:38250) 2023-05-16T13:54:18.760 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.750+0000 7fbe6ffff640 1 -- 172.21.15.39:0/610418229 learned_addr learned my addr 172.21.15.39:0/610418229 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:18.760 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.750+0000 7fbe6effd640 1 --2- 172.21.15.39:0/610418229 >> v2:172.21.15.118:3300/0 conn(0x7fbe700b5670 0x7fbe700b42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:18.760 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.750+0000 7fbe6f7fe640 1 -- 172.21.15.39:0/610418229 >> v2:172.21.15.118:3300/0 conn(0x7fbe700b5670 msgr2=0x7fbe700b42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:18.760 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.750+0000 7fbe6f7fe640 1 --2- 172.21.15.39:0/610418229 >> v2:172.21.15.118:3300/0 conn(0x7fbe700b5670 0x7fbe700b42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:18.760 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.750+0000 7fbe6f7fe640 1 -- 172.21.15.39:0/610418229 >> v1:172.21.15.39:6789/0 conn(0x7fbe700b5b10 legacy=0x7fbe700ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:18.760 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.750+0000 7fbe6f7fe640 1 -- 172.21.15.39:0/610418229 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe700cdb00 con 0x7fbe7015c470 2023-05-16T13:54:18.760 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.750+0000 7fbe6e7fc640 1 -- 172.21.15.39:0/610418229 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2961540065 0 0) 0x7fbe700ce150 con 0x7fbe700b5b10 2023-05-16T13:54:18.761 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.754+0000 7fbe6f7fe640 1 --2- 172.21.15.39:0/610418229 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe7015c470 0x7fbe700d0720 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbe7008ac00 tx=0x7fbe6001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4ff97dadc9a6147 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:18.762 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.754+0000 7fbe6e7fc640 1 -- 172.21.15.39:0/610418229 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe600ac630 con 0x7fbe7015c470 2023-05-16T13:54:18.762 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.754+0000 7fbe6e7fc640 1 -- 172.21.15.39:0/610418229 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe600ac790 con 0x7fbe7015c470 2023-05-16T13:54:18.762 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.754+0000 7fbe6e7fc640 1 -- 172.21.15.39:0/610418229 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe600acb20 con 0x7fbe7015c470 2023-05-16T13:54:18.763 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.754+0000 7fbe75f11640 1 -- 172.21.15.39:0/610418229 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe7015c470 msgr2=0x7fbe700d0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:18.763 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.754+0000 7fbe75f11640 1 --2- 172.21.15.39:0/610418229 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe7015c470 0x7fbe700d0720 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbe7008ac00 tx=0x7fbe6001c410 comp rx=0 tx=0).stop 2023-05-16T13:54:18.763 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.754+0000 7fbe75f11640 1 -- 172.21.15.39:0/610418229 shutdown_connections 2023-05-16T13:54:18.763 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.754+0000 7fbe75f11640 1 --2- 172.21.15.39:0/610418229 >> v2:172.21.15.118:3300/0 conn(0x7fbe700b5670 0x7fbe700b42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:18.763 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.754+0000 7fbe75f11640 1 --2- 172.21.15.39:0/610418229 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe7015c470 0x7fbe700d0720 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:18.764 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.754+0000 7fbe75f11640 1 -- 172.21.15.39:0/610418229 >> 172.21.15.39:0/610418229 conn(0x7fbe7009bae0 msgr2=0x7fbe700d2820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:18.764 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.754+0000 7fbe75f11640 1 -- 172.21.15.39:0/610418229 shutdown_connections 2023-05-16T13:54:18.764 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.754+0000 7fbe75f11640 1 -- 172.21.15.39:0/610418229 wait complete. 2023-05-16T13:54:18.764 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.758+0000 7fbe75f11640 1 Processor -- start 2023-05-16T13:54:18.765 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.758+0000 7fbe75f11640 1 -- start start 2023-05-16T13:54:18.766 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.758+0000 7fbe75f11640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe700b5670 0x7fbe700cbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:18.766 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.758+0000 7fbe75f11640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbe700b5b10 0x7fbe700c9860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:18.766 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.758+0000 7fbe75f11640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe7015c470 0x7fbe7015ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:18.767 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.758+0000 7fbe75f11640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe700cac50 con 0x7fbe700b5670 2023-05-16T13:54:18.767 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.758+0000 7fbe75f11640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe700c9da0 con 0x7fbe7015c470 2023-05-16T13:54:18.767 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.758+0000 7fbe75f11640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe700ca040 con 0x7fbe700b5b10 2023-05-16T13:54:18.767 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.758+0000 7fbe6f7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe700b5670 0x7fbe700cbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:18.768 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.758+0000 7fbe6f7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe700b5670 0x7fbe700cbeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38078/0 (socket says 172.21.15.39:38078) 2023-05-16T13:54:18.768 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.758+0000 7fbe6f7fe640 1 -- 172.21.15.39:0/40355656 learned_addr learned my addr 172.21.15.39:0/40355656 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:18.768 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.758+0000 7fbe6f7fe640 1 -- 172.21.15.39:0/40355656 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbe700b5b10 msgr2=0x7fbe700c9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:18.768 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.758+0000 7fbe6f7fe640 1 --2- 172.21.15.39:0/40355656 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbe700b5b10 0x7fbe700c9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:18.769 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.758+0000 7fbe6f7fe640 1 -- 172.21.15.39:0/40355656 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe7015c470 msgr2=0x7fbe7015ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:18.769 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.758+0000 7fbe6f7fe640 1 --2- 172.21.15.39:0/40355656 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe7015c470 0x7fbe7015ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:18.769 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.758+0000 7fbe6f7fe640 1 -- 172.21.15.39:0/40355656 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe600093b0 con 0x7fbe700b5670 2023-05-16T13:54:18.769 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.758+0000 7fbe6f7fe640 1 --2- 172.21.15.39:0/40355656 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe700b5670 0x7fbe700cbeb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbe60019020 tx=0x7fbe6001ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:18.770 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.758+0000 7fbe57fff640 1 -- 172.21.15.39:0/40355656 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe60005ba0 con 0x7fbe700b5670 2023-05-16T13:54:18.770 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.758+0000 7fbe57fff640 1 -- 172.21.15.39:0/40355656 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe60005d00 con 0x7fbe700b5670 2023-05-16T13:54:18.770 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.758+0000 7fbe57fff640 1 -- 172.21.15.39:0/40355656 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe60006230 con 0x7fbe700b5670 2023-05-16T13:54:18.770 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.758+0000 7fbe75f11640 1 -- 172.21.15.39:0/40355656 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe7009bf70 con 0x7fbe700b5670 2023-05-16T13:54:18.772 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.758+0000 7fbe75f11640 1 -- 172.21.15.39:0/40355656 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe700b4bf0 con 0x7fbe700b5670 2023-05-16T13:54:18.772 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.762+0000 7fbe75f11640 1 -- 172.21.15.39:0/40355656 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe700d0ee0 con 0x7fbe700b5670 2023-05-16T13:54:18.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.762+0000 7fbe57fff640 1 -- 172.21.15.39:0/40355656 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbe60006390 con 0x7fbe700b5670 2023-05-16T13:54:18.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.762+0000 7fbe57fff640 1 --2- 172.21.15.39:0/40355656 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fbe5c0662b0 0x7fbe5c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:18.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.762+0000 7fbe57fff640 1 -- 172.21.15.39:0/40355656 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbe6011e5e0 con 0x7fbe700b5670 2023-05-16T13:54:18.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.762+0000 7fbe6effd640 1 --2- 172.21.15.39:0/40355656 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fbe5c0662b0 0x7fbe5c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:18.774 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.762+0000 7fbe6effd640 1 --2- 172.21.15.39:0/40355656 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fbe5c0662b0 0x7fbe5c068760 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbe700c9350 tx=0x7fbe64008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:18.774 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.766+0000 7fbe57fff640 1 -- 172.21.15.39:0/40355656 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fbe600eba60 con 0x7fbe700b5670 2023-05-16T13:54:18.928 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.922+0000 7fbe75f11640 1 -- 172.21.15.39:0/40355656 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbe7015d630 con 0x7fbe700b5670 2023-05-16T13:54:18.929 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.922+0000 7fbe57fff640 1 -- 172.21.15.39:0/40355656 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18279 (secure 0 0 0) 0x7fbe600ef080 con 0x7fbe700b5670 2023-05-16T13:54:18.930 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:54:18.930 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":24,"fsid":"9c1e210b-c515-4ea4-a065-397956895c68","created":"2023-05-16T13:53:48.955290+0000","modified":"2023-05-16T13:54:16.194544+0000","last_up_change":"2023-05-16T13:54:01.722051+0000","last_in_change":"2023-05-16T13:53:52.331336+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-16T13:54:00.885009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-16T13:54:08.327895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-16T13:54:12.864823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-16T13:54:14.180225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4ce0f0ba-c4bf-4405-8c95-d2e9a62878ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6809","nonce":3462013698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6811","nonce":3462013698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6815","nonce":3462013698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6813","nonce":3462013698}]},"public_addr":"172.21.15.39:6809/3462013698","cluster_addr":"172.21.15.39:6811/3462013698","heartbeat_back_addr":"172.21.15.39:6815/3462013698","heartbeat_front_addr":"172.21.15.39:6813/3462013698","state":["exists","up"]},{"osd":1,"uuid":"53fdc1ac-2473-472d-af32-2760fdf6e476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6801","nonce":2829970892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6803","nonce":2829970892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6807","nonce":2829970892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6805","nonce":2829970892}]},"public_addr":"172.21.15.39:6801/2829970892","cluster_addr":"172.21.15.39:6803/2829970892","heartbeat_back_addr":"172.21.15.39:6807/2829970892","heartbeat_front_addr":"172.21.15.39:6805/2829970892","state":["exists","up"]},{"osd":2,"uuid":"0b92d770-7030-42fa-a19f-4f7f1ac113c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6817","nonce":3888067413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6819","nonce":3888067413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6823","nonce":3888067413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6821","nonce":3888067413}]},"public_addr":"172.21.15.39:6817/3888067413","cluster_addr":"172.21.15.39:6819/3888067413","heartbeat_back_addr":"172.21.15.39:6823/3888067413","heartbeat_front_addr":"172.21.15.39:6821/3888067413","state":["exists","up"]},{"osd":3,"uuid":"000d9506-cbb2-4017-b875-deca579860ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6825","nonce":405003958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6827","nonce":405003958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6831","nonce":405003958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6829","nonce":405003958}]},"public_addr":"172.21.15.39:6825/405003958","cluster_addr":"172.21.15.39:6827/405003958","heartbeat_back_addr":"172.21.15.39:6831/405003958","heartbeat_front_addr":"172.21.15.39:6829/405003958","state":["exists","up"]},{"osd":4,"uuid":"70f0dacb-e960-40c5-bf6a-183e52bbe2ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6801","nonce":3895278838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6805","nonce":3895278838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6813","nonce":3895278838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6809","nonce":3895278838}]},"public_addr":"172.21.15.118:6801/3895278838","cluster_addr":"172.21.15.118:6805/3895278838","heartbeat_back_addr":"172.21.15.118:6813/3895278838","heartbeat_front_addr":"172.21.15.118:6809/3895278838","state":["exists","up"]},{"osd":5,"uuid":"756feb54-c3ae-4a2a-8f74-85c291ba707c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6804","nonce":3513592808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6808","nonce":3513592808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6815","nonce":3513592808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6812","nonce":3513592808}]},"public_addr":"172.21.15.118:6804/3513592808","cluster_addr":"172.21.15.118:6808/3513592808","heartbeat_back_addr":"172.21.15.118:6815/3513592808","heartbeat_front_addr":"172.21.15.118:6812/3513592808","state":["exists","up"]},{"osd":6,"uuid":"c4a982c1-f497-4b0f-8a23-c77372e4621e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6824","nonce":1863656053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6827","nonce":1863656053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6831","nonce":1863656053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6829","nonce":1863656053}]},"public_addr":"172.21.15.118:6824/1863656053","cluster_addr":"172.21.15.118:6827/1863656053","heartbeat_back_addr":"172.21.15.118:6831/1863656053","heartbeat_front_addr":"172.21.15.118:6829/1863656053","state":["exists","up"]},{"osd":7,"uuid":"6f2888aa-a7ac-4e26-9159-e31817934f44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6817","nonce":3636642904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6819","nonce":3636642904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6825","nonce":3636642904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6821","nonce":3636642904}]},"public_addr":"172.21.15.118:6817/3636642904","cluster_addr":"172.21.15.118:6819/3636642904","heartbeat_back_addr":"172.21.15.118:6825/3636642904","heartbeat_front_addr":"172.21.15.118:6821/3636642904","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.717636+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.724036+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.739144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:58.079275+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:58.073921+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.930466+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.987813+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.941098+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-16T13:54:18.932 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.922+0000 7fbe75f11640 1 -- 172.21.15.39:0/40355656 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fbe5c0662b0 msgr2=0x7fbe5c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:18.932 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.922+0000 7fbe75f11640 1 --2- 172.21.15.39:0/40355656 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fbe5c0662b0 0x7fbe5c068760 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbe700c9350 tx=0x7fbe64008040 comp rx=0 tx=0).stop 2023-05-16T13:54:18.932 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.922+0000 7fbe75f11640 1 -- 172.21.15.39:0/40355656 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe700b5670 msgr2=0x7fbe700cbeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:18.932 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.922+0000 7fbe75f11640 1 --2- 172.21.15.39:0/40355656 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe700b5670 0x7fbe700cbeb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbe60019020 tx=0x7fbe6001ac50 comp rx=0 tx=0).stop 2023-05-16T13:54:18.932 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.922+0000 7fbe75f11640 1 -- 172.21.15.39:0/40355656 shutdown_connections 2023-05-16T13:54:18.933 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.922+0000 7fbe75f11640 1 --2- 172.21.15.39:0/40355656 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fbe5c0662b0 0x7fbe5c068760 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:18.933 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.922+0000 7fbe75f11640 1 --2- 172.21.15.39:0/40355656 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbe700b5b10 0x7fbe700c9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:18.933 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.922+0000 7fbe75f11640 1 --2- 172.21.15.39:0/40355656 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe7015c470 0x7fbe7015ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:18.933 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.926+0000 7fbe75f11640 1 --2- 172.21.15.39:0/40355656 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe700b5670 0x7fbe700cbeb0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:18.933 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.926+0000 7fbe75f11640 1 -- 172.21.15.39:0/40355656 >> 172.21.15.39:0/40355656 conn(0x7fbe7009bae0 msgr2=0x7fbe700ce5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:18.933 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.926+0000 7fbe75f11640 1 -- 172.21.15.39:0/40355656 shutdown_connections 2023-05-16T13:54:18.933 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:18.926+0000 7fbe75f11640 1 -- 172.21.15.39:0/40355656 wait complete. 2023-05-16T13:54:18.951 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-05-16T13:54:18.951 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-16T13:54:19.088 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.082+0000 7f6715bcb640 1 Processor -- start 2023-05-16T13:54:19.088 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.082+0000 7f6715bcb640 1 -- start start 2023-05-16T13:54:19.090 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.082+0000 7f6715bcb640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f67100ced10 0x7f671006fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:19.090 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.082+0000 7f6715bcb640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f67100c9cb0 0x7f67100713f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:19.090 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.082+0000 7f6715bcb640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f6710071930 0x7f671015d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:19.090 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.082+0000 7f6715bcb640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67100cf0e0 con 0x7f67100c9cb0 2023-05-16T13:54:19.090 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.082+0000 7f6715bcb640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67100c89f0 con 0x7f6710071930 2023-05-16T13:54:19.091 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.082+0000 7f6715bcb640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67100c8c40 con 0x7f67100ced10 2023-05-16T13:54:19.091 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.082+0000 7f670effd640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f67100c9cb0 0x7f67100713f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:19.091 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.082+0000 7f670effd640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f67100c9cb0 0x7f67100713f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38082/0 (socket says 172.21.15.39:38082) 2023-05-16T13:54:19.091 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.082+0000 7f670effd640 1 -- 172.21.15.39:0/1066387144 learned_addr learned my addr 172.21.15.39:0/1066387144 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:19.091 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.082+0000 7f670ffff640 1 --2- 172.21.15.39:0/1066387144 >> v2:172.21.15.118:3300/0 conn(0x7f6710071930 0x7f671015d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:19.091 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.082+0000 7f670f7fe640 1 --2- 172.21.15.39:0/1066387144 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f67100ced10 0x7f671006fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:19.091 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.082+0000 7f670effd640 1 -- 172.21.15.39:0/1066387144 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f67100ced10 msgr2=0x7f671006fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:19.091 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.082+0000 7f670effd640 1 --2- 172.21.15.39:0/1066387144 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f67100ced10 0x7f671006fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:19.092 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.082+0000 7f670effd640 1 -- 172.21.15.39:0/1066387144 >> v2:172.21.15.118:3300/0 conn(0x7f6710071930 msgr2=0x7f671015d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:19.092 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.082+0000 7f670effd640 1 --2- 172.21.15.39:0/1066387144 >> v2:172.21.15.118:3300/0 conn(0x7f6710071930 0x7f671015d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:19.092 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.082+0000 7f670effd640 1 -- 172.21.15.39:0/1066387144 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67100c8f20 con 0x7f67100c9cb0 2023-05-16T13:54:19.092 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.082+0000 7f670f7fe640 1 --2- 172.21.15.39:0/1066387144 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f67100ced10 0x7f671006fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:54:19.092 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.086+0000 7f670effd640 1 --2- 172.21.15.39:0/1066387144 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f67100c9cb0 0x7f67100713f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f67100ada00 tx=0x7f670401c180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6ea84abe1b12689 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:19.093 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.086+0000 7f670e7fc640 1 -- 172.21.15.39:0/1066387144 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67040ab600 con 0x7f67100c9cb0 2023-05-16T13:54:19.094 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.086+0000 7f670e7fc640 1 -- 172.21.15.39:0/1066387144 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67040a7050 con 0x7f67100c9cb0 2023-05-16T13:54:19.094 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.086+0000 7f670e7fc640 1 -- 172.21.15.39:0/1066387144 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67040ab980 con 0x7f67100c9cb0 2023-05-16T13:54:19.094 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.086+0000 7f6715bcb640 1 -- 172.21.15.39:0/1066387144 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f67100c9cb0 msgr2=0x7f67100713f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:19.094 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.086+0000 7f6715bcb640 1 --2- 172.21.15.39:0/1066387144 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f67100c9cb0 0x7f67100713f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f67100ada00 tx=0x7f670401c180 comp rx=0 tx=0).stop 2023-05-16T13:54:19.094 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.086+0000 7f6715bcb640 1 -- 172.21.15.39:0/1066387144 shutdown_connections 2023-05-16T13:54:19.094 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.086+0000 7f6715bcb640 1 --2- 172.21.15.39:0/1066387144 >> v2:172.21.15.118:3300/0 conn(0x7f6710071930 0x7f671015d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:19.094 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.086+0000 7f6715bcb640 1 --2- 172.21.15.39:0/1066387144 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f67100c9cb0 0x7f67100713f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:19.095 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.086+0000 7f6715bcb640 1 --2- 172.21.15.39:0/1066387144 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f67100ced10 0x7f671006fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:19.095 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.086+0000 7f6715bcb640 1 -- 172.21.15.39:0/1066387144 >> 172.21.15.39:0/1066387144 conn(0x7f6710069a50 msgr2=0x7f6710069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:19.095 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.086+0000 7f6715bcb640 1 -- 172.21.15.39:0/1066387144 shutdown_connections 2023-05-16T13:54:19.095 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.086+0000 7f6715bcb640 1 -- 172.21.15.39:0/1066387144 wait complete. 2023-05-16T13:54:19.095 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.086+0000 7f6715bcb640 1 Processor -- start 2023-05-16T13:54:19.096 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.090+0000 7f6715bcb640 1 -- start start 2023-05-16T13:54:19.098 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.090+0000 7f6715bcb640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6710071930 0x7f671014d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:19.098 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.090+0000 7f6715bcb640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f67100c9cb0 0x7f67100cc950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:19.098 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.090+0000 7f6715bcb640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f67100ced10 0x7f67100b2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:19.098 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.090+0000 7f6715bcb640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f671014db50 con 0x7f6710071930 2023-05-16T13:54:19.099 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.090+0000 7f6715bcb640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f671014f1c0 con 0x7f67100ced10 2023-05-16T13:54:19.099 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.090+0000 7f6715bcb640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f671014eeb0 con 0x7f67100c9cb0 2023-05-16T13:54:19.099 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.090+0000 7f670f7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6710071930 0x7f671014d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:19.099 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.090+0000 7f670f7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6710071930 0x7f671014d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38088/0 (socket says 172.21.15.39:38088) 2023-05-16T13:54:19.099 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.090+0000 7f670f7fe640 1 -- 172.21.15.39:0/562623028 learned_addr learned my addr 172.21.15.39:0/562623028 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:19.099 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.090+0000 7f670f7fe640 1 -- 172.21.15.39:0/562623028 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f67100c9cb0 msgr2=0x7f67100cc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:19.099 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.090+0000 7f670f7fe640 1 --2- 172.21.15.39:0/562623028 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f67100c9cb0 0x7f67100cc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:19.100 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.090+0000 7f670ffff640 1 --2- 172.21.15.39:0/562623028 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f67100ced10 0x7f67100b2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:19.100 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.090+0000 7f670f7fe640 1 -- 172.21.15.39:0/562623028 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f67100ced10 msgr2=0x7f67100b2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:19.100 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.090+0000 7f670f7fe640 1 --2- 172.21.15.39:0/562623028 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f67100ced10 0x7f67100b2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:19.100 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.090+0000 7f670f7fe640 1 -- 172.21.15.39:0/562623028 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67040094d0 con 0x7f6710071930 2023-05-16T13:54:19.100 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.090+0000 7f670ffff640 1 --2- 172.21.15.39:0/562623028 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f67100ced10 0x7f67100b2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-16T13:54:19.100 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.090+0000 7f670f7fe640 1 --2- 172.21.15.39:0/562623028 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6710071930 0x7f671014d610 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f670000d830 tx=0x7f670000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:19.100 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.090+0000 7f66f7fff640 1 -- 172.21.15.39:0/562623028 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67000096c0 con 0x7f6710071930 2023-05-16T13:54:19.100 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.090+0000 7f66f7fff640 1 -- 172.21.15.39:0/562623028 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6700009820 con 0x7f6710071930 2023-05-16T13:54:19.101 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.090+0000 7f66f7fff640 1 -- 172.21.15.39:0/562623028 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6700009bd0 con 0x7f6710071930 2023-05-16T13:54:19.101 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.090+0000 7f6715bcb640 1 -- 172.21.15.39:0/562623028 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67100b42f0 con 0x7f6710071930 2023-05-16T13:54:19.101 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.090+0000 7f6715bcb640 1 -- 172.21.15.39:0/562623028 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67100c97c0 con 0x7f6710071930 2023-05-16T13:54:19.102 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.090+0000 7f6715bcb640 1 -- 172.21.15.39:0/562623028 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6710071d30 con 0x7f6710071930 2023-05-16T13:54:19.102 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.094+0000 7f66f7fff640 1 -- 172.21.15.39:0/562623028 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6700009d30 con 0x7f6710071930 2023-05-16T13:54:19.102 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.094+0000 7f66f7fff640 1 --2- 172.21.15.39:0/562623028 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f66fc066280 0x7f66fc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:19.102 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.094+0000 7f66f7fff640 1 -- 172.21.15.39:0/562623028 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f67000845b0 con 0x7f6710071930 2023-05-16T13:54:19.102 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.094+0000 7f670effd640 1 --2- 172.21.15.39:0/562623028 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f66fc066280 0x7f66fc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:19.102 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.094+0000 7f670effd640 1 --2- 172.21.15.39:0/562623028 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f66fc066280 0x7f66fc068730 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f67040ad000 tx=0x7f6704008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:19.104 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.098+0000 7f66f7fff640 1 -- 172.21.15.39:0/562623028 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f6700051990 con 0x7f6710071930 2023-05-16T13:54:19.254 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.246+0000 7f6715bcb640 1 -- 172.21.15.39:0/562623028 --> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f671014eff0 con 0x7f66fc066280 2023-05-16T13:54:19.264 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.258+0000 7f66f7fff640 1 -- 172.21.15.39:0/562623028 <== mgr.4098 v2:172.21.15.39:6832/288296800 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286738 (secure 0 0 0) 0x7f671014eff0 con 0x7f66fc066280 2023-05-16T13:54:19.265 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:54:19.268 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2023-05-16T13:54:19.269 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.262+0000 7f6715bcb640 1 -- 172.21.15.39:0/562623028 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f66fc066280 msgr2=0x7f66fc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:19.269 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.262+0000 7f6715bcb640 1 --2- 172.21.15.39:0/562623028 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f66fc066280 0x7f66fc068730 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f67040ad000 tx=0x7f6704008040 comp rx=0 tx=0).stop 2023-05-16T13:54:19.269 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.262+0000 7f6715bcb640 1 -- 172.21.15.39:0/562623028 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6710071930 msgr2=0x7f671014d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:19.270 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.262+0000 7f6715bcb640 1 --2- 172.21.15.39:0/562623028 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6710071930 0x7f671014d610 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f670000d830 tx=0x7f670000dcf0 comp rx=0 tx=0).stop 2023-05-16T13:54:19.270 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.262+0000 7f6715bcb640 1 -- 172.21.15.39:0/562623028 shutdown_connections 2023-05-16T13:54:19.270 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.262+0000 7f6715bcb640 1 --2- 172.21.15.39:0/562623028 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f66fc066280 0x7f66fc068730 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:19.270 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.262+0000 7f6715bcb640 1 --2- 172.21.15.39:0/562623028 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f67100c9cb0 0x7f67100cc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:19.270 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.262+0000 7f6715bcb640 1 --2- 172.21.15.39:0/562623028 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f67100ced10 0x7f67100b2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:19.270 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.262+0000 7f6715bcb640 1 --2- 172.21.15.39:0/562623028 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6710071930 0x7f671014d610 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:19.270 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.262+0000 7f6715bcb640 1 -- 172.21.15.39:0/562623028 >> 172.21.15.39:0/562623028 conn(0x7f6710069a50 msgr2=0x7f67100ca290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:19.270 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.262+0000 7f6715bcb640 1 -- 172.21.15.39:0/562623028 shutdown_connections 2023-05-16T13:54:19.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.262+0000 7f6715bcb640 1 -- 172.21.15.39:0/562623028 wait complete. 2023-05-16T13:54:19.287 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-05-16T13:54:18.830060+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":148,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":90648,"kb_used_data":3032,"kb_used_omap":0,"kb_used_meta":87552,"kb_avail":754884072,"statfs":{"total":773094113280,"available":773001289728,"internally_reserved":0,"allocated":3104768,"data_stored":1854607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":89653248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.041404"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.213610+0000","last_change":"2023-05-16T13:54:15.211201+0000","last_active":"2023-05-16T13:54:15.213610+0000","last_peered":"2023-05-16T13:54:15.213610+0000","last_clean":"2023-05-16T13:54:15.213610+0000","last_became_active":"2023-05-16T13:54:15.210864+0000","last_became_peered":"2023-05-16T13:54:15.210864+0000","last_unstale":"2023-05-16T13:54:15.213610+0000","last_undegraded":"2023-05-16T13:54:15.213610+0000","last_fullsized":"2023-05-16T13:54:15.213610+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:43:44.249467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.230493+0000","last_change":"2023-05-16T13:54:15.225613+0000","last_active":"2023-05-16T13:54:15.230493+0000","last_peered":"2023-05-16T13:54:15.230493+0000","last_clean":"2023-05-16T13:54:15.230493+0000","last_became_active":"2023-05-16T13:54:15.225255+0000","last_became_peered":"2023-05-16T13:54:15.225255+0000","last_unstale":"2023-05-16T13:54:15.230493+0000","last_undegraded":"2023-05-16T13:54:15.230493+0000","last_fullsized":"2023-05-16T13:54:15.230493+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T20:48:13.566178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.203170+0000","last_change":"2023-05-16T13:54:15.228669+0000","last_active":"2023-05-16T13:54:16.203170+0000","last_peered":"2023-05-16T13:54:16.203170+0000","last_clean":"2023-05-16T13:54:16.203170+0000","last_became_active":"2023-05-16T13:54:15.228389+0000","last_became_peered":"2023-05-16T13:54:15.228389+0000","last_unstale":"2023-05-16T13:54:16.203170+0000","last_undegraded":"2023-05-16T13:54:16.203170+0000","last_fullsized":"2023-05-16T13:54:16.203170+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:58:10.666710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.201977+0000","last_change":"2023-05-16T13:54:15.228352+0000","last_active":"2023-05-16T13:54:16.201977+0000","last_peered":"2023-05-16T13:54:16.201977+0000","last_clean":"2023-05-16T13:54:16.201977+0000","last_became_active":"2023-05-16T13:54:15.228013+0000","last_became_peered":"2023-05-16T13:54:15.228013+0000","last_unstale":"2023-05-16T13:54:16.201977+0000","last_undegraded":"2023-05-16T13:54:16.201977+0000","last_fullsized":"2023-05-16T13:54:16.201977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:43:13.895642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.237398+0000","last_change":"2023-05-16T13:54:15.232326+0000","last_active":"2023-05-16T13:54:15.237398+0000","last_peered":"2023-05-16T13:54:15.237398+0000","last_clean":"2023-05-16T13:54:15.237398+0000","last_became_active":"2023-05-16T13:54:15.231852+0000","last_became_peered":"2023-05-16T13:54:15.231852+0000","last_unstale":"2023-05-16T13:54:15.237398+0000","last_undegraded":"2023-05-16T13:54:15.237398+0000","last_fullsized":"2023-05-16T13:54:15.237398+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T14:42:43.545307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.202661+0000","last_change":"2023-05-16T13:54:15.228982+0000","last_active":"2023-05-16T13:54:16.202661+0000","last_peered":"2023-05-16T13:54:16.202661+0000","last_clean":"2023-05-16T13:54:16.202661+0000","last_became_active":"2023-05-16T13:54:15.228468+0000","last_became_peered":"2023-05-16T13:54:15.228468+0000","last_unstale":"2023-05-16T13:54:16.202661+0000","last_undegraded":"2023-05-16T13:54:16.202661+0000","last_fullsized":"2023-05-16T13:54:16.202661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T16:19:34.312806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.234289+0000","last_change":"2023-05-16T13:54:15.217211+0000","last_active":"2023-05-16T13:54:16.234289+0000","last_peered":"2023-05-16T13:54:16.234289+0000","last_clean":"2023-05-16T13:54:16.234289+0000","last_became_active":"2023-05-16T13:54:15.216921+0000","last_became_peered":"2023-05-16T13:54:15.216921+0000","last_unstale":"2023-05-16T13:54:16.234289+0000","last_undegraded":"2023-05-16T13:54:16.234289+0000","last_fullsized":"2023-05-16T13:54:16.234289+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:05:33.250909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.226141+0000","last_change":"2023-05-16T13:54:15.220276+0000","last_active":"2023-05-16T13:54:15.226141+0000","last_peered":"2023-05-16T13:54:15.226141+0000","last_clean":"2023-05-16T13:54:15.226141+0000","last_became_active":"2023-05-16T13:54:15.219893+0000","last_became_peered":"2023-05-16T13:54:15.219893+0000","last_unstale":"2023-05-16T13:54:15.226141+0000","last_undegraded":"2023-05-16T13:54:15.226141+0000","last_fullsized":"2023-05-16T13:54:15.226141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:28:13.026725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.237688+0000","last_change":"2023-05-16T13:54:15.233844+0000","last_active":"2023-05-16T13:54:15.237688+0000","last_peered":"2023-05-16T13:54:15.237688+0000","last_clean":"2023-05-16T13:54:15.237688+0000","last_became_active":"2023-05-16T13:54:15.232864+0000","last_became_peered":"2023-05-16T13:54:15.232864+0000","last_unstale":"2023-05-16T13:54:15.237688+0000","last_undegraded":"2023-05-16T13:54:15.237688+0000","last_fullsized":"2023-05-16T13:54:15.237688+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:43:44.249467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.230907+0000","last_change":"2023-05-16T13:54:15.229695+0000","last_active":"2023-05-16T13:54:15.230907+0000","last_peered":"2023-05-16T13:54:15.230907+0000","last_clean":"2023-05-16T13:54:15.230907+0000","last_became_active":"2023-05-16T13:54:15.229428+0000","last_became_peered":"2023-05-16T13:54:15.229428+0000","last_unstale":"2023-05-16T13:54:15.230907+0000","last_undegraded":"2023-05-16T13:54:15.230907+0000","last_fullsized":"2023-05-16T13:54:15.230907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T18:27:40.065469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.203185+0000","last_change":"2023-05-16T13:54:15.223655+0000","last_active":"2023-05-16T13:54:16.203185+0000","last_peered":"2023-05-16T13:54:16.203185+0000","last_clean":"2023-05-16T13:54:16.203185+0000","last_became_active":"2023-05-16T13:54:15.223324+0000","last_became_peered":"2023-05-16T13:54:15.223324+0000","last_unstale":"2023-05-16T13:54:16.203185+0000","last_undegraded":"2023-05-16T13:54:16.203185+0000","last_fullsized":"2023-05-16T13:54:16.203185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:34:27.280408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.235164+0000","last_change":"2023-05-16T13:54:15.231258+0000","last_active":"2023-05-16T13:54:15.235164+0000","last_peered":"2023-05-16T13:54:15.235164+0000","last_clean":"2023-05-16T13:54:15.235164+0000","last_became_active":"2023-05-16T13:54:15.230996+0000","last_became_peered":"2023-05-16T13:54:15.230996+0000","last_unstale":"2023-05-16T13:54:15.235164+0000","last_undegraded":"2023-05-16T13:54:15.235164+0000","last_fullsized":"2023-05-16T13:54:15.235164+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T14:42:43.545307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.213533+0000","last_change":"2023-05-16T13:54:15.211137+0000","last_active":"2023-05-16T13:54:15.213533+0000","last_peered":"2023-05-16T13:54:15.213533+0000","last_clean":"2023-05-16T13:54:15.213533+0000","last_became_active":"2023-05-16T13:54:15.210834+0000","last_became_peered":"2023-05-16T13:54:15.210834+0000","last_unstale":"2023-05-16T13:54:15.213533+0000","last_undegraded":"2023-05-16T13:54:15.213533+0000","last_fullsized":"2023-05-16T13:54:15.213533+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T20:57:05.676569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.229985+0000","last_change":"2023-05-16T13:54:15.222527+0000","last_active":"2023-05-16T13:54:15.229985+0000","last_peered":"2023-05-16T13:54:15.229985+0000","last_clean":"2023-05-16T13:54:15.229985+0000","last_became_active":"2023-05-16T13:54:15.222111+0000","last_became_peered":"2023-05-16T13:54:15.222111+0000","last_unstale":"2023-05-16T13:54:15.229985+0000","last_undegraded":"2023-05-16T13:54:15.229985+0000","last_fullsized":"2023-05-16T13:54:15.229985+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T16:38:03.641008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.234380+0000","last_change":"2023-05-16T13:54:15.224759+0000","last_active":"2023-05-16T13:54:16.234380+0000","last_peered":"2023-05-16T13:54:16.234380+0000","last_clean":"2023-05-16T13:54:16.234380+0000","last_became_active":"2023-05-16T13:54:15.224486+0000","last_became_peered":"2023-05-16T13:54:15.224486+0000","last_unstale":"2023-05-16T13:54:16.234380+0000","last_undegraded":"2023-05-16T13:54:16.234380+0000","last_fullsized":"2023-05-16T13:54:16.234380+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:23:36.578764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.201645+0000","last_change":"2023-05-16T13:54:15.231690+0000","last_active":"2023-05-16T13:54:16.201645+0000","last_peered":"2023-05-16T13:54:16.201645+0000","last_clean":"2023-05-16T13:54:16.201645+0000","last_became_active":"2023-05-16T13:54:15.231041+0000","last_became_peered":"2023-05-16T13:54:15.231041+0000","last_unstale":"2023-05-16T13:54:16.201645+0000","last_undegraded":"2023-05-16T13:54:16.201645+0000","last_fullsized":"2023-05-16T13:54:16.201645+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:58:22.882260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.237699+0000","last_change":"2023-05-16T13:54:15.234033+0000","last_active":"2023-05-16T13:54:15.237699+0000","last_peered":"2023-05-16T13:54:15.237699+0000","last_clean":"2023-05-16T13:54:15.237699+0000","last_became_active":"2023-05-16T13:54:15.233573+0000","last_became_peered":"2023-05-16T13:54:15.233573+0000","last_unstale":"2023-05-16T13:54:15.237699+0000","last_undegraded":"2023-05-16T13:54:15.237699+0000","last_fullsized":"2023-05-16T13:54:15.237699+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:21:03.147698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.203259+0000","last_change":"2023-05-16T13:54:15.217992+0000","last_active":"2023-05-16T13:54:16.203259+0000","last_peered":"2023-05-16T13:54:16.203259+0000","last_clean":"2023-05-16T13:54:16.203259+0000","last_became_active":"2023-05-16T13:54:15.217320+0000","last_became_peered":"2023-05-16T13:54:15.217320+0000","last_unstale":"2023-05-16T13:54:16.203259+0000","last_undegraded":"2023-05-16T13:54:16.203259+0000","last_fullsized":"2023-05-16T13:54:16.203259+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:03:24.701966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.213373+0000","last_change":"2023-05-16T13:54:15.209420+0000","last_active":"2023-05-16T13:54:15.213373+0000","last_peered":"2023-05-16T13:54:15.213373+0000","last_clean":"2023-05-16T13:54:15.213373+0000","last_became_active":"2023-05-16T13:54:15.208345+0000","last_became_peered":"2023-05-16T13:54:15.208345+0000","last_unstale":"2023-05-16T13:54:15.213373+0000","last_undegraded":"2023-05-16T13:54:15.213373+0000","last_fullsized":"2023-05-16T13:54:15.213373+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:21:03.147698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.202730+0000","last_change":"2023-05-16T13:54:15.214941+0000","last_active":"2023-05-16T13:54:16.202730+0000","last_peered":"2023-05-16T13:54:16.202730+0000","last_clean":"2023-05-16T13:54:16.202730+0000","last_became_active":"2023-05-16T13:54:15.214581+0000","last_became_peered":"2023-05-16T13:54:15.214581+0000","last_unstale":"2023-05-16T13:54:16.202730+0000","last_undegraded":"2023-05-16T13:54:16.202730+0000","last_fullsized":"2023-05-16T13:54:16.202730+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:53:50.523933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.234462+0000","last_change":"2023-05-16T13:54:15.222860+0000","last_active":"2023-05-16T13:54:16.234462+0000","last_peered":"2023-05-16T13:54:16.234462+0000","last_clean":"2023-05-16T13:54:16.234462+0000","last_became_active":"2023-05-16T13:54:15.222149+0000","last_became_peered":"2023-05-16T13:54:15.222149+0000","last_unstale":"2023-05-16T13:54:16.234462+0000","last_undegraded":"2023-05-16T13:54:16.234462+0000","last_fullsized":"2023-05-16T13:54:16.234462+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:51:04.272951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.237130+0000","last_change":"2023-05-16T13:54:15.228300+0000","last_active":"2023-05-16T13:54:15.237130+0000","last_peered":"2023-05-16T13:54:15.237130+0000","last_clean":"2023-05-16T13:54:15.237130+0000","last_became_active":"2023-05-16T13:54:15.227773+0000","last_became_peered":"2023-05-16T13:54:15.227773+0000","last_unstale":"2023-05-16T13:54:15.237130+0000","last_undegraded":"2023-05-16T13:54:15.237130+0000","last_fullsized":"2023-05-16T13:54:15.237130+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T20:57:05.676569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.234149+0000","last_change":"2023-05-16T13:54:15.228240+0000","last_active":"2023-05-16T13:54:15.234149+0000","last_peered":"2023-05-16T13:54:15.234149+0000","last_clean":"2023-05-16T13:54:15.234149+0000","last_became_active":"2023-05-16T13:54:15.227927+0000","last_became_peered":"2023-05-16T13:54:15.227927+0000","last_unstale":"2023-05-16T13:54:15.234149+0000","last_undegraded":"2023-05-16T13:54:15.234149+0000","last_fullsized":"2023-05-16T13:54:15.234149+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T15:06:46.071541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.234446+0000","last_change":"2023-05-16T13:54:15.221851+0000","last_active":"2023-05-16T13:54:16.234446+0000","last_peered":"2023-05-16T13:54:16.234446+0000","last_clean":"2023-05-16T13:54:16.234446+0000","last_became_active":"2023-05-16T13:54:15.221511+0000","last_became_peered":"2023-05-16T13:54:15.221511+0000","last_unstale":"2023-05-16T13:54:16.234446+0000","last_undegraded":"2023-05-16T13:54:16.234446+0000","last_fullsized":"2023-05-16T13:54:16.234446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:18:56.753459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.227657+0000","last_change":"2023-05-16T13:54:15.224061+0000","last_active":"2023-05-16T13:54:15.227657+0000","last_peered":"2023-05-16T13:54:15.227657+0000","last_clean":"2023-05-16T13:54:15.227657+0000","last_became_active":"2023-05-16T13:54:15.223626+0000","last_became_peered":"2023-05-16T13:54:15.223626+0000","last_unstale":"2023-05-16T13:54:15.227657+0000","last_undegraded":"2023-05-16T13:54:15.227657+0000","last_fullsized":"2023-05-16T13:54:15.227657+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:00:33.678077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.224778+0000","last_change":"2023-05-16T13:54:15.216383+0000","last_active":"2023-05-16T13:54:15.224778+0000","last_peered":"2023-05-16T13:54:15.224778+0000","last_clean":"2023-05-16T13:54:15.224778+0000","last_became_active":"2023-05-16T13:54:15.216056+0000","last_became_peered":"2023-05-16T13:54:15.216056+0000","last_unstale":"2023-05-16T13:54:15.224778+0000","last_undegraded":"2023-05-16T13:54:15.224778+0000","last_fullsized":"2023-05-16T13:54:15.224778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T16:13:53.275348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.230327+0000","last_change":"2023-05-16T13:54:15.223638+0000","last_active":"2023-05-16T13:54:15.230327+0000","last_peered":"2023-05-16T13:54:15.230327+0000","last_clean":"2023-05-16T13:54:15.230327+0000","last_became_active":"2023-05-16T13:54:15.223140+0000","last_became_peered":"2023-05-16T13:54:15.223140+0000","last_unstale":"2023-05-16T13:54:15.230327+0000","last_undegraded":"2023-05-16T13:54:15.230327+0000","last_fullsized":"2023-05-16T13:54:15.230327+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T18:16:21.868926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.221702+0000","last_change":"2023-05-16T13:54:15.215238+0000","last_active":"2023-05-16T13:54:15.221702+0000","last_peered":"2023-05-16T13:54:15.221702+0000","last_clean":"2023-05-16T13:54:15.221702+0000","last_became_active":"2023-05-16T13:54:15.214974+0000","last_became_peered":"2023-05-16T13:54:15.214974+0000","last_unstale":"2023-05-16T13:54:15.221702+0000","last_undegraded":"2023-05-16T13:54:15.221702+0000","last_fullsized":"2023-05-16T13:54:15.221702+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:22:57.186846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.227100+0000","last_change":"2023-05-16T13:54:15.220178+0000","last_active":"2023-05-16T13:54:15.227100+0000","last_peered":"2023-05-16T13:54:15.227100+0000","last_clean":"2023-05-16T13:54:15.227100+0000","last_became_active":"2023-05-16T13:54:15.219892+0000","last_became_peered":"2023-05-16T13:54:15.219892+0000","last_unstale":"2023-05-16T13:54:15.227100+0000","last_undegraded":"2023-05-16T13:54:15.227100+0000","last_fullsized":"2023-05-16T13:54:15.227100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:41:21.218437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.202938+0000","last_change":"2023-05-16T13:54:15.211537+0000","last_active":"2023-05-16T13:54:16.202938+0000","last_peered":"2023-05-16T13:54:16.202938+0000","last_clean":"2023-05-16T13:54:16.202938+0000","last_became_active":"2023-05-16T13:54:15.211186+0000","last_became_peered":"2023-05-16T13:54:15.211186+0000","last_unstale":"2023-05-16T13:54:16.202938+0000","last_undegraded":"2023-05-16T13:54:16.202938+0000","last_fullsized":"2023-05-16T13:54:16.202938+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:23:36.578764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.225085+0000","last_change":"2023-05-16T13:54:15.217651+0000","last_active":"2023-05-16T13:54:15.225085+0000","last_peered":"2023-05-16T13:54:15.225085+0000","last_clean":"2023-05-16T13:54:15.225085+0000","last_became_active":"2023-05-16T13:54:15.217294+0000","last_became_peered":"2023-05-16T13:54:15.217294+0000","last_unstale":"2023-05-16T13:54:15.225085+0000","last_undegraded":"2023-05-16T13:54:15.225085+0000","last_fullsized":"2023-05-16T13:54:15.225085+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:43:13.895642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.201794+0000","last_change":"2023-05-16T13:54:15.217531+0000","last_active":"2023-05-16T13:54:16.201794+0000","last_peered":"2023-05-16T13:54:16.201794+0000","last_clean":"2023-05-16T13:54:16.201794+0000","last_became_active":"2023-05-16T13:54:15.217002+0000","last_became_peered":"2023-05-16T13:54:15.217002+0000","last_unstale":"2023-05-16T13:54:16.201794+0000","last_undegraded":"2023-05-16T13:54:16.201794+0000","last_fullsized":"2023-05-16T13:54:16.201794+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:10:29.866761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.232695+0000","last_change":"2023-05-16T13:54:15.223492+0000","last_active":"2023-05-16T13:54:15.232695+0000","last_peered":"2023-05-16T13:54:15.232695+0000","last_clean":"2023-05-16T13:54:15.232695+0000","last_became_active":"2023-05-16T13:54:15.223220+0000","last_became_peered":"2023-05-16T13:54:15.223220+0000","last_unstale":"2023-05-16T13:54:15.232695+0000","last_undegraded":"2023-05-16T13:54:15.232695+0000","last_fullsized":"2023-05-16T13:54:15.232695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:47:42.238742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.234538+0000","last_change":"2023-05-16T13:54:14.826021+0000","last_active":"2023-05-16T13:54:16.234538+0000","last_peered":"2023-05-16T13:54:16.234538+0000","last_clean":"2023-05-16T13:54:16.234538+0000","last_became_active":"2023-05-16T13:54:14.820310+0000","last_became_peered":"2023-05-16T13:54:14.820310+0000","last_unstale":"2023-05-16T13:54:16.234538+0000","last_undegraded":"2023-05-16T13:54:16.234538+0000","last_fullsized":"2023-05-16T13:54:16.234538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:58:09.660328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.230300+0000","last_change":"2023-05-16T13:54:15.223399+0000","last_active":"2023-05-16T13:54:15.230300+0000","last_peered":"2023-05-16T13:54:15.230300+0000","last_clean":"2023-05-16T13:54:15.230300+0000","last_became_active":"2023-05-16T13:54:15.222860+0000","last_became_peered":"2023-05-16T13:54:15.222860+0000","last_unstale":"2023-05-16T13:54:15.230300+0000","last_undegraded":"2023-05-16T13:54:15.230300+0000","last_fullsized":"2023-05-16T13:54:15.230300+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:20:01.628237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.212946+0000","last_change":"2023-05-16T13:54:14.811666+0000","last_active":"2023-05-16T13:54:15.212946+0000","last_peered":"2023-05-16T13:54:15.212946+0000","last_clean":"2023-05-16T13:54:15.212946+0000","last_became_active":"2023-05-16T13:54:14.811282+0000","last_became_peered":"2023-05-16T13:54:14.811282+0000","last_unstale":"2023-05-16T13:54:15.212946+0000","last_undegraded":"2023-05-16T13:54:15.212946+0000","last_fullsized":"2023-05-16T13:54:15.212946+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T16:13:52.268965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.237267+0000","last_change":"2023-05-16T13:54:15.229301+0000","last_active":"2023-05-16T13:54:15.237267+0000","last_peered":"2023-05-16T13:54:15.237267+0000","last_clean":"2023-05-16T13:54:15.237267+0000","last_became_active":"2023-05-16T13:54:15.228861+0000","last_became_peered":"2023-05-16T13:54:15.228861+0000","last_unstale":"2023-05-16T13:54:15.237267+0000","last_undegraded":"2023-05-16T13:54:15.237267+0000","last_fullsized":"2023-05-16T13:54:15.237267+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T14:55:56.380737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.234451+0000","last_change":"2023-05-16T13:54:14.822092+0000","last_active":"2023-05-16T13:54:16.234451+0000","last_peered":"2023-05-16T13:54:16.234451+0000","last_clean":"2023-05-16T13:54:16.234451+0000","last_became_active":"2023-05-16T13:54:14.820716+0000","last_became_peered":"2023-05-16T13:54:14.820716+0000","last_unstale":"2023-05-16T13:54:16.234451+0000","last_undegraded":"2023-05-16T13:54:16.234451+0000","last_fullsized":"2023-05-16T13:54:16.234451+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T20:40:58.823162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.232733+0000","last_change":"2023-05-16T13:54:15.222372+0000","last_active":"2023-05-16T13:54:15.232733+0000","last_peered":"2023-05-16T13:54:15.232733+0000","last_clean":"2023-05-16T13:54:15.232733+0000","last_became_active":"2023-05-16T13:54:15.219602+0000","last_became_peered":"2023-05-16T13:54:15.219602+0000","last_unstale":"2023-05-16T13:54:15.232733+0000","last_undegraded":"2023-05-16T13:54:15.232733+0000","last_fullsized":"2023-05-16T13:54:15.232733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:28:13.026725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.201862+0000","last_change":"2023-05-16T13:54:14.814991+0000","last_active":"2023-05-16T13:54:16.201862+0000","last_peered":"2023-05-16T13:54:16.201862+0000","last_clean":"2023-05-16T13:54:16.201862+0000","last_became_active":"2023-05-16T13:54:14.814571+0000","last_became_peered":"2023-05-16T13:54:14.814571+0000","last_unstale":"2023-05-16T13:54:16.201862+0000","last_undegraded":"2023-05-16T13:54:16.201862+0000","last_fullsized":"2023-05-16T13:54:16.201862+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T16:38:02.634625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.234878+0000","last_change":"2023-05-16T13:54:14.821745+0000","last_active":"2023-05-16T13:54:16.234878+0000","last_peered":"2023-05-16T13:54:16.234878+0000","last_clean":"2023-05-16T13:54:16.234878+0000","last_became_active":"2023-05-16T13:54:14.820978+0000","last_became_peered":"2023-05-16T13:54:14.820978+0000","last_unstale":"2023-05-16T13:54:16.234878+0000","last_undegraded":"2023-05-16T13:54:16.234878+0000","last_fullsized":"2023-05-16T13:54:16.234878+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:15:56.752324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.226160+0000","last_change":"2023-05-16T13:54:15.220768+0000","last_active":"2023-05-16T13:54:15.226160+0000","last_peered":"2023-05-16T13:54:15.226160+0000","last_clean":"2023-05-16T13:54:15.226160+0000","last_became_active":"2023-05-16T13:54:15.220494+0000","last_became_peered":"2023-05-16T13:54:15.220494+0000","last_unstale":"2023-05-16T13:54:15.226160+0000","last_undegraded":"2023-05-16T13:54:15.226160+0000","last_fullsized":"2023-05-16T13:54:15.226160+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:41:21.218437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.234833+0000","last_change":"2023-05-16T13:54:14.821942+0000","last_active":"2023-05-16T13:54:16.234833+0000","last_peered":"2023-05-16T13:54:16.234833+0000","last_clean":"2023-05-16T13:54:16.234833+0000","last_became_active":"2023-05-16T13:54:14.821539+0000","last_became_peered":"2023-05-16T13:54:14.821539+0000","last_unstale":"2023-05-16T13:54:16.234833+0000","last_undegraded":"2023-05-16T13:54:16.234833+0000","last_fullsized":"2023-05-16T13:54:16.234833+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T23:19:38.774487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.201687+0000","last_change":"2023-05-16T13:54:15.218507+0000","last_active":"2023-05-16T13:54:16.201687+0000","last_peered":"2023-05-16T13:54:16.201687+0000","last_clean":"2023-05-16T13:54:16.201687+0000","last_became_active":"2023-05-16T13:54:15.218014+0000","last_became_peered":"2023-05-16T13:54:15.218014+0000","last_unstale":"2023-05-16T13:54:16.201687+0000","last_undegraded":"2023-05-16T13:54:16.201687+0000","last_fullsized":"2023-05-16T13:54:16.201687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:12:06.609266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.234688+0000","last_change":"2023-05-16T13:54:14.824383+0000","last_active":"2023-05-16T13:54:16.234688+0000","last_peered":"2023-05-16T13:54:16.234688+0000","last_clean":"2023-05-16T13:54:16.234688+0000","last_became_active":"2023-05-16T13:54:14.824117+0000","last_became_peered":"2023-05-16T13:54:14.824117+0000","last_unstale":"2023-05-16T13:54:16.234688+0000","last_undegraded":"2023-05-16T13:54:16.234688+0000","last_fullsized":"2023-05-16T13:54:16.234688+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:32:07.899174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.202234+0000","last_change":"2023-05-16T13:54:15.219224+0000","last_active":"2023-05-16T13:54:16.202234+0000","last_peered":"2023-05-16T13:54:16.202234+0000","last_clean":"2023-05-16T13:54:16.202234+0000","last_became_active":"2023-05-16T13:54:15.218672+0000","last_became_peered":"2023-05-16T13:54:15.218672+0000","last_unstale":"2023-05-16T13:54:16.202234+0000","last_undegraded":"2023-05-16T13:54:16.202234+0000","last_fullsized":"2023-05-16T13:54:16.202234+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T18:27:40.065469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.209580+0000","last_change":"2023-05-16T13:54:14.821843+0000","last_active":"2023-05-16T13:54:15.209580+0000","last_peered":"2023-05-16T13:54:15.209580+0000","last_clean":"2023-05-16T13:54:15.209580+0000","last_became_active":"2023-05-16T13:54:14.821386+0000","last_became_peered":"2023-05-16T13:54:14.821386+0000","last_unstale":"2023-05-16T13:54:15.209580+0000","last_undegraded":"2023-05-16T13:54:15.209580+0000","last_fullsized":"2023-05-16T13:54:15.209580+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T15:06:45.065158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.237387+0000","last_change":"2023-05-16T13:54:15.232203+0000","last_active":"2023-05-16T13:54:15.237387+0000","last_peered":"2023-05-16T13:54:15.237387+0000","last_clean":"2023-05-16T13:54:15.237387+0000","last_became_active":"2023-05-16T13:54:15.231644+0000","last_became_peered":"2023-05-16T13:54:15.231644+0000","last_unstale":"2023-05-16T13:54:15.237387+0000","last_undegraded":"2023-05-16T13:54:15.237387+0000","last_fullsized":"2023-05-16T13:54:15.237387+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:22:57.186846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.235084+0000","last_change":"2023-05-16T13:54:14.819498+0000","last_active":"2023-05-16T13:54:15.235084+0000","last_peered":"2023-05-16T13:54:15.235084+0000","last_clean":"2023-05-16T13:54:15.235084+0000","last_became_active":"2023-05-16T13:54:14.819147+0000","last_became_peered":"2023-05-16T13:54:14.819147+0000","last_unstale":"2023-05-16T13:54:15.235084+0000","last_undegraded":"2023-05-16T13:54:15.235084+0000","last_fullsized":"2023-05-16T13:54:15.235084+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:20:00.621854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.202789+0000","last_change":"2023-05-16T13:54:15.217792+0000","last_active":"2023-05-16T13:54:16.202789+0000","last_peered":"2023-05-16T13:54:16.202789+0000","last_clean":"2023-05-16T13:54:16.202789+0000","last_became_active":"2023-05-16T13:54:15.216858+0000","last_became_peered":"2023-05-16T13:54:15.216858+0000","last_unstale":"2023-05-16T13:54:16.202789+0000","last_undegraded":"2023-05-16T13:54:16.202789+0000","last_fullsized":"2023-05-16T13:54:16.202789+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T23:50:22.458202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.202400+0000","last_change":"2023-05-16T13:54:14.819120+0000","last_active":"2023-05-16T13:54:16.202400+0000","last_peered":"2023-05-16T13:54:16.202400+0000","last_clean":"2023-05-16T13:54:16.202400+0000","last_became_active":"2023-05-16T13:54:14.818822+0000","last_became_peered":"2023-05-16T13:54:14.818822+0000","last_unstale":"2023-05-16T13:54:16.202400+0000","last_undegraded":"2023-05-16T13:54:16.202400+0000","last_fullsized":"2023-05-16T13:54:16.202400+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:13:17.386163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.203317+0000","last_change":"2023-05-16T13:54:15.217748+0000","last_active":"2023-05-16T13:54:16.203317+0000","last_peered":"2023-05-16T13:54:16.203317+0000","last_clean":"2023-05-16T13:54:16.203317+0000","last_became_active":"2023-05-16T13:54:15.216101+0000","last_became_peered":"2023-05-16T13:54:15.216101+0000","last_unstale":"2023-05-16T13:54:16.203317+0000","last_undegraded":"2023-05-16T13:54:16.203317+0000","last_fullsized":"2023-05-16T13:54:16.203317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:21:33.710987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.202468+0000","last_change":"2023-05-16T13:54:14.812220+0000","last_active":"2023-05-16T13:54:16.202468+0000","last_peered":"2023-05-16T13:54:16.202468+0000","last_clean":"2023-05-16T13:54:16.202468+0000","last_became_active":"2023-05-16T13:54:14.811901+0000","last_became_peered":"2023-05-16T13:54:14.811901+0000","last_unstale":"2023-05-16T13:54:16.202468+0000","last_undegraded":"2023-05-16T13:54:16.202468+0000","last_fullsized":"2023-05-16T13:54:16.202468+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:38:12.287244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.203309+0000","last_change":"2023-05-16T13:54:15.210585+0000","last_active":"2023-05-16T13:54:16.203309+0000","last_peered":"2023-05-16T13:54:16.203309+0000","last_clean":"2023-05-16T13:54:16.203309+0000","last_became_active":"2023-05-16T13:54:15.210268+0000","last_became_peered":"2023-05-16T13:54:15.210268+0000","last_unstale":"2023-05-16T13:54:16.203309+0000","last_undegraded":"2023-05-16T13:54:16.203309+0000","last_fullsized":"2023-05-16T13:54:16.203309+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:32:08.905557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.202492+0000","last_change":"2023-05-16T13:54:14.818548+0000","last_active":"2023-05-16T13:54:15.202492+0000","last_peered":"2023-05-16T13:54:15.202492+0000","last_clean":"2023-05-16T13:54:15.202492+0000","last_became_active":"2023-05-16T13:54:14.818253+0000","last_became_peered":"2023-05-16T13:54:14.818253+0000","last_unstale":"2023-05-16T13:54:15.202492+0000","last_undegraded":"2023-05-16T13:54:15.202492+0000","last_fullsized":"2023-05-16T13:54:15.202492+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:13:17.386163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.227447+0000","last_change":"2023-05-16T13:54:15.221849+0000","last_active":"2023-05-16T13:54:15.227447+0000","last_peered":"2023-05-16T13:54:15.227447+0000","last_clean":"2023-05-16T13:54:15.227447+0000","last_became_active":"2023-05-16T13:54:15.221542+0000","last_became_peered":"2023-05-16T13:54:15.221542+0000","last_unstale":"2023-05-16T13:54:15.227447+0000","last_undegraded":"2023-05-16T13:54:15.227447+0000","last_fullsized":"2023-05-16T13:54:15.227447+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T18:03:21.802487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":175,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.234530+0000","last_change":"2023-05-16T13:54:03.495814+0000","last_active":"2023-05-16T13:54:16.234530+0000","last_peered":"2023-05-16T13:54:16.234530+0000","last_clean":"2023-05-16T13:54:16.234530+0000","last_became_active":"2023-05-16T13:54:03.494265+0000","last_became_peered":"2023-05-16T13:54:03.494265+0000","last_unstale":"2023-05-16T13:54:16.234530+0000","last_undegraded":"2023-05-16T13:54:16.234530+0000","last_fullsized":"2023-05-16T13:54:16.234530+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:01.722051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:01.722051+0000","last_clean_scrub_stamp":"2023-05-16T13:54:01.722051+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:34:14.214601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.208681+0000","last_change":"2023-05-16T13:54:09.770727+0000","last_active":"2023-05-16T13:54:15.208681+0000","last_peered":"2023-05-16T13:54:15.208681+0000","last_clean":"2023-05-16T13:54:15.208681+0000","last_became_active":"2023-05-16T13:54:09.770179+0000","last_became_peered":"2023-05-16T13:54:09.770179+0000","last_unstale":"2023-05-16T13:54:15.208681+0000","last_undegraded":"2023-05-16T13:54:15.208681+0000","last_fullsized":"2023-05-16T13:54:15.208681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:10:23.833492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.201265+0000","last_change":"2023-05-16T13:54:14.817341+0000","last_active":"2023-05-16T13:54:15.201265+0000","last_peered":"2023-05-16T13:54:15.201265+0000","last_clean":"2023-05-16T13:54:15.201265+0000","last_became_active":"2023-05-16T13:54:14.816323+0000","last_became_peered":"2023-05-16T13:54:14.816323+0000","last_unstale":"2023-05-16T13:54:15.201265+0000","last_undegraded":"2023-05-16T13:54:15.201265+0000","last_fullsized":"2023-05-16T13:54:15.201265+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T14:06:34.210491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.202234+0000","last_change":"2023-05-16T13:54:15.211549+0000","last_active":"2023-05-16T13:54:16.202234+0000","last_peered":"2023-05-16T13:54:16.202234+0000","last_clean":"2023-05-16T13:54:16.202234+0000","last_became_active":"2023-05-16T13:54:15.211277+0000","last_became_peered":"2023-05-16T13:54:15.211277+0000","last_unstale":"2023-05-16T13:54:16.202234+0000","last_undegraded":"2023-05-16T13:54:16.202234+0000","last_fullsized":"2023-05-16T13:54:16.202234+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T20:48:13.566178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.234295+0000","last_change":"2023-05-16T13:54:09.768888+0000","last_active":"2023-05-16T13:54:16.234295+0000","last_peered":"2023-05-16T13:54:16.234295+0000","last_clean":"2023-05-16T13:54:16.234295+0000","last_became_active":"2023-05-16T13:54:09.768463+0000","last_became_peered":"2023-05-16T13:54:09.768463+0000","last_unstale":"2023-05-16T13:54:16.234295+0000","last_undegraded":"2023-05-16T13:54:16.234295+0000","last_fullsized":"2023-05-16T13:54:16.234295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T14:08:30.635672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.211871+0000","last_change":"2023-05-16T13:54:14.821190+0000","last_active":"2023-05-16T13:54:15.211871+0000","last_peered":"2023-05-16T13:54:15.211871+0000","last_clean":"2023-05-16T13:54:15.211871+0000","last_became_active":"2023-05-16T13:54:14.820901+0000","last_became_peered":"2023-05-16T13:54:14.820901+0000","last_unstale":"2023-05-16T13:54:15.211871+0000","last_undegraded":"2023-05-16T13:54:15.211871+0000","last_fullsized":"2023-05-16T13:54:15.211871+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T18:23:14.075852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.237219+0000","last_change":"2023-05-16T13:54:15.229018+0000","last_active":"2023-05-16T13:54:15.237219+0000","last_peered":"2023-05-16T13:54:15.237219+0000","last_clean":"2023-05-16T13:54:15.237219+0000","last_became_active":"2023-05-16T13:54:15.228331+0000","last_became_peered":"2023-05-16T13:54:15.228331+0000","last_unstale":"2023-05-16T13:54:15.237219+0000","last_undegraded":"2023-05-16T13:54:15.237219+0000","last_fullsized":"2023-05-16T13:54:15.237219+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:01:43.505062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.196958+0000","last_change":"2023-05-16T13:54:09.821010+0000","last_active":"2023-05-16T13:54:15.196958+0000","last_peered":"2023-05-16T13:54:15.196958+0000","last_clean":"2023-05-16T13:54:15.196958+0000","last_became_active":"2023-05-16T13:54:09.820636+0000","last_became_peered":"2023-05-16T13:54:09.820636+0000","last_unstale":"2023-05-16T13:54:15.196958+0000","last_undegraded":"2023-05-16T13:54:15.196958+0000","last_fullsized":"2023-05-16T13:54:15.196958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:31:28.171875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.216724+0000","last_change":"2023-05-16T13:54:14.813276+0000","last_active":"2023-05-16T13:54:15.216724+0000","last_peered":"2023-05-16T13:54:15.216724+0000","last_clean":"2023-05-16T13:54:15.216724+0000","last_became_active":"2023-05-16T13:54:14.812929+0000","last_became_peered":"2023-05-16T13:54:14.812929+0000","last_unstale":"2023-05-16T13:54:15.216724+0000","last_undegraded":"2023-05-16T13:54:15.216724+0000","last_fullsized":"2023-05-16T13:54:15.216724+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:34:14.240375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.227608+0000","last_change":"2023-05-16T13:54:15.223291+0000","last_active":"2023-05-16T13:54:15.227608+0000","last_peered":"2023-05-16T13:54:15.227608+0000","last_clean":"2023-05-16T13:54:15.227608+0000","last_became_active":"2023-05-16T13:54:15.222994+0000","last_became_peered":"2023-05-16T13:54:15.222994+0000","last_unstale":"2023-05-16T13:54:15.227608+0000","last_undegraded":"2023-05-16T13:54:15.227608+0000","last_fullsized":"2023-05-16T13:54:15.227608+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:27:26.622822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.211975+0000","last_change":"2023-05-16T13:54:09.771040+0000","last_active":"2023-05-16T13:54:15.211975+0000","last_peered":"2023-05-16T13:54:15.211975+0000","last_clean":"2023-05-16T13:54:15.211975+0000","last_became_active":"2023-05-16T13:54:09.770433+0000","last_became_peered":"2023-05-16T13:54:09.770433+0000","last_unstale":"2023-05-16T13:54:15.211975+0000","last_undegraded":"2023-05-16T13:54:15.211975+0000","last_fullsized":"2023-05-16T13:54:15.211975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:42:33.528137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.203109+0000","last_change":"2023-05-16T13:54:14.819218+0000","last_active":"2023-05-16T13:54:16.203109+0000","last_peered":"2023-05-16T13:54:16.203109+0000","last_clean":"2023-05-16T13:54:16.203109+0000","last_became_active":"2023-05-16T13:54:14.818575+0000","last_became_peered":"2023-05-16T13:54:14.818575+0000","last_unstale":"2023-05-16T13:54:16.203109+0000","last_undegraded":"2023-05-16T13:54:16.203109+0000","last_fullsized":"2023-05-16T13:54:16.203109+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:51:03.266568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.221681+0000","last_change":"2023-05-16T13:54:15.214918+0000","last_active":"2023-05-16T13:54:15.221681+0000","last_peered":"2023-05-16T13:54:15.221681+0000","last_clean":"2023-05-16T13:54:15.221681+0000","last_became_active":"2023-05-16T13:54:15.214604+0000","last_became_peered":"2023-05-16T13:54:15.214604+0000","last_unstale":"2023-05-16T13:54:15.221681+0000","last_undegraded":"2023-05-16T13:54:15.221681+0000","last_fullsized":"2023-05-16T13:54:15.221681+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T18:23:15.082235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.212855+0000","last_change":"2023-05-16T13:54:14.823582+0000","last_active":"2023-05-16T13:54:15.212855+0000","last_peered":"2023-05-16T13:54:15.212855+0000","last_clean":"2023-05-16T13:54:15.212855+0000","last_became_active":"2023-05-16T13:54:14.822465+0000","last_became_peered":"2023-05-16T13:54:14.822465+0000","last_unstale":"2023-05-16T13:54:15.212855+0000","last_undegraded":"2023-05-16T13:54:15.212855+0000","last_fullsized":"2023-05-16T13:54:15.212855+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:58:21.875877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.221448+0000","last_change":"2023-05-16T13:54:09.813177+0000","last_active":"2023-05-16T13:54:15.221448+0000","last_peered":"2023-05-16T13:54:15.221448+0000","last_clean":"2023-05-16T13:54:15.221448+0000","last_became_active":"2023-05-16T13:54:09.812487+0000","last_became_peered":"2023-05-16T13:54:09.812487+0000","last_unstale":"2023-05-16T13:54:15.221448+0000","last_undegraded":"2023-05-16T13:54:15.221448+0000","last_fullsized":"2023-05-16T13:54:15.221448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:01:16.645390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.227557+0000","last_change":"2023-05-16T13:54:15.223198+0000","last_active":"2023-05-16T13:54:15.227557+0000","last_peered":"2023-05-16T13:54:15.227557+0000","last_clean":"2023-05-16T13:54:15.227557+0000","last_became_active":"2023-05-16T13:54:15.222906+0000","last_became_peered":"2023-05-16T13:54:15.222906+0000","last_unstale":"2023-05-16T13:54:15.227557+0000","last_undegraded":"2023-05-16T13:54:15.227557+0000","last_fullsized":"2023-05-16T13:54:15.227557+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:01:13.149263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.221304+0000","last_change":"2023-05-16T13:54:14.814607+0000","last_active":"2023-05-16T13:54:15.221304+0000","last_peered":"2023-05-16T13:54:15.221304+0000","last_clean":"2023-05-16T13:54:15.221304+0000","last_became_active":"2023-05-16T13:54:14.814268+0000","last_became_peered":"2023-05-16T13:54:14.814268+0000","last_unstale":"2023-05-16T13:54:15.221304+0000","last_undegraded":"2023-05-16T13:54:15.221304+0000","last_fullsized":"2023-05-16T13:54:15.221304+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T15:35:37.410802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.234780+0000","last_change":"2023-05-16T13:54:09.813305+0000","last_active":"2023-05-16T13:54:16.234780+0000","last_peered":"2023-05-16T13:54:16.234780+0000","last_clean":"2023-05-16T13:54:16.234780+0000","last_became_active":"2023-05-16T13:54:09.812931+0000","last_became_peered":"2023-05-16T13:54:09.812931+0000","last_unstale":"2023-05-16T13:54:16.234780+0000","last_undegraded":"2023-05-16T13:54:16.234780+0000","last_fullsized":"2023-05-16T13:54:16.234780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:21:27.677717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.237361+0000","last_change":"2023-05-16T13:54:15.232010+0000","last_active":"2023-05-16T13:54:15.237361+0000","last_peered":"2023-05-16T13:54:15.237361+0000","last_clean":"2023-05-16T13:54:15.237361+0000","last_became_active":"2023-05-16T13:54:15.231424+0000","last_became_peered":"2023-05-16T13:54:15.231424+0000","last_unstale":"2023-05-16T13:54:15.237361+0000","last_undegraded":"2023-05-16T13:54:15.237361+0000","last_fullsized":"2023-05-16T13:54:15.237361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:19:30.585369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.229404+0000","last_change":"2023-05-16T13:54:14.815504+0000","last_active":"2023-05-16T13:54:15.229404+0000","last_peered":"2023-05-16T13:54:15.229404+0000","last_clean":"2023-05-16T13:54:15.229404+0000","last_became_active":"2023-05-16T13:54:14.814336+0000","last_became_peered":"2023-05-16T13:54:14.814336+0000","last_unstale":"2023-05-16T13:54:15.229404+0000","last_undegraded":"2023-05-16T13:54:15.229404+0000","last_fullsized":"2023-05-16T13:54:15.229404+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T20:48:12.559796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.221562+0000","last_change":"2023-05-16T13:54:09.768257+0000","last_active":"2023-05-16T13:54:15.221562+0000","last_peered":"2023-05-16T13:54:15.221562+0000","last_clean":"2023-05-16T13:54:15.221562+0000","last_became_active":"2023-05-16T13:54:09.767879+0000","last_became_peered":"2023-05-16T13:54:09.767879+0000","last_unstale":"2023-05-16T13:54:15.221562+0000","last_undegraded":"2023-05-16T13:54:15.221562+0000","last_fullsized":"2023-05-16T13:54:15.221562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:23:13.709300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.225161+0000","last_change":"2023-05-16T13:54:15.219094+0000","last_active":"2023-05-16T13:54:15.225161+0000","last_peered":"2023-05-16T13:54:15.225161+0000","last_clean":"2023-05-16T13:54:15.225161+0000","last_became_active":"2023-05-16T13:54:15.210545+0000","last_became_peered":"2023-05-16T13:54:15.210545+0000","last_unstale":"2023-05-16T13:54:15.225161+0000","last_undegraded":"2023-05-16T13:54:15.225161+0000","last_fullsized":"2023-05-16T13:54:15.225161+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T20:26:37.948462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.220080+0000","last_change":"2023-05-16T13:54:14.815739+0000","last_active":"2023-05-16T13:54:15.220080+0000","last_peered":"2023-05-16T13:54:15.220080+0000","last_clean":"2023-05-16T13:54:15.220080+0000","last_became_active":"2023-05-16T13:54:14.815433+0000","last_became_peered":"2023-05-16T13:54:14.815433+0000","last_unstale":"2023-05-16T13:54:15.220080+0000","last_undegraded":"2023-05-16T13:54:15.220080+0000","last_fullsized":"2023-05-16T13:54:15.220080+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:34:14.240375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.202058+0000","last_change":"2023-05-16T13:54:09.768603+0000","last_active":"2023-05-16T13:54:16.202058+0000","last_peered":"2023-05-16T13:54:16.202058+0000","last_clean":"2023-05-16T13:54:16.202058+0000","last_became_active":"2023-05-16T13:54:09.768323+0000","last_became_peered":"2023-05-16T13:54:09.768323+0000","last_unstale":"2023-05-16T13:54:16.202058+0000","last_undegraded":"2023-05-16T13:54:16.202058+0000","last_fullsized":"2023-05-16T13:54:16.202058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T15:06:40.038271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.202380+0000","last_change":"2023-05-16T13:54:15.221843+0000","last_active":"2023-05-16T13:54:16.202380+0000","last_peered":"2023-05-16T13:54:16.202380+0000","last_clean":"2023-05-16T13:54:16.202380+0000","last_became_active":"2023-05-16T13:54:15.221485+0000","last_became_peered":"2023-05-16T13:54:15.221485+0000","last_unstale":"2023-05-16T13:54:16.202380+0000","last_undegraded":"2023-05-16T13:54:16.202380+0000","last_fullsized":"2023-05-16T13:54:16.202380+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:56:30.067725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.202990+0000","last_change":"2023-05-16T13:54:15.211685+0000","last_active":"2023-05-16T13:54:16.202990+0000","last_peered":"2023-05-16T13:54:16.202990+0000","last_clean":"2023-05-16T13:54:16.202990+0000","last_became_active":"2023-05-16T13:54:15.210427+0000","last_became_peered":"2023-05-16T13:54:15.210427+0000","last_unstale":"2023-05-16T13:54:16.202990+0000","last_undegraded":"2023-05-16T13:54:16.202990+0000","last_fullsized":"2023-05-16T13:54:16.202990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:18:56.753459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"23'6","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.202865+0000","last_change":"2023-05-16T13:54:14.818519+0000","last_active":"2023-05-16T13:54:16.202865+0000","last_peered":"2023-05-16T13:54:16.202865+0000","last_clean":"2023-05-16T13:54:16.202865+0000","last_became_active":"2023-05-16T13:54:14.818006+0000","last_became_peered":"2023-05-16T13:54:14.818006+0000","last_unstale":"2023-05-16T13:54:16.202865+0000","last_undegraded":"2023-05-16T13:54:16.202865+0000","last_fullsized":"2023-05-16T13:54:16.202865+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T14:08:35.662558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.224846+0000","last_change":"2023-05-16T13:54:15.217209+0000","last_active":"2023-05-16T13:54:15.224846+0000","last_peered":"2023-05-16T13:54:15.224846+0000","last_clean":"2023-05-16T13:54:15.224846+0000","last_became_active":"2023-05-16T13:54:15.216903+0000","last_became_peered":"2023-05-16T13:54:15.216903+0000","last_unstale":"2023-05-16T13:54:15.224846+0000","last_undegraded":"2023-05-16T13:54:15.224846+0000","last_fullsized":"2023-05-16T13:54:15.224846+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:19:30.585369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.234591+0000","last_change":"2023-05-16T13:54:14.819409+0000","last_active":"2023-05-16T13:54:16.234591+0000","last_peered":"2023-05-16T13:54:16.234591+0000","last_clean":"2023-05-16T13:54:16.234591+0000","last_became_active":"2023-05-16T13:54:14.818998+0000","last_became_peered":"2023-05-16T13:54:14.818998+0000","last_unstale":"2023-05-16T13:54:16.234591+0000","last_undegraded":"2023-05-16T13:54:16.234591+0000","last_fullsized":"2023-05-16T13:54:16.234591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:03:23.695584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.210460+0000","last_change":"2023-05-16T13:54:14.826757+0000","last_active":"2023-05-16T13:54:15.210460+0000","last_peered":"2023-05-16T13:54:15.210460+0000","last_clean":"2023-05-16T13:54:15.210460+0000","last_became_active":"2023-05-16T13:54:14.826437+0000","last_became_peered":"2023-05-16T13:54:14.826437+0000","last_unstale":"2023-05-16T13:54:15.210460+0000","last_undegraded":"2023-05-16T13:54:15.210460+0000","last_fullsized":"2023-05-16T13:54:15.210460+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:13:17.386163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.222430+0000","last_change":"2023-05-16T13:54:15.217104+0000","last_active":"2023-05-16T13:54:15.222430+0000","last_peered":"2023-05-16T13:54:15.222430+0000","last_clean":"2023-05-16T13:54:15.222430+0000","last_became_active":"2023-05-16T13:54:15.212495+0000","last_became_peered":"2023-05-16T13:54:15.212495+0000","last_unstale":"2023-05-16T13:54:15.222430+0000","last_undegraded":"2023-05-16T13:54:15.222430+0000","last_fullsized":"2023-05-16T13:54:15.222430+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:10:29.866761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.218262+0000","last_change":"2023-05-16T13:54:14.828109+0000","last_active":"2023-05-16T13:54:15.218262+0000","last_peered":"2023-05-16T13:54:15.218262+0000","last_clean":"2023-05-16T13:54:15.218262+0000","last_became_active":"2023-05-16T13:54:14.827726+0000","last_became_peered":"2023-05-16T13:54:14.827726+0000","last_unstale":"2023-05-16T13:54:15.218262+0000","last_undegraded":"2023-05-16T13:54:15.218262+0000","last_fullsized":"2023-05-16T13:54:15.218262+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T18:03:20.796104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.226692+0000","last_change":"2023-05-16T13:54:15.219614+0000","last_active":"2023-05-16T13:54:15.226692+0000","last_peered":"2023-05-16T13:54:15.226692+0000","last_clean":"2023-05-16T13:54:15.226692+0000","last_became_active":"2023-05-16T13:54:15.219282+0000","last_became_peered":"2023-05-16T13:54:15.219282+0000","last_unstale":"2023-05-16T13:54:15.226692+0000","last_undegraded":"2023-05-16T13:54:15.226692+0000","last_fullsized":"2023-05-16T13:54:15.226692+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:21:42.482045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.202073+0000","last_change":"2023-05-16T13:54:15.223067+0000","last_active":"2023-05-16T13:54:16.202073+0000","last_peered":"2023-05-16T13:54:16.202073+0000","last_clean":"2023-05-16T13:54:16.202073+0000","last_became_active":"2023-05-16T13:54:15.222802+0000","last_became_peered":"2023-05-16T13:54:15.222802+0000","last_unstale":"2023-05-16T13:54:16.202073+0000","last_undegraded":"2023-05-16T13:54:16.202073+0000","last_fullsized":"2023-05-16T13:54:16.202073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:20:01.628237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.202361+0000","last_change":"2023-05-16T13:54:14.818182+0000","last_active":"2023-05-16T13:54:15.202361+0000","last_peered":"2023-05-16T13:54:15.202361+0000","last_clean":"2023-05-16T13:54:15.202361+0000","last_became_active":"2023-05-16T13:54:14.817829+0000","last_became_peered":"2023-05-16T13:54:14.817829+0000","last_unstale":"2023-05-16T13:54:15.202361+0000","last_undegraded":"2023-05-16T13:54:15.202361+0000","last_fullsized":"2023-05-16T13:54:15.202361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T18:27:39.059086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.237248+0000","last_change":"2023-05-16T13:54:15.229143+0000","last_active":"2023-05-16T13:54:15.237248+0000","last_peered":"2023-05-16T13:54:15.237248+0000","last_clean":"2023-05-16T13:54:15.237248+0000","last_became_active":"2023-05-16T13:54:15.228615+0000","last_became_peered":"2023-05-16T13:54:15.228615+0000","last_unstale":"2023-05-16T13:54:15.237248+0000","last_undegraded":"2023-05-16T13:54:15.237248+0000","last_fullsized":"2023-05-16T13:54:15.237248+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:01:13.149263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.222343+0000","last_change":"2023-05-16T13:54:14.820677+0000","last_active":"2023-05-16T13:54:15.222343+0000","last_peered":"2023-05-16T13:54:15.222343+0000","last_clean":"2023-05-16T13:54:15.222343+0000","last_became_active":"2023-05-16T13:54:14.820386+0000","last_became_peered":"2023-05-16T13:54:14.820386+0000","last_unstale":"2023-05-16T13:54:15.222343+0000","last_undegraded":"2023-05-16T13:54:15.222343+0000","last_fullsized":"2023-05-16T13:54:15.222343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:52:14.097165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.225218+0000","last_change":"2023-05-16T13:54:15.219472+0000","last_active":"2023-05-16T13:54:15.225218+0000","last_peered":"2023-05-16T13:54:15.225218+0000","last_clean":"2023-05-16T13:54:15.225218+0000","last_became_active":"2023-05-16T13:54:15.219173+0000","last_became_peered":"2023-05-16T13:54:15.219173+0000","last_unstale":"2023-05-16T13:54:15.225218+0000","last_undegraded":"2023-05-16T13:54:15.225218+0000","last_fullsized":"2023-05-16T13:54:15.225218+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T16:38:03.641008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.202997+0000","last_change":"2023-05-16T13:54:14.814610+0000","last_active":"2023-05-16T13:54:16.202997+0000","last_peered":"2023-05-16T13:54:16.202997+0000","last_clean":"2023-05-16T13:54:16.202997+0000","last_became_active":"2023-05-16T13:54:14.814132+0000","last_became_peered":"2023-05-16T13:54:14.814132+0000","last_unstale":"2023-05-16T13:54:16.202997+0000","last_undegraded":"2023-05-16T13:54:16.202997+0000","last_fullsized":"2023-05-16T13:54:16.202997+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T20:40:58.823162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.225347+0000","last_change":"2023-05-16T13:54:15.218356+0000","last_active":"2023-05-16T13:54:15.225347+0000","last_peered":"2023-05-16T13:54:15.225347+0000","last_clean":"2023-05-16T13:54:15.225347+0000","last_became_active":"2023-05-16T13:54:15.218043+0000","last_became_peered":"2023-05-16T13:54:15.218043+0000","last_unstale":"2023-05-16T13:54:15.225347+0000","last_undegraded":"2023-05-16T13:54:15.225347+0000","last_fullsized":"2023-05-16T13:54:15.225347+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T14:55:56.380737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.234189+0000","last_change":"2023-05-16T13:54:14.822015+0000","last_active":"2023-05-16T13:54:15.234189+0000","last_peered":"2023-05-16T13:54:15.234189+0000","last_clean":"2023-05-16T13:54:15.234189+0000","last_became_active":"2023-05-16T13:54:14.821739+0000","last_became_peered":"2023-05-16T13:54:14.821739+0000","last_unstale":"2023-05-16T13:54:15.234189+0000","last_undegraded":"2023-05-16T13:54:15.234189+0000","last_fullsized":"2023-05-16T13:54:15.234189+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:27:25.616440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.202799+0000","last_change":"2023-05-16T13:54:15.223263+0000","last_active":"2023-05-16T13:54:16.202799+0000","last_peered":"2023-05-16T13:54:16.202799+0000","last_clean":"2023-05-16T13:54:16.202799+0000","last_became_active":"2023-05-16T13:54:15.222945+0000","last_became_peered":"2023-05-16T13:54:15.222945+0000","last_unstale":"2023-05-16T13:54:16.202799+0000","last_undegraded":"2023-05-16T13:54:16.202799+0000","last_fullsized":"2023-05-16T13:54:16.202799+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:57:22.154305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.225476+0000","last_change":"2023-05-16T13:54:14.825328+0000","last_active":"2023-05-16T13:54:15.225476+0000","last_peered":"2023-05-16T13:54:15.225476+0000","last_clean":"2023-05-16T13:54:15.225476+0000","last_became_active":"2023-05-16T13:54:14.820763+0000","last_became_peered":"2023-05-16T13:54:14.820763+0000","last_unstale":"2023-05-16T13:54:15.225476+0000","last_undegraded":"2023-05-16T13:54:15.225476+0000","last_fullsized":"2023-05-16T13:54:15.225476+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:43:12.889259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.202804+0000","last_change":"2023-05-16T13:54:15.223253+0000","last_active":"2023-05-16T13:54:16.202804+0000","last_peered":"2023-05-16T13:54:16.202804+0000","last_clean":"2023-05-16T13:54:16.202804+0000","last_became_active":"2023-05-16T13:54:15.222884+0000","last_became_peered":"2023-05-16T13:54:15.222884+0000","last_unstale":"2023-05-16T13:54:16.202804+0000","last_undegraded":"2023-05-16T13:54:16.202804+0000","last_fullsized":"2023-05-16T13:54:16.202804+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:05:33.250909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.225872+0000","last_change":"2023-05-16T13:54:14.827946+0000","last_active":"2023-05-16T13:54:15.225872+0000","last_peered":"2023-05-16T13:54:15.225872+0000","last_clean":"2023-05-16T13:54:15.225872+0000","last_became_active":"2023-05-16T13:54:14.822920+0000","last_became_peered":"2023-05-16T13:54:14.822920+0000","last_unstale":"2023-05-16T13:54:15.225872+0000","last_undegraded":"2023-05-16T13:54:15.225872+0000","last_fullsized":"2023-05-16T13:54:15.225872+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:05:38.505124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.225192+0000","last_change":"2023-05-16T13:54:15.218282+0000","last_active":"2023-05-16T13:54:15.225192+0000","last_peered":"2023-05-16T13:54:15.225192+0000","last_clean":"2023-05-16T13:54:15.225192+0000","last_became_active":"2023-05-16T13:54:15.217961+0000","last_became_peered":"2023-05-16T13:54:15.217961+0000","last_unstale":"2023-05-16T13:54:15.225192+0000","last_undegraded":"2023-05-16T13:54:15.225192+0000","last_fullsized":"2023-05-16T13:54:15.225192+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:33:28.701129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.226978+0000","last_change":"2023-05-16T13:54:14.810916+0000","last_active":"2023-05-16T13:54:15.226978+0000","last_peered":"2023-05-16T13:54:15.226978+0000","last_clean":"2023-05-16T13:54:15.226978+0000","last_became_active":"2023-05-16T13:54:14.810471+0000","last_became_peered":"2023-05-16T13:54:14.810471+0000","last_unstale":"2023-05-16T13:54:15.226978+0000","last_undegraded":"2023-05-16T13:54:15.226978+0000","last_fullsized":"2023-05-16T13:54:15.226978+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T18:16:20.862543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.201687+0000","last_change":"2023-05-16T13:54:15.219216+0000","last_active":"2023-05-16T13:54:16.201687+0000","last_peered":"2023-05-16T13:54:16.201687+0000","last_clean":"2023-05-16T13:54:16.201687+0000","last_became_active":"2023-05-16T13:54:15.217942+0000","last_became_peered":"2023-05-16T13:54:15.217942+0000","last_unstale":"2023-05-16T13:54:16.201687+0000","last_undegraded":"2023-05-16T13:54:16.201687+0000","last_fullsized":"2023-05-16T13:54:16.201687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T15:50:58.482925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.234449+0000","last_change":"2023-05-16T13:54:14.816978+0000","last_active":"2023-05-16T13:54:15.234449+0000","last_peered":"2023-05-16T13:54:15.234449+0000","last_clean":"2023-05-16T13:54:15.234449+0000","last_became_active":"2023-05-16T13:54:14.816681+0000","last_became_peered":"2023-05-16T13:54:14.816681+0000","last_unstale":"2023-05-16T13:54:15.234449+0000","last_undegraded":"2023-05-16T13:54:15.234449+0000","last_fullsized":"2023-05-16T13:54:15.234449+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:00:32.671694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13208,"kb_used_data":848,"kb_used_omap":0,"kb_used_meta":12352,"kb_avail":94358632,"statfs":{"total":96636764160,"available":96623239168,"internally_reserved":0,"allocated":868352,"data_stored":683406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12648448},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]}]},{"osd":6,"up_from":15,"seq":64424509444,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12076,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":11840,"kb_avail":94359764,"statfs":{"total":96636764160,"available":96624398336,"internally_reserved":0,"allocated":233472,"data_stored":84605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12124160},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]}]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12084,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":11840,"kb_avail":94359756,"statfs":{"total":96636764160,"available":96624390144,"internally_reserved":0,"allocated":241664,"data_stored":85257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12124160},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12160,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":11904,"kb_avail":94359680,"statfs":{"total":96636764160,"available":96624312320,"internally_reserved":0,"allocated":253952,"data_stored":86225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12189696},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]}]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12000,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":11776,"kb_avail":94359840,"statfs":{"total":96636764160,"available":96624476160,"internally_reserved":0,"allocated":221184,"data_stored":77477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12058624},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]}]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7904,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":7680,"kb_avail":94363936,"statfs":{"total":96636764160,"available":96628670464,"internally_reserved":0,"allocated":221184,"data_stored":77477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7864320},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]}]},{"osd":1,"up_from":14,"seq":60129542148,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12140,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":11904,"kb_avail":94359700,"statfs":{"total":96636764160,"available":96624332800,"internally_reserved":0,"allocated":233472,"data_stored":84605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12189696},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0569999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]}]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9076,"kb_used_data":812,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362764,"statfs":{"total":96636764160,"available":96627470336,"internally_reserved":0,"allocated":831488,"data_stored":675555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-16T13:54:19.295 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-16T13:54:19.464 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.458+0000 7f7b4c76d640 1 Processor -- start 2023-05-16T13:54:19.465 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.458+0000 7f7b4c76d640 1 -- start start 2023-05-16T13:54:19.466 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.458+0000 7f7b4c76d640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b44158bf0 0x7f7b4415d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:19.466 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.458+0000 7f7b4c76d640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f7b440cb4c0 0x7f7b440ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:19.466 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.458+0000 7f7b4c76d640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b4415d6a0 con 0x7f7b440703b0 2023-05-16T13:54:19.466 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.458+0000 7f7b4c76d640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b44070870 con 0x7f7b440cb4c0 2023-05-16T13:54:19.466 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.458+0000 7f7b4c76d640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b44070b50 con 0x7f7b44158bf0 2023-05-16T13:54:19.466 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.458+0000 7f7b4ad0a640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f7b440cb4c0 0x7f7b440ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:19.467 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.458+0000 7f7b4ad0a640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f7b440cb4c0 0x7f7b440ccda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38094/0 (socket says 172.21.15.39:38094) 2023-05-16T13:54:19.467 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.458+0000 7f7b4ad0a640 1 -- 172.21.15.39:0/3694380046 learned_addr learned my addr 172.21.15.39:0/3694380046 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:19.467 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.458+0000 7f7b4a509640 1 --2- 172.21.15.39:0/3694380046 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b44158bf0 0x7f7b4415d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:19.467 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.458+0000 7f7b4ad0a640 1 -- 172.21.15.39:0/3694380046 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b44158bf0 msgr2=0x7f7b4415d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:19.468 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.458+0000 7f7b4ad0a640 1 --2- 172.21.15.39:0/3694380046 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b44158bf0 0x7f7b4415d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:19.468 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.458+0000 7f7b4ad0a640 1 -- 172.21.15.39:0/3694380046 >> v1:172.21.15.118:6789/0 conn(0x7f7b440703b0 legacy=0x7f7b440cadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:19.468 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.458+0000 7f7b4ad0a640 1 -- 172.21.15.39:0/3694380046 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b44070e30 con 0x7f7b440cb4c0 2023-05-16T13:54:19.469 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.462+0000 7f7b4ad0a640 1 --2- 172.21.15.39:0/3694380046 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b440cb4c0 0x7f7b440ccda0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c009e50 tx=0x7f7b3c01eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc6c82e49e5c25ba server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:19.469 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.462+0000 7f7b49507640 1 -- 172.21.15.39:0/3694380046 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c0a7a30 con 0x7f7b440cb4c0 2023-05-16T13:54:19.469 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.462+0000 7f7b49507640 1 -- 172.21.15.39:0/3694380046 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b3c0a7b90 con 0x7f7b440cb4c0 2023-05-16T13:54:19.470 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.462+0000 7f7b49507640 1 -- 172.21.15.39:0/3694380046 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c0af3f0 con 0x7f7b440cb4c0 2023-05-16T13:54:19.470 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.462+0000 7f7b4c76d640 1 -- 172.21.15.39:0/3694380046 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b440cb4c0 msgr2=0x7f7b440ccda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:19.470 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.462+0000 7f7b4c76d640 1 --2- 172.21.15.39:0/3694380046 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b440cb4c0 0x7f7b440ccda0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c009e50 tx=0x7f7b3c01eb60 comp rx=0 tx=0).stop 2023-05-16T13:54:19.471 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.462+0000 7f7b4c76d640 1 -- 172.21.15.39:0/3694380046 shutdown_connections 2023-05-16T13:54:19.471 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.462+0000 7f7b4c76d640 1 --2- 172.21.15.39:0/3694380046 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b440cb4c0 0x7f7b440ccda0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:19.471 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.462+0000 7f7b4c76d640 1 --2- 172.21.15.39:0/3694380046 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b44158bf0 0x7f7b4415d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:19.471 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.462+0000 7f7b4c76d640 1 -- 172.21.15.39:0/3694380046 >> 172.21.15.39:0/3694380046 conn(0x7f7b44069a50 msgr2=0x7f7b44069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:19.471 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.462+0000 7f7b4c76d640 1 -- 172.21.15.39:0/3694380046 shutdown_connections 2023-05-16T13:54:19.472 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.462+0000 7f7b4c76d640 1 -- 172.21.15.39:0/3694380046 wait complete. 2023-05-16T13:54:19.472 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.466+0000 7f7b4c76d640 1 Processor -- start 2023-05-16T13:54:19.472 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.466+0000 7f7b4c76d640 1 -- start start 2023-05-16T13:54:19.473 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.466+0000 7f7b4c76d640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b440703b0 0x7f7b44147590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:19.473 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.466+0000 7f7b4c76d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b440cb4c0 0x7f7b4414fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:19.473 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.466+0000 7f7b4c76d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b44158bf0 0x7f7b440b3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:19.474 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.466+0000 7f7b4c76d640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4414ebb0 con 0x7f7b44158bf0 2023-05-16T13:54:19.474 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.466+0000 7f7b4c76d640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4414ee20 con 0x7f7b440cb4c0 2023-05-16T13:54:19.474 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.466+0000 7f7b4c76d640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4414f100 con 0x7f7b440703b0 2023-05-16T13:54:19.474 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.466+0000 7f7b4ad0a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b44158bf0 0x7f7b440b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:19.474 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.466+0000 7f7b4ad0a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b44158bf0 0x7f7b440b3820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38096/0 (socket says 172.21.15.39:38096) 2023-05-16T13:54:19.474 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.466+0000 7f7b4ad0a640 1 -- 172.21.15.39:0/1887738029 learned_addr learned my addr 172.21.15.39:0/1887738029 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:19.474 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.466+0000 7f7b4a509640 1 --2- 172.21.15.39:0/1887738029 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b440703b0 0x7f7b44147590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:19.475 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.466+0000 7f7b49d08640 1 --2- 172.21.15.39:0/1887738029 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b440cb4c0 0x7f7b4414fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:19.475 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.466+0000 7f7b4ad0a640 1 -- 172.21.15.39:0/1887738029 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b440703b0 msgr2=0x7f7b44147590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:19.475 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.466+0000 7f7b4ad0a640 1 --2- 172.21.15.39:0/1887738029 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b440703b0 0x7f7b44147590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:19.475 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.466+0000 7f7b4ad0a640 1 -- 172.21.15.39:0/1887738029 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b440cb4c0 msgr2=0x7f7b4414fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:19.475 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.466+0000 7f7b4ad0a640 1 --2- 172.21.15.39:0/1887738029 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b440cb4c0 0x7f7b4414fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:19.475 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.466+0000 7f7b4ad0a640 1 -- 172.21.15.39:0/1887738029 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b3c009b30 con 0x7f7b44158bf0 2023-05-16T13:54:19.476 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.466+0000 7f7b4ad0a640 1 --2- 172.21.15.39:0/1887738029 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b44158bf0 0x7f7b440b3820 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c0b1040 tx=0x7f7b3c01b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:19.476 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.466+0000 7f7b3affd640 1 -- 172.21.15.39:0/1887738029 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c0a7a30 con 0x7f7b44158bf0 2023-05-16T13:54:19.476 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.466+0000 7f7b3affd640 1 -- 172.21.15.39:0/1887738029 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b3c00e150 con 0x7f7b44158bf0 2023-05-16T13:54:19.476 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.466+0000 7f7b4c76d640 1 -- 172.21.15.39:0/1887738029 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b440ad950 con 0x7f7b44158bf0 2023-05-16T13:54:19.477 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.466+0000 7f7b3affd640 1 -- 172.21.15.39:0/1887738029 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c007e10 con 0x7f7b44158bf0 2023-05-16T13:54:19.477 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.466+0000 7f7b4c76d640 1 -- 172.21.15.39:0/1887738029 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b44158fc0 con 0x7f7b44158bf0 2023-05-16T13:54:19.477 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.466+0000 7f7b4c76d640 1 -- 172.21.15.39:0/1887738029 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b440cdaf0 con 0x7f7b44158bf0 2023-05-16T13:54:19.477 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.470+0000 7f7b3affd640 1 -- 172.21.15.39:0/1887738029 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7b3c0af3f0 con 0x7f7b44158bf0 2023-05-16T13:54:19.478 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.470+0000 7f7b3affd640 1 --2- 172.21.15.39:0/1887738029 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f7b28066280 0x7f7b28068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:19.478 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.470+0000 7f7b3affd640 1 -- 172.21.15.39:0/1887738029 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7b3c11e3a0 con 0x7f7b44158bf0 2023-05-16T13:54:19.478 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.470+0000 7f7b4a509640 1 --2- 172.21.15.39:0/1887738029 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f7b28066280 0x7f7b28068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:19.478 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.470+0000 7f7b4a509640 1 --2- 172.21.15.39:0/1887738029 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f7b28066280 0x7f7b28068730 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7b40009ac0 tx=0x7f7b40009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:19.481 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.474+0000 7f7b3affd640 1 -- 172.21.15.39:0/1887738029 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f7b3c0eb8c0 con 0x7f7b44158bf0 2023-05-16T13:54:19.631 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.622+0000 7f7b4c76d640 1 -- 172.21.15.39:0/1887738029 --> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7b4414ef90 con 0x7f7b28066280 2023-05-16T13:54:19.638 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.630+0000 7f7b3affd640 1 -- 172.21.15.39:0/1887738029 <== mgr.4098 v2:172.21.15.39:6832/288296800 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286738 (secure 0 0 0) 0x7f7b4414ef90 con 0x7f7b28066280 2023-05-16T13:54:19.641 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:54:19.642 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2023-05-16T13:54:19.643 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.634+0000 7f7b4c76d640 1 -- 172.21.15.39:0/1887738029 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f7b28066280 msgr2=0x7f7b28068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:19.643 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.634+0000 7f7b4c76d640 1 --2- 172.21.15.39:0/1887738029 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f7b28066280 0x7f7b28068730 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7b40009ac0 tx=0x7f7b40009190 comp rx=0 tx=0).stop 2023-05-16T13:54:19.643 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.634+0000 7f7b4c76d640 1 -- 172.21.15.39:0/1887738029 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b44158bf0 msgr2=0x7f7b440b3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:19.643 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.634+0000 7f7b4c76d640 1 --2- 172.21.15.39:0/1887738029 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b44158bf0 0x7f7b440b3820 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c0b1040 tx=0x7f7b3c01b900 comp rx=0 tx=0).stop 2023-05-16T13:54:19.644 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.634+0000 7f7b4c76d640 1 -- 172.21.15.39:0/1887738029 shutdown_connections 2023-05-16T13:54:19.644 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.634+0000 7f7b4c76d640 1 --2- 172.21.15.39:0/1887738029 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7b44158bf0 0x7f7b440b3820 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:19.644 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.634+0000 7f7b4c76d640 1 --2- 172.21.15.39:0/1887738029 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b440cb4c0 0x7f7b4414fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:19.644 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.634+0000 7f7b4c76d640 1 --2- 172.21.15.39:0/1887738029 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f7b28066280 0x7f7b28068730 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:19.644 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.634+0000 7f7b4c76d640 1 --2- 172.21.15.39:0/1887738029 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7b440703b0 0x7f7b44147590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:19.644 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.634+0000 7f7b4c76d640 1 -- 172.21.15.39:0/1887738029 >> 172.21.15.39:0/1887738029 conn(0x7f7b44069a50 msgr2=0x7f7b440cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:19.644 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.634+0000 7f7b4c76d640 1 -- 172.21.15.39:0/1887738029 shutdown_connections 2023-05-16T13:54:19.645 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.634+0000 7f7b4c76d640 1 -- 172.21.15.39:0/1887738029 wait complete. 2023-05-16T13:54:19.662 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-05-16T13:54:18.830060+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":148,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":90648,"kb_used_data":3032,"kb_used_omap":0,"kb_used_meta":87552,"kb_avail":754884072,"statfs":{"total":773094113280,"available":773001289728,"internally_reserved":0,"allocated":3104768,"data_stored":1854607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":89653248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.041404"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.213610+0000","last_change":"2023-05-16T13:54:15.211201+0000","last_active":"2023-05-16T13:54:15.213610+0000","last_peered":"2023-05-16T13:54:15.213610+0000","last_clean":"2023-05-16T13:54:15.213610+0000","last_became_active":"2023-05-16T13:54:15.210864+0000","last_became_peered":"2023-05-16T13:54:15.210864+0000","last_unstale":"2023-05-16T13:54:15.213610+0000","last_undegraded":"2023-05-16T13:54:15.213610+0000","last_fullsized":"2023-05-16T13:54:15.213610+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:43:44.249467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.230493+0000","last_change":"2023-05-16T13:54:15.225613+0000","last_active":"2023-05-16T13:54:15.230493+0000","last_peered":"2023-05-16T13:54:15.230493+0000","last_clean":"2023-05-16T13:54:15.230493+0000","last_became_active":"2023-05-16T13:54:15.225255+0000","last_became_peered":"2023-05-16T13:54:15.225255+0000","last_unstale":"2023-05-16T13:54:15.230493+0000","last_undegraded":"2023-05-16T13:54:15.230493+0000","last_fullsized":"2023-05-16T13:54:15.230493+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T20:48:13.566178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.203170+0000","last_change":"2023-05-16T13:54:15.228669+0000","last_active":"2023-05-16T13:54:16.203170+0000","last_peered":"2023-05-16T13:54:16.203170+0000","last_clean":"2023-05-16T13:54:16.203170+0000","last_became_active":"2023-05-16T13:54:15.228389+0000","last_became_peered":"2023-05-16T13:54:15.228389+0000","last_unstale":"2023-05-16T13:54:16.203170+0000","last_undegraded":"2023-05-16T13:54:16.203170+0000","last_fullsized":"2023-05-16T13:54:16.203170+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:58:10.666710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.201977+0000","last_change":"2023-05-16T13:54:15.228352+0000","last_active":"2023-05-16T13:54:16.201977+0000","last_peered":"2023-05-16T13:54:16.201977+0000","last_clean":"2023-05-16T13:54:16.201977+0000","last_became_active":"2023-05-16T13:54:15.228013+0000","last_became_peered":"2023-05-16T13:54:15.228013+0000","last_unstale":"2023-05-16T13:54:16.201977+0000","last_undegraded":"2023-05-16T13:54:16.201977+0000","last_fullsized":"2023-05-16T13:54:16.201977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:43:13.895642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.237398+0000","last_change":"2023-05-16T13:54:15.232326+0000","last_active":"2023-05-16T13:54:15.237398+0000","last_peered":"2023-05-16T13:54:15.237398+0000","last_clean":"2023-05-16T13:54:15.237398+0000","last_became_active":"2023-05-16T13:54:15.231852+0000","last_became_peered":"2023-05-16T13:54:15.231852+0000","last_unstale":"2023-05-16T13:54:15.237398+0000","last_undegraded":"2023-05-16T13:54:15.237398+0000","last_fullsized":"2023-05-16T13:54:15.237398+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T14:42:43.545307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.202661+0000","last_change":"2023-05-16T13:54:15.228982+0000","last_active":"2023-05-16T13:54:16.202661+0000","last_peered":"2023-05-16T13:54:16.202661+0000","last_clean":"2023-05-16T13:54:16.202661+0000","last_became_active":"2023-05-16T13:54:15.228468+0000","last_became_peered":"2023-05-16T13:54:15.228468+0000","last_unstale":"2023-05-16T13:54:16.202661+0000","last_undegraded":"2023-05-16T13:54:16.202661+0000","last_fullsized":"2023-05-16T13:54:16.202661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T16:19:34.312806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.234289+0000","last_change":"2023-05-16T13:54:15.217211+0000","last_active":"2023-05-16T13:54:16.234289+0000","last_peered":"2023-05-16T13:54:16.234289+0000","last_clean":"2023-05-16T13:54:16.234289+0000","last_became_active":"2023-05-16T13:54:15.216921+0000","last_became_peered":"2023-05-16T13:54:15.216921+0000","last_unstale":"2023-05-16T13:54:16.234289+0000","last_undegraded":"2023-05-16T13:54:16.234289+0000","last_fullsized":"2023-05-16T13:54:16.234289+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:05:33.250909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.226141+0000","last_change":"2023-05-16T13:54:15.220276+0000","last_active":"2023-05-16T13:54:15.226141+0000","last_peered":"2023-05-16T13:54:15.226141+0000","last_clean":"2023-05-16T13:54:15.226141+0000","last_became_active":"2023-05-16T13:54:15.219893+0000","last_became_peered":"2023-05-16T13:54:15.219893+0000","last_unstale":"2023-05-16T13:54:15.226141+0000","last_undegraded":"2023-05-16T13:54:15.226141+0000","last_fullsized":"2023-05-16T13:54:15.226141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:28:13.026725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.237688+0000","last_change":"2023-05-16T13:54:15.233844+0000","last_active":"2023-05-16T13:54:15.237688+0000","last_peered":"2023-05-16T13:54:15.237688+0000","last_clean":"2023-05-16T13:54:15.237688+0000","last_became_active":"2023-05-16T13:54:15.232864+0000","last_became_peered":"2023-05-16T13:54:15.232864+0000","last_unstale":"2023-05-16T13:54:15.237688+0000","last_undegraded":"2023-05-16T13:54:15.237688+0000","last_fullsized":"2023-05-16T13:54:15.237688+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:43:44.249467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.230907+0000","last_change":"2023-05-16T13:54:15.229695+0000","last_active":"2023-05-16T13:54:15.230907+0000","last_peered":"2023-05-16T13:54:15.230907+0000","last_clean":"2023-05-16T13:54:15.230907+0000","last_became_active":"2023-05-16T13:54:15.229428+0000","last_became_peered":"2023-05-16T13:54:15.229428+0000","last_unstale":"2023-05-16T13:54:15.230907+0000","last_undegraded":"2023-05-16T13:54:15.230907+0000","last_fullsized":"2023-05-16T13:54:15.230907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T18:27:40.065469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.203185+0000","last_change":"2023-05-16T13:54:15.223655+0000","last_active":"2023-05-16T13:54:16.203185+0000","last_peered":"2023-05-16T13:54:16.203185+0000","last_clean":"2023-05-16T13:54:16.203185+0000","last_became_active":"2023-05-16T13:54:15.223324+0000","last_became_peered":"2023-05-16T13:54:15.223324+0000","last_unstale":"2023-05-16T13:54:16.203185+0000","last_undegraded":"2023-05-16T13:54:16.203185+0000","last_fullsized":"2023-05-16T13:54:16.203185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:34:27.280408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.235164+0000","last_change":"2023-05-16T13:54:15.231258+0000","last_active":"2023-05-16T13:54:15.235164+0000","last_peered":"2023-05-16T13:54:15.235164+0000","last_clean":"2023-05-16T13:54:15.235164+0000","last_became_active":"2023-05-16T13:54:15.230996+0000","last_became_peered":"2023-05-16T13:54:15.230996+0000","last_unstale":"2023-05-16T13:54:15.235164+0000","last_undegraded":"2023-05-16T13:54:15.235164+0000","last_fullsized":"2023-05-16T13:54:15.235164+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T14:42:43.545307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.213533+0000","last_change":"2023-05-16T13:54:15.211137+0000","last_active":"2023-05-16T13:54:15.213533+0000","last_peered":"2023-05-16T13:54:15.213533+0000","last_clean":"2023-05-16T13:54:15.213533+0000","last_became_active":"2023-05-16T13:54:15.210834+0000","last_became_peered":"2023-05-16T13:54:15.210834+0000","last_unstale":"2023-05-16T13:54:15.213533+0000","last_undegraded":"2023-05-16T13:54:15.213533+0000","last_fullsized":"2023-05-16T13:54:15.213533+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T20:57:05.676569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.229985+0000","last_change":"2023-05-16T13:54:15.222527+0000","last_active":"2023-05-16T13:54:15.229985+0000","last_peered":"2023-05-16T13:54:15.229985+0000","last_clean":"2023-05-16T13:54:15.229985+0000","last_became_active":"2023-05-16T13:54:15.222111+0000","last_became_peered":"2023-05-16T13:54:15.222111+0000","last_unstale":"2023-05-16T13:54:15.229985+0000","last_undegraded":"2023-05-16T13:54:15.229985+0000","last_fullsized":"2023-05-16T13:54:15.229985+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T16:38:03.641008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.234380+0000","last_change":"2023-05-16T13:54:15.224759+0000","last_active":"2023-05-16T13:54:16.234380+0000","last_peered":"2023-05-16T13:54:16.234380+0000","last_clean":"2023-05-16T13:54:16.234380+0000","last_became_active":"2023-05-16T13:54:15.224486+0000","last_became_peered":"2023-05-16T13:54:15.224486+0000","last_unstale":"2023-05-16T13:54:16.234380+0000","last_undegraded":"2023-05-16T13:54:16.234380+0000","last_fullsized":"2023-05-16T13:54:16.234380+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:23:36.578764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.201645+0000","last_change":"2023-05-16T13:54:15.231690+0000","last_active":"2023-05-16T13:54:16.201645+0000","last_peered":"2023-05-16T13:54:16.201645+0000","last_clean":"2023-05-16T13:54:16.201645+0000","last_became_active":"2023-05-16T13:54:15.231041+0000","last_became_peered":"2023-05-16T13:54:15.231041+0000","last_unstale":"2023-05-16T13:54:16.201645+0000","last_undegraded":"2023-05-16T13:54:16.201645+0000","last_fullsized":"2023-05-16T13:54:16.201645+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:58:22.882260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.237699+0000","last_change":"2023-05-16T13:54:15.234033+0000","last_active":"2023-05-16T13:54:15.237699+0000","last_peered":"2023-05-16T13:54:15.237699+0000","last_clean":"2023-05-16T13:54:15.237699+0000","last_became_active":"2023-05-16T13:54:15.233573+0000","last_became_peered":"2023-05-16T13:54:15.233573+0000","last_unstale":"2023-05-16T13:54:15.237699+0000","last_undegraded":"2023-05-16T13:54:15.237699+0000","last_fullsized":"2023-05-16T13:54:15.237699+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:21:03.147698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.203259+0000","last_change":"2023-05-16T13:54:15.217992+0000","last_active":"2023-05-16T13:54:16.203259+0000","last_peered":"2023-05-16T13:54:16.203259+0000","last_clean":"2023-05-16T13:54:16.203259+0000","last_became_active":"2023-05-16T13:54:15.217320+0000","last_became_peered":"2023-05-16T13:54:15.217320+0000","last_unstale":"2023-05-16T13:54:16.203259+0000","last_undegraded":"2023-05-16T13:54:16.203259+0000","last_fullsized":"2023-05-16T13:54:16.203259+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:03:24.701966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.213373+0000","last_change":"2023-05-16T13:54:15.209420+0000","last_active":"2023-05-16T13:54:15.213373+0000","last_peered":"2023-05-16T13:54:15.213373+0000","last_clean":"2023-05-16T13:54:15.213373+0000","last_became_active":"2023-05-16T13:54:15.208345+0000","last_became_peered":"2023-05-16T13:54:15.208345+0000","last_unstale":"2023-05-16T13:54:15.213373+0000","last_undegraded":"2023-05-16T13:54:15.213373+0000","last_fullsized":"2023-05-16T13:54:15.213373+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:21:03.147698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.202730+0000","last_change":"2023-05-16T13:54:15.214941+0000","last_active":"2023-05-16T13:54:16.202730+0000","last_peered":"2023-05-16T13:54:16.202730+0000","last_clean":"2023-05-16T13:54:16.202730+0000","last_became_active":"2023-05-16T13:54:15.214581+0000","last_became_peered":"2023-05-16T13:54:15.214581+0000","last_unstale":"2023-05-16T13:54:16.202730+0000","last_undegraded":"2023-05-16T13:54:16.202730+0000","last_fullsized":"2023-05-16T13:54:16.202730+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:53:50.523933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.234462+0000","last_change":"2023-05-16T13:54:15.222860+0000","last_active":"2023-05-16T13:54:16.234462+0000","last_peered":"2023-05-16T13:54:16.234462+0000","last_clean":"2023-05-16T13:54:16.234462+0000","last_became_active":"2023-05-16T13:54:15.222149+0000","last_became_peered":"2023-05-16T13:54:15.222149+0000","last_unstale":"2023-05-16T13:54:16.234462+0000","last_undegraded":"2023-05-16T13:54:16.234462+0000","last_fullsized":"2023-05-16T13:54:16.234462+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:51:04.272951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.237130+0000","last_change":"2023-05-16T13:54:15.228300+0000","last_active":"2023-05-16T13:54:15.237130+0000","last_peered":"2023-05-16T13:54:15.237130+0000","last_clean":"2023-05-16T13:54:15.237130+0000","last_became_active":"2023-05-16T13:54:15.227773+0000","last_became_peered":"2023-05-16T13:54:15.227773+0000","last_unstale":"2023-05-16T13:54:15.237130+0000","last_undegraded":"2023-05-16T13:54:15.237130+0000","last_fullsized":"2023-05-16T13:54:15.237130+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T20:57:05.676569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.234149+0000","last_change":"2023-05-16T13:54:15.228240+0000","last_active":"2023-05-16T13:54:15.234149+0000","last_peered":"2023-05-16T13:54:15.234149+0000","last_clean":"2023-05-16T13:54:15.234149+0000","last_became_active":"2023-05-16T13:54:15.227927+0000","last_became_peered":"2023-05-16T13:54:15.227927+0000","last_unstale":"2023-05-16T13:54:15.234149+0000","last_undegraded":"2023-05-16T13:54:15.234149+0000","last_fullsized":"2023-05-16T13:54:15.234149+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T15:06:46.071541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.234446+0000","last_change":"2023-05-16T13:54:15.221851+0000","last_active":"2023-05-16T13:54:16.234446+0000","last_peered":"2023-05-16T13:54:16.234446+0000","last_clean":"2023-05-16T13:54:16.234446+0000","last_became_active":"2023-05-16T13:54:15.221511+0000","last_became_peered":"2023-05-16T13:54:15.221511+0000","last_unstale":"2023-05-16T13:54:16.234446+0000","last_undegraded":"2023-05-16T13:54:16.234446+0000","last_fullsized":"2023-05-16T13:54:16.234446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:18:56.753459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.227657+0000","last_change":"2023-05-16T13:54:15.224061+0000","last_active":"2023-05-16T13:54:15.227657+0000","last_peered":"2023-05-16T13:54:15.227657+0000","last_clean":"2023-05-16T13:54:15.227657+0000","last_became_active":"2023-05-16T13:54:15.223626+0000","last_became_peered":"2023-05-16T13:54:15.223626+0000","last_unstale":"2023-05-16T13:54:15.227657+0000","last_undegraded":"2023-05-16T13:54:15.227657+0000","last_fullsized":"2023-05-16T13:54:15.227657+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:00:33.678077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.224778+0000","last_change":"2023-05-16T13:54:15.216383+0000","last_active":"2023-05-16T13:54:15.224778+0000","last_peered":"2023-05-16T13:54:15.224778+0000","last_clean":"2023-05-16T13:54:15.224778+0000","last_became_active":"2023-05-16T13:54:15.216056+0000","last_became_peered":"2023-05-16T13:54:15.216056+0000","last_unstale":"2023-05-16T13:54:15.224778+0000","last_undegraded":"2023-05-16T13:54:15.224778+0000","last_fullsized":"2023-05-16T13:54:15.224778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T16:13:53.275348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.230327+0000","last_change":"2023-05-16T13:54:15.223638+0000","last_active":"2023-05-16T13:54:15.230327+0000","last_peered":"2023-05-16T13:54:15.230327+0000","last_clean":"2023-05-16T13:54:15.230327+0000","last_became_active":"2023-05-16T13:54:15.223140+0000","last_became_peered":"2023-05-16T13:54:15.223140+0000","last_unstale":"2023-05-16T13:54:15.230327+0000","last_undegraded":"2023-05-16T13:54:15.230327+0000","last_fullsized":"2023-05-16T13:54:15.230327+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T18:16:21.868926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.221702+0000","last_change":"2023-05-16T13:54:15.215238+0000","last_active":"2023-05-16T13:54:15.221702+0000","last_peered":"2023-05-16T13:54:15.221702+0000","last_clean":"2023-05-16T13:54:15.221702+0000","last_became_active":"2023-05-16T13:54:15.214974+0000","last_became_peered":"2023-05-16T13:54:15.214974+0000","last_unstale":"2023-05-16T13:54:15.221702+0000","last_undegraded":"2023-05-16T13:54:15.221702+0000","last_fullsized":"2023-05-16T13:54:15.221702+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:22:57.186846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.227100+0000","last_change":"2023-05-16T13:54:15.220178+0000","last_active":"2023-05-16T13:54:15.227100+0000","last_peered":"2023-05-16T13:54:15.227100+0000","last_clean":"2023-05-16T13:54:15.227100+0000","last_became_active":"2023-05-16T13:54:15.219892+0000","last_became_peered":"2023-05-16T13:54:15.219892+0000","last_unstale":"2023-05-16T13:54:15.227100+0000","last_undegraded":"2023-05-16T13:54:15.227100+0000","last_fullsized":"2023-05-16T13:54:15.227100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:41:21.218437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.202938+0000","last_change":"2023-05-16T13:54:15.211537+0000","last_active":"2023-05-16T13:54:16.202938+0000","last_peered":"2023-05-16T13:54:16.202938+0000","last_clean":"2023-05-16T13:54:16.202938+0000","last_became_active":"2023-05-16T13:54:15.211186+0000","last_became_peered":"2023-05-16T13:54:15.211186+0000","last_unstale":"2023-05-16T13:54:16.202938+0000","last_undegraded":"2023-05-16T13:54:16.202938+0000","last_fullsized":"2023-05-16T13:54:16.202938+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:23:36.578764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.225085+0000","last_change":"2023-05-16T13:54:15.217651+0000","last_active":"2023-05-16T13:54:15.225085+0000","last_peered":"2023-05-16T13:54:15.225085+0000","last_clean":"2023-05-16T13:54:15.225085+0000","last_became_active":"2023-05-16T13:54:15.217294+0000","last_became_peered":"2023-05-16T13:54:15.217294+0000","last_unstale":"2023-05-16T13:54:15.225085+0000","last_undegraded":"2023-05-16T13:54:15.225085+0000","last_fullsized":"2023-05-16T13:54:15.225085+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:43:13.895642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.201794+0000","last_change":"2023-05-16T13:54:15.217531+0000","last_active":"2023-05-16T13:54:16.201794+0000","last_peered":"2023-05-16T13:54:16.201794+0000","last_clean":"2023-05-16T13:54:16.201794+0000","last_became_active":"2023-05-16T13:54:15.217002+0000","last_became_peered":"2023-05-16T13:54:15.217002+0000","last_unstale":"2023-05-16T13:54:16.201794+0000","last_undegraded":"2023-05-16T13:54:16.201794+0000","last_fullsized":"2023-05-16T13:54:16.201794+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:10:29.866761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.232695+0000","last_change":"2023-05-16T13:54:15.223492+0000","last_active":"2023-05-16T13:54:15.232695+0000","last_peered":"2023-05-16T13:54:15.232695+0000","last_clean":"2023-05-16T13:54:15.232695+0000","last_became_active":"2023-05-16T13:54:15.223220+0000","last_became_peered":"2023-05-16T13:54:15.223220+0000","last_unstale":"2023-05-16T13:54:15.232695+0000","last_undegraded":"2023-05-16T13:54:15.232695+0000","last_fullsized":"2023-05-16T13:54:15.232695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:47:42.238742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.234538+0000","last_change":"2023-05-16T13:54:14.826021+0000","last_active":"2023-05-16T13:54:16.234538+0000","last_peered":"2023-05-16T13:54:16.234538+0000","last_clean":"2023-05-16T13:54:16.234538+0000","last_became_active":"2023-05-16T13:54:14.820310+0000","last_became_peered":"2023-05-16T13:54:14.820310+0000","last_unstale":"2023-05-16T13:54:16.234538+0000","last_undegraded":"2023-05-16T13:54:16.234538+0000","last_fullsized":"2023-05-16T13:54:16.234538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:58:09.660328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.230300+0000","last_change":"2023-05-16T13:54:15.223399+0000","last_active":"2023-05-16T13:54:15.230300+0000","last_peered":"2023-05-16T13:54:15.230300+0000","last_clean":"2023-05-16T13:54:15.230300+0000","last_became_active":"2023-05-16T13:54:15.222860+0000","last_became_peered":"2023-05-16T13:54:15.222860+0000","last_unstale":"2023-05-16T13:54:15.230300+0000","last_undegraded":"2023-05-16T13:54:15.230300+0000","last_fullsized":"2023-05-16T13:54:15.230300+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:20:01.628237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.212946+0000","last_change":"2023-05-16T13:54:14.811666+0000","last_active":"2023-05-16T13:54:15.212946+0000","last_peered":"2023-05-16T13:54:15.212946+0000","last_clean":"2023-05-16T13:54:15.212946+0000","last_became_active":"2023-05-16T13:54:14.811282+0000","last_became_peered":"2023-05-16T13:54:14.811282+0000","last_unstale":"2023-05-16T13:54:15.212946+0000","last_undegraded":"2023-05-16T13:54:15.212946+0000","last_fullsized":"2023-05-16T13:54:15.212946+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T16:13:52.268965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.237267+0000","last_change":"2023-05-16T13:54:15.229301+0000","last_active":"2023-05-16T13:54:15.237267+0000","last_peered":"2023-05-16T13:54:15.237267+0000","last_clean":"2023-05-16T13:54:15.237267+0000","last_became_active":"2023-05-16T13:54:15.228861+0000","last_became_peered":"2023-05-16T13:54:15.228861+0000","last_unstale":"2023-05-16T13:54:15.237267+0000","last_undegraded":"2023-05-16T13:54:15.237267+0000","last_fullsized":"2023-05-16T13:54:15.237267+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T14:55:56.380737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.234451+0000","last_change":"2023-05-16T13:54:14.822092+0000","last_active":"2023-05-16T13:54:16.234451+0000","last_peered":"2023-05-16T13:54:16.234451+0000","last_clean":"2023-05-16T13:54:16.234451+0000","last_became_active":"2023-05-16T13:54:14.820716+0000","last_became_peered":"2023-05-16T13:54:14.820716+0000","last_unstale":"2023-05-16T13:54:16.234451+0000","last_undegraded":"2023-05-16T13:54:16.234451+0000","last_fullsized":"2023-05-16T13:54:16.234451+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T20:40:58.823162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.232733+0000","last_change":"2023-05-16T13:54:15.222372+0000","last_active":"2023-05-16T13:54:15.232733+0000","last_peered":"2023-05-16T13:54:15.232733+0000","last_clean":"2023-05-16T13:54:15.232733+0000","last_became_active":"2023-05-16T13:54:15.219602+0000","last_became_peered":"2023-05-16T13:54:15.219602+0000","last_unstale":"2023-05-16T13:54:15.232733+0000","last_undegraded":"2023-05-16T13:54:15.232733+0000","last_fullsized":"2023-05-16T13:54:15.232733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:28:13.026725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.201862+0000","last_change":"2023-05-16T13:54:14.814991+0000","last_active":"2023-05-16T13:54:16.201862+0000","last_peered":"2023-05-16T13:54:16.201862+0000","last_clean":"2023-05-16T13:54:16.201862+0000","last_became_active":"2023-05-16T13:54:14.814571+0000","last_became_peered":"2023-05-16T13:54:14.814571+0000","last_unstale":"2023-05-16T13:54:16.201862+0000","last_undegraded":"2023-05-16T13:54:16.201862+0000","last_fullsized":"2023-05-16T13:54:16.201862+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T16:38:02.634625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.234878+0000","last_change":"2023-05-16T13:54:14.821745+0000","last_active":"2023-05-16T13:54:16.234878+0000","last_peered":"2023-05-16T13:54:16.234878+0000","last_clean":"2023-05-16T13:54:16.234878+0000","last_became_active":"2023-05-16T13:54:14.820978+0000","last_became_peered":"2023-05-16T13:54:14.820978+0000","last_unstale":"2023-05-16T13:54:16.234878+0000","last_undegraded":"2023-05-16T13:54:16.234878+0000","last_fullsized":"2023-05-16T13:54:16.234878+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:15:56.752324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.226160+0000","last_change":"2023-05-16T13:54:15.220768+0000","last_active":"2023-05-16T13:54:15.226160+0000","last_peered":"2023-05-16T13:54:15.226160+0000","last_clean":"2023-05-16T13:54:15.226160+0000","last_became_active":"2023-05-16T13:54:15.220494+0000","last_became_peered":"2023-05-16T13:54:15.220494+0000","last_unstale":"2023-05-16T13:54:15.226160+0000","last_undegraded":"2023-05-16T13:54:15.226160+0000","last_fullsized":"2023-05-16T13:54:15.226160+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:41:21.218437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.234833+0000","last_change":"2023-05-16T13:54:14.821942+0000","last_active":"2023-05-16T13:54:16.234833+0000","last_peered":"2023-05-16T13:54:16.234833+0000","last_clean":"2023-05-16T13:54:16.234833+0000","last_became_active":"2023-05-16T13:54:14.821539+0000","last_became_peered":"2023-05-16T13:54:14.821539+0000","last_unstale":"2023-05-16T13:54:16.234833+0000","last_undegraded":"2023-05-16T13:54:16.234833+0000","last_fullsized":"2023-05-16T13:54:16.234833+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T23:19:38.774487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.201687+0000","last_change":"2023-05-16T13:54:15.218507+0000","last_active":"2023-05-16T13:54:16.201687+0000","last_peered":"2023-05-16T13:54:16.201687+0000","last_clean":"2023-05-16T13:54:16.201687+0000","last_became_active":"2023-05-16T13:54:15.218014+0000","last_became_peered":"2023-05-16T13:54:15.218014+0000","last_unstale":"2023-05-16T13:54:16.201687+0000","last_undegraded":"2023-05-16T13:54:16.201687+0000","last_fullsized":"2023-05-16T13:54:16.201687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:12:06.609266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.234688+0000","last_change":"2023-05-16T13:54:14.824383+0000","last_active":"2023-05-16T13:54:16.234688+0000","last_peered":"2023-05-16T13:54:16.234688+0000","last_clean":"2023-05-16T13:54:16.234688+0000","last_became_active":"2023-05-16T13:54:14.824117+0000","last_became_peered":"2023-05-16T13:54:14.824117+0000","last_unstale":"2023-05-16T13:54:16.234688+0000","last_undegraded":"2023-05-16T13:54:16.234688+0000","last_fullsized":"2023-05-16T13:54:16.234688+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:32:07.899174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.202234+0000","last_change":"2023-05-16T13:54:15.219224+0000","last_active":"2023-05-16T13:54:16.202234+0000","last_peered":"2023-05-16T13:54:16.202234+0000","last_clean":"2023-05-16T13:54:16.202234+0000","last_became_active":"2023-05-16T13:54:15.218672+0000","last_became_peered":"2023-05-16T13:54:15.218672+0000","last_unstale":"2023-05-16T13:54:16.202234+0000","last_undegraded":"2023-05-16T13:54:16.202234+0000","last_fullsized":"2023-05-16T13:54:16.202234+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T18:27:40.065469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.209580+0000","last_change":"2023-05-16T13:54:14.821843+0000","last_active":"2023-05-16T13:54:15.209580+0000","last_peered":"2023-05-16T13:54:15.209580+0000","last_clean":"2023-05-16T13:54:15.209580+0000","last_became_active":"2023-05-16T13:54:14.821386+0000","last_became_peered":"2023-05-16T13:54:14.821386+0000","last_unstale":"2023-05-16T13:54:15.209580+0000","last_undegraded":"2023-05-16T13:54:15.209580+0000","last_fullsized":"2023-05-16T13:54:15.209580+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T15:06:45.065158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.237387+0000","last_change":"2023-05-16T13:54:15.232203+0000","last_active":"2023-05-16T13:54:15.237387+0000","last_peered":"2023-05-16T13:54:15.237387+0000","last_clean":"2023-05-16T13:54:15.237387+0000","last_became_active":"2023-05-16T13:54:15.231644+0000","last_became_peered":"2023-05-16T13:54:15.231644+0000","last_unstale":"2023-05-16T13:54:15.237387+0000","last_undegraded":"2023-05-16T13:54:15.237387+0000","last_fullsized":"2023-05-16T13:54:15.237387+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:22:57.186846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.235084+0000","last_change":"2023-05-16T13:54:14.819498+0000","last_active":"2023-05-16T13:54:15.235084+0000","last_peered":"2023-05-16T13:54:15.235084+0000","last_clean":"2023-05-16T13:54:15.235084+0000","last_became_active":"2023-05-16T13:54:14.819147+0000","last_became_peered":"2023-05-16T13:54:14.819147+0000","last_unstale":"2023-05-16T13:54:15.235084+0000","last_undegraded":"2023-05-16T13:54:15.235084+0000","last_fullsized":"2023-05-16T13:54:15.235084+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:20:00.621854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.202789+0000","last_change":"2023-05-16T13:54:15.217792+0000","last_active":"2023-05-16T13:54:16.202789+0000","last_peered":"2023-05-16T13:54:16.202789+0000","last_clean":"2023-05-16T13:54:16.202789+0000","last_became_active":"2023-05-16T13:54:15.216858+0000","last_became_peered":"2023-05-16T13:54:15.216858+0000","last_unstale":"2023-05-16T13:54:16.202789+0000","last_undegraded":"2023-05-16T13:54:16.202789+0000","last_fullsized":"2023-05-16T13:54:16.202789+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T23:50:22.458202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.202400+0000","last_change":"2023-05-16T13:54:14.819120+0000","last_active":"2023-05-16T13:54:16.202400+0000","last_peered":"2023-05-16T13:54:16.202400+0000","last_clean":"2023-05-16T13:54:16.202400+0000","last_became_active":"2023-05-16T13:54:14.818822+0000","last_became_peered":"2023-05-16T13:54:14.818822+0000","last_unstale":"2023-05-16T13:54:16.202400+0000","last_undegraded":"2023-05-16T13:54:16.202400+0000","last_fullsized":"2023-05-16T13:54:16.202400+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:13:17.386163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.203317+0000","last_change":"2023-05-16T13:54:15.217748+0000","last_active":"2023-05-16T13:54:16.203317+0000","last_peered":"2023-05-16T13:54:16.203317+0000","last_clean":"2023-05-16T13:54:16.203317+0000","last_became_active":"2023-05-16T13:54:15.216101+0000","last_became_peered":"2023-05-16T13:54:15.216101+0000","last_unstale":"2023-05-16T13:54:16.203317+0000","last_undegraded":"2023-05-16T13:54:16.203317+0000","last_fullsized":"2023-05-16T13:54:16.203317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:21:33.710987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.202468+0000","last_change":"2023-05-16T13:54:14.812220+0000","last_active":"2023-05-16T13:54:16.202468+0000","last_peered":"2023-05-16T13:54:16.202468+0000","last_clean":"2023-05-16T13:54:16.202468+0000","last_became_active":"2023-05-16T13:54:14.811901+0000","last_became_peered":"2023-05-16T13:54:14.811901+0000","last_unstale":"2023-05-16T13:54:16.202468+0000","last_undegraded":"2023-05-16T13:54:16.202468+0000","last_fullsized":"2023-05-16T13:54:16.202468+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:38:12.287244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.203309+0000","last_change":"2023-05-16T13:54:15.210585+0000","last_active":"2023-05-16T13:54:16.203309+0000","last_peered":"2023-05-16T13:54:16.203309+0000","last_clean":"2023-05-16T13:54:16.203309+0000","last_became_active":"2023-05-16T13:54:15.210268+0000","last_became_peered":"2023-05-16T13:54:15.210268+0000","last_unstale":"2023-05-16T13:54:16.203309+0000","last_undegraded":"2023-05-16T13:54:16.203309+0000","last_fullsized":"2023-05-16T13:54:16.203309+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:32:08.905557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.202492+0000","last_change":"2023-05-16T13:54:14.818548+0000","last_active":"2023-05-16T13:54:15.202492+0000","last_peered":"2023-05-16T13:54:15.202492+0000","last_clean":"2023-05-16T13:54:15.202492+0000","last_became_active":"2023-05-16T13:54:14.818253+0000","last_became_peered":"2023-05-16T13:54:14.818253+0000","last_unstale":"2023-05-16T13:54:15.202492+0000","last_undegraded":"2023-05-16T13:54:15.202492+0000","last_fullsized":"2023-05-16T13:54:15.202492+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:13:17.386163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.227447+0000","last_change":"2023-05-16T13:54:15.221849+0000","last_active":"2023-05-16T13:54:15.227447+0000","last_peered":"2023-05-16T13:54:15.227447+0000","last_clean":"2023-05-16T13:54:15.227447+0000","last_became_active":"2023-05-16T13:54:15.221542+0000","last_became_peered":"2023-05-16T13:54:15.221542+0000","last_unstale":"2023-05-16T13:54:15.227447+0000","last_undegraded":"2023-05-16T13:54:15.227447+0000","last_fullsized":"2023-05-16T13:54:15.227447+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T18:03:21.802487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":175,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.234530+0000","last_change":"2023-05-16T13:54:03.495814+0000","last_active":"2023-05-16T13:54:16.234530+0000","last_peered":"2023-05-16T13:54:16.234530+0000","last_clean":"2023-05-16T13:54:16.234530+0000","last_became_active":"2023-05-16T13:54:03.494265+0000","last_became_peered":"2023-05-16T13:54:03.494265+0000","last_unstale":"2023-05-16T13:54:16.234530+0000","last_undegraded":"2023-05-16T13:54:16.234530+0000","last_fullsized":"2023-05-16T13:54:16.234530+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:01.722051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:01.722051+0000","last_clean_scrub_stamp":"2023-05-16T13:54:01.722051+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:34:14.214601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.208681+0000","last_change":"2023-05-16T13:54:09.770727+0000","last_active":"2023-05-16T13:54:15.208681+0000","last_peered":"2023-05-16T13:54:15.208681+0000","last_clean":"2023-05-16T13:54:15.208681+0000","last_became_active":"2023-05-16T13:54:09.770179+0000","last_became_peered":"2023-05-16T13:54:09.770179+0000","last_unstale":"2023-05-16T13:54:15.208681+0000","last_undegraded":"2023-05-16T13:54:15.208681+0000","last_fullsized":"2023-05-16T13:54:15.208681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:10:23.833492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.201265+0000","last_change":"2023-05-16T13:54:14.817341+0000","last_active":"2023-05-16T13:54:15.201265+0000","last_peered":"2023-05-16T13:54:15.201265+0000","last_clean":"2023-05-16T13:54:15.201265+0000","last_became_active":"2023-05-16T13:54:14.816323+0000","last_became_peered":"2023-05-16T13:54:14.816323+0000","last_unstale":"2023-05-16T13:54:15.201265+0000","last_undegraded":"2023-05-16T13:54:15.201265+0000","last_fullsized":"2023-05-16T13:54:15.201265+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T14:06:34.210491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.202234+0000","last_change":"2023-05-16T13:54:15.211549+0000","last_active":"2023-05-16T13:54:16.202234+0000","last_peered":"2023-05-16T13:54:16.202234+0000","last_clean":"2023-05-16T13:54:16.202234+0000","last_became_active":"2023-05-16T13:54:15.211277+0000","last_became_peered":"2023-05-16T13:54:15.211277+0000","last_unstale":"2023-05-16T13:54:16.202234+0000","last_undegraded":"2023-05-16T13:54:16.202234+0000","last_fullsized":"2023-05-16T13:54:16.202234+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T20:48:13.566178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.234295+0000","last_change":"2023-05-16T13:54:09.768888+0000","last_active":"2023-05-16T13:54:16.234295+0000","last_peered":"2023-05-16T13:54:16.234295+0000","last_clean":"2023-05-16T13:54:16.234295+0000","last_became_active":"2023-05-16T13:54:09.768463+0000","last_became_peered":"2023-05-16T13:54:09.768463+0000","last_unstale":"2023-05-16T13:54:16.234295+0000","last_undegraded":"2023-05-16T13:54:16.234295+0000","last_fullsized":"2023-05-16T13:54:16.234295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T14:08:30.635672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.211871+0000","last_change":"2023-05-16T13:54:14.821190+0000","last_active":"2023-05-16T13:54:15.211871+0000","last_peered":"2023-05-16T13:54:15.211871+0000","last_clean":"2023-05-16T13:54:15.211871+0000","last_became_active":"2023-05-16T13:54:14.820901+0000","last_became_peered":"2023-05-16T13:54:14.820901+0000","last_unstale":"2023-05-16T13:54:15.211871+0000","last_undegraded":"2023-05-16T13:54:15.211871+0000","last_fullsized":"2023-05-16T13:54:15.211871+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T18:23:14.075852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.237219+0000","last_change":"2023-05-16T13:54:15.229018+0000","last_active":"2023-05-16T13:54:15.237219+0000","last_peered":"2023-05-16T13:54:15.237219+0000","last_clean":"2023-05-16T13:54:15.237219+0000","last_became_active":"2023-05-16T13:54:15.228331+0000","last_became_peered":"2023-05-16T13:54:15.228331+0000","last_unstale":"2023-05-16T13:54:15.237219+0000","last_undegraded":"2023-05-16T13:54:15.237219+0000","last_fullsized":"2023-05-16T13:54:15.237219+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:01:43.505062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.196958+0000","last_change":"2023-05-16T13:54:09.821010+0000","last_active":"2023-05-16T13:54:15.196958+0000","last_peered":"2023-05-16T13:54:15.196958+0000","last_clean":"2023-05-16T13:54:15.196958+0000","last_became_active":"2023-05-16T13:54:09.820636+0000","last_became_peered":"2023-05-16T13:54:09.820636+0000","last_unstale":"2023-05-16T13:54:15.196958+0000","last_undegraded":"2023-05-16T13:54:15.196958+0000","last_fullsized":"2023-05-16T13:54:15.196958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:31:28.171875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.216724+0000","last_change":"2023-05-16T13:54:14.813276+0000","last_active":"2023-05-16T13:54:15.216724+0000","last_peered":"2023-05-16T13:54:15.216724+0000","last_clean":"2023-05-16T13:54:15.216724+0000","last_became_active":"2023-05-16T13:54:14.812929+0000","last_became_peered":"2023-05-16T13:54:14.812929+0000","last_unstale":"2023-05-16T13:54:15.216724+0000","last_undegraded":"2023-05-16T13:54:15.216724+0000","last_fullsized":"2023-05-16T13:54:15.216724+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:34:14.240375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.227608+0000","last_change":"2023-05-16T13:54:15.223291+0000","last_active":"2023-05-16T13:54:15.227608+0000","last_peered":"2023-05-16T13:54:15.227608+0000","last_clean":"2023-05-16T13:54:15.227608+0000","last_became_active":"2023-05-16T13:54:15.222994+0000","last_became_peered":"2023-05-16T13:54:15.222994+0000","last_unstale":"2023-05-16T13:54:15.227608+0000","last_undegraded":"2023-05-16T13:54:15.227608+0000","last_fullsized":"2023-05-16T13:54:15.227608+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:27:26.622822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.211975+0000","last_change":"2023-05-16T13:54:09.771040+0000","last_active":"2023-05-16T13:54:15.211975+0000","last_peered":"2023-05-16T13:54:15.211975+0000","last_clean":"2023-05-16T13:54:15.211975+0000","last_became_active":"2023-05-16T13:54:09.770433+0000","last_became_peered":"2023-05-16T13:54:09.770433+0000","last_unstale":"2023-05-16T13:54:15.211975+0000","last_undegraded":"2023-05-16T13:54:15.211975+0000","last_fullsized":"2023-05-16T13:54:15.211975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:42:33.528137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.203109+0000","last_change":"2023-05-16T13:54:14.819218+0000","last_active":"2023-05-16T13:54:16.203109+0000","last_peered":"2023-05-16T13:54:16.203109+0000","last_clean":"2023-05-16T13:54:16.203109+0000","last_became_active":"2023-05-16T13:54:14.818575+0000","last_became_peered":"2023-05-16T13:54:14.818575+0000","last_unstale":"2023-05-16T13:54:16.203109+0000","last_undegraded":"2023-05-16T13:54:16.203109+0000","last_fullsized":"2023-05-16T13:54:16.203109+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:51:03.266568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.221681+0000","last_change":"2023-05-16T13:54:15.214918+0000","last_active":"2023-05-16T13:54:15.221681+0000","last_peered":"2023-05-16T13:54:15.221681+0000","last_clean":"2023-05-16T13:54:15.221681+0000","last_became_active":"2023-05-16T13:54:15.214604+0000","last_became_peered":"2023-05-16T13:54:15.214604+0000","last_unstale":"2023-05-16T13:54:15.221681+0000","last_undegraded":"2023-05-16T13:54:15.221681+0000","last_fullsized":"2023-05-16T13:54:15.221681+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T18:23:15.082235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.212855+0000","last_change":"2023-05-16T13:54:14.823582+0000","last_active":"2023-05-16T13:54:15.212855+0000","last_peered":"2023-05-16T13:54:15.212855+0000","last_clean":"2023-05-16T13:54:15.212855+0000","last_became_active":"2023-05-16T13:54:14.822465+0000","last_became_peered":"2023-05-16T13:54:14.822465+0000","last_unstale":"2023-05-16T13:54:15.212855+0000","last_undegraded":"2023-05-16T13:54:15.212855+0000","last_fullsized":"2023-05-16T13:54:15.212855+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:58:21.875877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.221448+0000","last_change":"2023-05-16T13:54:09.813177+0000","last_active":"2023-05-16T13:54:15.221448+0000","last_peered":"2023-05-16T13:54:15.221448+0000","last_clean":"2023-05-16T13:54:15.221448+0000","last_became_active":"2023-05-16T13:54:09.812487+0000","last_became_peered":"2023-05-16T13:54:09.812487+0000","last_unstale":"2023-05-16T13:54:15.221448+0000","last_undegraded":"2023-05-16T13:54:15.221448+0000","last_fullsized":"2023-05-16T13:54:15.221448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:01:16.645390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.227557+0000","last_change":"2023-05-16T13:54:15.223198+0000","last_active":"2023-05-16T13:54:15.227557+0000","last_peered":"2023-05-16T13:54:15.227557+0000","last_clean":"2023-05-16T13:54:15.227557+0000","last_became_active":"2023-05-16T13:54:15.222906+0000","last_became_peered":"2023-05-16T13:54:15.222906+0000","last_unstale":"2023-05-16T13:54:15.227557+0000","last_undegraded":"2023-05-16T13:54:15.227557+0000","last_fullsized":"2023-05-16T13:54:15.227557+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:01:13.149263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.221304+0000","last_change":"2023-05-16T13:54:14.814607+0000","last_active":"2023-05-16T13:54:15.221304+0000","last_peered":"2023-05-16T13:54:15.221304+0000","last_clean":"2023-05-16T13:54:15.221304+0000","last_became_active":"2023-05-16T13:54:14.814268+0000","last_became_peered":"2023-05-16T13:54:14.814268+0000","last_unstale":"2023-05-16T13:54:15.221304+0000","last_undegraded":"2023-05-16T13:54:15.221304+0000","last_fullsized":"2023-05-16T13:54:15.221304+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T15:35:37.410802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.234780+0000","last_change":"2023-05-16T13:54:09.813305+0000","last_active":"2023-05-16T13:54:16.234780+0000","last_peered":"2023-05-16T13:54:16.234780+0000","last_clean":"2023-05-16T13:54:16.234780+0000","last_became_active":"2023-05-16T13:54:09.812931+0000","last_became_peered":"2023-05-16T13:54:09.812931+0000","last_unstale":"2023-05-16T13:54:16.234780+0000","last_undegraded":"2023-05-16T13:54:16.234780+0000","last_fullsized":"2023-05-16T13:54:16.234780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:21:27.677717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.237361+0000","last_change":"2023-05-16T13:54:15.232010+0000","last_active":"2023-05-16T13:54:15.237361+0000","last_peered":"2023-05-16T13:54:15.237361+0000","last_clean":"2023-05-16T13:54:15.237361+0000","last_became_active":"2023-05-16T13:54:15.231424+0000","last_became_peered":"2023-05-16T13:54:15.231424+0000","last_unstale":"2023-05-16T13:54:15.237361+0000","last_undegraded":"2023-05-16T13:54:15.237361+0000","last_fullsized":"2023-05-16T13:54:15.237361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:19:30.585369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.229404+0000","last_change":"2023-05-16T13:54:14.815504+0000","last_active":"2023-05-16T13:54:15.229404+0000","last_peered":"2023-05-16T13:54:15.229404+0000","last_clean":"2023-05-16T13:54:15.229404+0000","last_became_active":"2023-05-16T13:54:14.814336+0000","last_became_peered":"2023-05-16T13:54:14.814336+0000","last_unstale":"2023-05-16T13:54:15.229404+0000","last_undegraded":"2023-05-16T13:54:15.229404+0000","last_fullsized":"2023-05-16T13:54:15.229404+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T20:48:12.559796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.221562+0000","last_change":"2023-05-16T13:54:09.768257+0000","last_active":"2023-05-16T13:54:15.221562+0000","last_peered":"2023-05-16T13:54:15.221562+0000","last_clean":"2023-05-16T13:54:15.221562+0000","last_became_active":"2023-05-16T13:54:09.767879+0000","last_became_peered":"2023-05-16T13:54:09.767879+0000","last_unstale":"2023-05-16T13:54:15.221562+0000","last_undegraded":"2023-05-16T13:54:15.221562+0000","last_fullsized":"2023-05-16T13:54:15.221562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:23:13.709300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.225161+0000","last_change":"2023-05-16T13:54:15.219094+0000","last_active":"2023-05-16T13:54:15.225161+0000","last_peered":"2023-05-16T13:54:15.225161+0000","last_clean":"2023-05-16T13:54:15.225161+0000","last_became_active":"2023-05-16T13:54:15.210545+0000","last_became_peered":"2023-05-16T13:54:15.210545+0000","last_unstale":"2023-05-16T13:54:15.225161+0000","last_undegraded":"2023-05-16T13:54:15.225161+0000","last_fullsized":"2023-05-16T13:54:15.225161+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T20:26:37.948462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.220080+0000","last_change":"2023-05-16T13:54:14.815739+0000","last_active":"2023-05-16T13:54:15.220080+0000","last_peered":"2023-05-16T13:54:15.220080+0000","last_clean":"2023-05-16T13:54:15.220080+0000","last_became_active":"2023-05-16T13:54:14.815433+0000","last_became_peered":"2023-05-16T13:54:14.815433+0000","last_unstale":"2023-05-16T13:54:15.220080+0000","last_undegraded":"2023-05-16T13:54:15.220080+0000","last_fullsized":"2023-05-16T13:54:15.220080+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:34:14.240375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.202058+0000","last_change":"2023-05-16T13:54:09.768603+0000","last_active":"2023-05-16T13:54:16.202058+0000","last_peered":"2023-05-16T13:54:16.202058+0000","last_clean":"2023-05-16T13:54:16.202058+0000","last_became_active":"2023-05-16T13:54:09.768323+0000","last_became_peered":"2023-05-16T13:54:09.768323+0000","last_unstale":"2023-05-16T13:54:16.202058+0000","last_undegraded":"2023-05-16T13:54:16.202058+0000","last_fullsized":"2023-05-16T13:54:16.202058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T15:06:40.038271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.202380+0000","last_change":"2023-05-16T13:54:15.221843+0000","last_active":"2023-05-16T13:54:16.202380+0000","last_peered":"2023-05-16T13:54:16.202380+0000","last_clean":"2023-05-16T13:54:16.202380+0000","last_became_active":"2023-05-16T13:54:15.221485+0000","last_became_peered":"2023-05-16T13:54:15.221485+0000","last_unstale":"2023-05-16T13:54:16.202380+0000","last_undegraded":"2023-05-16T13:54:16.202380+0000","last_fullsized":"2023-05-16T13:54:16.202380+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:56:30.067725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.202990+0000","last_change":"2023-05-16T13:54:15.211685+0000","last_active":"2023-05-16T13:54:16.202990+0000","last_peered":"2023-05-16T13:54:16.202990+0000","last_clean":"2023-05-16T13:54:16.202990+0000","last_became_active":"2023-05-16T13:54:15.210427+0000","last_became_peered":"2023-05-16T13:54:15.210427+0000","last_unstale":"2023-05-16T13:54:16.202990+0000","last_undegraded":"2023-05-16T13:54:16.202990+0000","last_fullsized":"2023-05-16T13:54:16.202990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:18:56.753459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"23'6","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.202865+0000","last_change":"2023-05-16T13:54:14.818519+0000","last_active":"2023-05-16T13:54:16.202865+0000","last_peered":"2023-05-16T13:54:16.202865+0000","last_clean":"2023-05-16T13:54:16.202865+0000","last_became_active":"2023-05-16T13:54:14.818006+0000","last_became_peered":"2023-05-16T13:54:14.818006+0000","last_unstale":"2023-05-16T13:54:16.202865+0000","last_undegraded":"2023-05-16T13:54:16.202865+0000","last_fullsized":"2023-05-16T13:54:16.202865+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T14:08:35.662558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.224846+0000","last_change":"2023-05-16T13:54:15.217209+0000","last_active":"2023-05-16T13:54:15.224846+0000","last_peered":"2023-05-16T13:54:15.224846+0000","last_clean":"2023-05-16T13:54:15.224846+0000","last_became_active":"2023-05-16T13:54:15.216903+0000","last_became_peered":"2023-05-16T13:54:15.216903+0000","last_unstale":"2023-05-16T13:54:15.224846+0000","last_undegraded":"2023-05-16T13:54:15.224846+0000","last_fullsized":"2023-05-16T13:54:15.224846+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:19:30.585369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.234591+0000","last_change":"2023-05-16T13:54:14.819409+0000","last_active":"2023-05-16T13:54:16.234591+0000","last_peered":"2023-05-16T13:54:16.234591+0000","last_clean":"2023-05-16T13:54:16.234591+0000","last_became_active":"2023-05-16T13:54:14.818998+0000","last_became_peered":"2023-05-16T13:54:14.818998+0000","last_unstale":"2023-05-16T13:54:16.234591+0000","last_undegraded":"2023-05-16T13:54:16.234591+0000","last_fullsized":"2023-05-16T13:54:16.234591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:03:23.695584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.210460+0000","last_change":"2023-05-16T13:54:14.826757+0000","last_active":"2023-05-16T13:54:15.210460+0000","last_peered":"2023-05-16T13:54:15.210460+0000","last_clean":"2023-05-16T13:54:15.210460+0000","last_became_active":"2023-05-16T13:54:14.826437+0000","last_became_peered":"2023-05-16T13:54:14.826437+0000","last_unstale":"2023-05-16T13:54:15.210460+0000","last_undegraded":"2023-05-16T13:54:15.210460+0000","last_fullsized":"2023-05-16T13:54:15.210460+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:13:17.386163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.222430+0000","last_change":"2023-05-16T13:54:15.217104+0000","last_active":"2023-05-16T13:54:15.222430+0000","last_peered":"2023-05-16T13:54:15.222430+0000","last_clean":"2023-05-16T13:54:15.222430+0000","last_became_active":"2023-05-16T13:54:15.212495+0000","last_became_peered":"2023-05-16T13:54:15.212495+0000","last_unstale":"2023-05-16T13:54:15.222430+0000","last_undegraded":"2023-05-16T13:54:15.222430+0000","last_fullsized":"2023-05-16T13:54:15.222430+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:10:29.866761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.218262+0000","last_change":"2023-05-16T13:54:14.828109+0000","last_active":"2023-05-16T13:54:15.218262+0000","last_peered":"2023-05-16T13:54:15.218262+0000","last_clean":"2023-05-16T13:54:15.218262+0000","last_became_active":"2023-05-16T13:54:14.827726+0000","last_became_peered":"2023-05-16T13:54:14.827726+0000","last_unstale":"2023-05-16T13:54:15.218262+0000","last_undegraded":"2023-05-16T13:54:15.218262+0000","last_fullsized":"2023-05-16T13:54:15.218262+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T18:03:20.796104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.226692+0000","last_change":"2023-05-16T13:54:15.219614+0000","last_active":"2023-05-16T13:54:15.226692+0000","last_peered":"2023-05-16T13:54:15.226692+0000","last_clean":"2023-05-16T13:54:15.226692+0000","last_became_active":"2023-05-16T13:54:15.219282+0000","last_became_peered":"2023-05-16T13:54:15.219282+0000","last_unstale":"2023-05-16T13:54:15.226692+0000","last_undegraded":"2023-05-16T13:54:15.226692+0000","last_fullsized":"2023-05-16T13:54:15.226692+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:21:42.482045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.202073+0000","last_change":"2023-05-16T13:54:15.223067+0000","last_active":"2023-05-16T13:54:16.202073+0000","last_peered":"2023-05-16T13:54:16.202073+0000","last_clean":"2023-05-16T13:54:16.202073+0000","last_became_active":"2023-05-16T13:54:15.222802+0000","last_became_peered":"2023-05-16T13:54:15.222802+0000","last_unstale":"2023-05-16T13:54:16.202073+0000","last_undegraded":"2023-05-16T13:54:16.202073+0000","last_fullsized":"2023-05-16T13:54:16.202073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:20:01.628237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.202361+0000","last_change":"2023-05-16T13:54:14.818182+0000","last_active":"2023-05-16T13:54:15.202361+0000","last_peered":"2023-05-16T13:54:15.202361+0000","last_clean":"2023-05-16T13:54:15.202361+0000","last_became_active":"2023-05-16T13:54:14.817829+0000","last_became_peered":"2023-05-16T13:54:14.817829+0000","last_unstale":"2023-05-16T13:54:15.202361+0000","last_undegraded":"2023-05-16T13:54:15.202361+0000","last_fullsized":"2023-05-16T13:54:15.202361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T18:27:39.059086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.237248+0000","last_change":"2023-05-16T13:54:15.229143+0000","last_active":"2023-05-16T13:54:15.237248+0000","last_peered":"2023-05-16T13:54:15.237248+0000","last_clean":"2023-05-16T13:54:15.237248+0000","last_became_active":"2023-05-16T13:54:15.228615+0000","last_became_peered":"2023-05-16T13:54:15.228615+0000","last_unstale":"2023-05-16T13:54:15.237248+0000","last_undegraded":"2023-05-16T13:54:15.237248+0000","last_fullsized":"2023-05-16T13:54:15.237248+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:01:13.149263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.222343+0000","last_change":"2023-05-16T13:54:14.820677+0000","last_active":"2023-05-16T13:54:15.222343+0000","last_peered":"2023-05-16T13:54:15.222343+0000","last_clean":"2023-05-16T13:54:15.222343+0000","last_became_active":"2023-05-16T13:54:14.820386+0000","last_became_peered":"2023-05-16T13:54:14.820386+0000","last_unstale":"2023-05-16T13:54:15.222343+0000","last_undegraded":"2023-05-16T13:54:15.222343+0000","last_fullsized":"2023-05-16T13:54:15.222343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:52:14.097165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.225218+0000","last_change":"2023-05-16T13:54:15.219472+0000","last_active":"2023-05-16T13:54:15.225218+0000","last_peered":"2023-05-16T13:54:15.225218+0000","last_clean":"2023-05-16T13:54:15.225218+0000","last_became_active":"2023-05-16T13:54:15.219173+0000","last_became_peered":"2023-05-16T13:54:15.219173+0000","last_unstale":"2023-05-16T13:54:15.225218+0000","last_undegraded":"2023-05-16T13:54:15.225218+0000","last_fullsized":"2023-05-16T13:54:15.225218+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T16:38:03.641008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.202997+0000","last_change":"2023-05-16T13:54:14.814610+0000","last_active":"2023-05-16T13:54:16.202997+0000","last_peered":"2023-05-16T13:54:16.202997+0000","last_clean":"2023-05-16T13:54:16.202997+0000","last_became_active":"2023-05-16T13:54:14.814132+0000","last_became_peered":"2023-05-16T13:54:14.814132+0000","last_unstale":"2023-05-16T13:54:16.202997+0000","last_undegraded":"2023-05-16T13:54:16.202997+0000","last_fullsized":"2023-05-16T13:54:16.202997+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T20:40:58.823162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.225347+0000","last_change":"2023-05-16T13:54:15.218356+0000","last_active":"2023-05-16T13:54:15.225347+0000","last_peered":"2023-05-16T13:54:15.225347+0000","last_clean":"2023-05-16T13:54:15.225347+0000","last_became_active":"2023-05-16T13:54:15.218043+0000","last_became_peered":"2023-05-16T13:54:15.218043+0000","last_unstale":"2023-05-16T13:54:15.225347+0000","last_undegraded":"2023-05-16T13:54:15.225347+0000","last_fullsized":"2023-05-16T13:54:15.225347+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T14:55:56.380737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.234189+0000","last_change":"2023-05-16T13:54:14.822015+0000","last_active":"2023-05-16T13:54:15.234189+0000","last_peered":"2023-05-16T13:54:15.234189+0000","last_clean":"2023-05-16T13:54:15.234189+0000","last_became_active":"2023-05-16T13:54:14.821739+0000","last_became_peered":"2023-05-16T13:54:14.821739+0000","last_unstale":"2023-05-16T13:54:15.234189+0000","last_undegraded":"2023-05-16T13:54:15.234189+0000","last_fullsized":"2023-05-16T13:54:15.234189+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:27:25.616440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.202799+0000","last_change":"2023-05-16T13:54:15.223263+0000","last_active":"2023-05-16T13:54:16.202799+0000","last_peered":"2023-05-16T13:54:16.202799+0000","last_clean":"2023-05-16T13:54:16.202799+0000","last_became_active":"2023-05-16T13:54:15.222945+0000","last_became_peered":"2023-05-16T13:54:15.222945+0000","last_unstale":"2023-05-16T13:54:16.202799+0000","last_undegraded":"2023-05-16T13:54:16.202799+0000","last_fullsized":"2023-05-16T13:54:16.202799+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:57:22.154305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.225476+0000","last_change":"2023-05-16T13:54:14.825328+0000","last_active":"2023-05-16T13:54:15.225476+0000","last_peered":"2023-05-16T13:54:15.225476+0000","last_clean":"2023-05-16T13:54:15.225476+0000","last_became_active":"2023-05-16T13:54:14.820763+0000","last_became_peered":"2023-05-16T13:54:14.820763+0000","last_unstale":"2023-05-16T13:54:15.225476+0000","last_undegraded":"2023-05-16T13:54:15.225476+0000","last_fullsized":"2023-05-16T13:54:15.225476+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:43:12.889259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.202804+0000","last_change":"2023-05-16T13:54:15.223253+0000","last_active":"2023-05-16T13:54:16.202804+0000","last_peered":"2023-05-16T13:54:16.202804+0000","last_clean":"2023-05-16T13:54:16.202804+0000","last_became_active":"2023-05-16T13:54:15.222884+0000","last_became_peered":"2023-05-16T13:54:15.222884+0000","last_unstale":"2023-05-16T13:54:16.202804+0000","last_undegraded":"2023-05-16T13:54:16.202804+0000","last_fullsized":"2023-05-16T13:54:16.202804+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:05:33.250909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.225872+0000","last_change":"2023-05-16T13:54:14.827946+0000","last_active":"2023-05-16T13:54:15.225872+0000","last_peered":"2023-05-16T13:54:15.225872+0000","last_clean":"2023-05-16T13:54:15.225872+0000","last_became_active":"2023-05-16T13:54:14.822920+0000","last_became_peered":"2023-05-16T13:54:14.822920+0000","last_unstale":"2023-05-16T13:54:15.225872+0000","last_undegraded":"2023-05-16T13:54:15.225872+0000","last_fullsized":"2023-05-16T13:54:15.225872+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:05:38.505124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.225192+0000","last_change":"2023-05-16T13:54:15.218282+0000","last_active":"2023-05-16T13:54:15.225192+0000","last_peered":"2023-05-16T13:54:15.225192+0000","last_clean":"2023-05-16T13:54:15.225192+0000","last_became_active":"2023-05-16T13:54:15.217961+0000","last_became_peered":"2023-05-16T13:54:15.217961+0000","last_unstale":"2023-05-16T13:54:15.225192+0000","last_undegraded":"2023-05-16T13:54:15.225192+0000","last_fullsized":"2023-05-16T13:54:15.225192+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:33:28.701129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.226978+0000","last_change":"2023-05-16T13:54:14.810916+0000","last_active":"2023-05-16T13:54:15.226978+0000","last_peered":"2023-05-16T13:54:15.226978+0000","last_clean":"2023-05-16T13:54:15.226978+0000","last_became_active":"2023-05-16T13:54:14.810471+0000","last_became_peered":"2023-05-16T13:54:14.810471+0000","last_unstale":"2023-05-16T13:54:15.226978+0000","last_undegraded":"2023-05-16T13:54:15.226978+0000","last_fullsized":"2023-05-16T13:54:15.226978+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T18:16:20.862543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.201687+0000","last_change":"2023-05-16T13:54:15.219216+0000","last_active":"2023-05-16T13:54:16.201687+0000","last_peered":"2023-05-16T13:54:16.201687+0000","last_clean":"2023-05-16T13:54:16.201687+0000","last_became_active":"2023-05-16T13:54:15.217942+0000","last_became_peered":"2023-05-16T13:54:15.217942+0000","last_unstale":"2023-05-16T13:54:16.201687+0000","last_undegraded":"2023-05-16T13:54:16.201687+0000","last_fullsized":"2023-05-16T13:54:16.201687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T15:50:58.482925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-16T13:54:15.234449+0000","last_change":"2023-05-16T13:54:14.816978+0000","last_active":"2023-05-16T13:54:15.234449+0000","last_peered":"2023-05-16T13:54:15.234449+0000","last_clean":"2023-05-16T13:54:15.234449+0000","last_became_active":"2023-05-16T13:54:14.816681+0000","last_became_peered":"2023-05-16T13:54:14.816681+0000","last_unstale":"2023-05-16T13:54:15.234449+0000","last_undegraded":"2023-05-16T13:54:15.234449+0000","last_fullsized":"2023-05-16T13:54:15.234449+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:00:32.671694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13208,"kb_used_data":848,"kb_used_omap":0,"kb_used_meta":12352,"kb_avail":94358632,"statfs":{"total":96636764160,"available":96623239168,"internally_reserved":0,"allocated":868352,"data_stored":683406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12648448},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]}]},{"osd":6,"up_from":15,"seq":64424509444,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12076,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":11840,"kb_avail":94359764,"statfs":{"total":96636764160,"available":96624398336,"internally_reserved":0,"allocated":233472,"data_stored":84605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12124160},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]}]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12084,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":11840,"kb_avail":94359756,"statfs":{"total":96636764160,"available":96624390144,"internally_reserved":0,"allocated":241664,"data_stored":85257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12124160},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12160,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":11904,"kb_avail":94359680,"statfs":{"total":96636764160,"available":96624312320,"internally_reserved":0,"allocated":253952,"data_stored":86225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12189696},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]}]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12000,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":11776,"kb_avail":94359840,"statfs":{"total":96636764160,"available":96624476160,"internally_reserved":0,"allocated":221184,"data_stored":77477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12058624},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]}]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7904,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":7680,"kb_avail":94363936,"statfs":{"total":96636764160,"available":96628670464,"internally_reserved":0,"allocated":221184,"data_stored":77477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7864320},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]}]},{"osd":1,"up_from":14,"seq":60129542148,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12140,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":11904,"kb_avail":94359700,"statfs":{"total":96636764160,"available":96624332800,"internally_reserved":0,"allocated":233472,"data_stored":84605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12189696},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0569999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]}]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9076,"kb_used_data":812,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362764,"statfs":{"total":96636764160,"available":96627470336,"internally_reserved":0,"allocated":831488,"data_stored":675555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-16T13:54:19.668 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-05-16T13:54:19.668 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-05-16T13:54:19.669 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-05-16T13:54:19.669 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-05-16T13:54:19.669 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-05-16T13:54:19.840 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.834+0000 7f88fd8c3640 1 Processor -- start 2023-05-16T13:54:19.840 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.834+0000 7f88fd8c3640 1 -- start start 2023-05-16T13:54:19.841 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.834+0000 7f88fd8c3640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f88f81598b0 0x7f88f815cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:19.841 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.834+0000 7f88fd8c3640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f88f80b4b00 0x7f88f80d01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:19.842 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.834+0000 7f88fd8c3640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88f8159c80 con 0x7f88f80d06f0 2023-05-16T13:54:19.842 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.834+0000 7f88fd8c3640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88f815d270 con 0x7f88f80b4b00 2023-05-16T13:54:19.842 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.834+0000 7f88fd8c3640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88f80cd390 con 0x7f88f81598b0 2023-05-16T13:54:19.842 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.834+0000 7f88f7fff640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f88f80b4b00 0x7f88f80d01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:19.842 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.834+0000 7f88fd0c2640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f88f80d06f0 0x7f88f80cf000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:38260/0 (socket says 172.21.15.39:38260) 2023-05-16T13:54:19.842 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.834+0000 7f88fd0c2640 1 -- 172.21.15.39:0/654814581 learned_addr learned my addr 172.21.15.39:0/654814581 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:19.843 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.834+0000 7f88fc8c1640 1 --2- 172.21.15.39:0/654814581 >> v2:172.21.15.118:3300/0 conn(0x7f88f81598b0 0x7f88f815cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:19.843 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.834+0000 7f88f7fff640 1 -- 172.21.15.39:0/654814581 >> v2:172.21.15.118:3300/0 conn(0x7f88f81598b0 msgr2=0x7f88f815cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:19.843 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.834+0000 7f88f7fff640 1 --2- 172.21.15.39:0/654814581 >> v2:172.21.15.118:3300/0 conn(0x7f88f81598b0 0x7f88f815cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:19.843 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.834+0000 7f88f7fff640 1 -- 172.21.15.39:0/654814581 >> v1:172.21.15.39:6789/0 conn(0x7f88f80d06f0 legacy=0x7f88f80cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:19.843 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.834+0000 7f88f7fff640 1 -- 172.21.15.39:0/654814581 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f80ccdd0 con 0x7f88f80b4b00 2023-05-16T13:54:19.844 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.834+0000 7f88f77fe640 1 -- 172.21.15.39:0/654814581 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2486557807 0 0) 0x7f88f8159c80 con 0x7f88f80d06f0 2023-05-16T13:54:19.844 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.838+0000 7f88f7fff640 1 --2- 172.21.15.39:0/654814581 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88f80b4b00 0x7f88f80d01b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f88f8066ee0 tx=0x7f88e401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e05c4f7f9760f1a1 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:19.845 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.838+0000 7f88f77fe640 1 -- 172.21.15.39:0/654814581 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e40ab600 con 0x7f88f80b4b00 2023-05-16T13:54:19.845 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.838+0000 7f88f77fe640 1 -- 172.21.15.39:0/654814581 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88e40a7050 con 0x7f88f80b4b00 2023-05-16T13:54:19.845 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.838+0000 7f88f77fe640 1 -- 172.21.15.39:0/654814581 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e40ab980 con 0x7f88f80b4b00 2023-05-16T13:54:19.846 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.838+0000 7f88fd8c3640 1 -- 172.21.15.39:0/654814581 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88f80b4b00 msgr2=0x7f88f80d01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:19.846 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.838+0000 7f88fd8c3640 1 --2- 172.21.15.39:0/654814581 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88f80b4b00 0x7f88f80d01b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f88f8066ee0 tx=0x7f88e401c440 comp rx=0 tx=0).stop 2023-05-16T13:54:19.846 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.838+0000 7f88fd8c3640 1 -- 172.21.15.39:0/654814581 shutdown_connections 2023-05-16T13:54:19.846 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.838+0000 7f88fd8c3640 1 --2- 172.21.15.39:0/654814581 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88f80b4b00 0x7f88f80d01b0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:19.847 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.838+0000 7f88fd8c3640 1 --2- 172.21.15.39:0/654814581 >> v2:172.21.15.118:3300/0 conn(0x7f88f81598b0 0x7f88f815cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:19.847 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.838+0000 7f88fd8c3640 1 -- 172.21.15.39:0/654814581 >> 172.21.15.39:0/654814581 conn(0x7f88f806aad0 msgr2=0x7f88f806aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:19.847 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.838+0000 7f88fd8c3640 1 -- 172.21.15.39:0/654814581 shutdown_connections 2023-05-16T13:54:19.847 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.838+0000 7f88fd8c3640 1 -- 172.21.15.39:0/654814581 wait complete. 2023-05-16T13:54:19.848 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.838+0000 7f88fd8c3640 1 Processor -- start 2023-05-16T13:54:19.848 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.842+0000 7f88fd8c3640 1 -- start start 2023-05-16T13:54:19.849 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.842+0000 7f88fd8c3640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88f80b4b00 0x7f88f814edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:19.849 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.842+0000 7f88fd8c3640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88f80d06f0 0x7f88f815f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:19.849 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.842+0000 7f88fd8c3640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f88f81598b0 0x7f88f815fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:19.849 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.842+0000 7f88fd8c3640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f8157d60 con 0x7f88f80b4b00 2023-05-16T13:54:19.849 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.842+0000 7f88fd8c3640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f8158040 con 0x7f88f80d06f0 2023-05-16T13:54:19.850 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.842+0000 7f88fd8c3640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88f8158320 con 0x7f88f81598b0 2023-05-16T13:54:19.850 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.842+0000 7f88fc8c1640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88f80b4b00 0x7f88f814edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:19.850 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.842+0000 7f88fc8c1640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88f80b4b00 0x7f88f814edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38120/0 (socket says 172.21.15.39:38120) 2023-05-16T13:54:19.850 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.842+0000 7f88fc8c1640 1 -- 172.21.15.39:0/3600222139 learned_addr learned my addr 172.21.15.39:0/3600222139 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:19.850 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.842+0000 7f88f7fff640 1 --2- 172.21.15.39:0/3600222139 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88f80d06f0 0x7f88f815f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:19.850 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.842+0000 7f88fd0c2640 1 --2- 172.21.15.39:0/3600222139 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f88f81598b0 0x7f88f815fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:19.851 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.842+0000 7f88fc8c1640 1 -- 172.21.15.39:0/3600222139 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f88f81598b0 msgr2=0x7f88f815fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:19.851 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.842+0000 7f88fc8c1640 1 --2- 172.21.15.39:0/3600222139 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f88f81598b0 0x7f88f815fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:19.851 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.842+0000 7f88fc8c1640 1 -- 172.21.15.39:0/3600222139 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88f80d06f0 msgr2=0x7f88f815f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:19.852 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.842+0000 7f88fc8c1640 1 --2- 172.21.15.39:0/3600222139 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88f80d06f0 0x7f88f815f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:19.852 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.842+0000 7f88fc8c1640 1 -- 172.21.15.39:0/3600222139 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e4009420 con 0x7f88f80b4b00 2023-05-16T13:54:19.852 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.842+0000 7f88fd0c2640 1 --2- 172.21.15.39:0/3600222139 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f88f81598b0 0x7f88f815fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:54:19.852 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.842+0000 7f88fc8c1640 1 --2- 172.21.15.39:0/3600222139 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88f80b4b00 0x7f88f814edc0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f88ec00d5f0 tx=0x7f88ec00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:19.852 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.842+0000 7f88f57fa640 1 -- 172.21.15.39:0/3600222139 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ec0125f0 con 0x7f88f80b4b00 2023-05-16T13:54:19.852 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.842+0000 7f88f57fa640 1 -- 172.21.15.39:0/3600222139 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88ec012750 con 0x7f88f80b4b00 2023-05-16T13:54:19.852 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.842+0000 7f88f57fa640 1 -- 172.21.15.39:0/3600222139 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ec012ae0 con 0x7f88f80b4b00 2023-05-16T13:54:19.853 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.842+0000 7f88fd8c3640 1 -- 172.21.15.39:0/3600222139 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88f80ce790 con 0x7f88f80b4b00 2023-05-16T13:54:19.853 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.842+0000 7f88fd8c3640 1 -- 172.21.15.39:0/3600222139 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88f80b4fa0 con 0x7f88f80b4b00 2023-05-16T13:54:19.853 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.842+0000 7f88fd8c3640 1 -- 172.21.15.39:0/3600222139 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88f8168ba0 con 0x7f88f80b4b00 2023-05-16T13:54:19.853 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.846+0000 7f88f57fa640 1 -- 172.21.15.39:0/3600222139 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f88ec012c40 con 0x7f88f80b4b00 2023-05-16T13:54:19.854 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.846+0000 7f88f57fa640 1 --2- 172.21.15.39:0/3600222139 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f88dc066280 0x7f88dc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:19.854 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.846+0000 7f88f57fa640 1 -- 172.21.15.39:0/3600222139 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f88ec084120 con 0x7f88f80b4b00 2023-05-16T13:54:19.854 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.846+0000 7f88f7fff640 1 --2- 172.21.15.39:0/3600222139 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f88dc066280 0x7f88dc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:19.854 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.846+0000 7f88f7fff640 1 --2- 172.21.15.39:0/3600222139 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f88dc066280 0x7f88dc068730 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f88e40ad000 tx=0x7f88e4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:19.856 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:19.850+0000 7f88f57fa640 1 -- 172.21.15.39:0/3600222139 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f88ec051630 con 0x7f88f80b4b00 2023-05-16T13:54:20.047 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.038+0000 7f88fd8c3640 1 -- 172.21.15.39:0/3600222139 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f88f804ed20 con 0x7f88f80b4b00 2023-05-16T13:54:20.049 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.042+0000 7f88f57fa640 1 -- 172.21.15.39:0/3600222139 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164237 (secure 0 0 0) 0x7f88ec054c50 con 0x7f88f80b4b00 2023-05-16T13:54:20.051 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:54:20.052 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.046+0000 7f88fd8c3640 1 -- 172.21.15.39:0/3600222139 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f88dc066280 msgr2=0x7f88dc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:20.052 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.046+0000 7f88fd8c3640 1 --2- 172.21.15.39:0/3600222139 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f88dc066280 0x7f88dc068730 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f88e40ad000 tx=0x7f88e4008040 comp rx=0 tx=0).stop 2023-05-16T13:54:20.053 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.046+0000 7f88fd8c3640 1 -- 172.21.15.39:0/3600222139 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88f80b4b00 msgr2=0x7f88f814edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:20.053 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.046+0000 7f88fd8c3640 1 --2- 172.21.15.39:0/3600222139 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88f80b4b00 0x7f88f814edc0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f88ec00d5f0 tx=0x7f88ec00dab0 comp rx=0 tx=0).stop 2023-05-16T13:54:20.053 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.046+0000 7f88fd8c3640 1 -- 172.21.15.39:0/3600222139 shutdown_connections 2023-05-16T13:54:20.053 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.046+0000 7f88fd8c3640 1 --2- 172.21.15.39:0/3600222139 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f88dc066280 0x7f88dc068730 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:20.053 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.046+0000 7f88fd8c3640 1 --2- 172.21.15.39:0/3600222139 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f88f81598b0 0x7f88f815fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:20.053 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.046+0000 7f88fd8c3640 1 --2- 172.21.15.39:0/3600222139 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88f80d06f0 0x7f88f815f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:20.054 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.046+0000 7f88fd8c3640 1 --2- 172.21.15.39:0/3600222139 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88f80b4b00 0x7f88f814edc0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:20.054 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.046+0000 7f88fd8c3640 1 -- 172.21.15.39:0/3600222139 >> 172.21.15.39:0/3600222139 conn(0x7f88f806aad0 msgr2=0x7f88f8159e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:20.054 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.046+0000 7f88fd8c3640 1 -- 172.21.15.39:0/3600222139 shutdown_connections 2023-05-16T13:54:20.054 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.046+0000 7f88fd8c3640 1 -- 172.21.15.39:0/3600222139 wait complete. 2023-05-16T13:54:20.071 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":5,"active_gid":4098,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":288296800},{"type":"v1","addr":"172.21.15.39:6833","nonce":288296800}]},"active_addr":"172.21.15.39:6833/288296800","active_change":"2023-05-16T13:53:54.816260+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4111,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.39:0","nonce":3030385831}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.39:0","nonce":668025957}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.39:0","nonce":1924076512}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.39:0","nonce":934330533}]}]} 2023-05-16T13:54:20.075 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-05-16T13:54:20.076 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-05-16T13:54:20.076 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-16T13:54:20.213 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.206+0000 7f942dd98640 1 Processor -- start 2023-05-16T13:54:20.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.206+0000 7f942dd98640 1 -- start start 2023-05-16T13:54:20.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.206+0000 7f942dd98640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f942815c470 0x7f94280d0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:20.215 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.206+0000 7f942dd98640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f94280b49b0 0x7f94280ce5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:20.215 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.206+0000 7f942dd98640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94280ce150 con 0x7f94280b5670 2023-05-16T13:54:20.215 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.206+0000 7f942dd98640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94280cd890 con 0x7f942815c470 2023-05-16T13:54:20.215 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.206+0000 7f942dd98640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94280d0c60 con 0x7f94280b49b0 2023-05-16T13:54:20.215 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.206+0000 7f9426ffd640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f94280b5670 0x7f94280b42a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:38266/0 (socket says 172.21.15.39:38266) 2023-05-16T13:54:20.215 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.206+0000 7f9426ffd640 1 -- 172.21.15.39:0/1848084213 learned_addr learned my addr 172.21.15.39:0/1848084213 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:20.216 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.206+0000 7f94277fe640 1 --2- 172.21.15.39:0/1848084213 >> v2:172.21.15.118:3300/0 conn(0x7f942815c470 0x7f94280d0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:20.216 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.206+0000 7f9427fff640 1 --2- 172.21.15.39:0/1848084213 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f94280b49b0 0x7f94280ce5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:20.216 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.206+0000 7f94267fc640 1 -- 172.21.15.39:0/1848084213 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3406479867 0 0) 0x7f94280ce150 con 0x7f94280b5670 2023-05-16T13:54:20.216 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.206+0000 7f94267fc640 1 -- 172.21.15.39:0/1848084213 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9410003530 con 0x7f94280b5670 2023-05-16T13:54:20.216 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.206+0000 7f94277fe640 1 -- 172.21.15.39:0/1848084213 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f94280b49b0 msgr2=0x7f94280ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:20.217 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.206+0000 7f94277fe640 1 --2- 172.21.15.39:0/1848084213 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f94280b49b0 0x7f94280ce5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:20.217 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.206+0000 7f94277fe640 1 -- 172.21.15.39:0/1848084213 >> v1:172.21.15.39:6789/0 conn(0x7f94280b5670 legacy=0x7f94280b42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:20.217 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.210+0000 7f94277fe640 1 -- 172.21.15.39:0/1848084213 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94280cdb00 con 0x7f942815c470 2023-05-16T13:54:20.218 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.210+0000 7f94277fe640 1 --2- 172.21.15.39:0/1848084213 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f942815c470 0x7f94280d0720 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f94180097a0 tx=0x7f941801c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa897982a4eda357 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:20.218 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.210+0000 7f94267fc640 1 -- 172.21.15.39:0/1848084213 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94180ab5f0 con 0x7f942815c470 2023-05-16T13:54:20.219 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.210+0000 7f94267fc640 1 -- 172.21.15.39:0/1848084213 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94180ab750 con 0x7f942815c470 2023-05-16T13:54:20.219 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.210+0000 7f94267fc640 1 -- 172.21.15.39:0/1848084213 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94180abae0 con 0x7f942815c470 2023-05-16T13:54:20.219 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.210+0000 7f942dd98640 1 -- 172.21.15.39:0/1848084213 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f942815c470 msgr2=0x7f94280d0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:20.220 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.210+0000 7f942dd98640 1 --2- 172.21.15.39:0/1848084213 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f942815c470 0x7f94280d0720 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f94180097a0 tx=0x7f941801c430 comp rx=0 tx=0).stop 2023-05-16T13:54:20.220 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.210+0000 7f942dd98640 1 -- 172.21.15.39:0/1848084213 shutdown_connections 2023-05-16T13:54:20.220 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.210+0000 7f942dd98640 1 --2- 172.21.15.39:0/1848084213 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f94280b49b0 0x7f94280ce5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:20.220 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.210+0000 7f942dd98640 1 --2- 172.21.15.39:0/1848084213 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f942815c470 0x7f94280d0720 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:20.220 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.210+0000 7f942dd98640 1 -- 172.21.15.39:0/1848084213 >> 172.21.15.39:0/1848084213 conn(0x7f942809bae0 msgr2=0x7f94280d2820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:20.220 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.210+0000 7f942dd98640 1 -- 172.21.15.39:0/1848084213 shutdown_connections 2023-05-16T13:54:20.220 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.210+0000 7f942dd98640 1 -- 172.21.15.39:0/1848084213 wait complete. 2023-05-16T13:54:20.221 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.214+0000 7f942dd98640 1 Processor -- start 2023-05-16T13:54:20.221 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.214+0000 7f942dd98640 1 -- start start 2023-05-16T13:54:20.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.214+0000 7f942dd98640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f94280b49b0 0x7f9428157890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:20.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.214+0000 7f942dd98640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f94280b5670 0x7f94280d27b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:20.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.214+0000 7f942dd98640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f942815c470 0x7f94280d2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:20.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.214+0000 7f942dd98640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94280b6e70 con 0x7f94280b5670 2023-05-16T13:54:20.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.214+0000 7f942dd98640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f942815e600 con 0x7f942815c470 2023-05-16T13:54:20.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.214+0000 7f942dd98640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f942815dc60 con 0x7f94280b49b0 2023-05-16T13:54:20.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.214+0000 7f9426ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f94280b5670 0x7f94280d27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:20.224 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.214+0000 7f9426ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f94280b5670 0x7f94280d27b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38136/0 (socket says 172.21.15.39:38136) 2023-05-16T13:54:20.224 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.214+0000 7f9426ffd640 1 -- 172.21.15.39:0/1775896810 learned_addr learned my addr 172.21.15.39:0/1775896810 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:20.224 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.214+0000 7f9427fff640 1 --2- 172.21.15.39:0/1775896810 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f942815c470 0x7f94280d2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:20.224 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.214+0000 7f94277fe640 1 --2- 172.21.15.39:0/1775896810 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f94280b49b0 0x7f9428157890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:20.224 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.214+0000 7f9426ffd640 1 -- 172.21.15.39:0/1775896810 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f94280b49b0 msgr2=0x7f9428157890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:20.224 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.214+0000 7f9426ffd640 1 --2- 172.21.15.39:0/1775896810 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f94280b49b0 0x7f9428157890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:20.224 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.214+0000 7f9426ffd640 1 -- 172.21.15.39:0/1775896810 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f942815c470 msgr2=0x7f94280d2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:20.225 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.214+0000 7f9426ffd640 1 --2- 172.21.15.39:0/1775896810 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f942815c470 0x7f94280d2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:20.225 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.214+0000 7f9426ffd640 1 -- 172.21.15.39:0/1775896810 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94180093b0 con 0x7f94280b5670 2023-05-16T13:54:20.225 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.214+0000 7f9426ffd640 1 --2- 172.21.15.39:0/1775896810 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f94280b5670 0x7f94280d27b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f941c00c500 tx=0x7f941c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:20.225 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.214+0000 7f940ffff640 1 -- 172.21.15.39:0/1775896810 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941c005cf0 con 0x7f94280b5670 2023-05-16T13:54:20.225 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.214+0000 7f940ffff640 1 -- 172.21.15.39:0/1775896810 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f941c005e50 con 0x7f94280b5670 2023-05-16T13:54:20.225 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.214+0000 7f940ffff640 1 -- 172.21.15.39:0/1775896810 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941c0072f0 con 0x7f94280b5670 2023-05-16T13:54:20.225 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.214+0000 7f942dd98640 1 -- 172.21.15.39:0/1775896810 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f942809bf70 con 0x7f94280b5670 2023-05-16T13:54:20.225 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.214+0000 7f942dd98640 1 -- 172.21.15.39:0/1775896810 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94280cef30 con 0x7f94280b5670 2023-05-16T13:54:20.226 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.218+0000 7f942dd98640 1 -- 172.21.15.39:0/1775896810 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94280d0ee0 con 0x7f94280b5670 2023-05-16T13:54:20.226 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.218+0000 7f940ffff640 1 -- 172.21.15.39:0/1775896810 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f941c007450 con 0x7f94280b5670 2023-05-16T13:54:20.226 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.218+0000 7f940ffff640 1 --2- 172.21.15.39:0/1775896810 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f9414066280 0x7f9414068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:20.226 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.218+0000 7f940ffff640 1 -- 172.21.15.39:0/1775896810 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f941c0832e0 con 0x7f94280b5670 2023-05-16T13:54:20.227 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.218+0000 7f94277fe640 1 --2- 172.21.15.39:0/1775896810 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f9414066280 0x7f9414068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:20.227 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.218+0000 7f94277fe640 1 --2- 172.21.15.39:0/1775896810 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f9414066280 0x7f9414068730 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f94180af000 tx=0x7f94180a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:20.230 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.222+0000 7f940ffff640 1 -- 172.21.15.39:0/1775896810 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f941c050800 con 0x7f94280b5670 2023-05-16T13:54:20.388 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.382+0000 7f942dd98640 1 -- 172.21.15.39:0/1775896810 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f942815e740 con 0x7f94280b5670 2023-05-16T13:54:20.389 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.382+0000 7f940ffff640 1 -- 172.21.15.39:0/1775896810 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18279 (secure 0 0 0) 0x7f941c053e20 con 0x7f94280b5670 2023-05-16T13:54:20.390 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:54:20.390 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":24,"fsid":"9c1e210b-c515-4ea4-a065-397956895c68","created":"2023-05-16T13:53:48.955290+0000","modified":"2023-05-16T13:54:16.194544+0000","last_up_change":"2023-05-16T13:54:01.722051+0000","last_in_change":"2023-05-16T13:53:52.331336+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-16T13:54:00.885009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-16T13:54:08.327895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-16T13:54:12.864823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-16T13:54:14.180225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4ce0f0ba-c4bf-4405-8c95-d2e9a62878ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6809","nonce":3462013698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6811","nonce":3462013698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6815","nonce":3462013698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6813","nonce":3462013698}]},"public_addr":"172.21.15.39:6809/3462013698","cluster_addr":"172.21.15.39:6811/3462013698","heartbeat_back_addr":"172.21.15.39:6815/3462013698","heartbeat_front_addr":"172.21.15.39:6813/3462013698","state":["exists","up"]},{"osd":1,"uuid":"53fdc1ac-2473-472d-af32-2760fdf6e476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6801","nonce":2829970892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6803","nonce":2829970892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6807","nonce":2829970892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6805","nonce":2829970892}]},"public_addr":"172.21.15.39:6801/2829970892","cluster_addr":"172.21.15.39:6803/2829970892","heartbeat_back_addr":"172.21.15.39:6807/2829970892","heartbeat_front_addr":"172.21.15.39:6805/2829970892","state":["exists","up"]},{"osd":2,"uuid":"0b92d770-7030-42fa-a19f-4f7f1ac113c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6817","nonce":3888067413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6819","nonce":3888067413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6823","nonce":3888067413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6821","nonce":3888067413}]},"public_addr":"172.21.15.39:6817/3888067413","cluster_addr":"172.21.15.39:6819/3888067413","heartbeat_back_addr":"172.21.15.39:6823/3888067413","heartbeat_front_addr":"172.21.15.39:6821/3888067413","state":["exists","up"]},{"osd":3,"uuid":"000d9506-cbb2-4017-b875-deca579860ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6825","nonce":405003958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6827","nonce":405003958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6831","nonce":405003958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6829","nonce":405003958}]},"public_addr":"172.21.15.39:6825/405003958","cluster_addr":"172.21.15.39:6827/405003958","heartbeat_back_addr":"172.21.15.39:6831/405003958","heartbeat_front_addr":"172.21.15.39:6829/405003958","state":["exists","up"]},{"osd":4,"uuid":"70f0dacb-e960-40c5-bf6a-183e52bbe2ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6801","nonce":3895278838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6805","nonce":3895278838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6813","nonce":3895278838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6809","nonce":3895278838}]},"public_addr":"172.21.15.118:6801/3895278838","cluster_addr":"172.21.15.118:6805/3895278838","heartbeat_back_addr":"172.21.15.118:6813/3895278838","heartbeat_front_addr":"172.21.15.118:6809/3895278838","state":["exists","up"]},{"osd":5,"uuid":"756feb54-c3ae-4a2a-8f74-85c291ba707c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6804","nonce":3513592808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6808","nonce":3513592808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6815","nonce":3513592808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6812","nonce":3513592808}]},"public_addr":"172.21.15.118:6804/3513592808","cluster_addr":"172.21.15.118:6808/3513592808","heartbeat_back_addr":"172.21.15.118:6815/3513592808","heartbeat_front_addr":"172.21.15.118:6812/3513592808","state":["exists","up"]},{"osd":6,"uuid":"c4a982c1-f497-4b0f-8a23-c77372e4621e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6824","nonce":1863656053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6827","nonce":1863656053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6831","nonce":1863656053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6829","nonce":1863656053}]},"public_addr":"172.21.15.118:6824/1863656053","cluster_addr":"172.21.15.118:6827/1863656053","heartbeat_back_addr":"172.21.15.118:6831/1863656053","heartbeat_front_addr":"172.21.15.118:6829/1863656053","state":["exists","up"]},{"osd":7,"uuid":"6f2888aa-a7ac-4e26-9159-e31817934f44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6817","nonce":3636642904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6819","nonce":3636642904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6825","nonce":3636642904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6821","nonce":3636642904}]},"public_addr":"172.21.15.118:6817/3636642904","cluster_addr":"172.21.15.118:6819/3636642904","heartbeat_back_addr":"172.21.15.118:6825/3636642904","heartbeat_front_addr":"172.21.15.118:6821/3636642904","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.717636+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.724036+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.739144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:58.079275+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:58.073921+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.930466+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.987813+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.941098+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-16T13:54:20.391 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.382+0000 7f942dd98640 1 -- 172.21.15.39:0/1775896810 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f9414066280 msgr2=0x7f9414068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:20.392 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.382+0000 7f942dd98640 1 --2- 172.21.15.39:0/1775896810 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f9414066280 0x7f9414068730 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f94180af000 tx=0x7f94180a7000 comp rx=0 tx=0).stop 2023-05-16T13:54:20.392 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.382+0000 7f942dd98640 1 -- 172.21.15.39:0/1775896810 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f94280b5670 msgr2=0x7f94280d27b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:20.392 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.382+0000 7f942dd98640 1 --2- 172.21.15.39:0/1775896810 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f94280b5670 0x7f94280d27b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f941c00c500 tx=0x7f941c00c9c0 comp rx=0 tx=0).stop 2023-05-16T13:54:20.392 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.382+0000 7f942dd98640 1 -- 172.21.15.39:0/1775896810 shutdown_connections 2023-05-16T13:54:20.392 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.382+0000 7f942dd98640 1 --2- 172.21.15.39:0/1775896810 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f942815c470 0x7f94280d2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:20.392 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.382+0000 7f942dd98640 1 --2- 172.21.15.39:0/1775896810 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f94280b5670 0x7f94280d27b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:20.393 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.382+0000 7f942dd98640 1 --2- 172.21.15.39:0/1775896810 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f9414066280 0x7f9414068730 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:20.393 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.382+0000 7f942dd98640 1 --2- 172.21.15.39:0/1775896810 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f94280b49b0 0x7f9428157890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:20.393 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.382+0000 7f942dd98640 1 -- 172.21.15.39:0/1775896810 >> 172.21.15.39:0/1775896810 conn(0x7f942809bae0 msgr2=0x7f94280b42a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:20.393 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.386+0000 7f942dd98640 1 -- 172.21.15.39:0/1775896810 shutdown_connections 2023-05-16T13:54:20.393 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.386+0000 7f942dd98640 1 -- 172.21.15.39:0/1775896810 wait complete. 2023-05-16T13:54:20.411 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-05-16T13:54:20.411 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-16T13:54:20.548 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.542+0000 7f6fe5e12640 1 Processor -- start 2023-05-16T13:54:20.548 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.542+0000 7f6fe5e12640 1 -- start start 2023-05-16T13:54:20.549 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.542+0000 7f6fe5e12640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f6fe015cc40 0x7f6fe00b4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:20.549 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.542+0000 7f6fe5e12640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fe0159c80 con 0x7f6fe01598b0 2023-05-16T13:54:20.549 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.542+0000 7f6fe5e12640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fe00b5040 con 0x7f6fe00cf000 2023-05-16T13:54:20.549 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.542+0000 7f6fe5e12640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fe015d270 con 0x7f6fe015cc40 2023-05-16T13:54:20.550 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.542+0000 7f6fdffff640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f6fe015cc40 0x7f6fe00b4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:20.550 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.542+0000 7f6fdffff640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f6fe015cc40 0x7f6fe00b4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38144/0 (socket says 172.21.15.39:38144) 2023-05-16T13:54:20.550 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.542+0000 7f6fdffff640 1 -- 172.21.15.39:0/3419795358 learned_addr learned my addr 172.21.15.39:0/3419795358 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:20.550 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.542+0000 7f6fdffff640 1 -- 172.21.15.39:0/3419795358 >> v1:172.21.15.118:6789/0 conn(0x7f6fe00cf000 legacy=0x7f6fe00cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:20.551 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.542+0000 7f6fdffff640 1 -- 172.21.15.39:0/3419795358 >> v1:172.21.15.39:6789/0 conn(0x7f6fe01598b0 legacy=0x7f6fe00d01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:20.551 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.542+0000 7f6fdffff640 1 -- 172.21.15.39:0/3419795358 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe00ccdd0 con 0x7f6fe015cc40 2023-05-16T13:54:20.551 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.542+0000 7f6fdf7fe640 1 -- 172.21.15.39:0/3419795358 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3753988870 0 0) 0x7f6fe0159c80 con 0x7f6fe01598b0 2023-05-16T13:54:20.552 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.546+0000 7f6fdffff640 1 --2- 172.21.15.39:0/3419795358 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6fe015cc40 0x7f6fe00b4b00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc009870 tx=0x7f6fcc01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f160e99cdd92a81d server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:20.553 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.546+0000 7f6fdf7fe640 1 -- 172.21.15.39:0/3419795358 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc0ab600 con 0x7f6fe015cc40 2023-05-16T13:54:20.553 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.546+0000 7f6fdf7fe640 1 -- 172.21.15.39:0/3419795358 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fcc0a7050 con 0x7f6fe015cc40 2023-05-16T13:54:20.553 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.546+0000 7f6fdf7fe640 1 -- 172.21.15.39:0/3419795358 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc0ab980 con 0x7f6fe015cc40 2023-05-16T13:54:20.554 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.546+0000 7f6fe5e12640 1 -- 172.21.15.39:0/3419795358 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6fe015cc40 msgr2=0x7f6fe00b4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:20.554 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.546+0000 7f6fe5e12640 1 --2- 172.21.15.39:0/3419795358 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6fe015cc40 0x7f6fe00b4b00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc009870 tx=0x7f6fcc01c500 comp rx=0 tx=0).stop 2023-05-16T13:54:20.554 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.546+0000 7f6fe5e12640 1 -- 172.21.15.39:0/3419795358 shutdown_connections 2023-05-16T13:54:20.554 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.546+0000 7f6fe5e12640 1 --2- 172.21.15.39:0/3419795358 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6fe015cc40 0x7f6fe00b4b00 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:20.554 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.546+0000 7f6fe5e12640 1 -- 172.21.15.39:0/3419795358 >> 172.21.15.39:0/3419795358 conn(0x7f6fe006aad0 msgr2=0x7f6fe006aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:20.554 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.546+0000 7f6fe5e12640 1 -- 172.21.15.39:0/3419795358 shutdown_connections 2023-05-16T13:54:20.554 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.546+0000 7f6fe5e12640 1 -- 172.21.15.39:0/3419795358 wait complete. 2023-05-16T13:54:20.555 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.546+0000 7f6fe5e12640 1 Processor -- start 2023-05-16T13:54:20.555 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.546+0000 7f6fe5e12640 1 -- start start 2023-05-16T13:54:20.557 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.550+0000 7f6fe5e12640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6fe00cf000 0x7f6fe0158950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:20.557 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.550+0000 7f6fe5e12640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6fe01598b0 0x7f6fe0151150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:20.557 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.550+0000 7f6fe5e12640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6fe015cc40 0x7f6fe00b7510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:20.557 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.550+0000 7f6fe5e12640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe00b7080 con 0x7f6fe00cf000 2023-05-16T13:54:20.557 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.550+0000 7f6fe5e12640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe00b1ad0 con 0x7f6fe015cc40 2023-05-16T13:54:20.558 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.550+0000 7f6fe5e12640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe01539e0 con 0x7f6fe01598b0 2023-05-16T13:54:20.558 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.550+0000 7f6fe4e10640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6fe00cf000 0x7f6fe0158950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:20.558 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.550+0000 7f6fe4e10640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6fe00cf000 0x7f6fe0158950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38154/0 (socket says 172.21.15.39:38154) 2023-05-16T13:54:20.558 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.550+0000 7f6fe4e10640 1 -- 172.21.15.39:0/2858484902 learned_addr learned my addr 172.21.15.39:0/2858484902 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:20.558 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.550+0000 7f6fdffff640 1 --2- 172.21.15.39:0/2858484902 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6fe01598b0 0x7f6fe0151150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:20.558 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.550+0000 7f6fe5611640 1 --2- 172.21.15.39:0/2858484902 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6fe015cc40 0x7f6fe00b7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:20.558 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.550+0000 7f6fe4e10640 1 -- 172.21.15.39:0/2858484902 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6fe01598b0 msgr2=0x7f6fe0151150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:20.558 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.550+0000 7f6fe4e10640 1 --2- 172.21.15.39:0/2858484902 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6fe01598b0 0x7f6fe0151150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:20.559 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.550+0000 7f6fe4e10640 1 -- 172.21.15.39:0/2858484902 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6fe015cc40 msgr2=0x7f6fe00b7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:20.559 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.550+0000 7f6fe4e10640 1 --2- 172.21.15.39:0/2858484902 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6fe015cc40 0x7f6fe00b7510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:20.559 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.550+0000 7f6fe4e10640 1 -- 172.21.15.39:0/2858484902 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fcc0094d0 con 0x7f6fe00cf000 2023-05-16T13:54:20.559 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.550+0000 7f6fe5611640 1 --2- 172.21.15.39:0/2858484902 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6fe015cc40 0x7f6fe00b7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:54:20.559 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.550+0000 7f6fe4e10640 1 --2- 172.21.15.39:0/2858484902 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6fe00cf000 0x7f6fe0158950 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6fd400c4d0 tx=0x7f6fd400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:20.560 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.550+0000 7f6fdd7fa640 1 -- 172.21.15.39:0/2858484902 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd4005480 con 0x7f6fe00cf000 2023-05-16T13:54:20.560 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.550+0000 7f6fdd7fa640 1 -- 172.21.15.39:0/2858484902 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fd4003600 con 0x7f6fe00cf000 2023-05-16T13:54:20.560 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.550+0000 7f6fdd7fa640 1 -- 172.21.15.39:0/2858484902 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd40039b0 con 0x7f6fe00cf000 2023-05-16T13:54:20.560 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.550+0000 7f6fe5e12640 1 -- 172.21.15.39:0/2858484902 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fe00ce790 con 0x7f6fe00cf000 2023-05-16T13:54:20.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.550+0000 7f6fe5e12640 1 -- 172.21.15.39:0/2858484902 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fe00d08c0 con 0x7f6fe00cf000 2023-05-16T13:54:20.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.550+0000 7f6fe5e12640 1 -- 172.21.15.39:0/2858484902 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fe0169bb0 con 0x7f6fe00cf000 2023-05-16T13:54:20.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.550+0000 7f6fdd7fa640 1 -- 172.21.15.39:0/2858484902 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6fd4003b10 con 0x7f6fe00cf000 2023-05-16T13:54:20.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.554+0000 7f6fdd7fa640 1 --2- 172.21.15.39:0/2858484902 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f6fc4066280 0x7f6fc4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:20.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.554+0000 7f6fdd7fa640 1 -- 172.21.15.39:0/2858484902 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6fd4083400 con 0x7f6fe00cf000 2023-05-16T13:54:20.562 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.554+0000 7f6fdffff640 1 --2- 172.21.15.39:0/2858484902 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f6fc4066280 0x7f6fc4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:20.562 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.554+0000 7f6fdffff640 1 --2- 172.21.15.39:0/2858484902 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f6fc4066280 0x7f6fc4068730 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc0ad000 tx=0x7f6fcc0a4f90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:20.564 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.558+0000 7f6fdd7fa640 1 -- 172.21.15.39:0/2858484902 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f6fd4054330 con 0x7f6fe00cf000 2023-05-16T13:54:20.721 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.714+0000 7f6fe5e12640 1 -- 172.21.15.39:0/2858484902 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6fe004ed20 con 0x7f6fe00cf000 2023-05-16T13:54:20.722 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.714+0000 7f6fdd7fa640 1 -- 172.21.15.39:0/2858484902 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18279 (secure 0 0 0) 0x7f6fd4053ec0 con 0x7f6fe00cf000 2023-05-16T13:54:20.723 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:54:20.723 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":24,"fsid":"9c1e210b-c515-4ea4-a065-397956895c68","created":"2023-05-16T13:53:48.955290+0000","modified":"2023-05-16T13:54:16.194544+0000","last_up_change":"2023-05-16T13:54:01.722051+0000","last_in_change":"2023-05-16T13:53:52.331336+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-16T13:54:00.885009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-16T13:54:08.327895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-16T13:54:12.864823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-16T13:54:14.180225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4ce0f0ba-c4bf-4405-8c95-d2e9a62878ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6809","nonce":3462013698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6811","nonce":3462013698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6815","nonce":3462013698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6813","nonce":3462013698}]},"public_addr":"172.21.15.39:6809/3462013698","cluster_addr":"172.21.15.39:6811/3462013698","heartbeat_back_addr":"172.21.15.39:6815/3462013698","heartbeat_front_addr":"172.21.15.39:6813/3462013698","state":["exists","up"]},{"osd":1,"uuid":"53fdc1ac-2473-472d-af32-2760fdf6e476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6801","nonce":2829970892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6803","nonce":2829970892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6807","nonce":2829970892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6805","nonce":2829970892}]},"public_addr":"172.21.15.39:6801/2829970892","cluster_addr":"172.21.15.39:6803/2829970892","heartbeat_back_addr":"172.21.15.39:6807/2829970892","heartbeat_front_addr":"172.21.15.39:6805/2829970892","state":["exists","up"]},{"osd":2,"uuid":"0b92d770-7030-42fa-a19f-4f7f1ac113c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6817","nonce":3888067413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6819","nonce":3888067413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6823","nonce":3888067413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6821","nonce":3888067413}]},"public_addr":"172.21.15.39:6817/3888067413","cluster_addr":"172.21.15.39:6819/3888067413","heartbeat_back_addr":"172.21.15.39:6823/3888067413","heartbeat_front_addr":"172.21.15.39:6821/3888067413","state":["exists","up"]},{"osd":3,"uuid":"000d9506-cbb2-4017-b875-deca579860ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6825","nonce":405003958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6827","nonce":405003958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6831","nonce":405003958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6829","nonce":405003958}]},"public_addr":"172.21.15.39:6825/405003958","cluster_addr":"172.21.15.39:6827/405003958","heartbeat_back_addr":"172.21.15.39:6831/405003958","heartbeat_front_addr":"172.21.15.39:6829/405003958","state":["exists","up"]},{"osd":4,"uuid":"70f0dacb-e960-40c5-bf6a-183e52bbe2ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6801","nonce":3895278838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6805","nonce":3895278838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6813","nonce":3895278838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6809","nonce":3895278838}]},"public_addr":"172.21.15.118:6801/3895278838","cluster_addr":"172.21.15.118:6805/3895278838","heartbeat_back_addr":"172.21.15.118:6813/3895278838","heartbeat_front_addr":"172.21.15.118:6809/3895278838","state":["exists","up"]},{"osd":5,"uuid":"756feb54-c3ae-4a2a-8f74-85c291ba707c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6804","nonce":3513592808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6808","nonce":3513592808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6815","nonce":3513592808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6812","nonce":3513592808}]},"public_addr":"172.21.15.118:6804/3513592808","cluster_addr":"172.21.15.118:6808/3513592808","heartbeat_back_addr":"172.21.15.118:6815/3513592808","heartbeat_front_addr":"172.21.15.118:6812/3513592808","state":["exists","up"]},{"osd":6,"uuid":"c4a982c1-f497-4b0f-8a23-c77372e4621e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6824","nonce":1863656053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6827","nonce":1863656053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6831","nonce":1863656053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6829","nonce":1863656053}]},"public_addr":"172.21.15.118:6824/1863656053","cluster_addr":"172.21.15.118:6827/1863656053","heartbeat_back_addr":"172.21.15.118:6831/1863656053","heartbeat_front_addr":"172.21.15.118:6829/1863656053","state":["exists","up"]},{"osd":7,"uuid":"6f2888aa-a7ac-4e26-9159-e31817934f44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6817","nonce":3636642904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6819","nonce":3636642904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6825","nonce":3636642904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6821","nonce":3636642904}]},"public_addr":"172.21.15.118:6817/3636642904","cluster_addr":"172.21.15.118:6819/3636642904","heartbeat_back_addr":"172.21.15.118:6825/3636642904","heartbeat_front_addr":"172.21.15.118:6821/3636642904","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.717636+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.724036+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.739144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:58.079275+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:58.073921+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.930466+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.987813+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.941098+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-16T13:54:20.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.718+0000 7f6fe5e12640 1 -- 172.21.15.39:0/2858484902 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f6fc4066280 msgr2=0x7f6fc4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:20.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.718+0000 7f6fe5e12640 1 --2- 172.21.15.39:0/2858484902 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f6fc4066280 0x7f6fc4068730 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc0ad000 tx=0x7f6fcc0a4f90 comp rx=0 tx=0).stop 2023-05-16T13:54:20.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.718+0000 7f6fe5e12640 1 -- 172.21.15.39:0/2858484902 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6fe00cf000 msgr2=0x7f6fe0158950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:20.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.718+0000 7f6fe5e12640 1 --2- 172.21.15.39:0/2858484902 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6fe00cf000 0x7f6fe0158950 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6fd400c4d0 tx=0x7f6fd400c990 comp rx=0 tx=0).stop 2023-05-16T13:54:20.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.718+0000 7f6fe5e12640 1 -- 172.21.15.39:0/2858484902 shutdown_connections 2023-05-16T13:54:20.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.718+0000 7f6fe5e12640 1 --2- 172.21.15.39:0/2858484902 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f6fc4066280 0x7f6fc4068730 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:20.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.718+0000 7f6fe5e12640 1 --2- 172.21.15.39:0/2858484902 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6fe01598b0 0x7f6fe0151150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:20.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.718+0000 7f6fe5e12640 1 --2- 172.21.15.39:0/2858484902 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6fe015cc40 0x7f6fe00b7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:20.726 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.718+0000 7f6fe5e12640 1 --2- 172.21.15.39:0/2858484902 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6fe00cf000 0x7f6fe0158950 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:20.726 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.718+0000 7f6fe5e12640 1 -- 172.21.15.39:0/2858484902 >> 172.21.15.39:0/2858484902 conn(0x7f6fe006aad0 msgr2=0x7f6fe00d1760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:20.726 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.718+0000 7f6fe5e12640 1 -- 172.21.15.39:0/2858484902 shutdown_connections 2023-05-16T13:54:20.726 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.718+0000 7f6fe5e12640 1 -- 172.21.15.39:0/2858484902 wait complete. 2023-05-16T13:54:20.745 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-05-16T13:54:20.745 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-05-16T13:54:20.746 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-05-16T13:54:20.746 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-05-16T13:54:20.747 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-05-16T13:54:20.747 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-05-16T13:54:20.747 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-05-16T13:54:20.748 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-05-16T13:54:20.933 INFO:tasks.ceph.mds.c.smithi039.stderr:2023-05-16T13:54:20.926+0000 7f5b6f797640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-05-16T13:54:20.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.978+0000 7f7f61bdf640 1 Processor -- start 2023-05-16T13:54:20.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.982+0000 7f7f61bdf640 1 -- start start 2023-05-16T13:54:20.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.982+0000 7f287afdf640 1 Processor -- start 2023-05-16T13:54:20.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.982+0000 7f7f61bdf640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7f5c1605c0 0x7f7f5c0b0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:20.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.982+0000 7f7f61bdf640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f7f5c0718b0 0x7f7f5c0d1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:20.990 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.982+0000 7f7f61bdf640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f5c09bf80 con 0x7f7f5c0d1b90 2023-05-16T13:54:20.990 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.982+0000 7f7f61bdf640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f5c0b1830 con 0x7f7f5c0718b0 2023-05-16T13:54:20.990 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.982+0000 7f7f61bdf640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5c0d2000 con 0x7f7f5c1605c0 2023-05-16T13:54:20.990 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.982+0000 7f7f5bfff640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f7f5c0718b0 0x7f7f5c0d1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:20.991 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.982+0000 7f7f5bfff640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f7f5c0718b0 0x7f7f5c0d1650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59696/0 (socket says 172.21.15.39:59696) 2023-05-16T13:54:20.991 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.982+0000 7f7f5bfff640 1 -- 172.21.15.39:0/587035644 learned_addr learned my addr 172.21.15.39:0/587035644 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:20.991 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.982+0000 7f7f60bdd640 1 --2- 172.21.15.39:0/587035644 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7f5c1605c0 0x7f7f5c0b0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:20.991 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.982+0000 7f7f5bfff640 1 -- 172.21.15.39:0/587035644 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7f5c1605c0 msgr2=0x7f7f5c0b0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:20.992 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.982+0000 7f7f5bfff640 1 --2- 172.21.15.39:0/587035644 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7f5c1605c0 0x7f7f5c0b0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:20.992 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.982+0000 7f7f5bfff640 1 -- 172.21.15.39:0/587035644 >> v1:172.21.15.39:6789/0 conn(0x7f7f5c0d1b90 legacy=0x7f7f5c164050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:20.992 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.982+0000 7f7f5bfff640 1 -- 172.21.15.39:0/587035644 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f5c09aae0 con 0x7f7f5c0718b0 2023-05-16T13:54:20.992 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.982+0000 7f287afdf640 1 -- start start 2023-05-16T13:54:20.993 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.986+0000 7f287afdf640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f28740afcf0 0x7f287415bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:20.993 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.986+0000 7f287afdf640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28741584f0 con 0x7f28740cb200 2023-05-16T13:54:20.993 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.986+0000 7f287afdf640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28740ccbf0 con 0x7f2874158120 2023-05-16T13:54:20.993 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.986+0000 7f287afdf640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f287415c160 con 0x7f28740afcf0 2023-05-16T13:54:20.993 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.986+0000 7f28797dc640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f28740cb200 0x7f28740cd080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:60690/0 (socket says 172.21.15.39:60690) 2023-05-16T13:54:20.993 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.986+0000 7f28797dc640 1 -- 172.21.15.39:0/1658318073 learned_addr learned my addr 172.21.15.39:0/1658318073 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:20.994 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.986+0000 7f2878fdb640 1 -- 172.21.15.39:0/1658318073 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 843291244 0 0) 0x7f28741584f0 con 0x7f28740cb200 2023-05-16T13:54:20.994 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.986+0000 7f2878fdb640 1 -- 172.21.15.39:0/1658318073 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2860003530 con 0x7f28740cb200 2023-05-16T13:54:20.994 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.986+0000 7f2878fdb640 1 -- 172.21.15.39:0/1658318073 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1697401296 0 0) 0x7f28740ccbf0 con 0x7f2874158120 2023-05-16T13:54:20.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.986+0000 7f2878fdb640 1 -- 172.21.15.39:0/1658318073 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28741584f0 con 0x7f2874158120 2023-05-16T13:54:20.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.986+0000 7f2878fdb640 1 -- 172.21.15.39:0/1658318073 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2197887964 0 0) 0x7f2860003530 con 0x7f28740cb200 2023-05-16T13:54:20.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.986+0000 7f2878fdb640 1 -- 172.21.15.39:0/1658318073 >> v2:172.21.15.39:3300/0 conn(0x7f28740afcf0 msgr2=0x7f287415bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:20.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.986+0000 7f2878fdb640 1 --2- 172.21.15.39:0/1658318073 >> v2:172.21.15.39:3300/0 conn(0x7f28740afcf0 0x7f287415bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:20.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.986+0000 7f2878fdb640 1 -- 172.21.15.39:0/1658318073 >> v1:172.21.15.118:6789/0 conn(0x7f2874158120 legacy=0x7f28740caaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:20.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.986+0000 7f2878fdb640 1 -- 172.21.15.39:0/1658318073 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f287415c440 con 0x7f28740cb200 2023-05-16T13:54:20.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.986+0000 7f2878fdb640 1 -- 172.21.15.39:0/1658318073 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1738805496 0 0) 0x7f286c001980 con 0x7f28740cb200 2023-05-16T13:54:20.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.986+0000 7f2878fdb640 1 -- 172.21.15.39:0/1658318073 >> v1:172.21.15.39:6789/0 conn(0x7f28740cb200 legacy=0x7f28740cd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:20.997 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.990+0000 7f2878fdb640 1 --2- 172.21.15.39:0/1658318073 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2860003bd0 0x7f2860003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:20.997 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.990+0000 7f2878fdb640 1 --2- 172.21.15.39:0/1658318073 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28600047d0 0x7f2860004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:20.997 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.990+0000 7f2878fdb640 1 --2- 172.21.15.39:0/1658318073 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f28600052d0 0x7f286000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:20.997 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.990+0000 7f2878fdb640 1 -- 172.21.15.39:0/1658318073 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287415c160 con 0x7f28600052d0 2023-05-16T13:54:20.997 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.990+0000 7f2878fdb640 1 -- 172.21.15.39:0/1658318073 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f286000c160 con 0x7f28600047d0 2023-05-16T13:54:20.997 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.990+0000 7f2878fdb640 1 -- 172.21.15.39:0/1658318073 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f286000c320 con 0x7f2860003bd0 2023-05-16T13:54:20.997 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.990+0000 7f2879fdd640 1 --2- 172.21.15.39:0/1658318073 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2860003bd0 0x7f2860003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:20.998 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.990+0000 7f28797dc640 1 --2- 172.21.15.39:0/1658318073 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28600047d0 0x7f2860004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:20.998 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.990+0000 7f287a7de640 1 --2- 172.21.15.39:0/1658318073 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f28600052d0 0x7f286000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:20.998 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.990+0000 7f28797dc640 1 -- 172.21.15.39:0/1658318073 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2860003bd0 msgr2=0x7f2860003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:20.998 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.990+0000 7f28797dc640 1 --2- 172.21.15.39:0/1658318073 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2860003bd0 0x7f2860003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:20.999 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.990+0000 7f28797dc640 1 -- 172.21.15.39:0/1658318073 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f28600052d0 msgr2=0x7f286000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:20.999 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.990+0000 7f30b5a8c640 1 Processor -- start 2023-05-16T13:54:20.999 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.990+0000 7f28797dc640 1 --2- 172.21.15.39:0/1658318073 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f28600052d0 0x7f286000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.000 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.990+0000 7f28797dc640 1 -- 172.21.15.39:0/1658318073 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2860003530 con 0x7f28600047d0 2023-05-16T13:54:21.000 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.990+0000 7f2879fdd640 1 --2- 172.21.15.39:0/1658318073 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2860003bd0 0x7f2860003fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:54:21.000 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.990+0000 7f287a7de640 1 --2- 172.21.15.39:0/1658318073 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f28600052d0 0x7f286000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-16T13:54:21.000 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.990+0000 7f287a7de640 1 -- 172.21.15.39:0/1658318073 reap_dead start 2023-05-16T13:54:21.000 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.990+0000 7f30b5a8c640 1 -- start start 2023-05-16T13:54:21.001 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.994+0000 7f7f5bfff640 1 --2- 172.21.15.39:0/587035644 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7f5c0718b0 0x7f7f5c0d1650 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7f540098a0 tx=0x7f7f5401ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=328122da2e2a581e server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:21.001 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.994+0000 7f492d262640 1 Processor -- start 2023-05-16T13:54:21.001 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.994+0000 7f7f5b7fe640 1 -- 172.21.15.39:0/587035644 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f540a8a10 con 0x7f7f5c0718b0 2023-05-16T13:54:21.002 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.994+0000 7f7f5b7fe640 1 -- 172.21.15.39:0/587035644 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f540a8b70 con 0x7f7f5c0718b0 2023-05-16T13:54:21.002 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.994+0000 7f7f5b7fe640 1 -- 172.21.15.39:0/587035644 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f540a8a10 con 0x7f7f5c0718b0 2023-05-16T13:54:21.002 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.994+0000 7f30b5a8c640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f30b00ce970 0x7f30b006da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.002 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.994+0000 7f30b5a8c640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f30b00c88b0 0x7f30b0158f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.002 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.994+0000 7f30b5a8c640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30b0159490 con 0x7f30b0157df0 2023-05-16T13:54:21.002 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.994+0000 7f30b5a8c640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30b00c8e50 con 0x7f30b00ce970 2023-05-16T13:54:21.003 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.994+0000 7f30b5a8c640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30b006cf30 con 0x7f30b00c88b0 2023-05-16T13:54:21.003 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.990+0000 7f5b97fff640 1 Processor -- start 2023-05-16T13:54:21.003 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.990+0000 7f5b97fff640 1 -- start start 2023-05-16T13:54:21.003 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.994+0000 7f5b97fff640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5b900e6c70 0x7f5b9004f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.004 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.994+0000 7f5b97fff640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f5b9004f6a0 0x7f5b900526e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.004 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.994+0000 7f5b97fff640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b90052c20 0x7f5b900eacd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.004 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.994+0000 7f5b97fff640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b900e7040 con 0x7f5b9004f6a0 2023-05-16T13:54:21.004 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.994+0000 7f5b97fff640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b90054950 con 0x7f5b900e6c70 2023-05-16T13:54:21.004 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.994+0000 7f5b97fff640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b900484e0 con 0x7f5b90052c20 2023-05-16T13:54:21.004 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.994+0000 7f7f61bdf640 1 -- 172.21.15.39:0/587035644 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7f5c0718b0 msgr2=0x7f7f5c0d1650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.005 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.994+0000 7f7f61bdf640 1 --2- 172.21.15.39:0/587035644 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7f5c0718b0 0x7f7f5c0d1650 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7f540098a0 tx=0x7f7f5401ed30 comp rx=0 tx=0).stop 2023-05-16T13:54:21.005 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.994+0000 7f30affff640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f30b0157df0 0x7f30b006b7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:60704/0 (socket says 172.21.15.39:60704) 2023-05-16T13:54:21.005 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.994+0000 7f30affff640 1 -- 172.21.15.39:0/3157458977 learned_addr learned my addr 172.21.15.39:0/3157458977 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:21.005 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.994+0000 7f28797dc640 1 --2- 172.21.15.39:0/1658318073 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28600047d0 0x7f2860004c40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f286c008cb0 tx=0x7f286c01f6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af08819ff2cd18fb server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:21.006 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.994+0000 7f30af7fe640 1 --2- 172.21.15.39:0/3157458977 >> v2:172.21.15.39:3300/0 conn(0x7f30b00ce970 0x7f30b006da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.006 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.994+0000 7f2878fdb640 1 -- 172.21.15.39:0/1658318073 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286c008270 con 0x7f28600047d0 2023-05-16T13:54:21.006 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.994+0000 7f2878fdb640 1 -- 172.21.15.39:0/1658318073 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286c0064f0 con 0x7f28600047d0 2023-05-16T13:54:21.006 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.994+0000 7f2878fdb640 1 -- 172.21.15.39:0/1658318073 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286c006920 con 0x7f28600047d0 2023-05-16T13:54:21.007 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.994+0000 7f2f86a04640 1 Processor -- start 2023-05-16T13:54:21.007 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.994+0000 7f2f86a04640 1 -- start start 2023-05-16T13:54:21.007 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.994+0000 7f492d262640 1 -- start start 2023-05-16T13:54:21.007 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.994+0000 7f30aeffd640 1 --2- 172.21.15.39:0/3157458977 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f30b00c88b0 0x7f30b0158f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.008 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.994+0000 7f492d262640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f49200e27e0 0x7f49200e3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.008 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.994+0000 7f492d262640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4920054000 con 0x7f492003b2c0 2023-05-16T13:54:21.008 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.994+0000 7f492d262640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4920053d20 con 0x7f49200e7040 2023-05-16T13:54:21.008 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.994+0000 7f492d262640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49200e3db0 con 0x7f49200e27e0 2023-05-16T13:54:21.009 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.994+0000 7f5b96ffd640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5b900e6c70 0x7f5b9004f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.009 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.994+0000 7f5b967fc640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f5b9004f6a0 0x7f5b900526e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.009 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.994+0000 7f5b96ffd640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5b900e6c70 0x7f5b9004f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.39:34652/0 (socket says 172.21.15.39:34652) 2023-05-16T13:54:21.009 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.994+0000 7f5b96ffd640 1 -- 172.21.15.39:0/3354926764 learned_addr learned my addr 172.21.15.39:0/3354926764 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:21.009 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.994+0000 7f5b977fe640 1 --2- 172.21.15.39:0/3354926764 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b90052c20 0x7f5b900eacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.010 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.994+0000 7f30af7fe640 1 -- 172.21.15.39:0/3157458977 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f30b00c88b0 msgr2=0x7f30b0158f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:21.010 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.994+0000 7f30af7fe640 1 --2- 172.21.15.39:0/3157458977 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f30b00c88b0 0x7f30b0158f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.010 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.994+0000 7f7f61bdf640 1 -- 172.21.15.39:0/587035644 shutdown_connections 2023-05-16T13:54:21.010 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.994+0000 7f7f61bdf640 1 --2- 172.21.15.39:0/587035644 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7f5c0718b0 0x7f7f5c0d1650 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.010 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.994+0000 7f7f61bdf640 1 --2- 172.21.15.39:0/587035644 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7f5c1605c0 0x7f7f5c0b0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.011 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.994+0000 7f7f61bdf640 1 -- 172.21.15.39:0/587035644 >> 172.21.15.39:0/587035644 conn(0x7f7f5c0d2710 msgr2=0x7f7f5c0d2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:21.011 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.994+0000 7f7f61bdf640 1 -- 172.21.15.39:0/587035644 shutdown_connections 2023-05-16T13:54:21.011 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.994+0000 7f7f61bdf640 1 -- 172.21.15.39:0/587035644 wait complete. 2023-05-16T13:54:21.011 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.998+0000 7f287afdf640 1 -- 172.21.15.39:0/1658318073 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28600047d0 msgr2=0x7f2860004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.011 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.998+0000 7f287afdf640 1 --2- 172.21.15.39:0/1658318073 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28600047d0 0x7f2860004c40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f286c008cb0 tx=0x7f286c01f6a0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.011 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.998+0000 7f287afdf640 1 -- 172.21.15.39:0/1658318073 shutdown_connections 2023-05-16T13:54:21.012 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.998+0000 7f287afdf640 1 --2- 172.21.15.39:0/1658318073 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28600047d0 0x7f2860004c40 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.012 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.998+0000 7f287afdf640 1 -- 172.21.15.39:0/1658318073 >> 172.21.15.39:0/1658318073 conn(0x7f2874069a50 msgr2=0x7f2874069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:21.012 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.994+0000 7f4927fff640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f49200e27e0 0x7f49200e3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.012 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.998+0000 7f4927fff640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f49200e27e0 0x7f49200e3870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.39:34658/0 (socket says 172.21.15.39:34658) 2023-05-16T13:54:21.012 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.998+0000 7f4927fff640 1 -- 172.21.15.39:0/4285297253 learned_addr learned my addr 172.21.15.39:0/4285297253 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:21.013 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.998+0000 7f49277fe640 1 --1- 172.21.15.39:0/4285297253 >> v1:172.21.15.118:6789/0 conn(0x7f49200e7040 0x7f492003abb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.39:41184/0 (socket says 172.21.15.39:41184) 2023-05-16T13:54:21.013 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.994+0000 7f5b96ffd640 1 -- 172.21.15.39:0/3354926764 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b90052c20 msgr2=0x7f5b900eacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:21.013 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.994+0000 7f5b96ffd640 1 --2- 172.21.15.39:0/3354926764 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b90052c20 0x7f5b900eacd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.013 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.994+0000 7f5b96ffd640 1 -- 172.21.15.39:0/3354926764 >> v2:172.21.15.39:3300/0 conn(0x7f5b9004f6a0 msgr2=0x7f5b900526e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:21.013 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.994+0000 7f5b96ffd640 1 --2- 172.21.15.39:0/3354926764 >> v2:172.21.15.39:3300/0 conn(0x7f5b9004f6a0 0x7f5b900526e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.013 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.994+0000 7f5b96ffd640 1 -- 172.21.15.39:0/3354926764 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b900ea840 con 0x7f5b900e6c70 2023-05-16T13:54:21.014 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.998+0000 7f4926ffd640 1 -- 172.21.15.39:0/4285297253 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2106810140 0 0) 0x7f4920053d20 con 0x7f49200e7040 2023-05-16T13:54:21.014 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.998+0000 7f4926ffd640 1 -- 172.21.15.39:0/4285297253 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4918003530 con 0x7f49200e7040 2023-05-16T13:54:21.014 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.998+0000 7f4926ffd640 1 -- 172.21.15.39:0/4285297253 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 697132548 0 0) 0x7f491c001050 con 0x7f492003b2c0 2023-05-16T13:54:21.014 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.998+0000 7f4926ffd640 1 -- 172.21.15.39:0/4285297253 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4920053d20 con 0x7f492003b2c0 2023-05-16T13:54:21.015 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.998+0000 7f2f86a04640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2f800cc160 0x7f2f800ca5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.015 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.998+0000 7f2f86a04640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f2f800cac70 0x7f2f800cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.015 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.998+0000 7f4927fff640 1 -- 172.21.15.39:0/4285297253 >> v1:172.21.15.118:6789/0 conn(0x7f49200e7040 legacy=0x7f492003abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.015 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.998+0000 7f4927fff640 1 -- 172.21.15.39:0/4285297253 >> v1:172.21.15.39:6789/0 conn(0x7f492003b2c0 legacy=0x7f4920056d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.016 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.998+0000 7f4927fff640 1 -- 172.21.15.39:0/4285297253 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49200e6560 con 0x7f49200e27e0 2023-05-16T13:54:21.016 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.998+0000 7f287afdf640 1 -- 172.21.15.39:0/1658318073 shutdown_connections 2023-05-16T13:54:21.016 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.998+0000 7f2f86a04640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f800cb5f0 con 0x7f2f8006dac0 2023-05-16T13:54:21.017 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.998+0000 7f2f86a04640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f800ce050 con 0x7f2f800cac70 2023-05-16T13:54:21.017 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.998+0000 7f2f86a04640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f8015c600 con 0x7f2f800cc160 2023-05-16T13:54:21.017 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.998+0000 7f2f777fe640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2f800cc160 0x7f2f800ca5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.017 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.998+0000 7f2f777fe640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2f800cc160 0x7f2f800ca5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.39:34664/0 (socket says 172.21.15.39:34664) 2023-05-16T13:54:21.017 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.998+0000 7f2f777fe640 1 -- 172.21.15.39:0/3434467905 learned_addr learned my addr 172.21.15.39:0/3434467905 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:21.017 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.998+0000 7f287afdf640 1 -- 172.21.15.39:0/1658318073 wait complete. 2023-05-16T13:54:21.018 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.998+0000 7f2f777fe640 1 -- 172.21.15.39:0/3434467905 >> v2:172.21.15.39:3300/0 conn(0x7f2f800cac70 msgr2=0x7f2f800cb0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:21.018 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.998+0000 7f2f777fe640 1 --2- 172.21.15.39:0/3434467905 >> v2:172.21.15.39:3300/0 conn(0x7f2f800cac70 0x7f2f800cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.018 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.998+0000 7fa823a74640 1 Processor -- start 2023-05-16T13:54:21.019 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.998+0000 7f287afdf640 1 Processor -- start 2023-05-16T13:54:21.019 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.998+0000 7f287afdf640 1 -- start start 2023-05-16T13:54:21.019 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.998+0000 7fa823a74640 1 -- start start 2023-05-16T13:54:21.019 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.998+0000 7f7f61bdf640 1 Processor -- start 2023-05-16T13:54:21.020 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.998+0000 7f7f61bdf640 1 -- start start 2023-05-16T13:54:21.020 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.002+0000 7f30af7fe640 1 -- 172.21.15.39:0/3157458977 >> v1:172.21.15.39:6789/0 conn(0x7f30b0157df0 legacy=0x7f30b006b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.020 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.002+0000 7f7f61bdf640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7f5c0718b0 0x7f7f5c1f50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.021 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.002+0000 7f7f61bdf640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7f5c0d1b90 0x7f7f5c0cd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.021 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.002+0000 7fa823a74640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa81c0d0b80 0x7fa81c16b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.021 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.002+0000 7fa823a74640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa81c0d2f10 con 0x7fa81c0d33a0 2023-05-16T13:54:21.021 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.002+0000 7fa823a74640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa81c0d2380 con 0x7fa81c160450 2023-05-16T13:54:21.021 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.002+0000 7fa823a74640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa81c0d0130 con 0x7fa81c0d0b80 2023-05-16T13:54:21.022 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.002+0000 7f5b96ffd640 1 --2- 172.21.15.39:0/3354926764 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b900e6c70 0x7f5b9004f160 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5b9000b350 tx=0x7f5b8801c3d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=845a501179166cdd server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:21.022 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.998+0000 7f2f777fe640 1 -- 172.21.15.39:0/3434467905 >> v1:172.21.15.39:6789/0 conn(0x7f2f8006dac0 legacy=0x7f2f8006c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.022 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:20.998+0000 7f2f777fe640 1 -- 172.21.15.39:0/3434467905 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f8015c8e0 con 0x7f2f800cc160 2023-05-16T13:54:21.023 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.002+0000 7fe3e56d1640 1 Processor -- start 2023-05-16T13:54:21.023 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.002+0000 7f30af7fe640 1 -- 172.21.15.39:0/3157458977 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30b006d210 con 0x7f30b00ce970 2023-05-16T13:54:21.023 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.002+0000 7f30aeffd640 1 --2- 172.21.15.39:0/3157458977 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f30b00c88b0 0x7f30b0158f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:54:21.023 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.002+0000 7f7f61bdf640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7f5c1605c0 0x7f7f5c0cd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.024 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.002+0000 7fa821810640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fa81c160450 0x7fa81c0c56b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.39:41192/0 (socket says 172.21.15.39:41192) 2023-05-16T13:54:21.024 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.002+0000 7fa821810640 1 -- 172.21.15.39:0/3155245593 learned_addr learned my addr 172.21.15.39:0/3155245593 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:21.024 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.002+0000 7f7f5bfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7f5c0d1b90 0x7f7f5c0cd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.025 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.002+0000 7f7f5bfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7f5c0d1b90 0x7f7f5c0cd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.39:34694/0 (socket says 172.21.15.39:34694) 2023-05-16T13:54:21.025 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.002+0000 7fa822011640 1 --2- 172.21.15.39:0/3155245593 >> v2:172.21.15.118:3300/0 conn(0x7fa81c0d0b80 0x7fa81c16b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.025 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.002+0000 7fe3e56d1640 1 -- start start 2023-05-16T13:54:21.026 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.002+0000 7f287afdf640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f28600047d0 0x7f28740ca680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.026 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.002+0000 7f287afdf640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2874153540 0x7f287414d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.026 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.002+0000 7f287afdf640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28740abf90 0x7f28740ac400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.026 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.002+0000 7f287afdf640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28740ac940 con 0x7f2874153540 2023-05-16T13:54:21.026 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.002+0000 7f287afdf640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28740c88a0 con 0x7f28740abf90 2023-05-16T13:54:21.027 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.002+0000 7f287afdf640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28740c8af0 con 0x7f28600047d0 2023-05-16T13:54:21.027 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.002+0000 7fa82080e640 1 -- 172.21.15.39:0/3155245593 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3273902621 0 0) 0x7fa81c0d2380 con 0x7fa81c160450 2023-05-16T13:54:21.027 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.002+0000 7fa82080e640 1 -- 172.21.15.39:0/3155245593 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa808003530 con 0x7fa81c160450 2023-05-16T13:54:21.027 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.002+0000 7f4927fff640 1 --2- 172.21.15.39:0/4285297253 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f49200e27e0 0x7f49200e3870 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f492804f3a0 tx=0x7f49280963c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c0fbfc54bafee70 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:21.028 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.002+0000 7fa822011640 1 -- 172.21.15.39:0/3155245593 >> v1:172.21.15.118:6789/0 conn(0x7fa81c160450 legacy=0x7fa81c0c56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.028 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.002+0000 7fa822011640 1 -- 172.21.15.39:0/3155245593 >> v1:172.21.15.39:6789/0 conn(0x7fa81c0d33a0 legacy=0x7fa81c0d0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:21.028 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.002+0000 7fa822011640 1 -- 172.21.15.39:0/3155245593 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa81c0d25e0 con 0x7fa81c0d0b80 2023-05-16T13:54:21.028 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.002+0000 7f2879fdd640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f28600047d0 0x7f28740ca680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.029 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.002+0000 7f2879fdd640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f28600047d0 0x7f28740ca680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.39:33372/0 (socket says 172.21.15.39:33372) 2023-05-16T13:54:21.029 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.002+0000 7f2879fdd640 1 -- 172.21.15.39:0/2805211827 learned_addr learned my addr 172.21.15.39:0/2805211827 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:21.029 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.002+0000 7f7f5bfff640 1 -- 172.21.15.39:0/2890758490 learned_addr learned my addr 172.21.15.39:0/2890758490 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:21.029 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.002+0000 7f287a7de640 1 --2- 172.21.15.39:0/2805211827 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28740abf90 0x7f28740ac400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.030 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.002+0000 7f7f613de640 1 --2- 172.21.15.39:0/2890758490 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7f5c1605c0 0x7f7f5c0cd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.030 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.002+0000 7f7f61bdf640 1 -- 172.21.15.39:0/2890758490 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5c0b56f0 con 0x7f7f5c0718b0 2023-05-16T13:54:21.030 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.002+0000 7f7f61bdf640 1 -- 172.21.15.39:0/2890758490 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5c0cc8b0 con 0x7f7f5c0d1b90 2023-05-16T13:54:21.030 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.002+0000 7f4926ffd640 1 -- 172.21.15.39:0/4285297253 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4928125600 con 0x7f49200e27e0 2023-05-16T13:54:21.031 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.002+0000 7f4926ffd640 1 -- 172.21.15.39:0/4285297253 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4928121050 con 0x7f49200e27e0 2023-05-16T13:54:21.031 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.002+0000 7f4926ffd640 1 -- 172.21.15.39:0/4285297253 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4928125aa0 con 0x7f49200e27e0 2023-05-16T13:54:21.031 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.002+0000 7f7f61bdf640 1 -- 172.21.15.39:0/2890758490 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5c0b59b0 con 0x7f7f5c1605c0 2023-05-16T13:54:21.032 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.002+0000 7f2879fdd640 1 -- 172.21.15.39:0/2805211827 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28740abf90 msgr2=0x7f28740ac400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.032 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.002+0000 7f2879fdd640 1 --2- 172.21.15.39:0/2805211827 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28740abf90 0x7f28740ac400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.032 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.002+0000 7f2879fdd640 1 -- 172.21.15.39:0/2805211827 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2874153540 msgr2=0x7f287414d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.032 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.002+0000 7f2879fdd640 1 --2- 172.21.15.39:0/2805211827 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2874153540 0x7f287414d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.032 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.002+0000 7f2879fdd640 1 -- 172.21.15.39:0/2805211827 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f287415ca00 con 0x7f28600047d0 2023-05-16T13:54:21.032 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.002+0000 7f287a7de640 1 --2- 172.21.15.39:0/2805211827 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28740abf90 0x7f28740ac400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-16T13:54:21.033 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.002+0000 7f2879fdd640 1 --2- 172.21.15.39:0/2805211827 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f28600047d0 0x7f28740ca680 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f286400e550 tx=0x7f286400e580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:21.033 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.002+0000 7f492d262640 1 -- 172.21.15.39:0/4285297253 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f49200e27e0 msgr2=0x7f49200e3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.033 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.002+0000 7f492d262640 1 --2- 172.21.15.39:0/4285297253 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f49200e27e0 0x7f49200e3870 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f492804f3a0 tx=0x7f49280963c0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.033 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.002+0000 7f7f5bfff640 1 -- 172.21.15.39:0/2890758490 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7f5c1605c0 msgr2=0x7f7f5c0cd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.034 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.002+0000 7f7f5bfff640 1 --2- 172.21.15.39:0/2890758490 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7f5c1605c0 0x7f7f5c0cd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.034 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.002+0000 7f7f5bfff640 1 -- 172.21.15.39:0/2890758490 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7f5c0718b0 msgr2=0x7f7f5c1f50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.034 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.002+0000 7f7f5bfff640 1 --2- 172.21.15.39:0/2890758490 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7f5c0718b0 0x7f7f5c1f50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.034 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.002+0000 7f7f5bfff640 1 -- 172.21.15.39:0/2890758490 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f540094d0 con 0x7f7f5c0d1b90 2023-05-16T13:54:21.034 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.002+0000 7f286a7fc640 1 -- 172.21.15.39:0/2805211827 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28640050d0 con 0x7f28600047d0 2023-05-16T13:54:21.035 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.002+0000 7fe3e56d1640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe3d80ea0e0 0x7fe3d804f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.035 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.002+0000 7fe3e56d1640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe3d8034050 0x7fe3d80528b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.035 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.006+0000 7f7f5bfff640 1 --2- 172.21.15.39:0/2890758490 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7f5c0d1b90 0x7f7f5c0cd1c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7f5401c960 tx=0x7f7f5401bad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:21.035 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.006+0000 7f7f597fa640 1 -- 172.21.15.39:0/2890758490 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f540bf070 con 0x7f7f5c0d1b90 2023-05-16T13:54:21.035 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.006+0000 7f7f597fa640 1 -- 172.21.15.39:0/2890758490 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f54003620 con 0x7f7f5c0d1b90 2023-05-16T13:54:21.036 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.006+0000 7f7f597fa640 1 -- 172.21.15.39:0/2890758490 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f540039b0 con 0x7f7f5c0d1b90 2023-05-16T13:54:21.036 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.006+0000 7f7f61bdf640 1 -- 172.21.15.39:0/2890758490 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f5c071d00 con 0x7f7f5c0d1b90 2023-05-16T13:54:21.036 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.006+0000 7f7f61bdf640 1 -- 172.21.15.39:0/2890758490 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f5c160990 con 0x7f7f5c0d1b90 2023-05-16T13:54:21.036 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.002+0000 7f286a7fc640 1 -- 172.21.15.39:0/2805211827 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2864005230 con 0x7f28600047d0 2023-05-16T13:54:21.037 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.002+0000 7f286a7fc640 1 -- 172.21.15.39:0/2805211827 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2864003600 con 0x7f28600047d0 2023-05-16T13:54:21.037 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.006+0000 7f287afdf640 1 -- 172.21.15.39:0/2805211827 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f287415c720 con 0x7f28600047d0 2023-05-16T13:54:21.037 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.006+0000 7f287afdf640 1 -- 172.21.15.39:0/2805211827 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f287409c040 con 0x7f28600047d0 2023-05-16T13:54:21.037 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.002+0000 7f492d262640 1 -- 172.21.15.39:0/4285297253 shutdown_connections 2023-05-16T13:54:21.037 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.002+0000 7f492d262640 1 --2- 172.21.15.39:0/4285297253 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f49200e27e0 0x7f49200e3870 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.037 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.002+0000 7f492d262640 1 -- 172.21.15.39:0/4285297253 >> 172.21.15.39:0/4285297253 conn(0x7f4920055bb0 msgr2=0x7f4920055fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:21.038 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.006+0000 7f2f777fe640 1 --2- 172.21.15.39:0/3434467905 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f800cc160 0x7f2f800ca5b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2f8006f820 tx=0x7f2f6801c3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=162c4dd094a0882a server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:21.038 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.006+0000 7f2f7f7fe640 1 -- 172.21.15.39:0/3434467905 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f680ac410 con 0x7f2f800cc160 2023-05-16T13:54:21.038 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.006+0000 7f2f7f7fe640 1 -- 172.21.15.39:0/3434467905 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f680ac570 con 0x7f2f800cc160 2023-05-16T13:54:21.038 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.006+0000 7f5b95ffb640 1 -- 172.21.15.39:0/3354926764 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b880ab600 con 0x7f5b900e6c70 2023-05-16T13:54:21.039 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.002+0000 7fe3e56d1640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3d8052df0 con 0x7fe3d8050cc0 2023-05-16T13:54:21.039 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.002+0000 7fe3e56d1640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3d80ea4b0 con 0x7fe3d80ea0e0 2023-05-16T13:54:21.039 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.002+0000 7fe3e56d1640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d8051450 con 0x7fe3d8034050 2023-05-16T13:54:21.039 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.006+0000 7fe3deffd640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe3d80ea0e0 0x7fe3d804f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.039 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.006+0000 7fe3deffd640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe3d80ea0e0 0x7fe3d804f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.39:34720/0 (socket says 172.21.15.39:34720) 2023-05-16T13:54:21.039 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.006+0000 7fe3deffd640 1 -- 172.21.15.39:0/1765676989 learned_addr learned my addr 172.21.15.39:0/1765676989 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:21.040 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.006+0000 7fe3dffff640 1 --2- 172.21.15.39:0/1765676989 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe3d8034050 0x7fe3d80528b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.040 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.006+0000 7fe3deffd640 1 -- 172.21.15.39:0/1765676989 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe3d8034050 msgr2=0x7fe3d80528b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:21.040 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.006+0000 7fe3ddffb640 1 -- 172.21.15.39:0/1765676989 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 652345038 0 0) 0x7fe3d8052df0 con 0x7fe3d8050cc0 2023-05-16T13:54:21.040 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.006+0000 7f5b95ffb640 1 -- 172.21.15.39:0/3354926764 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b880a7050 con 0x7f5b900e6c70 2023-05-16T13:54:21.040 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.006+0000 7f2f86a04640 1 -- 172.21.15.39:0/3434467905 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f800cc160 msgr2=0x7f2f800ca5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.041 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.006+0000 7f2f7f7fe640 1 -- 172.21.15.39:0/3434467905 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f680ac410 con 0x7f2f800cc160 2023-05-16T13:54:21.041 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.006+0000 7fe3deffd640 1 --2- 172.21.15.39:0/1765676989 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe3d8034050 0x7fe3d80528b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.041 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.006+0000 7fe3deffd640 1 -- 172.21.15.39:0/1765676989 >> v1:172.21.15.39:6789/0 conn(0x7fe3d8050cc0 legacy=0x7fe3d8033940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.041 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.006+0000 7fe3deffd640 1 -- 172.21.15.39:0/1765676989 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d80542f0 con 0x7fe3d80ea0e0 2023-05-16T13:54:21.042 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.006+0000 7f492d262640 1 -- 172.21.15.39:0/4285297253 shutdown_connections 2023-05-16T13:54:21.042 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.006+0000 7f5b97fff640 1 -- 172.21.15.39:0/3354926764 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b900e6c70 msgr2=0x7f5b9004f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.042 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.006+0000 7fa822011640 1 --2- 172.21.15.39:0/3155245593 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa81c0d0b80 0x7fa81c16b370 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa814009d90 tx=0x7fa81401c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14ece8b0478deba3 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:21.043 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.006+0000 7fe3dffff640 1 --2- 172.21.15.39:0/1765676989 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe3d8034050 0x7fe3d80528b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:54:21.043 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.006+0000 7fa82080e640 1 -- 172.21.15.39:0/3155245593 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8140a59a0 con 0x7fa81c0d0b80 2023-05-16T13:54:21.043 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.006+0000 7f5b95ffb640 1 -- 172.21.15.39:0/3354926764 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b880ab600 con 0x7f5b900e6c70 2023-05-16T13:54:21.044 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.006+0000 7fa82080e640 1 -- 172.21.15.39:0/3155245593 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8140a5b00 con 0x7fa81c0d0b80 2023-05-16T13:54:21.044 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.006+0000 7f2f86a04640 1 --2- 172.21.15.39:0/3434467905 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f800cc160 0x7f2f800ca5b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2f8006f820 tx=0x7f2f6801c3b0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.044 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.006+0000 7fa82080e640 1 -- 172.21.15.39:0/3155245593 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8140a5e70 con 0x7fa81c0d0b80 2023-05-16T13:54:21.045 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.006+0000 7f2f86a04640 1 -- 172.21.15.39:0/3434467905 shutdown_connections 2023-05-16T13:54:21.045 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.006+0000 7f2f86a04640 1 --2- 172.21.15.39:0/3434467905 >> v2:172.21.15.39:3300/0 conn(0x7f2f800cac70 0x7f2f800cb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.045 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.006+0000 7f2f86a04640 1 --2- 172.21.15.39:0/3434467905 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f800cc160 0x7f2f800ca5b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.045 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.006+0000 7f2f86a04640 1 -- 172.21.15.39:0/3434467905 >> 172.21.15.39:0/3434467905 conn(0x7f2f80069a50 msgr2=0x7f2f80069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:21.046 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.006+0000 7f5b97fff640 1 --2- 172.21.15.39:0/3354926764 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b900e6c70 0x7f5b9004f160 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5b9000b350 tx=0x7f5b8801c3d0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.046 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.006+0000 7f5b97fff640 1 -- 172.21.15.39:0/3354926764 shutdown_connections 2023-05-16T13:54:21.046 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.006+0000 7f5b97fff640 1 --2- 172.21.15.39:0/3354926764 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b90052c20 0x7f5b900eacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.046 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.006+0000 7f5b97fff640 1 --2- 172.21.15.39:0/3354926764 >> v2:172.21.15.39:3300/0 conn(0x7f5b9004f6a0 0x7f5b900526e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.046 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.006+0000 7f5b97fff640 1 --2- 172.21.15.39:0/3354926764 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b900e6c70 0x7f5b9004f160 secure :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5b9000b350 tx=0x7f5b8801c3d0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.046 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.006+0000 7f5b97fff640 1 -- 172.21.15.39:0/3354926764 >> 172.21.15.39:0/3354926764 conn(0x7f5b90051590 msgr2=0x7f5b90051990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:21.047 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.006+0000 7fa823a74640 1 -- 172.21.15.39:0/3155245593 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa81c0d0b80 msgr2=0x7fa81c16b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.047 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.006+0000 7fa823a74640 1 --2- 172.21.15.39:0/3155245593 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa81c0d0b80 0x7fa81c16b370 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa814009d90 tx=0x7fa81401c8e0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.047 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.006+0000 7f7f52ffd640 1 -- 172.21.15.39:0/2890758490 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7f34000fd0 con 0x7f7f5c0d1b90 2023-05-16T13:54:21.047 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.006+0000 7f30af7fe640 1 --2- 172.21.15.39:0/3157458977 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30b00ce970 0x7f30b006da10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f30980097c0 tx=0x7f309801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24fd99acf6f29c40 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:21.048 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.010+0000 7f5b97fff640 1 -- 172.21.15.39:0/3354926764 shutdown_connections 2023-05-16T13:54:21.048 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.010+0000 7f7f597fa640 1 -- 172.21.15.39:0/2890758490 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7f54003b10 con 0x7f7f5c0d1b90 2023-05-16T13:54:21.048 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.010+0000 7f287afdf640 1 -- 172.21.15.39:0/2805211827 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f287404ed20 con 0x7f28600047d0 2023-05-16T13:54:21.049 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.010+0000 7fa823a74640 1 -- 172.21.15.39:0/3155245593 shutdown_connections 2023-05-16T13:54:21.049 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.010+0000 7fa823a74640 1 --2- 172.21.15.39:0/3155245593 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa81c0d0b80 0x7fa81c16b370 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.049 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.010+0000 7fa823a74640 1 -- 172.21.15.39:0/3155245593 >> 172.21.15.39:0/3155245593 conn(0x7fa81c071aa0 msgr2=0x7fa81c09bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:21.049 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.010+0000 7fa823a74640 1 -- 172.21.15.39:0/3155245593 shutdown_connections 2023-05-16T13:54:21.049 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.010+0000 7fa823a74640 1 -- 172.21.15.39:0/3155245593 wait complete. 2023-05-16T13:54:21.050 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.006+0000 7f492d262640 1 -- 172.21.15.39:0/4285297253 wait complete. 2023-05-16T13:54:21.050 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.010+0000 7f492d262640 1 Processor -- start 2023-05-16T13:54:21.050 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.010+0000 7f286a7fc640 1 -- 172.21.15.39:0/2805211827 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2864003760 con 0x7f28600047d0 2023-05-16T13:54:21.051 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.010+0000 7f2f86a04640 1 -- 172.21.15.39:0/3434467905 shutdown_connections 2023-05-16T13:54:21.051 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.010+0000 7f2f86a04640 1 -- 172.21.15.39:0/3434467905 wait complete. 2023-05-16T13:54:21.051 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.010+0000 7f7f597fa640 1 --2- 172.21.15.39:0/2890758490 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f7f3c0662d0 0x7f7f3c068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.051 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.010+0000 7fe3deffd640 1 --2- 172.21.15.39:0/1765676989 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe3d80ea0e0 0x7fe3d804f330 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe3d4009870 tx=0x7fe3d401c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13a432323326afe6 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:21.052 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.010+0000 7f492d262640 1 -- start start 2023-05-16T13:54:21.052 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.010+0000 7f5b97fff640 1 -- 172.21.15.39:0/3354926764 wait complete. 2023-05-16T13:54:21.053 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.010+0000 7fe3ddffb640 1 -- 172.21.15.39:0/1765676989 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d4004230 con 0x7fe3d80ea0e0 2023-05-16T13:54:21.053 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.010+0000 7fe3ddffb640 1 -- 172.21.15.39:0/1765676989 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3d40a7050 con 0x7fe3d80ea0e0 2023-05-16T13:54:21.053 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.010+0000 7fe3ddffb640 1 -- 172.21.15.39:0/1765676989 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d4003620 con 0x7fe3d80ea0e0 2023-05-16T13:54:21.053 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.010+0000 7f30ae7fc640 1 -- 172.21.15.39:0/3157458977 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30980ab600 con 0x7f30b00ce970 2023-05-16T13:54:21.053 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.010+0000 7f30ae7fc640 1 -- 172.21.15.39:0/3157458977 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30980a7050 con 0x7f30b00ce970 2023-05-16T13:54:21.053 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.010+0000 7f30ae7fc640 1 -- 172.21.15.39:0/3157458977 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30980ab980 con 0x7f30b00ce970 2023-05-16T13:54:21.054 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.010+0000 7f286a7fc640 1 --2- 172.21.15.39:0/2805211827 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f28580662d0 0x7f2858068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.054 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.010+0000 7fa823a74640 1 Processor -- start 2023-05-16T13:54:21.054 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.010+0000 7fe3e56d1640 1 -- 172.21.15.39:0/1765676989 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe3d80ea0e0 msgr2=0x7fe3d804f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.055 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.010+0000 7fe3e56d1640 1 --2- 172.21.15.39:0/1765676989 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe3d80ea0e0 0x7fe3d804f330 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe3d4009870 tx=0x7fe3d401c540 comp rx=0 tx=0).stop 2023-05-16T13:54:21.055 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.010+0000 7f286a7fc640 1 -- 172.21.15.39:0/2805211827 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2864083280 con 0x7f28600047d0 2023-05-16T13:54:21.055 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.010+0000 7f28797dc640 1 --2- 172.21.15.39:0/2805211827 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f28580662d0 0x7f2858068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.055 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.010+0000 7f7f597fa640 1 -- 172.21.15.39:0/2890758490 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7f54121850 con 0x7f7f5c0d1b90 2023-05-16T13:54:21.056 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.010+0000 7f7f597fa640 1 --2- 172.21.15.39:0/2890758490 >> [v2:172.21.15.39:6808/3462013698,v1:172.21.15.39:6809/3462013698] conn(0x7f7f3c06eb80 0x7f7f3c070f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.056 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.010+0000 7f7f597fa640 1 -- 172.21.15.39:0/2890758490 --> [v2:172.21.15.39:6808/3462013698,v1:172.21.15.39:6809/3462013698] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7f3c071640 con 0x7f7f3c06eb80 2023-05-16T13:54:21.056 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.010+0000 7f7f597fa640 1 -- 172.21.15.39:0/2890758490 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7f54123e30 con 0x7f7f5c0d1b90 2023-05-16T13:54:21.056 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.010+0000 7f7f60bdd640 1 --2- 172.21.15.39:0/2890758490 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f7f3c0662d0 0x7f7f3c068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.056 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.010+0000 7f7f613de640 1 --2- 172.21.15.39:0/2890758490 >> [v2:172.21.15.39:6808/3462013698,v1:172.21.15.39:6809/3462013698] conn(0x7f7f3c06eb80 0x7f7f3c070f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.056 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.010+0000 7f286a7fc640 1 --2- 172.21.15.39:0/2805211827 >> [v2:172.21.15.39:6800/2829970892,v1:172.21.15.39:6801/2829970892] conn(0x7f285806eb00 0x7f2858070f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.057 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.010+0000 7f286a7fc640 1 -- 172.21.15.39:0/2805211827 --> [v2:172.21.15.39:6800/2829970892,v1:172.21.15.39:6801/2829970892] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f28580715c0 con 0x7f285806eb00 2023-05-16T13:54:21.057 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.010+0000 7f286a7fc640 1 -- 172.21.15.39:0/2805211827 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2864050770 con 0x7f28600047d0 2023-05-16T13:54:21.057 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.010+0000 7f30b5a8c640 1 -- 172.21.15.39:0/3157458977 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30b00ce970 msgr2=0x7f30b006da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.057 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.010+0000 7f30b5a8c640 1 --2- 172.21.15.39:0/3157458977 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30b00ce970 0x7f30b006da10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f30980097c0 tx=0x7f309801c410 comp rx=0 tx=0).stop 2023-05-16T13:54:21.058 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.010+0000 7fe3e56d1640 1 -- 172.21.15.39:0/1765676989 shutdown_connections 2023-05-16T13:54:21.058 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.010+0000 7fe3e56d1640 1 --2- 172.21.15.39:0/1765676989 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe3d8034050 0x7fe3d80528b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.058 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.010+0000 7fe3e56d1640 1 --2- 172.21.15.39:0/1765676989 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe3d80ea0e0 0x7fe3d804f330 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.058 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.010+0000 7fe3e56d1640 1 -- 172.21.15.39:0/1765676989 >> 172.21.15.39:0/1765676989 conn(0x7fe3d8051760 msgr2=0x7fe3d8051b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:21.058 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.014+0000 7f287a7de640 1 --2- 172.21.15.39:0/2805211827 >> [v2:172.21.15.39:6800/2829970892,v1:172.21.15.39:6801/2829970892] conn(0x7f285806eb00 0x7f2858070f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.059 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.014+0000 7f28797dc640 1 --2- 172.21.15.39:0/2805211827 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f28580662d0 0x7f2858068780 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f28740cb5f0 tx=0x7f286c0aa000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:21.059 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.014+0000 7f2f86a04640 1 Processor -- start 2023-05-16T13:54:21.059 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.010+0000 7fa823a74640 1 -- start start 2023-05-16T13:54:21.060 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.014+0000 7f2f86a04640 1 -- start start 2023-05-16T13:54:21.060 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.014+0000 7f7f613de640 1 --2- 172.21.15.39:0/2890758490 >> [v2:172.21.15.39:6808/3462013698,v1:172.21.15.39:6809/3462013698] conn(0x7f7f3c06eb80 0x7f7f3c070f90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:21.060 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.014+0000 7f287a7de640 1 --2- 172.21.15.39:0/2805211827 >> [v2:172.21.15.39:6800/2829970892,v1:172.21.15.39:6801/2829970892] conn(0x7f285806eb00 0x7f2858070f10 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:21.061 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.014+0000 7fa823a74640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa81c0d0b80 0x7fa81c1616f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.061 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.014+0000 7f30b5a8c640 1 -- 172.21.15.39:0/3157458977 shutdown_connections 2023-05-16T13:54:21.061 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.014+0000 7f30b5a8c640 1 --2- 172.21.15.39:0/3157458977 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f30b00c88b0 0x7f30b0158f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.061 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.014+0000 7f30b5a8c640 1 --2- 172.21.15.39:0/3157458977 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30b00ce970 0x7f30b006da10 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.061 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.014+0000 7f30b5a8c640 1 -- 172.21.15.39:0/3157458977 >> 172.21.15.39:0/3157458977 conn(0x7f30b00cb970 msgr2=0x7f30b00ce260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:21.062 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.014+0000 7fa823a74640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa81c0d33a0 0x7fa81c153920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.062 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.014+0000 7fa823a74640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa81c160450 0x7fa81c06b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.062 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.014+0000 7f5b97fff640 1 Processor -- start 2023-05-16T13:54:21.063 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.014+0000 7fa821810640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa81c0d0b80 0x7fa81c1616f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.063 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.014+0000 7f7f60bdd640 1 --2- 172.21.15.39:0/2890758490 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f7f3c0662d0 0x7f7f3c068780 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c0070b0 tx=0x7f7f4c007040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:21.063 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.014+0000 7fa821810640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa81c0d0b80 0x7fa81c1616f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.39:33400/0 (socket says 172.21.15.39:33400) 2023-05-16T13:54:21.063 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.014+0000 7fa821810640 1 -- 172.21.15.39:0/1891508731 learned_addr learned my addr 172.21.15.39:0/1891508731 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:21.064 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.014+0000 7fa82100f640 1 --2- 172.21.15.39:0/1891508731 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa81c0d33a0 0x7fa81c153920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.064 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.014+0000 7fe3e56d1640 1 -- 172.21.15.39:0/1765676989 shutdown_connections 2023-05-16T13:54:21.064 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.014+0000 7fa823a74640 1 -- 172.21.15.39:0/1891508731 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa81c0b7020 con 0x7fa81c160450 2023-05-16T13:54:21.065 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.014+0000 7fe3e56d1640 1 -- 172.21.15.39:0/1765676989 wait complete. 2023-05-16T13:54:21.065 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.014+0000 7f7f597fa640 1 -- 172.21.15.39:0/2890758490 <== osd.0 v2:172.21.15.39:6808/3462013698 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f7f3c071640 con 0x7f7f3c06eb80 2023-05-16T13:54:21.065 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.014+0000 7f286a7fc640 1 -- 172.21.15.39:0/2805211827 <== osd.1 v2:172.21.15.39:6800/2829970892 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f28580715c0 con 0x7f285806eb00 2023-05-16T13:54:21.065 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.014+0000 7fa822011640 1 --2- 172.21.15.39:0/1891508731 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa81c160450 0x7fa81c06b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.066 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.014+0000 7f2f86a04640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2f8006dac0 0x7f2f801f8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.066 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.014+0000 7fa823a74640 1 -- 172.21.15.39:0/1891508731 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa81c0c63d0 con 0x7fa81c0d33a0 2023-05-16T13:54:21.066 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.014+0000 7fa823a74640 1 -- 172.21.15.39:0/1891508731 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa81c161cd0 con 0x7fa81c0d0b80 2023-05-16T13:54:21.067 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.014+0000 7f2f86a04640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f800cac70 0x7f2f800b1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.067 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.014+0000 7f2f86a04640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f800cc620 0x7f2f800ccaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.067 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.014+0000 7f2f86a04640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f800ccfe0 con 0x7f2f8006dac0 2023-05-16T13:54:21.067 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.014+0000 7f2f86a04640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f80150d70 con 0x7f2f800cc620 2023-05-16T13:54:21.068 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.014+0000 7f2f84fa1640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f800cc620 0x7f2f800ccaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.068 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.014+0000 7f2f84fa1640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f800cc620 0x7f2f800ccaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.39:34744/0 (socket says 172.21.15.39:34744) 2023-05-16T13:54:21.068 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.014+0000 7f2f84fa1640 1 -- 172.21.15.39:0/436657829 learned_addr learned my addr 172.21.15.39:0/436657829 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:21.068 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.014+0000 7f2f86a04640 1 -- 172.21.15.39:0/436657829 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f801fd250 con 0x7f2f800cac70 2023-05-16T13:54:21.068 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.014+0000 7fa821810640 1 -- 172.21.15.39:0/1891508731 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa81c0d33a0 msgr2=0x7fa81c153920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.069 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.014+0000 7fa821810640 1 --2- 172.21.15.39:0/1891508731 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa81c0d33a0 0x7fa81c153920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.069 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.014+0000 7fa821810640 1 -- 172.21.15.39:0/1891508731 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa81c160450 msgr2=0x7fa81c06b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.069 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.018+0000 7fa821810640 1 --2- 172.21.15.39:0/1891508731 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa81c160450 0x7fa81c06b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.069 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.018+0000 7fa821810640 1 -- 172.21.15.39:0/1891508731 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa814009a70 con 0x7fa81c0d0b80 2023-05-16T13:54:21.069 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.018+0000 7f2f777fe640 1 --2- 172.21.15.39:0/436657829 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f800cac70 0x7f2f800b1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.070 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.018+0000 7fa821810640 1 --2- 172.21.15.39:0/1891508731 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa81c0d0b80 0x7fa81c1616f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa80c00c420 tx=0x7fa80c00c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:21.070 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.014+0000 7f5b97fff640 1 -- start start 2023-05-16T13:54:21.071 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.014+0000 7f5b97fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5b9004f6a0 0x7f5b900f1210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.071 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.014+0000 7f5b97fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b90052c20 0x7f5b900d3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.071 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.014+0000 7f5b97fff640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b9004bbe0 0x7f5b900e8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.071 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.014+0000 7f5b97fff640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b900e9bf0 con 0x7f5b9004f6a0 2023-05-16T13:54:21.071 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.014+0000 7f5b97fff640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b900f1750 con 0x7f5b90052c20 2023-05-16T13:54:21.071 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.014+0000 7f5b97fff640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b900dbc50 con 0x7f5b9004bbe0 2023-05-16T13:54:21.071 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.018+0000 7f5b967fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b90052c20 0x7f5b900d3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.071 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.018+0000 7f5b967fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b90052c20 0x7f5b900d3e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.39:34760/0 (socket says 172.21.15.39:34760) 2023-05-16T13:54:21.072 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.018+0000 7f5b967fc640 1 -- 172.21.15.39:0/399741706 learned_addr learned my addr 172.21.15.39:0/399741706 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:21.072 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.014+0000 7f492d262640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f492003b2c0 0x7f492000bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.072 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.014+0000 7f492d262640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f49200e27e0 0x7f492000a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.072 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.014+0000 7f492d262640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f49200e7040 0x7f492017c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.073 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.014+0000 7f492d262640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f492000b300 con 0x7f49200e7040 2023-05-16T13:54:21.073 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.014+0000 7f492d262640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f492000b5e0 con 0x7f492003b2c0 2023-05-16T13:54:21.073 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.014+0000 7f492d262640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f492017bc70 con 0x7f49200e27e0 2023-05-16T13:54:21.073 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.018+0000 7fa8127fc640 1 -- 172.21.15.39:0/1891508731 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80c005cf0 con 0x7fa81c0d0b80 2023-05-16T13:54:21.073 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.018+0000 7fa8127fc640 1 -- 172.21.15.39:0/1891508731 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa80c005e50 con 0x7fa81c0d0b80 2023-05-16T13:54:21.073 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.018+0000 7fa8127fc640 1 -- 172.21.15.39:0/1891508731 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80c0072d0 con 0x7fa81c0d0b80 2023-05-16T13:54:21.074 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.018+0000 7f5b967fc640 1 -- 172.21.15.39:0/399741706 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b9004bbe0 msgr2=0x7f5b900e8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.074 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.018+0000 7f5b967fc640 1 --2- 172.21.15.39:0/399741706 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b9004bbe0 0x7f5b900e8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.074 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.018+0000 7f5b967fc640 1 -- 172.21.15.39:0/399741706 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5b9004f6a0 msgr2=0x7f5b900f1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.074 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.018+0000 7f5b967fc640 1 --2- 172.21.15.39:0/399741706 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5b9004f6a0 0x7f5b900f1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.074 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.018+0000 7f5b967fc640 1 -- 172.21.15.39:0/399741706 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b880094d0 con 0x7f5b90052c20 2023-05-16T13:54:21.074 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.018+0000 7f5b967fc640 1 --2- 172.21.15.39:0/399741706 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b90052c20 0x7f5b900d3e60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c00d800 tx=0x7f5b8c00dcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:21.075 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.018+0000 7fe3e56d1640 1 Processor -- start 2023-05-16T13:54:21.075 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.018+0000 7fa823a74640 1 -- 172.21.15.39:0/1891508731 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa81c0c5dc0 con 0x7fa81c0d0b80 2023-05-16T13:54:21.075 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.018+0000 7f30b5a8c640 1 -- 172.21.15.39:0/3157458977 shutdown_connections 2023-05-16T13:54:21.076 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.018+0000 7fa823a74640 1 -- 172.21.15.39:0/1891508731 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa81c160820 con 0x7fa81c0d0b80 2023-05-16T13:54:21.076 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.018+0000 7f2f84fa1640 1 -- 172.21.15.39:0/436657829 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f800cac70 msgr2=0x7f2f800b1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.076 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.018+0000 7f2f84fa1640 1 --2- 172.21.15.39:0/436657829 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f800cac70 0x7f2f800b1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.077 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.018+0000 7f2f84fa1640 1 -- 172.21.15.39:0/436657829 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2f8006dac0 msgr2=0x7f2f801f8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.077 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.018+0000 7f2f84fa1640 1 --2- 172.21.15.39:0/436657829 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2f8006dac0 0x7f2f801f8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.077 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.018+0000 7f2f84fa1640 1 -- 172.21.15.39:0/436657829 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f680094d0 con 0x7f2f800cc620 2023-05-16T13:54:21.077 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.018+0000 7f2f84fa1640 1 --2- 172.21.15.39:0/436657829 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f800cc620 0x7f2f800ccaa0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2f7800b390 tx=0x7f2f7800b850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:21.077 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.018+0000 7f2f7d7fa640 1 -- 172.21.15.39:0/436657829 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f78011830 con 0x7f2f800cc620 2023-05-16T13:54:21.077 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.018+0000 7f2f7d7fa640 1 -- 172.21.15.39:0/436657829 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f78011990 con 0x7f2f800cc620 2023-05-16T13:54:21.077 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.018+0000 7f2f7d7fa640 1 -- 172.21.15.39:0/436657829 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f78011d40 con 0x7f2f800cc620 2023-05-16T13:54:21.078 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.018+0000 7f2f86a04640 1 -- 172.21.15.39:0/436657829 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f80158e50 con 0x7f2f800cc620 2023-05-16T13:54:21.078 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.018+0000 7f30b5a8c640 1 -- 172.21.15.39:0/3157458977 wait complete. 2023-05-16T13:54:21.078 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.018+0000 7fe3e56d1640 1 -- start start 2023-05-16T13:54:21.078 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.018+0000 7f2f86a04640 1 -- 172.21.15.39:0/436657829 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f800c8e70 con 0x7f2f800cc620 2023-05-16T13:54:21.079 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.018+0000 7fe3e56d1640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe3d8034050 0x7fe3d8038870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.079 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.022+0000 7fe3e56d1640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe3d8050cc0 0x7fe3d8034740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.079 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.022+0000 7fe3e56d1640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe3d80ea0e0 0x7fe3d80dc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.079 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.022+0000 7fe3e56d1640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d80358e0 con 0x7fe3d8050cc0 2023-05-16T13:54:21.080 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.022+0000 7fe3e56d1640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d8035040 con 0x7fe3d8034050 2023-05-16T13:54:21.080 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.022+0000 7fe3e56d1640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d8035320 con 0x7fe3d80ea0e0 2023-05-16T13:54:21.080 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.022+0000 7fa823a74640 1 -- 172.21.15.39:0/1891508731 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa81c0c5f50 con 0x7fa81c0d0b80 2023-05-16T13:54:21.081 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.022+0000 7f2f86a04640 1 -- 172.21.15.39:0/436657829 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2f80158fe0 con 0x7f2f800cc620 2023-05-16T13:54:21.081 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.022+0000 7fe3deffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe3d8034050 0x7fe3d8038870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.081 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.022+0000 7fe3deffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe3d8034050 0x7fe3d8038870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.39:34764/0 (socket says 172.21.15.39:34764) 2023-05-16T13:54:21.081 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.022+0000 7fe3deffd640 1 -- 172.21.15.39:0/1785893162 learned_addr learned my addr 172.21.15.39:0/1785893162 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:21.081 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.022+0000 7fe3dffff640 1 --2- 172.21.15.39:0/1785893162 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe3d80ea0e0 0x7fe3d80dc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.082 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.022+0000 7f30b5a8c640 1 Processor -- start 2023-05-16T13:54:21.082 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.022+0000 7f2f7d7fa640 1 -- 172.21.15.39:0/436657829 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2f7801a400 con 0x7f2f800cc620 2023-05-16T13:54:21.082 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.018+0000 7f5b7f7fe640 1 -- 172.21.15.39:0/399741706 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b8c00b6c0 con 0x7f5b90052c20 2023-05-16T13:54:21.083 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.018+0000 7f5b7f7fe640 1 -- 172.21.15.39:0/399741706 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b8c00b820 con 0x7f5b90052c20 2023-05-16T13:54:21.083 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.018+0000 7f5b7f7fe640 1 -- 172.21.15.39:0/399741706 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b8c00bbb0 con 0x7f5b90052c20 2023-05-16T13:54:21.083 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.022+0000 7fe3dffff640 1 -- 172.21.15.39:0/1785893162 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe3d8034050 msgr2=0x7fe3d8038870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.083 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.022+0000 7fe3dffff640 1 --2- 172.21.15.39:0/1785893162 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe3d8034050 0x7fe3d8038870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.083 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.022+0000 7fe3dffff640 1 -- 172.21.15.39:0/1785893162 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe3d8050cc0 msgr2=0x7fe3d8034740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.084 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.022+0000 7fe3de7fc640 1 --2- 172.21.15.39:0/1785893162 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe3d8050cc0 0x7fe3d8034740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.084 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.022+0000 7fe3dffff640 1 --2- 172.21.15.39:0/1785893162 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe3d8050cc0 0x7fe3d8034740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.084 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.022+0000 7fe3dffff640 1 -- 172.21.15.39:0/1785893162 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d40094d0 con 0x7fe3d80ea0e0 2023-05-16T13:54:21.084 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.022+0000 7fe3deffd640 1 --2- 172.21.15.39:0/1785893162 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe3d8034050 0x7fe3d8038870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-16T13:54:21.084 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.022+0000 7fe3de7fc640 1 --2- 172.21.15.39:0/1785893162 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe3d8050cc0 0x7fe3d8034740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-16T13:54:21.084 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.022+0000 7fe3dffff640 1 --2- 172.21.15.39:0/1785893162 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe3d80ea0e0 0x7fe3d80dc1e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe3e004ebe0 tx=0x7fe3e004e130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:21.084 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.022+0000 7fe3c77fe640 1 -- 172.21.15.39:0/1785893162 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e008e720 con 0x7fe3d80ea0e0 2023-05-16T13:54:21.085 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.022+0000 7f2f7d7fa640 1 --2- 172.21.15.39:0/436657829 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f2f60066380 0x7f2f60068830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.085 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.022+0000 7fe3c77fe640 1 -- 172.21.15.39:0/1785893162 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3e008e880 con 0x7fe3d80ea0e0 2023-05-16T13:54:21.085 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.022+0000 7fe3e56d1640 1 -- 172.21.15.39:0/1785893162 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3d8006ca0 con 0x7fe3d80ea0e0 2023-05-16T13:54:21.085 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.022+0000 7fe3c77fe640 1 -- 172.21.15.39:0/1785893162 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e008ec30 con 0x7fe3d80ea0e0 2023-05-16T13:54:21.086 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.022+0000 7fa8127fc640 1 -- 172.21.15.39:0/1891508731 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa80c007430 con 0x7fa81c0d0b80 2023-05-16T13:54:21.086 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.022+0000 7fe3e56d1640 1 -- 172.21.15.39:0/1785893162 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3d80510d0 con 0x7fe3d80ea0e0 2023-05-16T13:54:21.086 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.022+0000 7fe3e56d1640 1 -- 172.21.15.39:0/1785893162 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe3d8006e30 con 0x7fe3d80ea0e0 2023-05-16T13:54:21.087 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.022+0000 7fa8127fc640 1 --2- 172.21.15.39:0/1891508731 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fa800066350 0x7fa800068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.087 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.022+0000 7fa8127fc640 1 -- 172.21.15.39:0/1891508731 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa80c083290 con 0x7fa81c0d0b80 2023-05-16T13:54:21.087 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.026+0000 7fa8127fc640 1 --2- 172.21.15.39:0/1891508731 >> [v2:172.21.15.39:6824/405003958,v1:172.21.15.39:6825/405003958] conn(0x7fa80006ec00 0x7fa800071010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.087 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.026+0000 7fa8127fc640 1 -- 172.21.15.39:0/1891508731 --> [v2:172.21.15.39:6824/405003958,v1:172.21.15.39:6825/405003958] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa8000716c0 con 0x7fa80006ec00 2023-05-16T13:54:21.087 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.026+0000 7fa8127fc640 1 -- 172.21.15.39:0/1891508731 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa80c0858b0 con 0x7fa81c0d0b80 2023-05-16T13:54:21.087 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.022+0000 7f2f7d7fa640 1 -- 172.21.15.39:0/436657829 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2f78083d70 con 0x7f2f800cc620 2023-05-16T13:54:21.088 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.022+0000 7f2f7d7fa640 1 --2- 172.21.15.39:0/436657829 >> [v2:172.21.15.118:6802/3513592808,v1:172.21.15.118:6804/3513592808] conn(0x7f2f6006ec30 0x7f2f60071040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.088 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.022+0000 7f2f7d7fa640 1 -- 172.21.15.39:0/436657829 --> [v2:172.21.15.118:6802/3513592808,v1:172.21.15.118:6804/3513592808] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2f600716f0 con 0x7f2f6006ec30 2023-05-16T13:54:21.088 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.022+0000 7f2f7d7fa640 1 -- 172.21.15.39:0/436657829 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f78086390 con 0x7f2f800cc620 2023-05-16T13:54:21.088 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.022+0000 7f2f7ffff640 1 --2- 172.21.15.39:0/436657829 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f2f60066380 0x7f2f60068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.088 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.022+0000 7f2f777fe640 1 --2- 172.21.15.39:0/436657829 >> [v2:172.21.15.118:6802/3513592808,v1:172.21.15.118:6804/3513592808] conn(0x7f2f6006ec30 0x7f2f60071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.088 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.022+0000 7f2f777fe640 1 --2- 172.21.15.39:0/436657829 >> [v2:172.21.15.118:6802/3513592808,v1:172.21.15.118:6804/3513592808] conn(0x7f2f6006ec30 0x7f2f60071040 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:21.088 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.026+0000 7f2f7ffff640 1 --2- 172.21.15.39:0/436657829 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f2f60066380 0x7f2f60068830 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2f70007fd0 tx=0x7f2f70007d40 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:21.089 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.026+0000 7fa82100f640 1 --2- 172.21.15.39:0/1891508731 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fa800066350 0x7fa800068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.089 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.026+0000 7f4927fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f492003b2c0 0x7f492000bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.089 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.026+0000 7f49277fe640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f49200e27e0 0x7f492000a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.090 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.026+0000 7f49277fe640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f49200e27e0 0x7f492000a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.39:33420/0 (socket says 172.21.15.39:33420) 2023-05-16T13:54:21.090 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.026+0000 7f49277fe640 1 -- 172.21.15.39:0/3950722752 learned_addr learned my addr 172.21.15.39:0/3950722752 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:21.090 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.026+0000 7fa822011640 1 --2- 172.21.15.39:0/1891508731 >> [v2:172.21.15.39:6824/405003958,v1:172.21.15.39:6825/405003958] conn(0x7fa80006ec00 0x7fa800071010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.090 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.026+0000 7fe3c77fe640 1 -- 172.21.15.39:0/1785893162 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe3e009b440 con 0x7fe3d80ea0e0 2023-05-16T13:54:21.091 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.026+0000 7fa82100f640 1 --2- 172.21.15.39:0/1891508731 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fa800066350 0x7fa800068800 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa81c0b6960 tx=0x7fa818009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:21.091 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.026+0000 7fa822011640 1 --2- 172.21.15.39:0/1891508731 >> [v2:172.21.15.39:6824/405003958,v1:172.21.15.39:6825/405003958] conn(0x7fa80006ec00 0x7fa800071010 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:21.091 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.026+0000 7f49277fe640 1 -- 172.21.15.39:0/3950722752 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f492003b2c0 msgr2=0x7f492000bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.092 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.026+0000 7f49277fe640 1 --2- 172.21.15.39:0/3950722752 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f492003b2c0 0x7f492000bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.092 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.026+0000 7f49277fe640 1 -- 172.21.15.39:0/3950722752 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f49200e7040 msgr2=0x7f492017c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.092 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.026+0000 7f49277fe640 1 --2- 172.21.15.39:0/3950722752 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f49200e7040 0x7f492017c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.092 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.026+0000 7f49277fe640 1 -- 172.21.15.39:0/3950722752 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49200f0790 con 0x7f49200e27e0 2023-05-16T13:54:21.092 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.026+0000 7f2f7d7fa640 1 -- 172.21.15.39:0/436657829 <== osd.5 v2:172.21.15.118:6802/3513592808 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f2f600716f0 con 0x7f2f6006ec30 2023-05-16T13:54:21.093 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.026+0000 7f49277fe640 1 --2- 172.21.15.39:0/3950722752 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f49200e27e0 0x7f492000a880 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f491400c4d0 tx=0x7f491400c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:21.093 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.026+0000 7fe3c77fe640 1 --2- 172.21.15.39:0/1785893162 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fe3cc066280 0x7fe3cc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.093 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.026+0000 7fe3c77fe640 1 -- 172.21.15.39:0/1785893162 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe3e00fd050 con 0x7fe3d80ea0e0 2023-05-16T13:54:21.093 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.026+0000 7fe3c77fe640 1 --2- 172.21.15.39:0/1785893162 >> [v2:172.21.15.118:6816/3636642904,v1:172.21.15.118:6817/3636642904] conn(0x7fe3cc06eb30 0x7fe3cc070f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.094 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.026+0000 7fe3c77fe640 1 -- 172.21.15.39:0/1785893162 --> [v2:172.21.15.118:6816/3636642904,v1:172.21.15.118:6817/3636642904] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe3cc0715f0 con 0x7fe3cc06eb30 2023-05-16T13:54:21.094 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.026+0000 7fe3c77fe640 1 -- 172.21.15.39:0/1785893162 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe3e00fd400 con 0x7fe3d80ea0e0 2023-05-16T13:54:21.094 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.026+0000 7f30b5a8c640 1 -- start start 2023-05-16T13:54:21.095 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.022+0000 7f5b97fff640 1 -- 172.21.15.39:0/399741706 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b90053cd0 con 0x7f5b90052c20 2023-05-16T13:54:21.095 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.022+0000 7f5b97fff640 1 -- 172.21.15.39:0/399741706 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b90054670 con 0x7f5b90052c20 2023-05-16T13:54:21.095 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.022+0000 7f5b97fff640 1 -- 172.21.15.39:0/399741706 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5b90053e60 con 0x7f5b90052c20 2023-05-16T13:54:21.095 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.026+0000 7f5b7f7fe640 1 -- 172.21.15.39:0/399741706 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5b8c00bd10 con 0x7f5b90052c20 2023-05-16T13:54:21.095 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.026+0000 7f5b7f7fe640 1 --2- 172.21.15.39:0/399741706 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f5b84066300 0x7f5b840687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.095 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.026+0000 7f5b96ffd640 1 --2- 172.21.15.39:0/399741706 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f5b84066300 0x7f5b840687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.096 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.026+0000 7f4924ff9640 1 -- 172.21.15.39:0/3950722752 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4914007480 con 0x7f49200e27e0 2023-05-16T13:54:21.096 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.026+0000 7f4924ff9640 1 -- 172.21.15.39:0/3950722752 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49140075e0 con 0x7f49200e27e0 2023-05-16T13:54:21.096 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.026+0000 7f4924ff9640 1 -- 172.21.15.39:0/3950722752 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4914004a10 con 0x7f49200e27e0 2023-05-16T13:54:21.096 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.026+0000 7f492d262640 1 -- 172.21.15.39:0/3950722752 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49200e2bb0 con 0x7f49200e27e0 2023-05-16T13:54:21.096 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.026+0000 7f492d262640 1 -- 172.21.15.39:0/3950722752 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49200f0920 con 0x7f49200e27e0 2023-05-16T13:54:21.097 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.026+0000 7f492d262640 1 -- 172.21.15.39:0/3950722752 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f49200058f0 con 0x7f49200e27e0 2023-05-16T13:54:21.097 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.030+0000 7fe3deffd640 1 --2- 172.21.15.39:0/1785893162 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fe3cc066280 0x7fe3cc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.097 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.030+0000 7fe3de7fc640 1 --2- 172.21.15.39:0/1785893162 >> [v2:172.21.15.118:6816/3636642904,v1:172.21.15.118:6817/3636642904] conn(0x7fe3cc06eb30 0x7fe3cc070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.097 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.030+0000 7f5b96ffd640 1 --2- 172.21.15.39:0/399741706 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f5b84066300 0x7f5b840687b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5b880ad000 tx=0x7f5b88004740 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:21.098 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.030+0000 7fe3deffd640 1 --2- 172.21.15.39:0/1785893162 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fe3cc066280 0x7fe3cc068730 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe3d401c580 tx=0x7fe3d40a6000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:21.098 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.030+0000 7f5b7f7fe640 1 -- 172.21.15.39:0/399741706 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5b8c058ad0 con 0x7f5b90052c20 2023-05-16T13:54:21.098 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.030+0000 7f5b7f7fe640 1 --2- 172.21.15.39:0/399741706 >> [v2:172.21.15.118:6823/1863656053,v1:172.21.15.118:6824/1863656053] conn(0x7f5b8406eb30 0x7f5b84070f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.099 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.030+0000 7f5b7f7fe640 1 -- 172.21.15.39:0/399741706 --> [v2:172.21.15.118:6823/1863656053,v1:172.21.15.118:6824/1863656053] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5b840715f0 con 0x7f5b8406eb30 2023-05-16T13:54:21.099 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.030+0000 7f5b7f7fe640 1 -- 172.21.15.39:0/399741706 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5b8c050e50 con 0x7f5b90052c20 2023-05-16T13:54:21.099 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.030+0000 7f5b977fe640 1 --2- 172.21.15.39:0/399741706 >> [v2:172.21.15.118:6823/1863656053,v1:172.21.15.118:6824/1863656053] conn(0x7f5b8406eb30 0x7f5b84070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.099 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.030+0000 7f5b977fe640 1 --2- 172.21.15.39:0/399741706 >> [v2:172.21.15.118:6823/1863656053,v1:172.21.15.118:6824/1863656053] conn(0x7f5b8406eb30 0x7f5b84070f40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:21.099 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.030+0000 7f30b5a8c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30b00c88b0 0x7f30b0139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.100 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.030+0000 7f5b7f7fe640 1 -- 172.21.15.39:0/399741706 <== osd.6 v2:172.21.15.118:6823/1863656053 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f5b98095220 con 0x7f5b8406eb30 2023-05-16T13:54:21.100 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.030+0000 7f30af7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30b00c88b0 0x7f30b0139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.100 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.030+0000 7f30af7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30b00c88b0 0x7f30b0139aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59810/0 (socket says 172.21.15.39:59810) 2023-05-16T13:54:21.100 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.030+0000 7f4924ff9640 1 -- 172.21.15.39:0/3950722752 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4914004b70 con 0x7f49200e27e0 2023-05-16T13:54:21.101 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.034+0000 7fe3de7fc640 1 --2- 172.21.15.39:0/1785893162 >> [v2:172.21.15.118:6816/3636642904,v1:172.21.15.118:6817/3636642904] conn(0x7fe3cc06eb30 0x7fe3cc070f40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:21.101 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.034+0000 7f30b5a8c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f30b00ce970 0x7f30b015c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.102 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.034+0000 7f30b5a8c640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f30b0157df0 0x7f30b0151710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.102 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.034+0000 7f30aeffd640 1 --2- 172.21.15.39:0/2314196644 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f30b00ce970 0x7f30b015c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.102 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.034+0000 7f30af7fe640 1 -- 172.21.15.39:0/2314196644 learned_addr learned my addr 172.21.15.39:0/2314196644 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:21.102 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.034+0000 7f4924ff9640 1 --2- 172.21.15.39:0/3950722752 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f490c066350 0x7f490c068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.102 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.034+0000 7f4924ff9640 1 -- 172.21.15.39:0/3950722752 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f49140839f0 con 0x7f49200e27e0 2023-05-16T13:54:21.102 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.034+0000 7f4924ff9640 1 --2- 172.21.15.39:0/3950722752 >> [v2:172.21.15.118:6800/3895278838,v1:172.21.15.118:6801/3895278838] conn(0x7f490c06ec00 0x7f490c071010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.103 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.034+0000 7f4924ff9640 1 -- 172.21.15.39:0/3950722752 --> [v2:172.21.15.118:6800/3895278838,v1:172.21.15.118:6801/3895278838] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f490c0716c0 con 0x7f490c06ec00 2023-05-16T13:54:21.103 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.034+0000 7f4924ff9640 1 -- 172.21.15.39:0/3950722752 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4914083da0 con 0x7f49200e27e0 2023-05-16T13:54:21.103 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.034+0000 7fe3c77fe640 1 -- 172.21.15.39:0/1785893162 <== osd.7 v2:172.21.15.118:6816/3636642904 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fe3cc0715f0 con 0x7fe3cc06eb30 2023-05-16T13:54:21.103 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.034+0000 7f30affff640 1 --2- 172.21.15.39:0/2314196644 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f30b0157df0 0x7f30b0151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.104 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.034+0000 7f30b5a8c640 1 -- 172.21.15.39:0/2314196644 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30b014b010 con 0x7f30b00c88b0 2023-05-16T13:54:21.104 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.034+0000 7f30b5a8c640 1 -- 172.21.15.39:0/2314196644 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30b0135c90 con 0x7f30b00ce970 2023-05-16T13:54:21.104 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.034+0000 7f30b5a8c640 1 -- 172.21.15.39:0/2314196644 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30b0135ee0 con 0x7f30b0157df0 2023-05-16T13:54:21.104 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.034+0000 7f4927fff640 1 --2- 172.21.15.39:0/3950722752 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f490c066350 0x7f490c068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.104 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.034+0000 7f492ca61640 1 --2- 172.21.15.39:0/3950722752 >> [v2:172.21.15.118:6800/3895278838,v1:172.21.15.118:6801/3895278838] conn(0x7f490c06ec00 0x7f490c071010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.105 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.034+0000 7f30aeffd640 1 -- 172.21.15.39:0/2314196644 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f30b0157df0 msgr2=0x7f30b0151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.105 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.034+0000 7f30aeffd640 1 --2- 172.21.15.39:0/2314196644 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f30b0157df0 0x7f30b0151710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.105 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.034+0000 7f30aeffd640 1 -- 172.21.15.39:0/2314196644 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30b00c88b0 msgr2=0x7f30b0139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.105 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.034+0000 7f30aeffd640 1 --2- 172.21.15.39:0/2314196644 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30b00c88b0 0x7f30b0139aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.105 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.034+0000 7f30aeffd640 1 -- 172.21.15.39:0/2314196644 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3098009420 con 0x7f30b00ce970 2023-05-16T13:54:21.105 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.034+0000 7f30aeffd640 1 --2- 172.21.15.39:0/2314196644 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f30b00ce970 0x7f30b015c050 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f30a8007e70 tx=0x7f30a800d4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:21.106 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.034+0000 7f492ca61640 1 --2- 172.21.15.39:0/3950722752 >> [v2:172.21.15.118:6800/3895278838,v1:172.21.15.118:6801/3895278838] conn(0x7f490c06ec00 0x7f490c071010 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:21.106 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.034+0000 7f4927fff640 1 --2- 172.21.15.39:0/3950722752 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f490c066350 0x7f490c068800 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4920010060 tx=0x7f4928122000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:21.106 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.034+0000 7f309ffff640 1 -- 172.21.15.39:0/2314196644 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30a8003ba0 con 0x7f30b00ce970 2023-05-16T13:54:21.107 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.026+0000 7fa8127fc640 1 -- 172.21.15.39:0/1891508731 <== osd.3 v2:172.21.15.39:6824/405003958 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fa8000716c0 con 0x7fa80006ec00 2023-05-16T13:54:21.107 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.034+0000 7f309ffff640 1 -- 172.21.15.39:0/2314196644 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30a800f040 con 0x7f30b00ce970 2023-05-16T13:54:21.107 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.034+0000 7f309ffff640 1 -- 172.21.15.39:0/2314196644 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30a800de80 con 0x7f30b00ce970 2023-05-16T13:54:21.107 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.038+0000 7f30b5a8c640 1 -- 172.21.15.39:0/2314196644 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30b006c060 con 0x7f30b00ce970 2023-05-16T13:54:21.108 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.038+0000 7f4924ff9640 1 -- 172.21.15.39:0/3950722752 <== osd.4 v2:172.21.15.118:6800/3895278838 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f490c0716c0 con 0x7f490c06ec00 2023-05-16T13:54:21.108 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.038+0000 7f30b5a8c640 1 -- 172.21.15.39:0/2314196644 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30b006bed0 con 0x7f30b00ce970 2023-05-16T13:54:21.108 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.038+0000 7f309ffff640 1 -- 172.21.15.39:0/2314196644 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f30a8004030 con 0x7f30b00ce970 2023-05-16T13:54:21.109 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.042+0000 7f309ffff640 1 --2- 172.21.15.39:0/2314196644 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f30900662d0 0x7f3090068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.109 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.042+0000 7f30af7fe640 1 --2- 172.21.15.39:0/2314196644 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f30900662d0 0x7f3090068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.109 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.042+0000 7f30af7fe640 1 --2- 172.21.15.39:0/2314196644 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f30900662d0 0x7f3090068780 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f30980097c0 tx=0x7f30980a6000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:21.109 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.042+0000 7f309ffff640 1 -- 172.21.15.39:0/2314196644 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f30a8083f60 con 0x7f30b00ce970 2023-05-16T13:54:21.109 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.042+0000 7f7f52ffd640 1 -- 172.21.15.39:0/2890758490 --> [v2:172.21.15.39:6808/3462013698,v1:172.21.15.39:6809/3462013698] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7f34002cc0 con 0x7f7f3c06eb80 2023-05-16T13:54:21.110 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.042+0000 7f309dffb640 1 --2- 172.21.15.39:0/2314196644 >> [v2:172.21.15.39:6816/3888067413,v1:172.21.15.39:6817/3888067413] conn(0x7f30b00c2560 0x7f30b0136400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.110 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.046+0000 7f7f597fa640 1 -- 172.21.15.39:0/2890758490 <== osd.0 v2:172.21.15.39:6808/3462013698 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7f34002cc0 con 0x7f7f3c06eb80 2023-05-16T13:54:21.110 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.046+0000 7f309dffb640 1 -- 172.21.15.39:0/2314196644 --> [v2:172.21.15.39:6816/3888067413,v1:172.21.15.39:6817/3888067413] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f30b004ed20 con 0x7f30b00c2560 2023-05-16T13:54:21.111 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.046+0000 7f30affff640 1 --2- 172.21.15.39:0/2314196644 >> [v2:172.21.15.39:6816/3888067413,v1:172.21.15.39:6817/3888067413] conn(0x7f30b00c2560 0x7f30b0136400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.111 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.046+0000 7f30affff640 1 --2- 172.21.15.39:0/2314196644 >> [v2:172.21.15.39:6816/3888067413,v1:172.21.15.39:6817/3888067413] conn(0x7f30b00c2560 0x7f30b0136400 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:21.111 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.046+0000 7f309ffff640 1 -- 172.21.15.39:0/2314196644 <== osd.2 v2:172.21.15.39:6816/3888067413 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f30b004ed20 con 0x7f30b00c2560 2023-05-16T13:54:21.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.046+0000 7f7f52ffd640 1 -- 172.21.15.39:0/2890758490 >> [v2:172.21.15.39:6808/3462013698,v1:172.21.15.39:6809/3462013698] conn(0x7f7f3c06eb80 msgr2=0x7f7f3c070f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.046+0000 7f7f52ffd640 1 --2- 172.21.15.39:0/2890758490 >> [v2:172.21.15.39:6808/3462013698,v1:172.21.15.39:6809/3462013698] conn(0x7f7f3c06eb80 0x7f7f3c070f90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.046+0000 7f7f52ffd640 1 -- 172.21.15.39:0/2890758490 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f7f3c0662d0 msgr2=0x7f7f3c068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.046+0000 7f7f52ffd640 1 --2- 172.21.15.39:0/2890758490 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f7f3c0662d0 0x7f7f3c068780 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c0070b0 tx=0x7f7f4c007040 comp rx=0 tx=0).stop 2023-05-16T13:54:21.113 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.046+0000 7f7f52ffd640 1 -- 172.21.15.39:0/2890758490 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7f5c0d1b90 msgr2=0x7f7f5c0cd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.113 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.046+0000 7f7f52ffd640 1 --2- 172.21.15.39:0/2890758490 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7f5c0d1b90 0x7f7f5c0cd1c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7f5401c960 tx=0x7f7f5401bad0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.113 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.046+0000 7f7f613de640 1 -- 172.21.15.39:0/2890758490 reap_dead start 2023-05-16T13:54:21.113 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.046+0000 7f7f52ffd640 1 -- 172.21.15.39:0/2890758490 shutdown_connections 2023-05-16T13:54:21.113 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.046+0000 7f7f52ffd640 1 -- 172.21.15.39:0/2890758490 >> 172.21.15.39:0/2890758490 conn(0x7f7f5c0d2710 msgr2=0x7f7f5c160b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:21.113 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.050+0000 7f7f52ffd640 1 -- 172.21.15.39:0/2890758490 shutdown_connections 2023-05-16T13:54:21.113 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.050+0000 7f7f52ffd640 1 -- 172.21.15.39:0/2890758490 wait complete. 2023-05-16T13:54:21.114 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.050+0000 7f287afdf640 1 -- 172.21.15.39:0/2805211827 --> [v2:172.21.15.39:6800/2829970892,v1:172.21.15.39:6801/2829970892] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f287406bff0 con 0x7f285806eb00 2023-05-16T13:54:21.114 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.050+0000 7f286a7fc640 1 -- 172.21.15.39:0/2805211827 <== osd.1 v2:172.21.15.39:6800/2829970892 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f287406bff0 con 0x7f285806eb00 2023-05-16T13:54:21.115 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.050+0000 7f2857fff640 1 -- 172.21.15.39:0/2805211827 >> [v2:172.21.15.39:6800/2829970892,v1:172.21.15.39:6801/2829970892] conn(0x7f285806eb00 msgr2=0x7f2858070f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.115 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.050+0000 7f2857fff640 1 --2- 172.21.15.39:0/2805211827 >> [v2:172.21.15.39:6800/2829970892,v1:172.21.15.39:6801/2829970892] conn(0x7f285806eb00 0x7f2858070f10 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.115 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.050+0000 7f2857fff640 1 -- 172.21.15.39:0/2805211827 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f28580662d0 msgr2=0x7f2858068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.115 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.050+0000 7f2857fff640 1 --2- 172.21.15.39:0/2805211827 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f28580662d0 0x7f2858068780 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f28740cb5f0 tx=0x7f286c0aa000 comp rx=0 tx=0).stop 2023-05-16T13:54:21.115 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.050+0000 7f2857fff640 1 -- 172.21.15.39:0/2805211827 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f28600047d0 msgr2=0x7f28740ca680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.115 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.050+0000 7f2857fff640 1 --2- 172.21.15.39:0/2805211827 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f28600047d0 0x7f28740ca680 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f286400e550 tx=0x7f286400e580 comp rx=0 tx=0).stop 2023-05-16T13:54:21.116 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.050+0000 7f287a7de640 1 -- 172.21.15.39:0/2805211827 reap_dead start 2023-05-16T13:54:21.116 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.050+0000 7f2857fff640 1 -- 172.21.15.39:0/2805211827 shutdown_connections 2023-05-16T13:54:21.116 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.050+0000 7f2857fff640 1 -- 172.21.15.39:0/2805211827 >> 172.21.15.39:0/2805211827 conn(0x7f2874069a50 msgr2=0x7f2874156a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:21.116 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.050+0000 7f2857fff640 1 -- 172.21.15.39:0/2805211827 shutdown_connections 2023-05-16T13:54:21.116 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.050+0000 7f2857fff640 1 -- 172.21.15.39:0/2805211827 wait complete. 2023-05-16T13:54:21.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.050+0000 7fa823a74640 1 -- 172.21.15.39:0/1891508731 --> [v2:172.21.15.39:6824/405003958,v1:172.21.15.39:6825/405003958] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa81c073c90 con 0x7fa80006ec00 2023-05-16T13:54:21.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.054+0000 7fa8127fc640 1 -- 172.21.15.39:0/1891508731 <== osd.3 v2:172.21.15.39:6824/405003958 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa81c073c90 con 0x7fa80006ec00 2023-05-16T13:54:21.118 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.054+0000 7fa823a74640 1 -- 172.21.15.39:0/1891508731 >> [v2:172.21.15.39:6824/405003958,v1:172.21.15.39:6825/405003958] conn(0x7fa80006ec00 msgr2=0x7fa800071010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.118 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.054+0000 7fa823a74640 1 --2- 172.21.15.39:0/1891508731 >> [v2:172.21.15.39:6824/405003958,v1:172.21.15.39:6825/405003958] conn(0x7fa80006ec00 0x7fa800071010 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.118 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.054+0000 7fa823a74640 1 -- 172.21.15.39:0/1891508731 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fa800066350 msgr2=0x7fa800068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.118 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.054+0000 7fa823a74640 1 --2- 172.21.15.39:0/1891508731 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fa800066350 0x7fa800068800 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa81c0b6960 tx=0x7fa818009040 comp rx=0 tx=0).stop 2023-05-16T13:54:21.118 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.054+0000 7fa823a74640 1 -- 172.21.15.39:0/1891508731 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa81c0d0b80 msgr2=0x7fa81c1616f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.118 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.054+0000 7fa823a74640 1 --2- 172.21.15.39:0/1891508731 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa81c0d0b80 0x7fa81c1616f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa80c00c420 tx=0x7fa80c00c8e0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.118 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.054+0000 7fa822011640 1 -- 172.21.15.39:0/1891508731 reap_dead start 2023-05-16T13:54:21.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.054+0000 7fa823a74640 1 -- 172.21.15.39:0/1891508731 shutdown_connections 2023-05-16T13:54:21.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.054+0000 7fa823a74640 1 -- 172.21.15.39:0/1891508731 >> 172.21.15.39:0/1891508731 conn(0x7fa81c071aa0 msgr2=0x7fa81c15f620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:21.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.054+0000 7fa823a74640 1 -- 172.21.15.39:0/1891508731 shutdown_connections 2023-05-16T13:54:21.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.054+0000 7fa823a74640 1 -- 172.21.15.39:0/1891508731 wait complete. 2023-05-16T13:54:21.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.054+0000 7f5b97fff640 1 -- 172.21.15.39:0/399741706 --> [v2:172.21.15.118:6823/1863656053,v1:172.21.15.118:6824/1863656053] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5b90005350 con 0x7f5b8406eb30 2023-05-16T13:54:21.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.058+0000 7f5b7f7fe640 1 -- 172.21.15.39:0/399741706 <== osd.6 v2:172.21.15.118:6823/1863656053 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5b9808f020 con 0x7f5b8406eb30 2023-05-16T13:54:21.120 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.062+0000 7f5b97fff640 1 -- 172.21.15.39:0/399741706 >> [v2:172.21.15.118:6823/1863656053,v1:172.21.15.118:6824/1863656053] conn(0x7f5b8406eb30 msgr2=0x7f5b84070f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.120 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.062+0000 7f5b97fff640 1 --2- 172.21.15.39:0/399741706 >> [v2:172.21.15.118:6823/1863656053,v1:172.21.15.118:6824/1863656053] conn(0x7f5b8406eb30 0x7f5b84070f40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.120 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.062+0000 7f5b97fff640 1 -- 172.21.15.39:0/399741706 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f5b84066300 msgr2=0x7f5b840687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.121 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.062+0000 7f5b97fff640 1 --2- 172.21.15.39:0/399741706 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f5b84066300 0x7f5b840687b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5b880ad000 tx=0x7f5b88004740 comp rx=0 tx=0).stop 2023-05-16T13:54:21.121 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.062+0000 7f5b97fff640 1 -- 172.21.15.39:0/399741706 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b90052c20 msgr2=0x7f5b900d3e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.121 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.062+0000 7f5b97fff640 1 --2- 172.21.15.39:0/399741706 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b90052c20 0x7f5b900d3e60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c00d800 tx=0x7f5b8c00dcc0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.121 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.062+0000 7f5b977fe640 1 -- 172.21.15.39:0/399741706 reap_dead start 2023-05-16T13:54:21.121 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.062+0000 7f5b97fff640 1 -- 172.21.15.39:0/399741706 shutdown_connections 2023-05-16T13:54:21.121 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.062+0000 7f5b97fff640 1 -- 172.21.15.39:0/399741706 >> 172.21.15.39:0/399741706 conn(0x7f5b90051590 msgr2=0x7f5b900e76e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:21.122 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.062+0000 7fe3e56d1640 1 -- 172.21.15.39:0/1785893162 --> [v2:172.21.15.118:6816/3636642904,v1:172.21.15.118:6817/3636642904] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe3d8005520 con 0x7fe3cc06eb30 2023-05-16T13:54:21.122 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.062+0000 7f5b97fff640 1 -- 172.21.15.39:0/399741706 shutdown_connections 2023-05-16T13:54:21.122 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.062+0000 7f5b97fff640 1 -- 172.21.15.39:0/399741706 wait complete. 2023-05-16T13:54:21.122 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.062+0000 7fe3c77fe640 1 -- 172.21.15.39:0/1785893162 <== osd.7 v2:172.21.15.118:6816/3636642904 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe3d8005520 con 0x7fe3cc06eb30 2023-05-16T13:54:21.123 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.062+0000 7fe3c57fa640 1 -- 172.21.15.39:0/1785893162 >> [v2:172.21.15.118:6816/3636642904,v1:172.21.15.118:6817/3636642904] conn(0x7fe3cc06eb30 msgr2=0x7fe3cc070f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.124 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.062+0000 7fe3c57fa640 1 --2- 172.21.15.39:0/1785893162 >> [v2:172.21.15.118:6816/3636642904,v1:172.21.15.118:6817/3636642904] conn(0x7fe3cc06eb30 0x7fe3cc070f40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.124 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.062+0000 7fe3c57fa640 1 -- 172.21.15.39:0/1785893162 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fe3cc066280 msgr2=0x7fe3cc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.124 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.062+0000 7fe3c57fa640 1 --2- 172.21.15.39:0/1785893162 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fe3cc066280 0x7fe3cc068730 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe3d401c580 tx=0x7fe3d40a6000 comp rx=0 tx=0).stop 2023-05-16T13:54:21.124 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.062+0000 7fe3c57fa640 1 -- 172.21.15.39:0/1785893162 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe3d80ea0e0 msgr2=0x7fe3d80dc1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.124 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.062+0000 7fe3c57fa640 1 --2- 172.21.15.39:0/1785893162 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe3d80ea0e0 0x7fe3d80dc1e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe3e004ebe0 tx=0x7fe3e004e130 comp rx=0 tx=0).stop 2023-05-16T13:54:21.124 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.066+0000 7fe3dffff640 1 -- 172.21.15.39:0/1785893162 reap_dead start 2023-05-16T13:54:21.124 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.066+0000 7fe3c57fa640 1 -- 172.21.15.39:0/1785893162 shutdown_connections 2023-05-16T13:54:21.125 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.066+0000 7fe3c57fa640 1 -- 172.21.15.39:0/1785893162 >> 172.21.15.39:0/1785893162 conn(0x7fe3d8051760 msgr2=0x7fe3d80df540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:21.125 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.066+0000 7fe3c57fa640 1 -- 172.21.15.39:0/1785893162 shutdown_connections 2023-05-16T13:54:21.125 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.066+0000 7f2f86a04640 1 -- 172.21.15.39:0/436657829 --> [v2:172.21.15.118:6802/3513592808,v1:172.21.15.118:6804/3513592808] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2f80150eb0 con 0x7f2f6006ec30 2023-05-16T13:54:21.125 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.066+0000 7fe3c57fa640 1 -- 172.21.15.39:0/1785893162 wait complete. 2023-05-16T13:54:21.126 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.066+0000 7f2f7d7fa640 1 -- 172.21.15.39:0/436657829 <== osd.5 v2:172.21.15.118:6802/3513592808 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2f68004300 con 0x7f2f6006ec30 2023-05-16T13:54:21.126 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.066+0000 7f492d262640 1 -- 172.21.15.39:0/3950722752 --> [v2:172.21.15.118:6800/3895278838,v1:172.21.15.118:6801/3895278838] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f492017bdb0 con 0x7f490c06ec00 2023-05-16T13:54:21.127 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.066+0000 7f2f767fc640 1 -- 172.21.15.39:0/436657829 >> [v2:172.21.15.118:6802/3513592808,v1:172.21.15.118:6804/3513592808] conn(0x7f2f6006ec30 msgr2=0x7f2f60071040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.127 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.066+0000 7f2f767fc640 1 --2- 172.21.15.39:0/436657829 >> [v2:172.21.15.118:6802/3513592808,v1:172.21.15.118:6804/3513592808] conn(0x7f2f6006ec30 0x7f2f60071040 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.127 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.066+0000 7f2f767fc640 1 -- 172.21.15.39:0/436657829 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f2f60066380 msgr2=0x7f2f60068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.128 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.066+0000 7f2f767fc640 1 --2- 172.21.15.39:0/436657829 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f2f60066380 0x7f2f60068830 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2f70007fd0 tx=0x7f2f70007d40 comp rx=0 tx=0).stop 2023-05-16T13:54:21.128 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.066+0000 7f2f767fc640 1 -- 172.21.15.39:0/436657829 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f800cc620 msgr2=0x7f2f800ccaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.128 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.066+0000 7f2f767fc640 1 --2- 172.21.15.39:0/436657829 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f800cc620 0x7f2f800ccaa0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2f7800b390 tx=0x7f2f7800b850 comp rx=0 tx=0).stop 2023-05-16T13:54:21.128 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.066+0000 7f2f84fa1640 1 -- 172.21.15.39:0/436657829 reap_dead start 2023-05-16T13:54:21.128 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.066+0000 7f2f767fc640 1 -- 172.21.15.39:0/436657829 shutdown_connections 2023-05-16T13:54:21.128 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.066+0000 7f2f767fc640 1 -- 172.21.15.39:0/436657829 >> 172.21.15.39:0/436657829 conn(0x7f2f80069a50 msgr2=0x7f2f8006ff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:21.128 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.066+0000 7f2f767fc640 1 -- 172.21.15.39:0/436657829 shutdown_connections 2023-05-16T13:54:21.129 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.070+0000 7f4924ff9640 1 -- 172.21.15.39:0/3950722752 <== osd.4 v2:172.21.15.118:6800/3895278838 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f492017bdb0 con 0x7f490c06ec00 2023-05-16T13:54:21.129 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.070+0000 7f2f767fc640 1 -- 172.21.15.39:0/436657829 wait complete. 2023-05-16T13:54:21.130 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.070+0000 7f492d262640 1 -- 172.21.15.39:0/3950722752 >> [v2:172.21.15.118:6800/3895278838,v1:172.21.15.118:6801/3895278838] conn(0x7f490c06ec00 msgr2=0x7f490c071010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.130 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.070+0000 7f492d262640 1 --2- 172.21.15.39:0/3950722752 >> [v2:172.21.15.118:6800/3895278838,v1:172.21.15.118:6801/3895278838] conn(0x7f490c06ec00 0x7f490c071010 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.130 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.070+0000 7f492d262640 1 -- 172.21.15.39:0/3950722752 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f490c066350 msgr2=0x7f490c068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.130 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.070+0000 7f492d262640 1 --2- 172.21.15.39:0/3950722752 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f490c066350 0x7f490c068800 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4920010060 tx=0x7f4928122000 comp rx=0 tx=0).stop 2023-05-16T13:54:21.131 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.070+0000 7f492d262640 1 -- 172.21.15.39:0/3950722752 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f49200e27e0 msgr2=0x7f492000a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.131 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.070+0000 7f492d262640 1 --2- 172.21.15.39:0/3950722752 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f49200e27e0 0x7f492000a880 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f491400c4d0 tx=0x7f491400c990 comp rx=0 tx=0).stop 2023-05-16T13:54:21.131 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.070+0000 7f492ca61640 1 -- 172.21.15.39:0/3950722752 reap_dead start 2023-05-16T13:54:21.131 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.070+0000 7f492d262640 1 -- 172.21.15.39:0/3950722752 shutdown_connections 2023-05-16T13:54:21.131 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.070+0000 7f492d262640 1 -- 172.21.15.39:0/3950722752 >> 172.21.15.39:0/3950722752 conn(0x7f4920055bb0 msgr2=0x7f492003bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:21.131 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.074+0000 7f492d262640 1 -- 172.21.15.39:0/3950722752 shutdown_connections 2023-05-16T13:54:21.132 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.074+0000 7f492d262640 1 -- 172.21.15.39:0/3950722752 wait complete. 2023-05-16T13:54:21.132 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.078+0000 7f309dffb640 1 -- 172.21.15.39:0/2314196644 --> [v2:172.21.15.39:6816/3888067413,v1:172.21.15.39:6817/3888067413] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f30b00b41e0 con 0x7f30b00c2560 2023-05-16T13:54:21.132 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.078+0000 7f309ffff640 1 -- 172.21.15.39:0/2314196644 <== osd.2 v2:172.21.15.39:6816/3888067413 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f30b00b41e0 con 0x7f30b00c2560 2023-05-16T13:54:21.133 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.078+0000 7f30b5a8c640 1 -- 172.21.15.39:0/2314196644 >> [v2:172.21.15.39:6816/3888067413,v1:172.21.15.39:6817/3888067413] conn(0x7f30b00c2560 msgr2=0x7f30b0136400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.134 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.078+0000 7f30b5a8c640 1 --2- 172.21.15.39:0/2314196644 >> [v2:172.21.15.39:6816/3888067413,v1:172.21.15.39:6817/3888067413] conn(0x7f30b00c2560 0x7f30b0136400 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.134 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.082+0000 7f30b5a8c640 1 -- 172.21.15.39:0/2314196644 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f30900662d0 msgr2=0x7f3090068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.134 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.082+0000 7f30b5a8c640 1 --2- 172.21.15.39:0/2314196644 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f30900662d0 0x7f3090068780 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f30980097c0 tx=0x7f30980a6000 comp rx=0 tx=0).stop 2023-05-16T13:54:21.134 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.082+0000 7f30b5a8c640 1 -- 172.21.15.39:0/2314196644 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f30b00ce970 msgr2=0x7f30b015c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.134 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.082+0000 7f30b5a8c640 1 --2- 172.21.15.39:0/2314196644 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f30b00ce970 0x7f30b015c050 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f30a8007e70 tx=0x7f30a800d4a0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.134 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.082+0000 7f30affff640 1 -- 172.21.15.39:0/2314196644 reap_dead start 2023-05-16T13:54:21.134 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.082+0000 7f30b5a8c640 1 -- 172.21.15.39:0/2314196644 shutdown_connections 2023-05-16T13:54:21.134 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.082+0000 7f30b5a8c640 1 -- 172.21.15.39:0/2314196644 >> 172.21.15.39:0/2314196644 conn(0x7f30b00cb970 msgr2=0x7f30b00ccd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:21.135 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.082+0000 7f30b5a8c640 1 -- 172.21.15.39:0/2314196644 shutdown_connections 2023-05-16T13:54:21.135 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.082+0000 7f30b5a8c640 1 -- 172.21.15.39:0/2314196644 wait complete. 2023-05-16T13:54:21.136 INFO:teuthology.orchestra.run.smithi039.stdout:60129542151 2023-05-16T13:54:21.136 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-05-16T13:54:21.137 INFO:teuthology.orchestra.run.smithi039.stdout:60129542151 2023-05-16T13:54:21.137 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-05-16T13:54:21.138 INFO:teuthology.orchestra.run.smithi039.stdout:60129542150 2023-05-16T13:54:21.138 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-05-16T13:54:21.139 INFO:teuthology.orchestra.run.smithi039.stdout:64424509445 2023-05-16T13:54:21.139 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-05-16T13:54:21.140 INFO:teuthology.orchestra.run.smithi039.stdout:64424509446 2023-05-16T13:54:21.141 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-05-16T13:54:21.141 INFO:teuthology.orchestra.run.smithi039.stdout:64424509446 2023-05-16T13:54:21.142 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-05-16T13:54:21.142 INFO:teuthology.orchestra.run.smithi039.stdout:64424509446 2023-05-16T13:54:21.143 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-05-16T13:54:21.144 INFO:teuthology.orchestra.run.smithi039.stdout:60129542151 2023-05-16T13:54:21.144 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-05-16T13:54:21.416 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.410+0000 7f1e8f77b640 1 Processor -- start 2023-05-16T13:54:21.416 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.410+0000 7f1e8f77b640 1 -- start start 2023-05-16T13:54:21.418 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.410+0000 7f1e8f77b640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1e880b03f0 0x7f1e8815c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.418 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.410+0000 7f1e8f77b640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e8815cf80 con 0x7f1e880cd9b0 2023-05-16T13:54:21.418 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.410+0000 7f1e8f77b640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e8815c6e0 con 0x7f1e88158660 2023-05-16T13:54:21.419 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.410+0000 7f1e8f77b640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e88158c70 con 0x7f1e880b03f0 2023-05-16T13:54:21.419 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.410+0000 7f1e8dd18640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1e880b03f0 0x7f1e8815c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.419 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.410+0000 7f1e8d517640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f1e88158660 0x7f1e880cc630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.39:41194/0 (socket says 172.21.15.39:41194) 2023-05-16T13:54:21.419 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.410+0000 7f1e8d517640 1 -- 172.21.15.39:0/282447070 learned_addr learned my addr 172.21.15.39:0/282447070 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:21.419 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.410+0000 7f1e8cd16640 1 --1- 172.21.15.39:0/282447070 >> v1:172.21.15.39:6789/0 conn(0x7f1e880cd9b0 0x7f1e880afce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:60754/0 (socket says 172.21.15.39:60754) 2023-05-16T13:54:21.420 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.410+0000 7f1e8dd18640 1 -- 172.21.15.39:0/282447070 >> v1:172.21.15.118:6789/0 conn(0x7f1e88158660 legacy=0x7f1e880cc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.420 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.410+0000 7f1e8dd18640 1 -- 172.21.15.39:0/282447070 >> v1:172.21.15.39:6789/0 conn(0x7f1e880cd9b0 legacy=0x7f1e880afce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.420 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.410+0000 7f1e8dd18640 1 -- 172.21.15.39:0/282447070 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e8815c9c0 con 0x7f1e880b03f0 2023-05-16T13:54:21.424 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.418+0000 7f1e8dd18640 1 --2- 172.21.15.39:0/282447070 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1e880b03f0 0x7f1e8815c050 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1e780097f0 tx=0x7f1e7801c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8a3d904b76d1508 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:21.425 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.418+0000 7f1e7ffff640 1 -- 172.21.15.39:0/282447070 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e780ac640 con 0x7f1e880b03f0 2023-05-16T13:54:21.425 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.418+0000 7f1e7ffff640 1 -- 172.21.15.39:0/282447070 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e780ac7a0 con 0x7f1e880b03f0 2023-05-16T13:54:21.425 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.418+0000 7f1e7ffff640 1 -- 172.21.15.39:0/282447070 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e780acb30 con 0x7f1e880b03f0 2023-05-16T13:54:21.426 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.418+0000 7f1e8f77b640 1 -- 172.21.15.39:0/282447070 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1e880b03f0 msgr2=0x7f1e8815c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.426 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.418+0000 7f1e8f77b640 1 --2- 172.21.15.39:0/282447070 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1e880b03f0 0x7f1e8815c050 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1e780097f0 tx=0x7f1e7801c370 comp rx=0 tx=0).stop 2023-05-16T13:54:21.426 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.418+0000 7f1e8f77b640 1 -- 172.21.15.39:0/282447070 shutdown_connections 2023-05-16T13:54:21.426 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.418+0000 7f1e8f77b640 1 --2- 172.21.15.39:0/282447070 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1e880b03f0 0x7f1e8815c050 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.427 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.418+0000 7f1e8f77b640 1 -- 172.21.15.39:0/282447070 >> 172.21.15.39:0/282447070 conn(0x7f1e88069a50 msgr2=0x7f1e88069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:21.427 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.418+0000 7f309a9c0640 1 Processor -- start 2023-05-16T13:54:21.427 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.418+0000 7f1e8f77b640 1 -- 172.21.15.39:0/282447070 shutdown_connections 2023-05-16T13:54:21.428 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.418+0000 7f309a9c0640 1 -- start start 2023-05-16T13:54:21.428 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.422+0000 7f309a9c0640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f308c0e6db0 0x7f308c04f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.428 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.422+0000 7f309a9c0640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f308c04f7e0 0x7f308c052820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.428 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.422+0000 7f309a9c0640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f308c0ea980 con 0x7f308c052d60 2023-05-16T13:54:21.428 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.422+0000 7f309a9c0640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f308c0e7180 con 0x7f308c04f7e0 2023-05-16T13:54:21.429 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.422+0000 7f309a9c0640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f308c054a90 con 0x7f308c0e6db0 2023-05-16T13:54:21.429 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.422+0000 7f30937fe640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f308c04f7e0 0x7f308c052820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.429 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.422+0000 7f30937fe640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f308c04f7e0 0x7f308c052820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.39:34776/0 (socket says 172.21.15.39:34776) 2023-05-16T13:54:21.429 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.422+0000 7f30937fe640 1 -- 172.21.15.39:0/4154643251 learned_addr learned my addr 172.21.15.39:0/4154643251 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:21.430 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.418+0000 7f1e8f77b640 1 -- 172.21.15.39:0/282447070 wait complete. 2023-05-16T13:54:21.430 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.422+0000 7f30937fe640 1 -- 172.21.15.39:0/4154643251 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f308c0e6db0 msgr2=0x7f308c04f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:21.431 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.422+0000 7f30937fe640 1 --2- 172.21.15.39:0/4154643251 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f308c0e6db0 0x7f308c04f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.431 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.422+0000 7f30937fe640 1 -- 172.21.15.39:0/4154643251 >> v1:172.21.15.118:6789/0 conn(0x7f308c052d60 legacy=0x7f308c0eae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:21.431 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.422+0000 7f30937fe640 1 -- 172.21.15.39:0/4154643251 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f308c0541f0 con 0x7f308c04f7e0 2023-05-16T13:54:21.431 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.422+0000 7f1e8f77b640 1 Processor -- start 2023-05-16T13:54:21.432 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.422+0000 7f1a3590a640 1 Processor -- start 2023-05-16T13:54:21.432 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.422+0000 7f1a3590a640 1 -- start start 2023-05-16T13:54:21.432 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.422+0000 7f1e8f77b640 1 -- start start 2023-05-16T13:54:21.432 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.422+0000 7fe54359e640 1 Processor -- start 2023-05-16T13:54:21.433 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.426+0000 7f1e8f77b640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1e880b03f0 0x7f1e88201040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.433 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.426+0000 7f1a3590a640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1a2803ab80 0x7f1a280553c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.434 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.426+0000 7f1a3590a640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1a28038560 0x7f1a2803af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.434 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.426+0000 7f1a3590a640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f1a280e6510 0x7f1a280e6990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.434 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.426+0000 7f1a3590a640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a28053ff0 con 0x7f1a280e6510 2023-05-16T13:54:21.434 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.426+0000 7f1a3590a640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a2803bf50 con 0x7f1a28038560 2023-05-16T13:54:21.434 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.426+0000 7f1a3590a640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a28053750 con 0x7f1a2803ab80 2023-05-16T13:54:21.434 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.422+0000 7fe54359e640 1 -- start start 2023-05-16T13:54:21.435 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.426+0000 7f1e8d517640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1e880b03f0 0x7f1e88201040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.435 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.426+0000 7f1e8f77b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e880cd9b0 0x7f1e880b20d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.435 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.426+0000 7f1e8d517640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1e880b03f0 0x7f1e88201040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.39:33456/0 (socket says 172.21.15.39:33456) 2023-05-16T13:54:21.435 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.426+0000 7f1a2e7fc640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1a28038560 0x7f1a2803af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.436 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.426+0000 7f1a2effd640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1a2803ab80 0x7f1a280553c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.436 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.426+0000 7f1e8f77b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e88158660 0x7f1e880ce210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.436 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.426+0000 7f1e8f77b640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e880b3750 con 0x7f1e88158660 2023-05-16T13:54:21.436 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.426+0000 7f1e8f77b640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e880b2ad0 con 0x7f1e880cd9b0 2023-05-16T13:54:21.436 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.426+0000 7f1e8f77b640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e880b2db0 con 0x7f1e880b03f0 2023-05-16T13:54:21.437 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.426+0000 7f1e8d517640 1 -- 172.21.15.39:0/1759180950 learned_addr learned my addr 172.21.15.39:0/1759180950 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:21.437 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.426+0000 7f1a2e7fc640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1a28038560 0x7f1a2803af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.39:34786/0 (socket says 172.21.15.39:34786) 2023-05-16T13:54:21.437 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.426+0000 7f1a2e7fc640 1 -- 172.21.15.39:0/4148083870 learned_addr learned my addr 172.21.15.39:0/4148083870 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:21.437 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.426+0000 7f1a2f7fe640 1 --2- 172.21.15.39:0/4148083870 >> v2:172.21.15.39:3300/0 conn(0x7f1a280e6510 0x7f1a280e6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.438 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.426+0000 7f30937fe640 1 --2- 172.21.15.39:0/4154643251 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f308c04f7e0 0x7f308c052820 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f309404f3a0 tx=0x7f3094096310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f3fa6c29abe6c43 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:21.438 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.426+0000 7f1a2effd640 1 -- 172.21.15.39:0/4148083870 >> v2:172.21.15.118:3300/0 conn(0x7f1a28038560 msgr2=0x7f1a2803af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:21.438 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.426+0000 7f1a2effd640 1 --2- 172.21.15.39:0/4148083870 >> v2:172.21.15.118:3300/0 conn(0x7f1a28038560 0x7f1a2803af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.438 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.426+0000 7f1a2effd640 1 -- 172.21.15.39:0/4148083870 >> v2:172.21.15.39:3300/0 conn(0x7f1a280e6510 msgr2=0x7f1a280e6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:21.438 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.426+0000 7f1a2effd640 1 --2- 172.21.15.39:0/4148083870 >> v2:172.21.15.39:3300/0 conn(0x7f1a280e6510 0x7f1a280e6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.438 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.426+0000 7f1a2effd640 1 -- 172.21.15.39:0/4148083870 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a2803b490 con 0x7f1a2803ab80 2023-05-16T13:54:21.439 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.426+0000 7f1a2e7fc640 1 --2- 172.21.15.39:0/4148083870 >> v2:172.21.15.118:3300/0 conn(0x7f1a28038560 0x7f1a2803af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-16T13:54:21.439 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.426+0000 7f1e8cd16640 1 --2- 172.21.15.39:0/1759180950 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e880cd9b0 0x7f1e880b20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.439 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.426+0000 7f1e8d517640 1 -- 172.21.15.39:0/1759180950 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e880cd9b0 msgr2=0x7f1e880b20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.439 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.426+0000 7f1e8d517640 1 --2- 172.21.15.39:0/1759180950 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e880cd9b0 0x7f1e880b20d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.439 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.426+0000 7f1e8d517640 1 -- 172.21.15.39:0/1759180950 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e88158660 msgr2=0x7f1e880ce210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.439 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.426+0000 7f1e8d517640 1 --2- 172.21.15.39:0/1759180950 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e88158660 0x7f1e880ce210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.440 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.426+0000 7f1e8d517640 1 -- 172.21.15.39:0/1759180950 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e78009420 con 0x7f1e880b03f0 2023-05-16T13:54:21.440 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.426+0000 7fe54359e640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe544157eb0 0x7fe5440cb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.440 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.426+0000 7fe54359e640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fe5440c8900 0x7fe5440afd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.440 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.426+0000 7f1e8d517640 1 --2- 172.21.15.39:0/1759180950 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1e880b03f0 0x7f1e88201040 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1e8400c370 tx=0x7f1e8400c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:21.441 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.426+0000 7f3092ffd640 1 -- 172.21.15.39:0/4154643251 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3094126440 con 0x7f308c04f7e0 2023-05-16T13:54:21.441 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.426+0000 7f3092ffd640 1 -- 172.21.15.39:0/4154643251 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30941265e0 con 0x7f308c04f7e0 2023-05-16T13:54:21.441 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.426+0000 7f3092ffd640 1 -- 172.21.15.39:0/4154643251 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3094126a50 con 0x7f308c04f7e0 2023-05-16T13:54:21.441 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.426+0000 7fd649ec3640 1 Processor -- start 2023-05-16T13:54:21.442 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.426+0000 7fe54259c640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe544157eb0 0x7fe5440cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.442 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.426+0000 7fe54259c640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe544157eb0 0x7fe5440cb120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.39:34802/0 (socket says 172.21.15.39:34802) 2023-05-16T13:54:21.442 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.426+0000 7fe54259c640 1 -- 172.21.15.39:0/1313281205 learned_addr learned my addr 172.21.15.39:0/1313281205 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:21.442 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.426+0000 7fe53bfff640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fe5440c8900 0x7fe5440afd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.443 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.426+0000 7fd649ec3640 1 -- start start 2023-05-16T13:54:21.443 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.426+0000 7f1e7dffb640 1 -- 172.21.15.39:0/1759180950 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e84005cf0 con 0x7f1e880b03f0 2023-05-16T13:54:21.443 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.426+0000 7f1e7dffb640 1 -- 172.21.15.39:0/1759180950 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e84005e50 con 0x7f1e880b03f0 2023-05-16T13:54:21.443 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.426+0000 7f1e8f77b640 1 -- 172.21.15.39:0/1759180950 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e88159090 con 0x7f1e880b03f0 2023-05-16T13:54:21.444 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.426+0000 7fe54359e640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe544158280 con 0x7fe5440b0270 2023-05-16T13:54:21.444 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.426+0000 7fe54359e640 1 -- 172.21.15.39:0/1313281205 --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5440b06f0 con 0x7fe5440c8900 2023-05-16T13:54:21.444 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.426+0000 7fe54359e640 1 -- 172.21.15.39:0/1313281205 --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5440c91a0 con 0x7fe544157eb0 2023-05-16T13:54:21.444 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.426+0000 7f1e7dffb640 1 -- 172.21.15.39:0/1759180950 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e840072f0 con 0x7f1e880b03f0 2023-05-16T13:54:21.445 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.426+0000 7f1e8f77b640 1 -- 172.21.15.39:0/1759180950 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e880c94e0 con 0x7f1e880b03f0 2023-05-16T13:54:21.445 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.426+0000 7f309a9c0640 1 -- 172.21.15.39:0/4154643251 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f308c04f7e0 msgr2=0x7f308c052820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.445 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.426+0000 7f309a9c0640 1 --2- 172.21.15.39:0/4154643251 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f308c04f7e0 0x7f308c052820 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f309404f3a0 tx=0x7f3094096310 comp rx=0 tx=0).stop 2023-05-16T13:54:21.445 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.426+0000 7f309a9c0640 1 -- 172.21.15.39:0/4154643251 shutdown_connections 2023-05-16T13:54:21.446 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.426+0000 7f309a9c0640 1 --2- 172.21.15.39:0/4154643251 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f308c04f7e0 0x7f308c052820 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.446 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.426+0000 7f309a9c0640 1 --2- 172.21.15.39:0/4154643251 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f308c0e6db0 0x7f308c04f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.446 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.426+0000 7f309a9c0640 1 -- 172.21.15.39:0/4154643251 >> 172.21.15.39:0/4154643251 conn(0x7f308c0516d0 msgr2=0x7f308c051ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:21.446 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.430+0000 7f309a9c0640 1 -- 172.21.15.39:0/4154643251 shutdown_connections 2023-05-16T13:54:21.446 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.430+0000 7f1e8f77b640 1 -- 172.21.15.39:0/1759180950 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e68005260 con 0x7f1e880b03f0 2023-05-16T13:54:21.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.430+0000 7f64ee3cb640 1 Processor -- start 2023-05-16T13:54:21.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.430+0000 7f64ee3cb640 1 -- start start 2023-05-16T13:54:21.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.430+0000 7f309a9c0640 1 -- 172.21.15.39:0/4154643251 wait complete. 2023-05-16T13:54:21.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.430+0000 7f185d2f2640 1 Processor -- start 2023-05-16T13:54:21.448 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.430+0000 7fe53bfff640 1 -- 172.21.15.39:0/1313281205 >> v2:172.21.15.118:3300/0 conn(0x7fe544157eb0 msgr2=0x7fe5440cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:21.448 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.430+0000 7fe53bfff640 1 --2- 172.21.15.39:0/1313281205 >> v2:172.21.15.118:3300/0 conn(0x7fe544157eb0 0x7fe5440cb120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.448 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.430+0000 7fe53bfff640 1 -- 172.21.15.39:0/1313281205 >> v1:172.21.15.118:6789/0 conn(0x7fe5440b0270 legacy=0x7fe54415b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.448 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.430+0000 7fd649ec3640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd64415c170 0x7fd6440d0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.449 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.430+0000 7fd6437fe640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd64415c170 0x7fd6440d0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.449 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.430+0000 7fd6437fe640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd64415c170 0x7fd6440d0470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59842/0 (socket says 172.21.15.39:59842) 2023-05-16T13:54:21.449 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.430+0000 7fd6437fe640 1 -- 172.21.15.39:0/3952844657 learned_addr learned my addr 172.21.15.39:0/3952844657 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:21.449 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.430+0000 7fd649ec3640 1 --2- 172.21.15.39:0/3952844657 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd6440d2a90 0x7fd6440cd890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.449 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.430+0000 7fd649ec3640 1 -- 172.21.15.39:0/3952844657 --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6440d2f10 con 0x7fd6440d09b0 2023-05-16T13:54:21.449 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.430+0000 7fd649ec3640 1 -- 172.21.15.39:0/3952844657 --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6440d3700 con 0x7fd64415c170 2023-05-16T13:54:21.449 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.430+0000 7fd649ec3640 1 -- 172.21.15.39:0/3952844657 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6440d0e30 con 0x7fd6440d2a90 2023-05-16T13:54:21.450 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.430+0000 7fe53bfff640 1 -- 172.21.15.39:0/1313281205 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5440cbe80 con 0x7fe5440c8900 2023-05-16T13:54:21.450 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.430+0000 7f185d2f2640 1 -- start start 2023-05-16T13:54:21.450 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.430+0000 7f309a9c0640 1 Processor -- start 2023-05-16T13:54:21.451 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.430+0000 7f1a2effd640 1 --2- 172.21.15.39:0/4148083870 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1a2803ab80 0x7f1a280553c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1a2803bcf0 tx=0x7f1a2001c310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7fcfda6b4edbf0ec server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:21.451 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.430+0000 7f64ee3cb640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f64e80d0960 0x7f64e80cecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.451 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.430+0000 7f64ee3cb640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64e80af740 con 0x7f64e80af240 2023-05-16T13:54:21.451 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.430+0000 7f64ee3cb640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64e80afa20 con 0x7f64e8163a70 2023-05-16T13:54:21.452 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.430+0000 7f64ee3cb640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64e80c6060 con 0x7f64e80d0960 2023-05-16T13:54:21.452 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.434+0000 7f309a9c0640 1 -- start start 2023-05-16T13:54:21.452 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.434+0000 7f64ed3c9640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f64e8163a70 0x7f64e80d0250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.39:41222/0 (socket says 172.21.15.39:41222) 2023-05-16T13:54:21.452 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.434+0000 7f64ed3c9640 1 -- 172.21.15.39:0/1753410789 learned_addr learned my addr 172.21.15.39:0/1753410789 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:21.453 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.434+0000 7f1e7dffb640 1 -- 172.21.15.39:0/1759180950 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1e84007450 con 0x7f1e880b03f0 2023-05-16T13:54:21.453 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.434+0000 7f185d2f2640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f185806a560 0x7f18581559a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.453 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.434+0000 7f185d2f2640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f1858155ee0 0x7f18580c8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.454 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.434+0000 7f185d2f2640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f185815c960 0x7f18580c9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.454 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.434+0000 7f185d2f2640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f185815be80 con 0x7f1858155ee0 2023-05-16T13:54:21.454 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.434+0000 7f185d2f2640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f185815c160 con 0x7f185806a560 2023-05-16T13:54:21.454 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.434+0000 7f185d2f2640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f185815c440 con 0x7f185815c960 2023-05-16T13:54:21.454 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.434+0000 7f1856ffd640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f185806a560 0x7f18581559a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.454 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.434+0000 7f1856ffd640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f185806a560 0x7f18581559a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.39:34818/0 (socket says 172.21.15.39:34818) 2023-05-16T13:54:21.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.434+0000 7f1856ffd640 1 -- 172.21.15.39:0/3974954171 learned_addr learned my addr 172.21.15.39:0/3974954171 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:21.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.434+0000 7f64dffff640 1 -- 172.21.15.39:0/1753410789 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1479166428 0 0) 0x7f64e80afa20 con 0x7f64e8163a70 2023-05-16T13:54:21.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.434+0000 7f64dffff640 1 -- 172.21.15.39:0/1753410789 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64d4003530 con 0x7f64e8163a70 2023-05-16T13:54:21.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.430+0000 7fd6437fe640 1 -- 172.21.15.39:0/3952844657 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd6440d2a90 msgr2=0x7fd6440cd890 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-05-16T13:54:21.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.430+0000 7fd6437fe640 1 --2- 172.21.15.39:0/3952844657 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd6440d2a90 0x7fd6440cd890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.430+0000 7fd6437fe640 1 -- 172.21.15.39:0/3952844657 >> v1:172.21.15.118:6789/0 conn(0x7fd6440d09b0 legacy=0x7fd6440d2380 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-05-16T13:54:21.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.430+0000 7fd6437fe640 1 -- 172.21.15.39:0/3952844657 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6440cd400 con 0x7fd64415c170 2023-05-16T13:54:21.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.434+0000 7f18577fe640 1 --2- 172.21.15.39:0/3974954171 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f185815c960 0x7f18580c9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.457 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.434+0000 7f1856ffd640 1 -- 172.21.15.39:0/3974954171 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f185815c960 msgr2=0x7f18580c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:21.457 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.434+0000 7f1856ffd640 1 --2- 172.21.15.39:0/3974954171 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f185815c960 0x7f18580c9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.457 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.434+0000 7f1856ffd640 1 -- 172.21.15.39:0/3974954171 >> v2:172.21.15.39:3300/0 conn(0x7f1858155ee0 msgr2=0x7f18580c8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:21.457 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.434+0000 7f1856ffd640 1 --2- 172.21.15.39:0/3974954171 >> v2:172.21.15.39:3300/0 conn(0x7f1858155ee0 0x7f18580c8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.457 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.434+0000 7f1856ffd640 1 -- 172.21.15.39:0/3974954171 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1858158710 con 0x7f185806a560 2023-05-16T13:54:21.460 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.434+0000 7f64dffff640 1 -- 172.21.15.39:0/1753410789 <== mon.1 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1932006161 0 0) 0x7f64d4003530 con 0x7f64e8163a70 2023-05-16T13:54:21.460 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.434+0000 7f64ecbc8640 1 --2- 172.21.15.39:0/1753410789 >> v2:172.21.15.39:3300/0 conn(0x7f64e80d0960 0x7f64e80cecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.460 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.434+0000 7f64dffff640 1 -- 172.21.15.39:0/1753410789 >> v2:172.21.15.39:3300/0 conn(0x7f64e80d0960 msgr2=0x7f64e80cecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:21.460 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.434+0000 7f64dffff640 1 --2- 172.21.15.39:0/1753410789 >> v2:172.21.15.39:3300/0 conn(0x7f64e80d0960 0x7f64e80cecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.460 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.434+0000 7f64dffff640 1 -- 172.21.15.39:0/1753410789 >> v1:172.21.15.39:6789/0 conn(0x7f64e80af240 legacy=0x7f64e80cf230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:21.461 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.434+0000 7fe53bfff640 1 --2- 172.21.15.39:0/1313281205 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe5440c8900 0x7fe5440afd30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe5440cf380 tx=0x7fe52c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3faa2e9efd0d9b90 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:21.461 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.434+0000 7f64dffff640 1 -- 172.21.15.39:0/1753410789 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64e80afd00 con 0x7f64e8163a70 2023-05-16T13:54:21.462 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.434+0000 7f64dffff640 1 -- 172.21.15.39:0/1753410789 <== mon.1 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1738805496 0 0) 0x7f64d80016b0 con 0x7f64e8163a70 2023-05-16T13:54:21.462 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.434+0000 7f64dffff640 1 -- 172.21.15.39:0/1753410789 >> v1:172.21.15.118:6789/0 conn(0x7f64e8163a70 legacy=0x7f64e80d0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.462 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.434+0000 7f64dffff640 1 --2- 172.21.15.39:0/1753410789 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64d40039f0 0x7f64d4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.462 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.434+0000 7f64dffff640 1 --2- 172.21.15.39:0/1753410789 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f64d40047d0 0x7f64d4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.462 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.434+0000 7f64dffff640 1 --2- 172.21.15.39:0/1753410789 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f64d4005330 0x7f64d400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.462 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.434+0000 7f64dffff640 1 -- 172.21.15.39:0/1753410789 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d400c240 con 0x7f64d4005330 2023-05-16T13:54:21.462 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.434+0000 7f64dffff640 1 -- 172.21.15.39:0/1753410789 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d400c3b0 con 0x7f64d40039f0 2023-05-16T13:54:21.463 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.434+0000 7f64dffff640 1 -- 172.21.15.39:0/1753410789 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64d400c570 con 0x7f64d40047d0 2023-05-16T13:54:21.463 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.434+0000 7f1e7dffb640 1 --2- 172.21.15.39:0/1759180950 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f1e6c066350 0x7f1e6c068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.463 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.434+0000 7f1e7dffb640 1 -- 172.21.15.39:0/1759180950 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1e840832a0 con 0x7f1e880b03f0 2023-05-16T13:54:21.463 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.434+0000 7f64ecbc8640 1 --2- 172.21.15.39:0/1753410789 >> v2:172.21.15.39:3300/0 conn(0x7f64e80d0960 0x7f64e80cecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-16T13:54:21.464 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.434+0000 7f309a9c0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f308c04f7e0 0x7f308c0dda20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.464 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.434+0000 7f1e8cd16640 1 --2- 172.21.15.39:0/1759180950 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f1e6c066350 0x7f1e6c068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.465 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.434+0000 7f309a9c0640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f308c052d60 0x7f308c0e60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.465 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.434+0000 7f309a9c0640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f308c0e6db0 0x7f308c0e65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.465 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.434+0000 7f309a9c0640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f308c0de9c0 con 0x7f308c04f7e0 2023-05-16T13:54:21.466 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.434+0000 7f309a9c0640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f308c0df860 con 0x7f308c052d60 2023-05-16T13:54:21.466 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.434+0000 7f309a9c0640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f308c0e5c20 con 0x7f308c0e6db0 2023-05-16T13:54:21.466 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.434+0000 7f64ed3c9640 1 --2- 172.21.15.39:0/1753410789 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64d40039f0 0x7f64d4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.466 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.434+0000 7f64ecbc8640 1 --2- 172.21.15.39:0/1753410789 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f64d40047d0 0x7f64d4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.467 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.434+0000 7f3093fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f308c04f7e0 0x7f308c0dda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.467 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.434+0000 7f3093fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f308c04f7e0 0x7f308c0dda20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59880/0 (socket says 172.21.15.39:59880) 2023-05-16T13:54:21.468 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.434+0000 7f3093fff640 1 -- 172.21.15.39:0/2598479783 learned_addr learned my addr 172.21.15.39:0/2598479783 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:21.468 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.434+0000 7f30937fe640 1 --2- 172.21.15.39:0/2598479783 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f308c052d60 0x7f308c0e60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.468 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.434+0000 7f64edbca640 1 --2- 172.21.15.39:0/1753410789 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f64d4005330 0x7f64d400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.469 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.434+0000 7f1e8cd16640 1 --2- 172.21.15.39:0/1759180950 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f1e6c066350 0x7f1e6c068800 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1e80005fd0 tx=0x7f1e80005ba0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:21.469 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.434+0000 7f3098f5d640 1 --2- 172.21.15.39:0/2598479783 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f308c0e6db0 0x7f308c0e65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.469 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.438+0000 7fe541d9b640 1 -- 172.21.15.39:0/1313281205 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52c0ab600 con 0x7fe5440c8900 2023-05-16T13:54:21.470 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.438+0000 7fe541d9b640 1 -- 172.21.15.39:0/1313281205 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe52c0a7050 con 0x7fe5440c8900 2023-05-16T13:54:21.470 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.438+0000 7f30937fe640 1 -- 172.21.15.39:0/2598479783 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f308c0e6db0 msgr2=0x7f308c0e65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.470 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.438+0000 7f30937fe640 1 --2- 172.21.15.39:0/2598479783 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f308c0e6db0 0x7f308c0e65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.470 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.438+0000 7f30937fe640 1 -- 172.21.15.39:0/2598479783 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f308c04f7e0 msgr2=0x7f308c0dda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.470 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.438+0000 7f30937fe640 1 --2- 172.21.15.39:0/2598479783 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f308c04f7e0 0x7f308c0dda20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.471 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.438+0000 7f30937fe640 1 -- 172.21.15.39:0/2598479783 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f308c053fa0 con 0x7f308c052d60 2023-05-16T13:54:21.471 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.438+0000 7f64edbca640 1 -- 172.21.15.39:0/1753410789 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f64d40047d0 msgr2=0x7f64d4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:21.471 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.438+0000 7f64edbca640 1 --2- 172.21.15.39:0/1753410789 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f64d40047d0 0x7f64d4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.471 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.438+0000 7f64edbca640 1 -- 172.21.15.39:0/1753410789 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64d40039f0 msgr2=0x7f64d4003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:21.472 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.438+0000 7f64edbca640 1 --2- 172.21.15.39:0/1753410789 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64d40039f0 0x7f64d4003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.472 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.438+0000 7f64edbca640 1 -- 172.21.15.39:0/1753410789 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64e80afd00 con 0x7f64d4005330 2023-05-16T13:54:21.472 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.438+0000 7f3093fff640 1 --2- 172.21.15.39:0/2598479783 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f308c04f7e0 0x7f308c0dda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-16T13:54:21.472 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.438+0000 7fd6437fe640 1 --2- 172.21.15.39:0/3952844657 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd64415c170 0x7fd6440d0470 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd634009e50 tx=0x7fd63401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cee3056ff973ff2 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:21.473 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.438+0000 7fd6427fc640 1 -- 172.21.15.39:0/3952844657 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6340a57b0 con 0x7fd64415c170 2023-05-16T13:54:21.473 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.438+0000 7fd6427fc640 1 -- 172.21.15.39:0/3952844657 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6340a5910 con 0x7fd64415c170 2023-05-16T13:54:21.473 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.438+0000 7fd6427fc640 1 -- 172.21.15.39:0/3952844657 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6340a5ca0 con 0x7fd64415c170 2023-05-16T13:54:21.473 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.438+0000 7fe54359e640 1 -- 172.21.15.39:0/1313281205 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe5440c8900 msgr2=0x7fe5440afd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.473 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.438+0000 7fe54359e640 1 --2- 172.21.15.39:0/1313281205 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe5440c8900 0x7fe5440afd30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe5440cf380 tx=0x7fe52c01c4a0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.474 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.438+0000 7f30937fe640 1 --2- 172.21.15.39:0/2598479783 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f308c052d60 0x7f308c0e60b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f309404f6f0 tx=0x7f3094094ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:21.474 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.438+0000 7fe54359e640 1 -- 172.21.15.39:0/1313281205 shutdown_connections 2023-05-16T13:54:21.474 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.438+0000 7fe54359e640 1 --2- 172.21.15.39:0/1313281205 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe5440c8900 0x7fe5440afd30 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.474 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.438+0000 7fe54359e640 1 --2- 172.21.15.39:0/1313281205 >> v2:172.21.15.118:3300/0 conn(0x7fe544157eb0 0x7fe5440cb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.475 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.438+0000 7fe54359e640 1 -- 172.21.15.39:0/1313281205 >> 172.21.15.39:0/1313281205 conn(0x7fe54406bac0 msgr2=0x7fe54406bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:21.475 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.438+0000 7fe54359e640 1 -- 172.21.15.39:0/1313281205 shutdown_connections 2023-05-16T13:54:21.475 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.438+0000 7f1856ffd640 1 --2- 172.21.15.39:0/3974954171 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f185806a560 0x7f18581559a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f18580b1070 tx=0x7f185001f1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c65c4d4d92405cdc server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:21.475 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.438+0000 7ff9d54a8640 1 Processor -- start 2023-05-16T13:54:21.476 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.438+0000 7f3090ff9640 1 -- 172.21.15.39:0/2598479783 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309412f640 con 0x7f308c052d60 2023-05-16T13:54:21.476 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.438+0000 7f3090ff9640 1 -- 172.21.15.39:0/2598479783 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f309412f7a0 con 0x7f308c052d60 2023-05-16T13:54:21.476 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.438+0000 7f3090ff9640 1 -- 172.21.15.39:0/2598479783 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309412fb50 con 0x7f308c052d60 2023-05-16T13:54:21.476 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.438+0000 7ff9d54a8640 1 -- start start 2023-05-16T13:54:21.477 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.438+0000 7f309a9c0640 1 -- 172.21.15.39:0/2598479783 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f308c053e10 con 0x7f308c052d60 2023-05-16T13:54:21.477 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.438+0000 7fd649ec3640 1 -- 172.21.15.39:0/3952844657 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd64415c170 msgr2=0x7fd6440d0470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.477 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.438+0000 7fd649ec3640 1 --2- 172.21.15.39:0/3952844657 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd64415c170 0x7fd6440d0470 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd634009e50 tx=0x7fd63401c930 comp rx=0 tx=0).stop 2023-05-16T13:54:21.477 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.438+0000 7fd649ec3640 1 -- 172.21.15.39:0/3952844657 shutdown_connections 2023-05-16T13:54:21.478 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.438+0000 7fd649ec3640 1 --2- 172.21.15.39:0/3952844657 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd6440d2a90 0x7fd6440cd890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.478 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.438+0000 7fd649ec3640 1 --2- 172.21.15.39:0/3952844657 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd64415c170 0x7fd6440d0470 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.478 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.438+0000 7fd649ec3640 1 -- 172.21.15.39:0/3952844657 >> 172.21.15.39:0/3952844657 conn(0x7fd644071aa0 msgr2=0x7fd64409bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:21.478 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.438+0000 7f309a9c0640 1 -- 172.21.15.39:0/2598479783 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f308c0eb520 con 0x7f308c052d60 2023-05-16T13:54:21.479 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.438+0000 7fd649ec3640 1 -- 172.21.15.39:0/3952844657 shutdown_connections 2023-05-16T13:54:21.479 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.438+0000 7f1855ffb640 1 -- 172.21.15.39:0/3974954171 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18500af400 con 0x7f185806a560 2023-05-16T13:54:21.479 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.438+0000 7f1855ffb640 1 -- 172.21.15.39:0/3974954171 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18500ab050 con 0x7f185806a560 2023-05-16T13:54:21.479 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.438+0000 7f1855ffb640 1 -- 172.21.15.39:0/3974954171 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18500af780 con 0x7f185806a560 2023-05-16T13:54:21.480 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.438+0000 7f1e7dffb640 1 -- 172.21.15.39:0/1759180950 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f1e84050700 con 0x7f1e880b03f0 2023-05-16T13:54:21.480 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.438+0000 7f185d2f2640 1 -- 172.21.15.39:0/3974954171 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f185806a560 msgr2=0x7f18581559a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.480 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.438+0000 7f185d2f2640 1 --2- 172.21.15.39:0/3974954171 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f185806a560 0x7f18581559a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f18580b1070 tx=0x7f185001f1c0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.480 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.442+0000 7f1a2dffb640 1 -- 172.21.15.39:0/4148083870 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a200ab600 con 0x7f1a2803ab80 2023-05-16T13:54:21.481 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.442+0000 7f1a2dffb640 1 -- 172.21.15.39:0/4148083870 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a200a7050 con 0x7f1a2803ab80 2023-05-16T13:54:21.481 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.438+0000 7f309a9c0640 1 -- 172.21.15.39:0/2598479783 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f308c0e59f0 con 0x7f308c052d60 2023-05-16T13:54:21.481 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.442+0000 7f1a2dffb640 1 -- 172.21.15.39:0/4148083870 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a200ab980 con 0x7f1a2803ab80 2023-05-16T13:54:21.482 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.438+0000 7fd649ec3640 1 -- 172.21.15.39:0/3952844657 wait complete. 2023-05-16T13:54:21.482 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.442+0000 7ff9d54a8640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7ff9d006d700 0x7ff9d00afcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.482 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.438+0000 7fe54359e640 1 -- 172.21.15.39:0/1313281205 wait complete. 2023-05-16T13:54:21.482 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.442+0000 7fe54359e640 1 Processor -- start 2023-05-16T13:54:21.483 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.442+0000 7f1a3590a640 1 -- 172.21.15.39:0/4148083870 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1a2803ab80 msgr2=0x7f1a280553c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.483 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.442+0000 7f1a3590a640 1 --2- 172.21.15.39:0/4148083870 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1a2803ab80 0x7f1a280553c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1a2803bcf0 tx=0x7f1a2001c310 comp rx=0 tx=0).stop 2023-05-16T13:54:21.483 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.442+0000 7ff9cffff640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7ff9d006d700 0x7ff9d00afcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.483 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.442+0000 7fd649ec3640 1 Processor -- start 2023-05-16T13:54:21.484 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.442+0000 7f64edbca640 1 -- 172.21.15.39:0/1753410789 reap_dead start 2023-05-16T13:54:21.484 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.442+0000 7f185d2f2640 1 -- 172.21.15.39:0/3974954171 shutdown_connections 2023-05-16T13:54:21.484 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.442+0000 7f185d2f2640 1 --2- 172.21.15.39:0/3974954171 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f185815c960 0x7f18580c9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.484 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.442+0000 7f185d2f2640 1 --2- 172.21.15.39:0/3974954171 >> v2:172.21.15.39:3300/0 conn(0x7f1858155ee0 0x7f18580c8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.485 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.442+0000 7f185d2f2640 1 --2- 172.21.15.39:0/3974954171 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f185806a560 0x7f18581559a0 secure :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f18580b1070 tx=0x7f185001f1c0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.485 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.442+0000 7f185d2f2640 1 -- 172.21.15.39:0/3974954171 >> 172.21.15.39:0/3974954171 conn(0x7f1858069a50 msgr2=0x7f1858069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:21.485 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.442+0000 7ff9cffff640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7ff9d006d700 0x7ff9d00afcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59894/0 (socket says 172.21.15.39:59894) 2023-05-16T13:54:21.485 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.442+0000 7f64edbca640 1 --2- 172.21.15.39:0/1753410789 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f64d4005330 0x7f64d400b990 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f64e4001670 tx=0x7f64e401c300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b66b36a997f951cd server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:21.486 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.442+0000 7ff9cffff640 1 -- 172.21.15.39:0/394652402 learned_addr learned my addr 172.21.15.39:0/394652402 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:21.486 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.442+0000 7ff9d54a8640 1 --2- 172.21.15.39:0/394652402 >> v2:172.21.15.118:3300/0 conn(0x7ff9d00ad7d0 0x7ff9d00cd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.486 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.442+0000 7f185d2f2640 1 -- 172.21.15.39:0/3974954171 shutdown_connections 2023-05-16T13:54:21.486 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.442+0000 7f185d2f2640 1 -- 172.21.15.39:0/3974954171 wait complete. 2023-05-16T13:54:21.487 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.442+0000 7ff9d54a8640 1 -- 172.21.15.39:0/394652402 --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9d00b21c0 con 0x7ff9d00cb490 2023-05-16T13:54:21.487 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.442+0000 7fd649ec3640 1 -- start start 2023-05-16T13:54:21.487 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.442+0000 7ff9d4ca7640 1 --2- 172.21.15.39:0/394652402 >> v2:172.21.15.118:3300/0 conn(0x7ff9d00ad7d0 0x7ff9d00cd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.488 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.442+0000 7fd649ec3640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd6440d09b0 0x7fd6440702d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.488 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.442+0000 7fe54359e640 1 -- start start 2023-05-16T13:54:21.488 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.442+0000 7fe54359e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe5440b0270 0x7fe544157050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.489 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.442+0000 7fe54359e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe5440c8900 0x7fe5440c6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.489 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.442+0000 7fe54359e640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe544157eb0 0x7fe54414b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.489 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.442+0000 7fe54359e640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5440c5800 con 0x7fe5440b0270 2023-05-16T13:54:21.489 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.442+0000 7fe54359e640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe544156c90 con 0x7fe5440c8900 2023-05-16T13:54:21.489 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.442+0000 7fe54359e640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5440c70e0 con 0x7fe544157eb0 2023-05-16T13:54:21.489 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.442+0000 7ff9d54a8640 1 -- 172.21.15.39:0/394652402 --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9d009bc90 con 0x7ff9d006d700 2023-05-16T13:54:21.490 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.442+0000 7ff9d54a8640 1 -- 172.21.15.39:0/394652402 --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9d009bf50 con 0x7ff9d00ad7d0 2023-05-16T13:54:21.490 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.442+0000 7fe542d9d640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe544157eb0 0x7fe54414b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.490 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.442+0000 7fe542d9d640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe544157eb0 0x7fe54414b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.39:33508/0 (socket says 172.21.15.39:33508) 2023-05-16T13:54:21.490 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.442+0000 7fe542d9d640 1 -- 172.21.15.39:0/1508879239 learned_addr learned my addr 172.21.15.39:0/1508879239 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:21.490 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.442+0000 7fe542d9d640 1 -- 172.21.15.39:0/1508879239 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe5440c8900 msgr2=0x7fe5440c6ba0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-05-16T13:54:21.490 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.442+0000 7fe542d9d640 1 --2- 172.21.15.39:0/1508879239 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe5440c8900 0x7fe5440c6ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.491 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.442+0000 7fe542d9d640 1 -- 172.21.15.39:0/1508879239 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe5440b0270 msgr2=0x7fe544157050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.491 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.442+0000 7fe542d9d640 1 --2- 172.21.15.39:0/1508879239 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe5440b0270 0x7fe544157050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.491 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.442+0000 7fe542d9d640 1 -- 172.21.15.39:0/1508879239 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe52c009420 con 0x7fe544157eb0 2023-05-16T13:54:21.491 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.442+0000 7f185d2f2640 1 Processor -- start 2023-05-16T13:54:21.491 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.442+0000 7f64dffff640 1 -- 172.21.15.39:0/1753410789 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e4005270 con 0x7f64d4005330 2023-05-16T13:54:21.492 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.446+0000 7f64dffff640 1 -- 172.21.15.39:0/1753410789 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64e40a7070 con 0x7f64d4005330 2023-05-16T13:54:21.492 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.446+0000 7f64dffff640 1 -- 172.21.15.39:0/1753410789 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e4003600 con 0x7f64d4005330 2023-05-16T13:54:21.492 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.446+0000 7f1a3590a640 1 -- 172.21.15.39:0/4148083870 shutdown_connections 2023-05-16T13:54:21.492 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.446+0000 7f1a3590a640 1 --2- 172.21.15.39:0/4148083870 >> v2:172.21.15.39:3300/0 conn(0x7f1a280e6510 0x7f1a280e6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.492 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.446+0000 7f1a3590a640 1 --2- 172.21.15.39:0/4148083870 >> v2:172.21.15.118:3300/0 conn(0x7f1a28038560 0x7f1a2803af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.493 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.446+0000 7f1a3590a640 1 --2- 172.21.15.39:0/4148083870 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1a2803ab80 0x7f1a280553c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.493 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.446+0000 7f1a3590a640 1 -- 172.21.15.39:0/4148083870 >> 172.21.15.39:0/4148083870 conn(0x7f1a28055b80 msgr2=0x7f1a28055f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:21.493 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.446+0000 7ff9cffff640 1 -- 172.21.15.39:0/394652402 >> v2:172.21.15.118:3300/0 conn(0x7ff9d00ad7d0 msgr2=0x7ff9d00cd9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:21.493 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.446+0000 7f185d2f2640 1 -- start start 2023-05-16T13:54:21.494 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.446+0000 7f1a3590a640 1 -- 172.21.15.39:0/4148083870 shutdown_connections 2023-05-16T13:54:21.494 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.446+0000 7fd6437fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd6440d09b0 0x7fd6440702d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.494 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.446+0000 7fd6437fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd6440d09b0 0x7fd6440702d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59916/0 (socket says 172.21.15.39:59916) 2023-05-16T13:54:21.494 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.446+0000 7fd649ec3640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6440d2a90 0x7fd6440c8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.495 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.446+0000 7fd6437fe640 1 -- 172.21.15.39:0/751970071 learned_addr learned my addr 172.21.15.39:0/751970071 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:21.495 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.446+0000 7f64ee3cb640 1 -- 172.21.15.39:0/1753410789 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f64d4005330 msgr2=0x7f64d400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.495 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.446+0000 7f64ee3cb640 1 --2- 172.21.15.39:0/1753410789 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f64d4005330 0x7f64d400b990 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f64e4001670 tx=0x7f64e401c300 comp rx=0 tx=0).stop 2023-05-16T13:54:21.495 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.446+0000 7fd649ec3640 1 --2- 172.21.15.39:0/751970071 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd64415c170 0x7fd64414aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.495 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.446+0000 7fd642ffd640 1 --2- 172.21.15.39:0/751970071 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6440d2a90 0x7fd6440c8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.496 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.446+0000 7f64ee3cb640 1 -- 172.21.15.39:0/1753410789 shutdown_connections 2023-05-16T13:54:21.496 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.446+0000 7f64ee3cb640 1 --2- 172.21.15.39:0/1753410789 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f64d4005330 0x7f64d400b990 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.496 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.446+0000 7f64ee3cb640 1 -- 172.21.15.39:0/1753410789 >> 172.21.15.39:0/1753410789 conn(0x7f64e8071aa0 msgr2=0x7f64e809b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:21.496 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.446+0000 7fd649ec3640 1 -- 172.21.15.39:0/751970071 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd64414eff0 con 0x7fd6440d09b0 2023-05-16T13:54:21.497 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.446+0000 7f3090ff9640 1 -- 172.21.15.39:0/2598479783 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f309412d070 con 0x7f308c052d60 2023-05-16T13:54:21.497 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.446+0000 7f3090ff9640 1 --2- 172.21.15.39:0/2598479783 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f3078066280 0x7f3078068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.497 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.446+0000 7f3090ff9640 1 -- 172.21.15.39:0/2598479783 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3094198330 con 0x7f308c052d60 2023-05-16T13:54:21.497 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.446+0000 7fd649ec3640 1 -- 172.21.15.39:0/751970071 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6440c8d80 con 0x7fd6440d2a90 2023-05-16T13:54:21.498 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.446+0000 7fd649ec3640 1 -- 172.21.15.39:0/751970071 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6440708b0 con 0x7fd64415c170 2023-05-16T13:54:21.498 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.446+0000 7fd643fff640 1 --2- 172.21.15.39:0/751970071 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd64415c170 0x7fd64414aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.498 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.446+0000 7fe542d9d640 1 --2- 172.21.15.39:0/1508879239 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe544157eb0 0x7fe54414b710 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe53c00c340 tx=0x7fe53c00c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:21.498 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.446+0000 7f3093fff640 1 --2- 172.21.15.39:0/2598479783 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f3078066280 0x7f3078068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.499 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.446+0000 7f1a3590a640 1 -- 172.21.15.39:0/4148083870 wait complete. 2023-05-16T13:54:21.499 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.446+0000 7fd642ffd640 1 -- 172.21.15.39:0/751970071 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd64415c170 msgr2=0x7fd64414aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.499 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.446+0000 7fd642ffd640 1 --2- 172.21.15.39:0/751970071 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd64415c170 0x7fd64414aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.499 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.446+0000 7fd642ffd640 1 -- 172.21.15.39:0/751970071 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd6440d09b0 msgr2=0x7fd6440702d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.499 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.446+0000 7fd642ffd640 1 --2- 172.21.15.39:0/751970071 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd6440d09b0 0x7fd6440702d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.500 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.446+0000 7fd642ffd640 1 -- 172.21.15.39:0/751970071 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd634009b30 con 0x7fd6440d2a90 2023-05-16T13:54:21.500 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.446+0000 7f64ee3cb640 1 -- 172.21.15.39:0/1753410789 shutdown_connections 2023-05-16T13:54:21.500 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.446+0000 7f1a3590a640 1 Processor -- start 2023-05-16T13:54:21.500 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.446+0000 7f64ee3cb640 1 -- 172.21.15.39:0/1753410789 wait complete. 2023-05-16T13:54:21.501 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.446+0000 7f185d2f2640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1858155ee0 0x7f18581459b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.501 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.446+0000 7f185d2f2640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f185815c960 0x7f1858145ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.501 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.446+0000 7f185d2f2640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1858146430 0x7f18580adf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.501 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.446+0000 7ff9cffff640 1 --2- 172.21.15.39:0/394652402 >> v2:172.21.15.118:3300/0 conn(0x7ff9d00ad7d0 0x7ff9d00cd9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.502 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.446+0000 7ff9cffff640 1 -- 172.21.15.39:0/394652402 >> v1:172.21.15.118:6789/0 conn(0x7ff9d00cb490 legacy=0x7ff9d006bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.502 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.446+0000 7f185d2f2640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18581481c0 con 0x7f1858155ee0 2023-05-16T13:54:21.502 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.446+0000 7f185d2f2640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18581469a0 con 0x7f1858146430 2023-05-16T13:54:21.502 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.446+0000 7f185d2f2640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1858147c00 con 0x7f185815c960 2023-05-16T13:54:21.502 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.446+0000 7f18567fc640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f185815c960 0x7f1858145ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.503 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.446+0000 7f18567fc640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f185815c960 0x7f1858145ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.39:33532/0 (socket says 172.21.15.39:33532) 2023-05-16T13:54:21.503 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.446+0000 7f18567fc640 1 -- 172.21.15.39:0/142861172 learned_addr learned my addr 172.21.15.39:0/142861172 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:21.503 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.446+0000 7f18577fe640 1 --2- 172.21.15.39:0/142861172 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1858146430 0x7f18580adf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.503 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.446+0000 7f18567fc640 1 -- 172.21.15.39:0/142861172 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1858146430 msgr2=0x7f18580adf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.503 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.446+0000 7f18567fc640 1 --2- 172.21.15.39:0/142861172 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1858146430 0x7f18580adf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.503 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.446+0000 7f18567fc640 1 -- 172.21.15.39:0/142861172 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1858155ee0 msgr2=0x7f18581459b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.503 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.446+0000 7f18567fc640 1 --2- 172.21.15.39:0/142861172 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1858155ee0 0x7f18581459b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.504 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.446+0000 7f18567fc640 1 -- 172.21.15.39:0/142861172 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1850009b30 con 0x7f185815c960 2023-05-16T13:54:21.504 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.446+0000 7ff9cffff640 1 -- 172.21.15.39:0/394652402 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d00b1b70 con 0x7ff9d006d700 2023-05-16T13:54:21.504 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.446+0000 7f18567fc640 1 --2- 172.21.15.39:0/142861172 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f185815c960 0x7f1858145ef0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f184c01c490 tx=0x7f184c01c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:21.505 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.450+0000 7f3093fff640 1 --2- 172.21.15.39:0/2598479783 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f3078066280 0x7f3078068730 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f308c0060c0 tx=0x7f3080009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:21.505 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.446+0000 7f1a3590a640 1 -- start start 2023-05-16T13:54:21.505 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.446+0000 7fe53affd640 1 -- 172.21.15.39:0/1508879239 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53c005220 con 0x7fe544157eb0 2023-05-16T13:54:21.505 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.446+0000 7fe53affd640 1 -- 172.21.15.39:0/1508879239 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe53c005380 con 0x7fe544157eb0 2023-05-16T13:54:21.506 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.446+0000 7fe53affd640 1 -- 172.21.15.39:0/1508879239 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53c007270 con 0x7fe544157eb0 2023-05-16T13:54:21.506 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.446+0000 7fe54359e640 1 -- 172.21.15.39:0/1508879239 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5440cdbc0 con 0x7fe544157eb0 2023-05-16T13:54:21.506 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.450+0000 7fe54359e640 1 -- 172.21.15.39:0/1508879239 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5440cc3b0 con 0x7fe544157eb0 2023-05-16T13:54:21.506 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.446+0000 7f183f7fe640 1 -- 172.21.15.39:0/142861172 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184c021800 con 0x7f185815c960 2023-05-16T13:54:21.506 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.450+0000 7f185d2f2640 1 -- 172.21.15.39:0/142861172 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1858158c30 con 0x7f185815c960 2023-05-16T13:54:21.506 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.450+0000 7f183f7fe640 1 -- 172.21.15.39:0/142861172 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f184c021960 con 0x7f185815c960 2023-05-16T13:54:21.507 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.450+0000 7f183f7fe640 1 -- 172.21.15.39:0/142861172 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184c021d10 con 0x7f185815c960 2023-05-16T13:54:21.507 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.450+0000 7f185d2f2640 1 -- 172.21.15.39:0/142861172 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1858158aa0 con 0x7f185815c960 2023-05-16T13:54:21.507 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.450+0000 7fd642ffd640 1 --2- 172.21.15.39:0/751970071 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6440d2a90 0x7fd6440c8840 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd62c00b3c0 tx=0x7fd62c00b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:21.507 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.450+0000 7fe54359e640 1 -- 172.21.15.39:0/1508879239 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe528005260 con 0x7fe544157eb0 2023-05-16T13:54:21.508 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.450+0000 7f1a3590a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a28038560 0x7f1a280d8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.508 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.450+0000 7f1a3590a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a2803ab80 0x7f1a28050be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.508 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.450+0000 7f1a3590a640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1a280e6510 0x7f1a2804df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.508 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.450+0000 7f1a3590a640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2804cc10 con 0x7f1a28038560 2023-05-16T13:54:21.508 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.450+0000 7f1a3590a640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2804ce60 con 0x7f1a2803ab80 2023-05-16T13:54:21.508 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.450+0000 7f1a3590a640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2804d140 con 0x7f1a280e6510 2023-05-16T13:54:21.509 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.450+0000 7ff9cffff640 1 --2- 172.21.15.39:0/394652402 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9d006d700 0x7ff9d00afcf0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff9d00caca0 tx=0x7ff9c401e990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fc605c404319a8c server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:21.509 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.450+0000 7f3090ff9640 1 -- 172.21.15.39:0/2598479783 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f3094165a20 con 0x7f308c052d60 2023-05-16T13:54:21.509 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.450+0000 7f1a2f7fe640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1a280e6510 0x7f1a2804df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.510 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.450+0000 7f1a2f7fe640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1a280e6510 0x7f1a2804df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.39:33542/0 (socket says 172.21.15.39:33542) 2023-05-16T13:54:21.510 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.450+0000 7f1a2f7fe640 1 -- 172.21.15.39:0/1753537132 learned_addr learned my addr 172.21.15.39:0/1753537132 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:21.510 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.450+0000 7f64ee3cb640 1 Processor -- start 2023-05-16T13:54:21.510 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.450+0000 7f64ee3cb640 1 -- start start 2023-05-16T13:54:21.510 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.450+0000 7f1a2effd640 1 --2- 172.21.15.39:0/1753537132 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a28038560 0x7f1a280d8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.511 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.450+0000 7f185d2f2640 1 -- 172.21.15.39:0/142861172 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1858158dc0 con 0x7f185815c960 2023-05-16T13:54:21.511 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.450+0000 7fd63bfff640 1 -- 172.21.15.39:0/751970071 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62c011830 con 0x7fd6440d2a90 2023-05-16T13:54:21.511 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.450+0000 7fd63bfff640 1 -- 172.21.15.39:0/751970071 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd62c011990 con 0x7fd6440d2a90 2023-05-16T13:54:21.511 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.450+0000 7fd63bfff640 1 -- 172.21.15.39:0/751970071 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62c011d80 con 0x7fd6440d2a90 2023-05-16T13:54:21.512 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.450+0000 7fd649ec3640 1 -- 172.21.15.39:0/751970071 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd64415c540 con 0x7fd6440d2a90 2023-05-16T13:54:21.512 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.450+0000 7f1a2f7fe640 1 -- 172.21.15.39:0/1753537132 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a2803ab80 msgr2=0x7f1a28050be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.512 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.450+0000 7f1a2f7fe640 1 --2- 172.21.15.39:0/1753537132 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a2803ab80 0x7f1a28050be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.512 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.450+0000 7f1a2f7fe640 1 -- 172.21.15.39:0/1753537132 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a28038560 msgr2=0x7f1a280d8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.512 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.450+0000 7f1a2f7fe640 1 --2- 172.21.15.39:0/1753537132 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a28038560 0x7f1a280d8cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.512 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.450+0000 7f1a2f7fe640 1 -- 172.21.15.39:0/1753537132 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a20009420 con 0x7f1a280e6510 2023-05-16T13:54:21.513 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.450+0000 7fd649ec3640 1 -- 172.21.15.39:0/751970071 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6440cd090 con 0x7fd6440d2a90 2023-05-16T13:54:21.513 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.450+0000 7f64ee3cb640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f64d4005330 0x7f64e8159ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.513 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.454+0000 7f64ee3cb640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64e815b3d0 0x7f64e814fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.514 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.454+0000 7f64ee3cb640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f64e815c680 0x7f64e815cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.514 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.454+0000 7f64ee3cb640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e815efe0 con 0x7f64d4005330 2023-05-16T13:54:21.514 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.454+0000 7fe53affd640 1 -- 172.21.15.39:0/1508879239 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe53c0073d0 con 0x7fe544157eb0 2023-05-16T13:54:21.515 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.454+0000 7f64ee3cb640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e815d060 con 0x7f64e815b3d0 2023-05-16T13:54:21.515 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.454+0000 7f64ee3cb640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64e8150330 con 0x7f64e815c680 2023-05-16T13:54:21.515 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.454+0000 7f64edbca640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f64e815c680 0x7f64e815cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.515 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.454+0000 7f64ed3c9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f64d4005330 0x7f64e8159ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.515 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.454+0000 7f64edbca640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f64e815c680 0x7f64e815cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.39:33548/0 (socket says 172.21.15.39:33548) 2023-05-16T13:54:21.515 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.454+0000 7f64edbca640 1 -- 172.21.15.39:0/4022999602 learned_addr learned my addr 172.21.15.39:0/4022999602 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:21.516 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.454+0000 7f1a2f7fe640 1 --2- 172.21.15.39:0/1753537132 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1a280e6510 0x7f1a2804df00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1a2400e930 tx=0x7f1a2400edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:21.516 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.454+0000 7fd649ec3640 1 -- 172.21.15.39:0/751970071 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6440ce5e0 con 0x7fd6440d2a90 2023-05-16T13:54:21.516 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.454+0000 7f64ed3c9640 1 -- 172.21.15.39:0/4022999602 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f64e815c680 msgr2=0x7f64e815cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.517 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.454+0000 7f64ed3c9640 1 --2- 172.21.15.39:0/4022999602 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f64e815c680 0x7f64e815cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.517 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.454+0000 7f64ed3c9640 1 -- 172.21.15.39:0/4022999602 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64e815b3d0 msgr2=0x7f64e814fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.517 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.454+0000 7f64ed3c9640 1 --2- 172.21.15.39:0/4022999602 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64e815b3d0 0x7f64e814fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.517 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.454+0000 7f64ed3c9640 1 -- 172.21.15.39:0/4022999602 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64e80b02c0 con 0x7f64d4005330 2023-05-16T13:54:21.517 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.454+0000 7f183f7fe640 1 -- 172.21.15.39:0/142861172 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f184c02a450 con 0x7f185815c960 2023-05-16T13:54:21.518 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.454+0000 7ff9ceffd640 1 -- 172.21.15.39:0/394652402 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c40a7950 con 0x7ff9d006d700 2023-05-16T13:54:21.518 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.454+0000 7ff9ceffd640 1 -- 172.21.15.39:0/394652402 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9c40a7ab0 con 0x7ff9d006d700 2023-05-16T13:54:21.518 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.454+0000 7f183f7fe640 1 --2- 172.21.15.39:0/142861172 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f1844066280 0x7f1844068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.519 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.454+0000 7fe53affd640 1 --2- 172.21.15.39:0/1508879239 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fe524066350 0x7fe524068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.519 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.454+0000 7fe53affd640 1 -- 172.21.15.39:0/1508879239 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe53c0834a0 con 0x7fe544157eb0 2023-05-16T13:54:21.519 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.454+0000 7fe54259c640 1 --2- 172.21.15.39:0/1508879239 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fe524066350 0x7fe524068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.519 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.454+0000 7f183f7fe640 1 -- 172.21.15.39:0/142861172 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f184c095430 con 0x7f185815c960 2023-05-16T13:54:21.520 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.454+0000 7f1856ffd640 1 --2- 172.21.15.39:0/142861172 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f1844066280 0x7f1844068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.520 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.454+0000 7ff9d54a8640 1 -- 172.21.15.39:0/394652402 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9d006d700 msgr2=0x7ff9d00afcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.520 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.454+0000 7ff9d54a8640 1 --2- 172.21.15.39:0/394652402 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9d006d700 0x7ff9d00afcf0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff9d00caca0 tx=0x7ff9c401e990 comp rx=0 tx=0).stop 2023-05-16T13:54:21.520 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.454+0000 7ff9d54a8640 1 -- 172.21.15.39:0/394652402 shutdown_connections 2023-05-16T13:54:21.520 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.454+0000 7ff9d54a8640 1 --2- 172.21.15.39:0/394652402 >> v2:172.21.15.118:3300/0 conn(0x7ff9d00ad7d0 0x7ff9d00cd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.521 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.454+0000 7ff9d54a8640 1 --2- 172.21.15.39:0/394652402 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9d006d700 0x7ff9d00afcf0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.521 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.454+0000 7ff9d54a8640 1 -- 172.21.15.39:0/394652402 >> 172.21.15.39:0/394652402 conn(0x7ff9d006a660 msgr2=0x7ff9d00cacf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:21.521 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.454+0000 7ff9d54a8640 1 -- 172.21.15.39:0/394652402 shutdown_connections 2023-05-16T13:54:21.521 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.454+0000 7ff9d54a8640 1 -- 172.21.15.39:0/394652402 wait complete. 2023-05-16T13:54:21.521 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.454+0000 7f64ed3c9640 1 --2- 172.21.15.39:0/4022999602 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f64d4005330 0x7f64e8159ed0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f64d8004fd0 tx=0x7f64d80074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:21.522 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.458+0000 7fd63bfff640 1 -- 172.21.15.39:0/751970071 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd62c03a080 con 0x7fd6440d2a90 2023-05-16T13:54:21.522 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.458+0000 7f1856ffd640 1 --2- 172.21.15.39:0/142861172 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f1844066280 0x7f1844068730 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f18500b1000 tx=0x7f1850004ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:21.522 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.458+0000 7fe54259c640 1 --2- 172.21.15.39:0/1508879239 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fe524066350 0x7fe524068800 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe534009fd0 tx=0x7fe534007040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:21.523 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.458+0000 7f64ddffb640 1 -- 172.21.15.39:0/4022999602 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d8007740 con 0x7f64d4005330 2023-05-16T13:54:21.523 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.458+0000 7fe53affd640 1 -- 172.21.15.39:0/1508879239 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fe53c050990 con 0x7fe544157eb0 2023-05-16T13:54:21.523 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.458+0000 7f64ee3cb640 1 -- 172.21.15.39:0/4022999602 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64e80affe0 con 0x7f64d4005330 2023-05-16T13:54:21.523 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.458+0000 7f64ddffb640 1 -- 172.21.15.39:0/4022999602 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64d800f9c0 con 0x7f64d4005330 2023-05-16T13:54:21.524 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.458+0000 7f64ee3cb640 1 -- 172.21.15.39:0/4022999602 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64e8163e40 con 0x7f64d4005330 2023-05-16T13:54:21.524 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.458+0000 7ff9d54a8640 1 Processor -- start 2023-05-16T13:54:21.524 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.458+0000 7ff9d54a8640 1 -- start start 2023-05-16T13:54:21.524 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.458+0000 7f64ddffb640 1 -- 172.21.15.39:0/4022999602 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d800fd70 con 0x7f64d4005330 2023-05-16T13:54:21.525 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.458+0000 7fd63bfff640 1 --2- 172.21.15.39:0/751970071 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd624066380 0x7fd624068830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.525 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.458+0000 7fd63bfff640 1 -- 172.21.15.39:0/751970071 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd62c038070 con 0x7fd6440d2a90 2023-05-16T13:54:21.525 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.458+0000 7fd6437fe640 1 --2- 172.21.15.39:0/751970071 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd624066380 0x7fd624068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.525 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.458+0000 7fd63bfff640 1 -- 172.21.15.39:0/751970071 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fd62c0ad730 con 0x7fd6440d2a90 2023-05-16T13:54:21.526 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.458+0000 7f64d37fe640 1 -- 172.21.15.39:0/4022999602 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64c0005260 con 0x7f64d4005330 2023-05-16T13:54:21.526 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.462+0000 7ff9d54a8640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff9d00ad7d0 0x7ff9d0145b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.526 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.462+0000 7fd6437fe640 1 --2- 172.21.15.39:0/751970071 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd624066380 0x7fd624068830 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd634009e50 tx=0x7fd6340a7070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:21.527 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.462+0000 7f1a17fff640 1 -- 172.21.15.39:0/1753537132 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2400c9a0 con 0x7f1a280e6510 2023-05-16T13:54:21.527 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.462+0000 7f1a17fff640 1 -- 172.21.15.39:0/1753537132 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a2400cb00 con 0x7f1a280e6510 2023-05-16T13:54:21.527 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.462+0000 7f1a17fff640 1 -- 172.21.15.39:0/1753537132 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2400ce90 con 0x7f1a280e6510 2023-05-16T13:54:21.527 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.462+0000 7f1a3590a640 1 -- 172.21.15.39:0/1753537132 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a280e72e0 con 0x7f1a280e6510 2023-05-16T13:54:21.527 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.462+0000 7f1a3590a640 1 -- 172.21.15.39:0/1753537132 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a28053c80 con 0x7f1a280e6510 2023-05-16T13:54:21.528 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.462+0000 7f183f7fe640 1 -- 172.21.15.39:0/142861172 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f184c062940 con 0x7f185815c960 2023-05-16T13:54:21.528 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.462+0000 7f1a3590a640 1 -- 172.21.15.39:0/1753537132 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a2803ec70 con 0x7f1a280e6510 2023-05-16T13:54:21.528 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.462+0000 7ff9cffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff9d00ad7d0 0x7ff9d0145b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.529 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.462+0000 7ff9cffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff9d00ad7d0 0x7ff9d0145b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.39:34924/0 (socket says 172.21.15.39:34924) 2023-05-16T13:54:21.529 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.462+0000 7ff9cffff640 1 -- 172.21.15.39:0/1315652536 learned_addr learned my addr 172.21.15.39:0/1315652536 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:21.529 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.462+0000 7f64ddffb640 1 -- 172.21.15.39:0/4022999602 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f64d801d460 con 0x7f64d4005330 2023-05-16T13:54:21.529 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.462+0000 7f64ddffb640 1 --2- 172.21.15.39:0/4022999602 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f64cc066380 0x7f64cc068830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.529 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.462+0000 7f64ddffb640 1 -- 172.21.15.39:0/4022999602 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f64d8083d80 con 0x7f64d4005330 2023-05-16T13:54:21.530 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.466+0000 7f1a17fff640 1 -- 172.21.15.39:0/1753537132 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1a24013470 con 0x7f1a280e6510 2023-05-16T13:54:21.530 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.466+0000 7f1a17fff640 1 --2- 172.21.15.39:0/1753537132 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f1a1c066380 0x7f1a1c068830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.530 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.466+0000 7f1a17fff640 1 -- 172.21.15.39:0/1753537132 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1a240846f0 con 0x7f1a280e6510 2023-05-16T13:54:21.530 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.470+0000 7f64ecbc8640 1 --2- 172.21.15.39:0/4022999602 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f64cc066380 0x7f64cc068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.531 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.470+0000 7ff9d54a8640 1 --2- 172.21.15.39:0/1315652536 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9d00cb490 0x7ff9d00ca180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.531 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.470+0000 7ff9d54a8640 1 --2- 172.21.15.39:0/1315652536 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff9d00ac350 0x7ff9d0155450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.531 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.470+0000 7ff9d54a8640 1 -- 172.21.15.39:0/1315652536 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d0146070 con 0x7ff9d00cb490 2023-05-16T13:54:21.531 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.470+0000 7ff9d54a8640 1 -- 172.21.15.39:0/1315652536 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d00ab340 con 0x7ff9d00ad7d0 2023-05-16T13:54:21.531 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.470+0000 7ff9d54a8640 1 -- 172.21.15.39:0/1315652536 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d00ca6c0 con 0x7ff9d00ac350 2023-05-16T13:54:21.531 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.470+0000 7f64ecbc8640 1 --2- 172.21.15.39:0/4022999602 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f64cc066380 0x7f64cc068830 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f64e815df00 tx=0x7f64e0007ad0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:21.532 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.470+0000 7f1a2effd640 1 --2- 172.21.15.39:0/1753537132 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f1a1c066380 0x7f1a1c068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.532 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.470+0000 7f1a17fff640 1 -- 172.21.15.39:0/1753537132 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f1a24051ca0 con 0x7f1a280e6510 2023-05-16T13:54:21.533 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.470+0000 7ff9cf7fe640 1 --2- 172.21.15.39:0/1315652536 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9d00cb490 0x7ff9d00ca180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.533 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.470+0000 7ff9d4ca7640 1 --2- 172.21.15.39:0/1315652536 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff9d00ac350 0x7ff9d0155450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.533 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.470+0000 7ff9cffff640 1 -- 172.21.15.39:0/1315652536 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff9d00ac350 msgr2=0x7ff9d0155450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.533 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.470+0000 7ff9cffff640 1 --2- 172.21.15.39:0/1315652536 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff9d00ac350 0x7ff9d0155450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.533 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.470+0000 7ff9cffff640 1 -- 172.21.15.39:0/1315652536 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9d00cb490 msgr2=0x7ff9d00ca180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.533 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.470+0000 7ff9cffff640 1 --2- 172.21.15.39:0/1315652536 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9d00cb490 0x7ff9d00ca180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.533 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.470+0000 7ff9cffff640 1 -- 172.21.15.39:0/1315652536 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9c40094d0 con 0x7ff9d00ad7d0 2023-05-16T13:54:21.534 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.470+0000 7ff9cffff640 1 --2- 172.21.15.39:0/1315652536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff9d00ad7d0 0x7ff9d0145b30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff9c401b5a0 tx=0x7ff9c401b730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:21.534 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.470+0000 7ff9ccff9640 1 -- 172.21.15.39:0/1315652536 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c40af760 con 0x7ff9d00ad7d0 2023-05-16T13:54:21.534 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.474+0000 7ff9ccff9640 1 -- 172.21.15.39:0/1315652536 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9c40af8c0 con 0x7ff9d00ad7d0 2023-05-16T13:54:21.534 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.474+0000 7ff9ccff9640 1 -- 172.21.15.39:0/1315652536 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c40afc50 con 0x7ff9d00ad7d0 2023-05-16T13:54:21.534 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.474+0000 7ff9d54a8640 1 -- 172.21.15.39:0/1315652536 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9d00b0640 con 0x7ff9d00ad7d0 2023-05-16T13:54:21.534 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.474+0000 7f64ddffb640 1 -- 172.21.15.39:0/4022999602 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f64d80511e0 con 0x7f64d4005330 2023-05-16T13:54:21.535 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.474+0000 7ff9d54a8640 1 -- 172.21.15.39:0/1315652536 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9d006ca00 con 0x7ff9d00ad7d0 2023-05-16T13:54:21.535 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.478+0000 7ff9ccff9640 1 -- 172.21.15.39:0/1315652536 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff9c40b8470 con 0x7ff9d00ad7d0 2023-05-16T13:54:21.535 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.478+0000 7ff9ccff9640 1 --2- 172.21.15.39:0/1315652536 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ff9bc066380 0x7ff9bc068830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:21.535 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.478+0000 7ff9ccff9640 1 -- 172.21.15.39:0/1315652536 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff9c411e420 con 0x7ff9d00ad7d0 2023-05-16T13:54:21.536 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.478+0000 7ff9cf7fe640 1 --2- 172.21.15.39:0/1315652536 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ff9bc066380 0x7ff9bc068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:21.536 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.478+0000 7ff9cf7fe640 1 --2- 172.21.15.39:0/1315652536 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ff9bc066380 0x7ff9bc068830 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff9d00c9a40 tx=0x7ff9c0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:21.536 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.482+0000 7f1a2effd640 1 --2- 172.21.15.39:0/1753537132 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f1a1c066380 0x7f1a1c068830 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1a200ad000 tx=0x7f1a20008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:21.536 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.482+0000 7ff9d54a8640 1 -- 172.21.15.39:0/1315652536 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9d0164950 con 0x7ff9d00ad7d0 2023-05-16T13:54:21.537 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.490+0000 7ff9ccff9640 1 -- 172.21.15.39:0/1315652536 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ff9c40eba50 con 0x7ff9d00ad7d0 2023-05-16T13:54:21.778 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.770+0000 7f1e8f77b640 1 -- 172.21.15.39:0/1759180950 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1e68005510 con 0x7f1e880b03f0 2023-05-16T13:54:21.778 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.770+0000 7f1e7dffb640 1 -- 172.21.15.39:0/1759180950 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1e84053d20 con 0x7f1e880b03f0 2023-05-16T13:54:21.781 INFO:teuthology.orchestra.run.smithi039.stdout:60129542149 2023-05-16T13:54:21.782 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.774+0000 7f1e737fe640 1 -- 172.21.15.39:0/1759180950 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f1e6c066350 msgr2=0x7f1e6c068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.782 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.774+0000 7f1e737fe640 1 --2- 172.21.15.39:0/1759180950 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f1e6c066350 0x7f1e6c068800 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1e80005fd0 tx=0x7f1e80005ba0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.783 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.774+0000 7f1e737fe640 1 -- 172.21.15.39:0/1759180950 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1e880b03f0 msgr2=0x7f1e88201040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.783 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.774+0000 7f1e737fe640 1 --2- 172.21.15.39:0/1759180950 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1e880b03f0 0x7f1e88201040 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1e8400c370 tx=0x7f1e8400c830 comp rx=0 tx=0).stop 2023-05-16T13:54:21.783 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.774+0000 7f1e737fe640 1 -- 172.21.15.39:0/1759180950 shutdown_connections 2023-05-16T13:54:21.784 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.774+0000 7f1e737fe640 1 --2- 172.21.15.39:0/1759180950 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e88158660 0x7f1e880ce210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.784 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.774+0000 7f1e737fe640 1 --2- 172.21.15.39:0/1759180950 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e880cd9b0 0x7f1e880b20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.784 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.774+0000 7f1e737fe640 1 --2- 172.21.15.39:0/1759180950 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f1e6c066350 0x7f1e6c068800 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.784 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.774+0000 7f1e737fe640 1 --2- 172.21.15.39:0/1759180950 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1e880b03f0 0x7f1e88201040 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.784 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.778+0000 7f1e737fe640 1 -- 172.21.15.39:0/1759180950 >> 172.21.15.39:0/1759180950 conn(0x7f1e88069a50 msgr2=0x7f1e880af5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:21.785 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.778+0000 7f1e737fe640 1 -- 172.21.15.39:0/1759180950 shutdown_connections 2023-05-16T13:54:21.785 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.778+0000 7f1e737fe640 1 -- 172.21.15.39:0/1759180950 wait complete. 2023-05-16T13:54:21.793 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.786+0000 7fd649ec3640 1 -- 172.21.15.39:0/751970071 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fd644073c90 con 0x7fd6440d2a90 2023-05-16T13:54:21.794 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.786+0000 7fd63bfff640 1 -- 172.21.15.39:0/751970071 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd62c051300 con 0x7fd6440d2a90 2023-05-16T13:54:21.794 INFO:teuthology.orchestra.run.smithi039.stdout:64424509444 2023-05-16T13:54:21.795 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.786+0000 7f309a9c0640 1 -- 172.21.15.39:0/2598479783 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f308c0e59f0 con 0x7f308c052d60 2023-05-16T13:54:21.795 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.790+0000 7f185d2f2640 1 -- 172.21.15.39:0/142861172 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f1858147a60 con 0x7f185815c960 2023-05-16T13:54:21.796 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.790+0000 7f3090ff9640 1 -- 172.21.15.39:0/2598479783 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f308c0e59f0 con 0x7f308c052d60 2023-05-16T13:54:21.796 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.790+0000 7f183f7fe640 1 -- 172.21.15.39:0/142861172 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1858147a60 con 0x7f185815c960 2023-05-16T13:54:21.798 INFO:teuthology.orchestra.run.smithi039.stdout:60129542149 2023-05-16T13:54:21.798 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.790+0000 7fd649ec3640 1 -- 172.21.15.39:0/751970071 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd624066380 msgr2=0x7fd624068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.798 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.790+0000 7fd649ec3640 1 --2- 172.21.15.39:0/751970071 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd624066380 0x7fd624068830 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd634009e50 tx=0x7fd6340a7070 comp rx=0 tx=0).stop 2023-05-16T13:54:21.799 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.790+0000 7fd649ec3640 1 -- 172.21.15.39:0/751970071 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6440d2a90 msgr2=0x7fd6440c8840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.799 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.790+0000 7fd649ec3640 1 --2- 172.21.15.39:0/751970071 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6440d2a90 0x7fd6440c8840 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd62c00b3c0 tx=0x7fd62c00b880 comp rx=0 tx=0).stop 2023-05-16T13:54:21.799 INFO:teuthology.orchestra.run.smithi039.stdout:64424509445 2023-05-16T13:54:21.800 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.790+0000 7fd649ec3640 1 -- 172.21.15.39:0/751970071 shutdown_connections 2023-05-16T13:54:21.800 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.790+0000 7fd649ec3640 1 --2- 172.21.15.39:0/751970071 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd624066380 0x7fd624068830 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.800 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.790+0000 7fd649ec3640 1 --2- 172.21.15.39:0/751970071 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd64415c170 0x7fd64414aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.800 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.790+0000 7fd649ec3640 1 --2- 172.21.15.39:0/751970071 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6440d2a90 0x7fd6440c8840 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.800 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.790+0000 7fd649ec3640 1 --2- 172.21.15.39:0/751970071 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd6440d09b0 0x7fd6440702d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.800 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.790+0000 7fd649ec3640 1 -- 172.21.15.39:0/751970071 >> 172.21.15.39:0/751970071 conn(0x7fd644071aa0 msgr2=0x7fd6440afa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:21.800 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.790+0000 7fd649ec3640 1 -- 172.21.15.39:0/751970071 shutdown_connections 2023-05-16T13:54:21.801 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.790+0000 7fd649ec3640 1 -- 172.21.15.39:0/751970071 wait complete. 2023-05-16T13:54:21.801 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.790+0000 7fe54359e640 1 -- 172.21.15.39:0/1508879239 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fe5280057e0 con 0x7fe544157eb0 2023-05-16T13:54:21.802 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.794+0000 7f185d2f2640 1 -- 172.21.15.39:0/142861172 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f1844066280 msgr2=0x7f1844068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.802 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.794+0000 7f185d2f2640 1 --2- 172.21.15.39:0/142861172 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f1844066280 0x7f1844068730 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f18500b1000 tx=0x7f1850004ac0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.802 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.794+0000 7f185d2f2640 1 -- 172.21.15.39:0/142861172 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f185815c960 msgr2=0x7f1858145ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.802 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.794+0000 7f185d2f2640 1 --2- 172.21.15.39:0/142861172 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f185815c960 0x7f1858145ef0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f184c01c490 tx=0x7f184c01c950 comp rx=0 tx=0).stop 2023-05-16T13:54:21.802 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.794+0000 7f185d2f2640 1 -- 172.21.15.39:0/142861172 shutdown_connections 2023-05-16T13:54:21.802 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.794+0000 7f185d2f2640 1 --2- 172.21.15.39:0/142861172 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f1844066280 0x7f1844068730 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.802 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.794+0000 7f185d2f2640 1 --2- 172.21.15.39:0/142861172 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f185815c960 0x7f1858145ef0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.803 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.794+0000 7f185d2f2640 1 --2- 172.21.15.39:0/142861172 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1858146430 0x7f18580adf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.803 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.794+0000 7f185d2f2640 1 --2- 172.21.15.39:0/142861172 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1858155ee0 0x7f18581459b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.803 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.794+0000 7f185d2f2640 1 -- 172.21.15.39:0/142861172 >> 172.21.15.39:0/142861172 conn(0x7f1858069a50 msgr2=0x7f185814afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:21.803 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.794+0000 7f309a9c0640 1 -- 172.21.15.39:0/2598479783 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f3078066280 msgr2=0x7f3078068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.803 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.794+0000 7fe53affd640 1 -- 172.21.15.39:0/1508879239 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe53c053fb0 con 0x7fe544157eb0 2023-05-16T13:54:21.804 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.794+0000 7f185d2f2640 1 -- 172.21.15.39:0/142861172 shutdown_connections 2023-05-16T13:54:21.804 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.794+0000 7f185d2f2640 1 -- 172.21.15.39:0/142861172 wait complete. 2023-05-16T13:54:21.804 INFO:teuthology.orchestra.run.smithi039.stdout:64424509445 2023-05-16T13:54:21.805 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.794+0000 7f309a9c0640 1 --2- 172.21.15.39:0/2598479783 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f3078066280 0x7f3078068730 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f308c0060c0 tx=0x7f3080009190 comp rx=0 tx=0).stop 2023-05-16T13:54:21.805 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.794+0000 7f309a9c0640 1 -- 172.21.15.39:0/2598479783 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f308c052d60 msgr2=0x7f308c0e60b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.805 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.794+0000 7f309a9c0640 1 --2- 172.21.15.39:0/2598479783 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f308c052d60 0x7f308c0e60b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f309404f6f0 tx=0x7f3094094ba0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.806 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.794+0000 7f309a9c0640 1 -- 172.21.15.39:0/2598479783 shutdown_connections 2023-05-16T13:54:21.806 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.794+0000 7f309a9c0640 1 --2- 172.21.15.39:0/2598479783 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f3078066280 0x7f3078068730 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.806 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.794+0000 7f309a9c0640 1 --2- 172.21.15.39:0/2598479783 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f308c0e6db0 0x7f308c0e65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.806 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.794+0000 7f309a9c0640 1 --2- 172.21.15.39:0/2598479783 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f308c052d60 0x7f308c0e60b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.806 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.794+0000 7f309a9c0640 1 --2- 172.21.15.39:0/2598479783 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f308c04f7e0 0x7f308c0dda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.806 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.794+0000 7f309a9c0640 1 -- 172.21.15.39:0/2598479783 >> 172.21.15.39:0/2598479783 conn(0x7f308c0516d0 msgr2=0x7f308c047cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:21.806 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.794+0000 7fe54359e640 1 -- 172.21.15.39:0/1508879239 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fe524066350 msgr2=0x7fe524068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.807 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.794+0000 7fe54359e640 1 --2- 172.21.15.39:0/1508879239 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fe524066350 0x7fe524068800 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe534009fd0 tx=0x7fe534007040 comp rx=0 tx=0).stop 2023-05-16T13:54:21.807 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.794+0000 7f309a9c0640 1 -- 172.21.15.39:0/2598479783 shutdown_connections 2023-05-16T13:54:21.807 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.794+0000 7f309a9c0640 1 -- 172.21.15.39:0/2598479783 wait complete. 2023-05-16T13:54:21.808 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.794+0000 7fe54359e640 1 -- 172.21.15.39:0/1508879239 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe544157eb0 msgr2=0x7fe54414b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.808 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.794+0000 7fe54359e640 1 --2- 172.21.15.39:0/1508879239 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe544157eb0 0x7fe54414b710 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe53c00c340 tx=0x7fe53c00c800 comp rx=0 tx=0).stop 2023-05-16T13:54:21.808 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.794+0000 7fe54359e640 1 -- 172.21.15.39:0/1508879239 shutdown_connections 2023-05-16T13:54:21.808 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.794+0000 7fe54359e640 1 --2- 172.21.15.39:0/1508879239 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fe524066350 0x7fe524068800 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.809 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.794+0000 7fe54359e640 1 --2- 172.21.15.39:0/1508879239 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe544157eb0 0x7fe54414b710 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.809 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.794+0000 7fe54359e640 1 --2- 172.21.15.39:0/1508879239 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe5440c8900 0x7fe5440c6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.809 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.794+0000 7fe54359e640 1 --2- 172.21.15.39:0/1508879239 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe5440b0270 0x7fe544157050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.809 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.794+0000 7fe54359e640 1 -- 172.21.15.39:0/1508879239 >> 172.21.15.39:0/1508879239 conn(0x7fe54406bac0 msgr2=0x7fe54406be90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:21.809 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.798+0000 7fe54359e640 1 -- 172.21.15.39:0/1508879239 shutdown_connections 2023-05-16T13:54:21.809 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.798+0000 7fe54359e640 1 -- 172.21.15.39:0/1508879239 wait complete. 2023-05-16T13:54:21.810 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.802+0000 7f1a3590a640 1 -- 172.21.15.39:0/1753537132 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1a2804d280 con 0x7f1a280e6510 2023-05-16T13:54:21.810 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.802+0000 7f1a17fff640 1 -- 172.21.15.39:0/1753537132 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1a24017020 con 0x7f1a280e6510 2023-05-16T13:54:21.813 INFO:teuthology.orchestra.run.smithi039.stdout:60129542148 2023-05-16T13:54:21.814 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.806+0000 7f64d37fe640 1 -- 172.21.15.39:0/4022999602 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f64c0005510 con 0x7f64d4005330 2023-05-16T13:54:21.814 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.806+0000 7f64ddffb640 1 -- 172.21.15.39:0/4022999602 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f64d8054800 con 0x7f64d4005330 2023-05-16T13:54:21.814 INFO:teuthology.orchestra.run.smithi039.stdout:64424509445 2023-05-16T13:54:21.818 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.810+0000 7f64ee3cb640 1 -- 172.21.15.39:0/4022999602 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f64cc066380 msgr2=0x7f64cc068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.818 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.810+0000 7f64ee3cb640 1 --2- 172.21.15.39:0/4022999602 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f64cc066380 0x7f64cc068830 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f64e815df00 tx=0x7f64e0007ad0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.818 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.810+0000 7f64ee3cb640 1 -- 172.21.15.39:0/4022999602 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f64d4005330 msgr2=0x7f64e8159ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.818 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.810+0000 7f64ee3cb640 1 --2- 172.21.15.39:0/4022999602 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f64d4005330 0x7f64e8159ed0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f64d8004fd0 tx=0x7f64d80074f0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.819 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542149 for osd.0 2023-05-16T13:54:21.820 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.810+0000 7f64ee3cb640 1 -- 172.21.15.39:0/4022999602 shutdown_connections 2023-05-16T13:54:21.820 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.810+0000 7f64ee3cb640 1 --2- 172.21.15.39:0/4022999602 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f64cc066380 0x7f64cc068830 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.820 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.810+0000 7f64ee3cb640 1 --2- 172.21.15.39:0/4022999602 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f64e815c680 0x7f64e815cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.820 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.810+0000 7f64ee3cb640 1 --2- 172.21.15.39:0/4022999602 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64e815b3d0 0x7f64e814fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.820 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.810+0000 7f64ee3cb640 1 --2- 172.21.15.39:0/4022999602 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f64d4005330 0x7f64e8159ed0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.820 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.810+0000 7f64ee3cb640 1 -- 172.21.15.39:0/4022999602 >> 172.21.15.39:0/4022999602 conn(0x7f64e8071aa0 msgr2=0x7f64e80d2710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:21.821 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.810+0000 7f64ee3cb640 1 -- 172.21.15.39:0/4022999602 shutdown_connections 2023-05-16T13:54:21.821 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.810+0000 7f64ee3cb640 1 -- 172.21.15.39:0/4022999602 wait complete. 2023-05-16T13:54:21.821 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.810+0000 7f1a15ffb640 1 -- 172.21.15.39:0/1753537132 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f1a1c066380 msgr2=0x7f1a1c068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.822 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.810+0000 7f1a15ffb640 1 --2- 172.21.15.39:0/1753537132 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f1a1c066380 0x7f1a1c068830 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1a200ad000 tx=0x7f1a20008040 comp rx=0 tx=0).stop 2023-05-16T13:54:21.822 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.810+0000 7f1a15ffb640 1 -- 172.21.15.39:0/1753537132 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1a280e6510 msgr2=0x7f1a2804df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.822 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.810+0000 7f1a15ffb640 1 --2- 172.21.15.39:0/1753537132 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1a280e6510 0x7f1a2804df00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1a2400e930 tx=0x7f1a2400edf0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.822 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.814+0000 7f1a15ffb640 1 -- 172.21.15.39:0/1753537132 shutdown_connections 2023-05-16T13:54:21.822 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.814+0000 7f1a15ffb640 1 --2- 172.21.15.39:0/1753537132 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f1a1c066380 0x7f1a1c068830 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.822 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.814+0000 7f1a15ffb640 1 --2- 172.21.15.39:0/1753537132 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1a280e6510 0x7f1a2804df00 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.822 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.814+0000 7f1a15ffb640 1 --2- 172.21.15.39:0/1753537132 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a2803ab80 0x7f1a28050be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.822 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.814+0000 7f1a15ffb640 1 --2- 172.21.15.39:0/1753537132 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a28038560 0x7f1a280d8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.823 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.814+0000 7f1a15ffb640 1 -- 172.21.15.39:0/1753537132 >> 172.21.15.39:0/1753537132 conn(0x7f1a28055b80 msgr2=0x7f1a2803c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:21.823 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.814+0000 7f1a15ffb640 1 -- 172.21.15.39:0/1753537132 shutdown_connections 2023-05-16T13:54:21.823 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.814+0000 7f1a15ffb640 1 -- 172.21.15.39:0/1753537132 wait complete. 2023-05-16T13:54:21.831 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.826+0000 7ff9d54a8640 1 -- 172.21.15.39:0/1315652536 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff9d004ed20 con 0x7ff9d00ad7d0 2023-05-16T13:54:21.833 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.826+0000 7ff9ccff9640 1 -- 172.21.15.39:0/1315652536 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff9c40b4090 con 0x7ff9d00ad7d0 2023-05-16T13:54:21.833 INFO:teuthology.orchestra.run.smithi039.stdout:60129542149 2023-05-16T13:54:21.836 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.830+0000 7ff9d54a8640 1 -- 172.21.15.39:0/1315652536 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ff9bc066380 msgr2=0x7ff9bc068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.836 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.830+0000 7ff9d54a8640 1 --2- 172.21.15.39:0/1315652536 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ff9bc066380 0x7ff9bc068830 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff9d00c9a40 tx=0x7ff9c0009040 comp rx=0 tx=0).stop 2023-05-16T13:54:21.836 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.830+0000 7ff9d54a8640 1 -- 172.21.15.39:0/1315652536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff9d00ad7d0 msgr2=0x7ff9d0145b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:21.836 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.830+0000 7ff9d54a8640 1 --2- 172.21.15.39:0/1315652536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff9d00ad7d0 0x7ff9d0145b30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff9c401b5a0 tx=0x7ff9c401b730 comp rx=0 tx=0).stop 2023-05-16T13:54:21.837 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.830+0000 7ff9d54a8640 1 -- 172.21.15.39:0/1315652536 shutdown_connections 2023-05-16T13:54:21.837 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.830+0000 7ff9d54a8640 1 --2- 172.21.15.39:0/1315652536 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ff9bc066380 0x7ff9bc068830 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.837 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.830+0000 7ff9d54a8640 1 --2- 172.21.15.39:0/1315652536 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff9d00ac350 0x7ff9d0155450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.838 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.830+0000 7ff9d54a8640 1 --2- 172.21.15.39:0/1315652536 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9d00cb490 0x7ff9d00ca180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.838 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.830+0000 7ff9d54a8640 1 --2- 172.21.15.39:0/1315652536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff9d00ad7d0 0x7ff9d0145b30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:21.838 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.830+0000 7ff9d54a8640 1 -- 172.21.15.39:0/1315652536 >> 172.21.15.39:0/1315652536 conn(0x7ff9d006a660 msgr2=0x7ff9d0157810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:21.839 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.5 2023-05-16T13:54:21.839 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.830+0000 7ff9d54a8640 1 -- 172.21.15.39:0/1315652536 shutdown_connections 2023-05-16T13:54:21.839 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:21.830+0000 7ff9d54a8640 1 -- 172.21.15.39:0/1315652536 wait complete. 2023-05-16T13:54:21.840 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509444 for osd.6 2023-05-16T13:54:21.845 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542149 for osd.3 2023-05-16T13:54:21.845 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.7 2023-05-16T13:54:21.852 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.4 2023-05-16T13:54:21.854 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542148 for osd.1 2023-05-16T13:54:21.861 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542149 for osd.2 2023-05-16T13:54:22.820 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-05-16T13:54:22.839 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-05-16T13:54:22.840 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-05-16T13:54:22.846 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-05-16T13:54:22.846 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-05-16T13:54:22.853 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-05-16T13:54:22.854 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-05-16T13:54:22.863 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-05-16T13:54:23.040 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.029+0000 7fbce290a640 1 Processor -- start 2023-05-16T13:54:23.042 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.033+0000 7fbce290a640 1 -- start start 2023-05-16T13:54:23.042 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.033+0000 7fbce290a640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbcdc158050 0x7fbcdc06da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:23.043 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.033+0000 7fbce290a640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fbcdc0c88b0 0x7fbcdc158f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:23.043 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.033+0000 7fbce290a640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcdc0c9130 con 0x7fbcdc06b7c0 2023-05-16T13:54:23.043 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.033+0000 7fbce290a640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcdc159490 con 0x7fbcdc0c88b0 2023-05-16T13:54:23.043 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.033+0000 7fbce290a640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcdc0c8e50 con 0x7fbcdc158050 2023-05-16T13:54:23.043 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.033+0000 7fbcdb7fe640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fbcdc0c88b0 0x7fbcdc158f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:23.043 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.033+0000 7fbcdb7fe640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fbcdc0c88b0 0x7fbcdc158f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59960/0 (socket says 172.21.15.39:59960) 2023-05-16T13:54:23.043 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.033+0000 7fbcdb7fe640 1 -- 172.21.15.39:0/4024555826 learned_addr learned my addr 172.21.15.39:0/4024555826 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:23.044 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.033+0000 7fbcdbfff640 1 --2- 172.21.15.39:0/4024555826 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbcdc158050 0x7fbcdc06da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:23.048 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.037+0000 7fbcdb7fe640 1 -- 172.21.15.39:0/4024555826 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbcdc158050 msgr2=0x7fbcdc06da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:23.048 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.037+0000 7fbcdb7fe640 1 --2- 172.21.15.39:0/4024555826 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbcdc158050 0x7fbcdc06da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.048 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.037+0000 7fbcdb7fe640 1 -- 172.21.15.39:0/4024555826 >> v1:172.21.15.118:6789/0 conn(0x7fbcdc06b7c0 legacy=0x7fbcdc0cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:23.048 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.037+0000 7fbcdb7fe640 1 -- 172.21.15.39:0/4024555826 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcdc06cf30 con 0x7fbcdc0c88b0 2023-05-16T13:54:23.049 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.041+0000 7fbcdb7fe640 1 --2- 172.21.15.39:0/4024555826 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbcdc0c88b0 0x7fbcdc158f50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbcd400d370 tx=0x7fbcd401ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da9a9af84e01660e server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:23.049 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.041+0000 7fbcdaffd640 1 -- 172.21.15.39:0/4024555826 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd40a7c00 con 0x7fbcdc0c88b0 2023-05-16T13:54:23.050 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.041+0000 7fbcdaffd640 1 -- 172.21.15.39:0/4024555826 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcd40ab070 con 0x7fbcdc0c88b0 2023-05-16T13:54:23.050 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.041+0000 7fbcdaffd640 1 -- 172.21.15.39:0/4024555826 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd40b1400 con 0x7fbcdc0c88b0 2023-05-16T13:54:23.051 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.041+0000 7fbce290a640 1 -- 172.21.15.39:0/4024555826 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbcdc0c88b0 msgr2=0x7fbcdc158f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:23.051 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.041+0000 7fbce290a640 1 --2- 172.21.15.39:0/4024555826 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbcdc0c88b0 0x7fbcdc158f50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbcd400d370 tx=0x7fbcd401ebd0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.051 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.045+0000 7fbce290a640 1 -- 172.21.15.39:0/4024555826 shutdown_connections 2023-05-16T13:54:23.052 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.045+0000 7fbce290a640 1 --2- 172.21.15.39:0/4024555826 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbcdc0c88b0 0x7fbcdc158f50 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.052 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.045+0000 7fbce290a640 1 --2- 172.21.15.39:0/4024555826 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbcdc158050 0x7fbcdc06da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.052 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.045+0000 7fbce290a640 1 -- 172.21.15.39:0/4024555826 >> 172.21.15.39:0/4024555826 conn(0x7fbcdc0cb970 msgr2=0x7fbcdc0ce260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:23.052 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.045+0000 7fbce290a640 1 -- 172.21.15.39:0/4024555826 shutdown_connections 2023-05-16T13:54:23.053 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.045+0000 7fbce290a640 1 -- 172.21.15.39:0/4024555826 wait complete. 2023-05-16T13:54:23.054 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.045+0000 7fbce290a640 1 Processor -- start 2023-05-16T13:54:23.055 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.045+0000 7fbce290a640 1 -- start start 2023-05-16T13:54:23.056 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.049+0000 7fbce290a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbcdc06b7c0 0x7fbcdc14a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:23.057 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.049+0000 7fbce290a640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbcdc0c88b0 0x7fbcdc0b3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:23.057 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.049+0000 7fbce290a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbcdc158050 0x7fbcdc157150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:23.058 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.049+0000 7fbce290a640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcdc156a00 con 0x7fbcdc06b7c0 2023-05-16T13:54:23.058 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.049+0000 7fbce290a640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcdc070760 con 0x7fbcdc158050 2023-05-16T13:54:23.058 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.049+0000 7fbcdb7fe640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbcdc0c88b0 0x7fbcdc0b3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:23.058 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.049+0000 7fbcdb7fe640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbcdc0c88b0 0x7fbcdc0b3840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.39:33574/0 (socket says 172.21.15.39:33574) 2023-05-16T13:54:23.058 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.049+0000 7fbcdb7fe640 1 -- 172.21.15.39:0/611967425 learned_addr learned my addr 172.21.15.39:0/611967425 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:23.058 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.049+0000 7fbce0ea7640 1 --2- 172.21.15.39:0/611967425 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbcdc158050 0x7fbcdc157150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:23.059 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.049+0000 7fbce290a640 1 -- 172.21.15.39:0/611967425 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcdc070f70 con 0x7fbcdc0c88b0 2023-05-16T13:54:23.059 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.049+0000 7fbcdbfff640 1 --2- 172.21.15.39:0/611967425 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbcdc06b7c0 0x7fbcdc14a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:23.059 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.049+0000 7fbce0ea7640 1 -- 172.21.15.39:0/611967425 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbcdc0c88b0 msgr2=0x7fbcdc0b3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:23.060 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.049+0000 7fbce0ea7640 1 --2- 172.21.15.39:0/611967425 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbcdc0c88b0 0x7fbcdc0b3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.060 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.049+0000 7fbce0ea7640 1 -- 172.21.15.39:0/611967425 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbcdc06b7c0 msgr2=0x7fbcdc14a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:23.060 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.049+0000 7fbce0ea7640 1 --2- 172.21.15.39:0/611967425 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbcdc06b7c0 0x7fbcdc14a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.060 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.049+0000 7fbce0ea7640 1 -- 172.21.15.39:0/611967425 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcd400d050 con 0x7fbcdc158050 2023-05-16T13:54:23.060 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.049+0000 7fbcdbfff640 1 --2- 172.21.15.39:0/611967425 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbcdc06b7c0 0x7fbcdc14a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:54:23.060 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.049+0000 7fbce0ea7640 1 --2- 172.21.15.39:0/611967425 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbcdc158050 0x7fbcdc157150 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbccc009d90 tx=0x7fbccc00c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:23.063 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.057+0000 7fbcd8ff9640 1 -- 172.21.15.39:0/611967425 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbccc00ccf0 con 0x7fbcdc158050 2023-05-16T13:54:23.064 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.057+0000 7fbcd8ff9640 1 -- 172.21.15.39:0/611967425 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbccc00ce50 con 0x7fbcdc158050 2023-05-16T13:54:23.064 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.057+0000 7fbce290a640 1 -- 172.21.15.39:0/611967425 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcdc06d4f0 con 0x7fbcdc158050 2023-05-16T13:54:23.065 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.057+0000 7fbcd8ff9640 1 -- 172.21.15.39:0/611967425 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbccc004260 con 0x7fbcdc158050 2023-05-16T13:54:23.065 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.057+0000 7fbce290a640 1 -- 172.21.15.39:0/611967425 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcdc06d210 con 0x7fbcdc158050 2023-05-16T13:54:23.066 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.057+0000 7fbce290a640 1 -- 172.21.15.39:0/611967425 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcdc0ce970 con 0x7fbcdc158050 2023-05-16T13:54:23.067 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.061+0000 7fbcd8ff9640 1 -- 172.21.15.39:0/611967425 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbccc003600 con 0x7fbcdc158050 2023-05-16T13:54:23.069 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.061+0000 7fbcd8ff9640 1 --2- 172.21.15.39:0/611967425 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fbcc4066500 0x7fbcc40689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:23.069 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.061+0000 7fbcd8ff9640 1 -- 172.21.15.39:0/611967425 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbccc0861e0 con 0x7fbcdc158050 2023-05-16T13:54:23.070 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.061+0000 7fbcdbfff640 1 --2- 172.21.15.39:0/611967425 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fbcc4066500 0x7fbcc40689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:23.071 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.061+0000 7fbcdbfff640 1 --2- 172.21.15.39:0/611967425 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fbcc4066500 0x7fbcc40689b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbcd000b9f0 tx=0x7fbcd0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:23.073 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.065+0000 7fbcd8ff9640 1 -- 172.21.15.39:0/611967425 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fbccc0536d0 con 0x7fbcdc158050 2023-05-16T13:54:23.110 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.101+0000 7f6a6fec4640 1 Processor -- start 2023-05-16T13:54:23.111 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.101+0000 7f6a6fec4640 1 -- start start 2023-05-16T13:54:23.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.105+0000 7fd54dcd1640 1 Processor -- start 2023-05-16T13:54:23.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.105+0000 7fd54dcd1640 1 -- start start 2023-05-16T13:54:23.113 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.105+0000 7f6a6fec4640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6a680b7f80 0x7f6a680ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:23.113 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.105+0000 7f6a6fec4640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f6a680ccbd0 0x7f6a680cef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:23.113 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.105+0000 7f43f59f0640 1 Processor -- start 2023-05-16T13:54:23.114 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.105+0000 7f6a6dc60640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6a680b7f80 0x7f6a680ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:23.114 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.105+0000 7f6a6dc60640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6a680b7f80 0x7f6a680ce840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.39:33590/0 (socket says 172.21.15.39:33590) 2023-05-16T13:54:23.114 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.105+0000 7f6a6dc60640 1 -- 172.21.15.39:0/1280980811 learned_addr learned my addr 172.21.15.39:0/1280980811 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:23.115 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.105+0000 7fd54dcd1640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd5480d0860 0x7fd5480cf110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:23.115 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.105+0000 7f6a6d45f640 1 --2- 172.21.15.39:0/1280980811 >> v2:172.21.15.118:3300/0 conn(0x7f6a680ccbd0 0x7f6a680cef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:23.115 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.105+0000 7fd54dcd1640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd54815fb00 0x7fd5480cf650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:23.116 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.105+0000 7fd54dcd1640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd5480b1b00 0x7fd54815c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:23.116 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.105+0000 7fd54dcd1640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5480b4240 con 0x7fd5480b1b00 2023-05-16T13:54:23.116 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.105+0000 7fd54dcd1640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5480b44e0 con 0x7fd54815fb00 2023-05-16T13:54:23.116 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.105+0000 7fd54dcd1640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5480b47c0 con 0x7fd5480d0860 2023-05-16T13:54:23.116 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.105+0000 7f6a6fec4640 1 -- 172.21.15.39:0/1280980811 --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a680cd400 con 0x7f6a680cf480 2023-05-16T13:54:23.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.105+0000 7f6a6fec4640 1 -- 172.21.15.39:0/1280980811 --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a680cf900 con 0x7f6a680ccbd0 2023-05-16T13:54:23.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.105+0000 7fd546ffd640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd54815fb00 0x7fd5480cf650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:23.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.105+0000 7fd546ffd640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd54815fb00 0x7fd5480cf650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.39:34954/0 (socket says 172.21.15.39:34954) 2023-05-16T13:54:23.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.105+0000 7fd546ffd640 1 -- 172.21.15.39:0/2325206673 learned_addr learned my addr 172.21.15.39:0/2325206673 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:23.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.105+0000 7fd5477fe640 1 --2- 172.21.15.39:0/2325206673 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd5480d0860 0x7fd5480cf110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:23.118 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.105+0000 7f6a6fec4640 1 -- 172.21.15.39:0/1280980811 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a680d2590 con 0x7f6a680b7f80 2023-05-16T13:54:23.118 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.105+0000 7fd547fff640 1 --2- 172.21.15.39:0/2325206673 >> v2:172.21.15.39:3300/0 conn(0x7fd5480b1b00 0x7fd54815c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:23.118 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.109+0000 7fd546ffd640 1 -- 172.21.15.39:0/2325206673 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd5480d0860 msgr2=0x7fd5480cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:23.118 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.109+0000 7fd546ffd640 1 --2- 172.21.15.39:0/2325206673 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd5480d0860 0x7fd5480cf110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.109+0000 7fd546ffd640 1 -- 172.21.15.39:0/2325206673 >> v2:172.21.15.39:3300/0 conn(0x7fd5480b1b00 msgr2=0x7fd54815c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:23.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.109+0000 7f6a6cc5e640 1 -- 172.21.15.39:0/1280980811 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2443871476 0 0) 0x7f6a680cd400 con 0x7f6a680cf480 2023-05-16T13:54:23.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.109+0000 7f6a6cc5e640 1 -- 172.21.15.39:0/1280980811 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a54003530 con 0x7f6a680cf480 2023-05-16T13:54:23.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.109+0000 7f6a6dc60640 1 -- 172.21.15.39:0/1280980811 >> v2:172.21.15.118:3300/0 conn(0x7f6a680ccbd0 msgr2=0x7f6a680cef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:23.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.109+0000 7f6a6dc60640 1 --2- 172.21.15.39:0/1280980811 >> v2:172.21.15.118:3300/0 conn(0x7f6a680ccbd0 0x7f6a680cef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.120 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.109+0000 7f6a6dc60640 1 -- 172.21.15.39:0/1280980811 >> v1:172.21.15.118:6789/0 conn(0x7f6a680cf480 legacy=0x7f6a6815f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:23.120 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.109+0000 7f6a6dc60640 1 -- 172.21.15.39:0/1280980811 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a680d3330 con 0x7f6a680b7f80 2023-05-16T13:54:23.120 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.109+0000 7fd546ffd640 1 --2- 172.21.15.39:0/2325206673 >> v2:172.21.15.39:3300/0 conn(0x7fd5480b1b00 0x7fd54815c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.120 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.109+0000 7fd546ffd640 1 -- 172.21.15.39:0/2325206673 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5480b4aa0 con 0x7fd54815fb00 2023-05-16T13:54:23.120 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.109+0000 7fd547fff640 1 --2- 172.21.15.39:0/2325206673 >> v2:172.21.15.39:3300/0 conn(0x7fd5480b1b00 0x7fd54815c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:54:23.121 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.105+0000 7f43f59f0640 1 -- start start 2023-05-16T13:54:23.121 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.109+0000 7f43f59f0640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f43e80e2840 0x7f43e80e6f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:23.121 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.109+0000 7f43f59f0640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f43e8055700 0x7f43e803ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:23.121 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.109+0000 7f43f59f0640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43e80587d0 con 0x7f43e80552d0 2023-05-16T13:54:23.121 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.109+0000 7f43f59f0640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43e8058ab0 con 0x7f43e8055700 2023-05-16T13:54:23.122 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.109+0000 7f43f59f0640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43e8058d90 con 0x7f43e80e2840 2023-05-16T13:54:23.122 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.109+0000 7f43eeffd640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f43e8055700 0x7f43e803ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:23.122 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.109+0000 7f43ee7fc640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f43e80e2840 0x7f43e80e6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:23.122 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.109+0000 7f43eeffd640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f43e8055700 0x7f43e803ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59984/0 (socket says 172.21.15.39:59984) 2023-05-16T13:54:23.122 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.109+0000 7f43eeffd640 1 -- 172.21.15.39:0/2481958270 learned_addr learned my addr 172.21.15.39:0/2481958270 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:23.122 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.109+0000 7f43eeffd640 1 -- 172.21.15.39:0/2481958270 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f43e80e2840 msgr2=0x7f43e80e6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:23.122 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.109+0000 7f43eeffd640 1 --2- 172.21.15.39:0/2481958270 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f43e80e2840 0x7f43e80e6f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.123 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.109+0000 7f43eeffd640 1 -- 172.21.15.39:0/2481958270 >> v1:172.21.15.39:6789/0 conn(0x7f43e80552d0 legacy=0x7f43e803bfe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-05-16T13:54:23.123 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.109+0000 7f43eeffd640 1 -- 172.21.15.39:0/2481958270 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43e8006520 con 0x7f43e8055700 2023-05-16T13:54:23.123 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.109+0000 7f43ee7fc640 1 --2- 172.21.15.39:0/2481958270 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f43e80e2840 0x7f43e80e6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-16T13:54:23.123 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.113+0000 7fd546ffd640 1 --2- 172.21.15.39:0/2325206673 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd54815fb00 0x7fd5480cf650 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd54808b780 tx=0x7fd53c01c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66bd45d80d756a11 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:23.124 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.113+0000 7f6a6dc60640 1 --2- 172.21.15.39:0/1280980811 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6a680b7f80 0x7f6a680ce840 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6a64009870 tx=0x7f6a6401c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab48905324d6ede0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:23.124 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.113+0000 7f6a6cc5e640 1 -- 172.21.15.39:0/1280980811 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a640ac410 con 0x7f6a680b7f80 2023-05-16T13:54:23.124 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.113+0000 7fd5467fc640 1 -- 172.21.15.39:0/2325206673 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53c0aa610 con 0x7fd54815fb00 2023-05-16T13:54:23.124 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.113+0000 7fd5467fc640 1 -- 172.21.15.39:0/2325206673 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd53c0a6040 con 0x7fd54815fb00 2023-05-16T13:54:23.125 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.113+0000 7fd5467fc640 1 -- 172.21.15.39:0/2325206673 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53c0aa990 con 0x7fd54815fb00 2023-05-16T13:54:23.125 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.113+0000 7f6a6cc5e640 1 -- 172.21.15.39:0/1280980811 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a640ac570 con 0x7f6a680b7f80 2023-05-16T13:54:23.125 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.113+0000 7f6a6cc5e640 1 -- 172.21.15.39:0/1280980811 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a640ac900 con 0x7f6a680b7f80 2023-05-16T13:54:23.126 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.113+0000 7f85bbdcb640 1 Processor -- start 2023-05-16T13:54:23.126 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.113+0000 7fd54dcd1640 1 -- 172.21.15.39:0/2325206673 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd54815fb00 msgr2=0x7fd5480cf650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:23.126 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.113+0000 7fd54dcd1640 1 --2- 172.21.15.39:0/2325206673 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd54815fb00 0x7fd5480cf650 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd54808b780 tx=0x7fd53c01c4d0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.127 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.113+0000 7f43eeffd640 1 --2- 172.21.15.39:0/2481958270 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43e8055700 0x7f43e803ac10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f43f004f3a0 tx=0x7f43f0096570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7386c7935d50549 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:23.127 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.113+0000 7f26cc68c640 1 Processor -- start 2023-05-16T13:54:23.127 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.113+0000 7f85bbdcb640 1 -- start start 2023-05-16T13:54:23.128 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.113+0000 7f6a6fec4640 1 -- 172.21.15.39:0/1280980811 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6a680b7f80 msgr2=0x7f6a680ce840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:23.128 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.113+0000 7f6a6fec4640 1 --2- 172.21.15.39:0/1280980811 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6a680b7f80 0x7f6a680ce840 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6a64009870 tx=0x7f6a6401c4d0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.128 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.113+0000 7f6a6fec4640 1 -- 172.21.15.39:0/1280980811 shutdown_connections 2023-05-16T13:54:23.128 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.113+0000 7f6a6fec4640 1 --2- 172.21.15.39:0/1280980811 >> v2:172.21.15.118:3300/0 conn(0x7f6a680ccbd0 0x7f6a680cef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.128 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.113+0000 7f6a6fec4640 1 --2- 172.21.15.39:0/1280980811 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6a680b7f80 0x7f6a680ce840 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.128 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.113+0000 7f6a6fec4640 1 -- 172.21.15.39:0/1280980811 >> 172.21.15.39:0/1280980811 conn(0x7f6a68065860 msgr2=0x7f6a68071180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:23.129 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.113+0000 7f26cc68c640 1 -- start start 2023-05-16T13:54:23.129 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.113+0000 7f6a6fec4640 1 -- 172.21.15.39:0/1280980811 shutdown_connections 2023-05-16T13:54:23.129 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.113+0000 7fd54dcd1640 1 -- 172.21.15.39:0/2325206673 shutdown_connections 2023-05-16T13:54:23.129 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.113+0000 7fd54dcd1640 1 --2- 172.21.15.39:0/2325206673 >> v2:172.21.15.39:3300/0 conn(0x7fd5480b1b00 0x7fd54815c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.130 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.113+0000 7fd54dcd1640 1 --2- 172.21.15.39:0/2325206673 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd54815fb00 0x7fd5480cf650 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.130 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.113+0000 7fd54dcd1640 1 --2- 172.21.15.39:0/2325206673 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd5480d0860 0x7fd5480cf110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.130 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.113+0000 7fd54dcd1640 1 -- 172.21.15.39:0/2325206673 >> 172.21.15.39:0/2325206673 conn(0x7fd54808c0f0 msgr2=0x7fd548071aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:23.130 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.113+0000 7f43effff640 1 -- 172.21.15.39:0/2481958270 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f0125600 con 0x7f43e8055700 2023-05-16T13:54:23.130 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.113+0000 7f43effff640 1 -- 172.21.15.39:0/2481958270 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43f0121050 con 0x7f43e8055700 2023-05-16T13:54:23.131 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.113+0000 7f43effff640 1 -- 172.21.15.39:0/2481958270 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f0125600 con 0x7f43e8055700 2023-05-16T13:54:23.131 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.113+0000 7ffa6e004640 1 Processor -- start 2023-05-16T13:54:23.131 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.113+0000 7ffa6e004640 1 -- start start 2023-05-16T13:54:23.131 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.113+0000 7fd54dcd1640 1 -- 172.21.15.39:0/2325206673 shutdown_connections 2023-05-16T13:54:23.132 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.117+0000 7fd54dcd1640 1 -- 172.21.15.39:0/2325206673 wait complete. 2023-05-16T13:54:23.132 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.117+0000 7fd54dcd1640 1 Processor -- start 2023-05-16T13:54:23.132 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.117+0000 7f43f59f0640 1 -- 172.21.15.39:0/2481958270 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43e8055700 msgr2=0x7f43e803ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:23.132 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.117+0000 7f43f59f0640 1 --2- 172.21.15.39:0/2481958270 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43e8055700 0x7f43e803ac10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f43f004f3a0 tx=0x7f43f0096570 comp rx=0 tx=0).stop 2023-05-16T13:54:23.132 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.117+0000 7f43f59f0640 1 -- 172.21.15.39:0/2481958270 shutdown_connections 2023-05-16T13:54:23.132 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.117+0000 7f43f59f0640 1 --2- 172.21.15.39:0/2481958270 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43e8055700 0x7f43e803ac10 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.133 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.117+0000 7f43f59f0640 1 --2- 172.21.15.39:0/2481958270 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f43e80e2840 0x7f43e80e6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.133 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.117+0000 7f43f59f0640 1 -- 172.21.15.39:0/2481958270 >> 172.21.15.39:0/2481958270 conn(0x7f43e8055c10 msgr2=0x7f43e8056010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:23.133 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.117+0000 7f43f59f0640 1 -- 172.21.15.39:0/2481958270 shutdown_connections 2023-05-16T13:54:23.133 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.117+0000 7ffa6e004640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffa60052820 0x7ffa60052c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:23.133 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.117+0000 7ffa6e004640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7ffa600eae10 0x7ffa600eb270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:23.134 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.113+0000 7f6a6fec4640 1 -- 172.21.15.39:0/1280980811 wait complete. 2023-05-16T13:54:23.134 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.117+0000 7f6a6fec4640 1 Processor -- start 2023-05-16T13:54:23.134 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.117+0000 7f26cc68c640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f26c4158e90 0x7f26c40704b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:23.135 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.117+0000 7f26cc68c640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26c40cb2f0 0x7f26c40c9470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:23.135 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.117+0000 7f26c9c27640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f26c415d2c0 0x7f26c40cabe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.39:41268/0 (socket says 172.21.15.39:41268) 2023-05-16T13:54:23.135 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.117+0000 7f26c9c27640 1 -- 172.21.15.39:0/1248319542 learned_addr learned my addr 172.21.15.39:0/1248319542 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:23.135 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.117+0000 7f26ca428640 1 --2- 172.21.15.39:0/1248319542 >> v2:172.21.15.118:3300/0 conn(0x7f26c4158e90 0x7f26c40704b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:23.135 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.117+0000 7f26cac29640 1 --2- 172.21.15.39:0/1248319542 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26c40cb2f0 0x7f26c40c9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:23.135 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.117+0000 7f26cc68c640 1 -- 172.21.15.39:0/1248319542 --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26c40cda10 con 0x7f26c415d2c0 2023-05-16T13:54:23.135 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.117+0000 7f26cc68c640 1 -- 172.21.15.39:0/1248319542 --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26c4159260 con 0x7f26c4158e90 2023-05-16T13:54:23.136 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.117+0000 7f26cc68c640 1 -- 172.21.15.39:0/1248319542 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26c40709f0 con 0x7f26c40cb2f0 2023-05-16T13:54:23.136 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.117+0000 7f26c9426640 1 -- 172.21.15.39:0/1248319542 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3344024705 0 0) 0x7f26c40cda10 con 0x7f26c415d2c0 2023-05-16T13:54:23.136 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.117+0000 7f6a6fec4640 1 -- start start 2023-05-16T13:54:23.136 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.117+0000 7f6a6fec4640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a680b7f80 0x7f6a681416b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:23.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.117+0000 7f43f59f0640 1 -- 172.21.15.39:0/2481958270 wait complete. 2023-05-16T13:54:23.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.117+0000 7f43f59f0640 1 Processor -- start 2023-05-16T13:54:23.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.117+0000 7ffa6e004640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa600ea980 con 0x7ffa600e6db0 2023-05-16T13:54:23.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.117+0000 7ffa6e004640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa600e7180 con 0x7ffa600eae10 2023-05-16T13:54:23.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.117+0000 7ffa6e004640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa60054a90 con 0x7ffa60052820 2023-05-16T13:54:23.138 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.117+0000 7ffa677fe640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7ffa600e6db0 0x7ffa6004f2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:60782/0 (socket says 172.21.15.39:60782) 2023-05-16T13:54:23.138 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.117+0000 7ffa67fff640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7ffa600eae10 0x7ffa600eb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:23.138 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.117+0000 7ffa677fe640 1 -- 172.21.15.39:0/3336094051 learned_addr learned my addr 172.21.15.39:0/3336094051 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:23.138 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.117+0000 7ffa66ffd640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffa60052820 0x7ffa60052c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:23.138 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.117+0000 7f6a6fec4640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6a680ccbd0 0x7f6a680b1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:23.139 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.117+0000 7f85bbdcb640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f85b40b03f0 0x7f85b4163eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:23.139 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.117+0000 7f85bbdcb640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85b40cb360 con 0x7f85b41603c0 2023-05-16T13:54:23.139 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.117+0000 7f85bbdcb640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85b4160790 con 0x7f85b40cb7f0 2023-05-16T13:54:23.139 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.117+0000 7f85bbdcb640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85b40cdfe0 con 0x7f85b40b03f0 2023-05-16T13:54:23.139 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.117+0000 7f85b9b67640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f85b41603c0 0x7f85b40cd8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:60768/0 (socket says 172.21.15.39:60768) 2023-05-16T13:54:23.139 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.117+0000 7f85b9b67640 1 -- 172.21.15.39:0/1470004299 learned_addr learned my addr 172.21.15.39:0/1470004299 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:23.140 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.117+0000 7f85ba368640 1 --2- 172.21.15.39:0/1470004299 >> v2:172.21.15.118:3300/0 conn(0x7f85b40b03f0 0x7f85b4163eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:23.140 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.117+0000 7f85b8b65640 1 -- 172.21.15.39:0/1470004299 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2164689455 0 0) 0x7f85b40cb360 con 0x7f85b41603c0 2023-05-16T13:54:23.140 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.117+0000 7f85b8b65640 1 -- 172.21.15.39:0/1470004299 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85a0003530 con 0x7f85b41603c0 2023-05-16T13:54:23.140 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.117+0000 7f85ba368640 1 -- 172.21.15.39:0/1470004299 >> v1:172.21.15.118:6789/0 conn(0x7f85b40cb7f0 legacy=0x7f85b40afce0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-05-16T13:54:23.140 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.117+0000 7f85ba368640 1 -- 172.21.15.39:0/1470004299 >> v1:172.21.15.39:6789/0 conn(0x7f85b41603c0 legacy=0x7f85b40cd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:23.140 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.117+0000 7f85ba368640 1 -- 172.21.15.39:0/1470004299 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85b40c1820 con 0x7f85b40b03f0 2023-05-16T13:54:23.141 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.121+0000 7f6a6fec4640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a680cf480 0x7f6a680b2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:23.141 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.121+0000 7f6a6fec4640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a680c8be0 con 0x7f6a680b7f80 2023-05-16T13:54:23.141 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.121+0000 7f6a6fec4640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a680b57c0 con 0x7f6a680cf480 2023-05-16T13:54:23.141 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.121+0000 7f6a6dc60640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a680b7f80 0x7f6a681416b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:23.141 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.121+0000 7f6a6dc60640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a680b7f80 0x7f6a681416b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59994/0 (socket says 172.21.15.39:59994) 2023-05-16T13:54:23.141 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.121+0000 7f6a6dc60640 1 -- 172.21.15.39:0/1858124718 learned_addr learned my addr 172.21.15.39:0/1858124718 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:23.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.117+0000 7fd54dcd1640 1 -- start start 2023-05-16T13:54:23.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.121+0000 7fd54dcd1640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd5480b1b00 0x7fd5481564d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:23.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.121+0000 7f6a6d45f640 1 --2- 172.21.15.39:0/1858124718 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6a680ccbd0 0x7f6a680b1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:23.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.121+0000 7f6a6e461640 1 --2- 172.21.15.39:0/1858124718 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a680cf480 0x7f6a680b2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:23.143 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.121+0000 7fd54dcd1640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd5480d0860 0x7fd5480afc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:23.143 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.121+0000 7f6a6fec4640 1 -- 172.21.15.39:0/1858124718 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a68155ae0 con 0x7f6a680ccbd0 2023-05-16T13:54:23.144 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.121+0000 7ffa67fff640 1 -- 172.21.15.39:0/3336094051 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffa60052820 msgr2=0x7ffa60052c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:23.144 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.121+0000 7ffa67fff640 1 --2- 172.21.15.39:0/3336094051 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffa60052820 0x7ffa60052c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.144 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.121+0000 7ffa67fff640 1 -- 172.21.15.39:0/3336094051 >> v1:172.21.15.39:6789/0 conn(0x7ffa600e6db0 legacy=0x7ffa6004f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:23.144 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.121+0000 7ffa67fff640 1 -- 172.21.15.39:0/3336094051 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa600541f0 con 0x7ffa600eae10 2023-05-16T13:54:23.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.121+0000 7fd5477fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd5480b1b00 0x7fd5481564d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:23.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.121+0000 7fd5477fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd5480b1b00 0x7fd5481564d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.39:34994/0 (socket says 172.21.15.39:34994) 2023-05-16T13:54:23.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.121+0000 7fd5477fe640 1 -- 172.21.15.39:0/1118874747 learned_addr learned my addr 172.21.15.39:0/1118874747 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:23.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.121+0000 7fd546ffd640 1 --2- 172.21.15.39:0/1118874747 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd5480d0860 0x7fd5480afc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:23.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.121+0000 7fd54dcd1640 1 --2- 172.21.15.39:0/1118874747 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd54815fb00 0x7fd548204d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:23.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.121+0000 7fd54dcd1640 1 -- 172.21.15.39:0/1118874747 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5480b0150 con 0x7fd54815fb00 2023-05-16T13:54:23.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.121+0000 7fd54dcd1640 1 -- 172.21.15.39:0/1118874747 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd548156b90 con 0x7fd5480b1b00 2023-05-16T13:54:23.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.121+0000 7fd54dcd1640 1 -- 172.21.15.39:0/1118874747 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd548156e70 con 0x7fd5480d0860 2023-05-16T13:54:23.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.121+0000 7fd547fff640 1 --2- 172.21.15.39:0/1118874747 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd54815fb00 0x7fd548204d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:23.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.121+0000 7fd5477fe640 1 -- 172.21.15.39:0/1118874747 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd5480d0860 msgr2=0x7fd5480afc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:23.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.121+0000 7fd5477fe640 1 --2- 172.21.15.39:0/1118874747 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd5480d0860 0x7fd5480afc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.121+0000 7fd5477fe640 1 -- 172.21.15.39:0/1118874747 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd54815fb00 msgr2=0x7fd548204d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:23.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.121+0000 7fd5477fe640 1 --2- 172.21.15.39:0/1118874747 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd54815fb00 0x7fd548204d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.121+0000 7fd5477fe640 1 -- 172.21.15.39:0/1118874747 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd53c0094d0 con 0x7fd5480b1b00 2023-05-16T13:54:23.147 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.121+0000 7f43f59f0640 1 -- start start 2023-05-16T13:54:23.147 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.121+0000 7f43f59f0640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f43e80552d0 0x7f43e80d5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:23.147 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.121+0000 7f43f59f0640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43e8055700 0x7f43e80da560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:23.147 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.121+0000 7f43ee7fc640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f43e80552d0 0x7f43e80d5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:23.147 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.121+0000 7f43ee7fc640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f43e80552d0 0x7f43e80d5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.39:33638/0 (socket says 172.21.15.39:33638) 2023-05-16T13:54:23.147 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.121+0000 7f43ee7fc640 1 -- 172.21.15.39:0/4222637322 learned_addr learned my addr 172.21.15.39:0/4222637322 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:23.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.121+0000 7f43edffb640 1 --2- 172.21.15.39:0/4222637322 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43e8055700 0x7f43e80da560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:23.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.121+0000 7f43f59f0640 1 --2- 172.21.15.39:0/4222637322 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43e80e2840 0x7f43e80d4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:23.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.121+0000 7f6a6d45f640 1 -- 172.21.15.39:0/1858124718 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a680cf480 msgr2=0x7f6a680b2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:23.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.121+0000 7f6a6d45f640 1 --2- 172.21.15.39:0/1858124718 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a680cf480 0x7f6a680b2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.121+0000 7f6a6d45f640 1 -- 172.21.15.39:0/1858124718 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a680b7f80 msgr2=0x7f6a681416b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:23.149 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.121+0000 7f6a6d45f640 1 --2- 172.21.15.39:0/1858124718 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a680b7f80 0x7f6a681416b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.149 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.121+0000 7f6a6d45f640 1 -- 172.21.15.39:0/1858124718 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a640094d0 con 0x7f6a680ccbd0 2023-05-16T13:54:23.149 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.121+0000 7f6a6dc60640 1 --2- 172.21.15.39:0/1858124718 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a680b7f80 0x7f6a681416b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-16T13:54:23.149 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.121+0000 7f6a6d45f640 1 --2- 172.21.15.39:0/1858124718 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6a680ccbd0 0x7f6a680b1fe0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6a5800e8a0 tx=0x7f6a5800ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:23.149 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.121+0000 7f6a5e7fc640 1 -- 172.21.15.39:0/1858124718 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a58009e80 con 0x7f6a680ccbd0 2023-05-16T13:54:23.149 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.121+0000 7f6a5e7fc640 1 -- 172.21.15.39:0/1858124718 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a5800c940 con 0x7f6a680ccbd0 2023-05-16T13:54:23.149 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.121+0000 7f6a5e7fc640 1 -- 172.21.15.39:0/1858124718 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5800ccb0 con 0x7f6a680ccbd0 2023-05-16T13:54:23.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.121+0000 7fd5477fe640 1 --2- 172.21.15.39:0/1118874747 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd5480b1b00 0x7fd5481564d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd54000efc0 tx=0x7fd54000c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:23.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.121+0000 7f26ca428640 1 -- 172.21.15.39:0/1248319542 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26c40cb2f0 msgr2=0x7f26c40c9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:23.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.121+0000 7f26ca428640 1 --2- 172.21.15.39:0/1248319542 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26c40cb2f0 0x7f26c40c9470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.121+0000 7f26ca428640 1 -- 172.21.15.39:0/1248319542 >> v1:172.21.15.118:6789/0 conn(0x7f26c415d2c0 legacy=0x7f26c40cabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:23.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.121+0000 7f26ca428640 1 -- 172.21.15.39:0/1248319542 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26c40cce90 con 0x7f26c4158e90 2023-05-16T13:54:23.151 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.125+0000 7f6a6fec4640 1 -- 172.21.15.39:0/1858124718 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a680d1160 con 0x7f6a680ccbd0 2023-05-16T13:54:23.151 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.125+0000 7fd52ffff640 1 -- 172.21.15.39:0/1118874747 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd540014480 con 0x7fd5480b1b00 2023-05-16T13:54:23.151 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.125+0000 7fd54dcd1640 1 -- 172.21.15.39:0/1118874747 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5480b3f70 con 0x7fd5480b1b00 2023-05-16T13:54:23.152 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.125+0000 7f43f59f0640 1 -- 172.21.15.39:0/4222637322 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e80daaa0 con 0x7f43e80e2840 2023-05-16T13:54:23.152 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.125+0000 7f43f59f0640 1 -- 172.21.15.39:0/4222637322 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e80e44e0 con 0x7f43e8055700 2023-05-16T13:54:23.152 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.125+0000 7f43f59f0640 1 -- 172.21.15.39:0/4222637322 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43e8180be0 con 0x7f43e80552d0 2023-05-16T13:54:23.152 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.125+0000 7f43eeffd640 1 --2- 172.21.15.39:0/4222637322 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43e80e2840 0x7f43e80d4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:23.152 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.125+0000 7f26cac29640 1 --2- 172.21.15.39:0/1248319542 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26c40cb2f0 0x7f26c40c9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-16T13:54:23.153 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.125+0000 7f85ba368640 1 --2- 172.21.15.39:0/1470004299 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85b40b03f0 0x7f85b4163eb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f85ac009d90 tx=0x7f85ac01f100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f159c588b411e44 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:23.153 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.125+0000 7fd54dcd1640 1 -- 172.21.15.39:0/1118874747 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5480b3de0 con 0x7fd5480b1b00 2023-05-16T13:54:23.153 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.125+0000 7fd52ffff640 1 -- 172.21.15.39:0/1118874747 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd54000f040 con 0x7fd5480b1b00 2023-05-16T13:54:23.153 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.125+0000 7fd52ffff640 1 -- 172.21.15.39:0/1118874747 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5400147e0 con 0x7fd5480b1b00 2023-05-16T13:54:23.154 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.125+0000 7f6a6fec4640 1 -- 172.21.15.39:0/1858124718 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a680d2e10 con 0x7f6a680ccbd0 2023-05-16T13:54:23.154 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.125+0000 7f85b8b65640 1 -- 172.21.15.39:0/1470004299 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85ac0af600 con 0x7f85b40b03f0 2023-05-16T13:54:23.154 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.125+0000 7f85b8b65640 1 -- 172.21.15.39:0/1470004299 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85ac0ab050 con 0x7f85b40b03f0 2023-05-16T13:54:23.154 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.125+0000 7f85b8b65640 1 -- 172.21.15.39:0/1470004299 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85ac0af600 con 0x7f85b40b03f0 2023-05-16T13:54:23.155 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.125+0000 7ffa67fff640 1 --2- 172.21.15.39:0/3336094051 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffa600eae10 0x7ffa600eb270 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ffa540097c0 tx=0x7ffa5401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91bf7fdf9fccb626 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:23.155 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.125+0000 7f85bbdcb640 1 -- 172.21.15.39:0/1470004299 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85b40b03f0 msgr2=0x7f85b4163eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:23.155 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.125+0000 7f85bbdcb640 1 --2- 172.21.15.39:0/1470004299 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85b40b03f0 0x7f85b4163eb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f85ac009d90 tx=0x7f85ac01f100 comp rx=0 tx=0).stop 2023-05-16T13:54:23.156 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.125+0000 7f43edffb640 1 -- 172.21.15.39:0/4222637322 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f43e80552d0 msgr2=0x7f43e80d5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:23.156 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.125+0000 7f43edffb640 1 --2- 172.21.15.39:0/4222637322 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f43e80552d0 0x7f43e80d5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.156 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.125+0000 7f43edffb640 1 -- 172.21.15.39:0/4222637322 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43e80e2840 msgr2=0x7f43e80d4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:23.156 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.125+0000 7f43edffb640 1 --2- 172.21.15.39:0/4222637322 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43e80e2840 0x7f43e80d4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.156 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.125+0000 7f43edffb640 1 -- 172.21.15.39:0/4222637322 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43e0009420 con 0x7f43e8055700 2023-05-16T13:54:23.156 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.125+0000 7f43edffb640 1 --2- 172.21.15.39:0/4222637322 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43e8055700 0x7f43e80da560 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f43e400c400 tx=0x7f43e400c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:23.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.125+0000 7f85bbdcb640 1 -- 172.21.15.39:0/1470004299 shutdown_connections 2023-05-16T13:54:23.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.125+0000 7f85bbdcb640 1 --2- 172.21.15.39:0/1470004299 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85b40b03f0 0x7f85b4163eb0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.125+0000 7f85bbdcb640 1 -- 172.21.15.39:0/1470004299 >> 172.21.15.39:0/1470004299 conn(0x7f85b4069a50 msgr2=0x7f85b4069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:23.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.125+0000 7f6a6fec4640 1 -- 172.21.15.39:0/1858124718 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a680ccfa0 con 0x7f6a680ccbd0 2023-05-16T13:54:23.158 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.125+0000 7f85bbdcb640 1 -- 172.21.15.39:0/1470004299 shutdown_connections 2023-05-16T13:54:23.158 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.125+0000 7f85bbdcb640 1 -- 172.21.15.39:0/1470004299 wait complete. 2023-05-16T13:54:23.158 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.125+0000 7f43d7fff640 1 -- 172.21.15.39:0/4222637322 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e40052d0 con 0x7f43e8055700 2023-05-16T13:54:23.158 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.125+0000 7f43d7fff640 1 -- 172.21.15.39:0/4222637322 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43e4005430 con 0x7f43e8055700 2023-05-16T13:54:23.158 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.125+0000 7f43d7fff640 1 -- 172.21.15.39:0/4222637322 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e4003800 con 0x7f43e8055700 2023-05-16T13:54:23.159 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.125+0000 7f43f59f0640 1 -- 172.21.15.39:0/4222637322 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43e80ed880 con 0x7f43e8055700 2023-05-16T13:54:23.159 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.125+0000 7f43f59f0640 1 -- 172.21.15.39:0/4222637322 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43e80ed6f0 con 0x7f43e8055700 2023-05-16T13:54:23.159 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.129+0000 7f26ca428640 1 --2- 172.21.15.39:0/1248319542 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26c4158e90 0x7f26c40704b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f26c0009d90 tx=0x7f26c001eae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8b01c5c216ea4f0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:23.159 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.125+0000 7fd54dcd1640 1 -- 172.21.15.39:0/1118874747 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd528005260 con 0x7fd5480b1b00 2023-05-16T13:54:23.160 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.129+0000 7ffa667fc640 1 -- 172.21.15.39:0/3336094051 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa540ab600 con 0x7ffa600eae10 2023-05-16T13:54:23.160 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.129+0000 7ffa667fc640 1 -- 172.21.15.39:0/3336094051 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa540a7050 con 0x7ffa600eae10 2023-05-16T13:54:23.160 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.129+0000 7ffa667fc640 1 -- 172.21.15.39:0/3336094051 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa540ab980 con 0x7ffa600eae10 2023-05-16T13:54:23.160 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.129+0000 7fd52ffff640 1 -- 172.21.15.39:0/1118874747 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd540006d50 con 0x7fd5480b1b00 2023-05-16T13:54:23.161 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.129+0000 7f6a5e7fc640 1 -- 172.21.15.39:0/1858124718 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6a580059a0 con 0x7f6a680ccbd0 2023-05-16T13:54:23.161 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.129+0000 7ffa6e004640 1 -- 172.21.15.39:0/3336094051 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffa600eae10 msgr2=0x7ffa600eb270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:23.161 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.129+0000 7ffa6e004640 1 --2- 172.21.15.39:0/3336094051 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffa600eae10 0x7ffa600eb270 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ffa540097c0 tx=0x7ffa5401c3f0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.161 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.129+0000 7f85bbdcb640 1 Processor -- start 2023-05-16T13:54:23.162 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.129+0000 7ffa6e004640 1 -- 172.21.15.39:0/3336094051 shutdown_connections 2023-05-16T13:54:23.162 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.129+0000 7f43f59f0640 1 -- 172.21.15.39:0/4222637322 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43e80eda10 con 0x7f43e8055700 2023-05-16T13:54:23.162 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.129+0000 7ffa6e004640 1 --2- 172.21.15.39:0/3336094051 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffa600eae10 0x7ffa600eb270 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.129+0000 7ffa6e004640 1 --2- 172.21.15.39:0/3336094051 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffa60052820 0x7ffa60052c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.129+0000 7ffa6e004640 1 -- 172.21.15.39:0/3336094051 >> 172.21.15.39:0/3336094051 conn(0x7ffa600516d0 msgr2=0x7ffa60051ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:23.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.129+0000 7f78fd10b640 1 Processor -- start 2023-05-16T13:54:23.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.129+0000 7ffa6e004640 1 -- 172.21.15.39:0/3336094051 shutdown_connections 2023-05-16T13:54:23.164 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.129+0000 7f78fd10b640 1 -- start start 2023-05-16T13:54:23.164 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.129+0000 7fd52ffff640 1 --2- 172.21.15.39:0/1118874747 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd5340662b0 0x7fd534068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:23.164 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.129+0000 7f85bbdcb640 1 -- start start 2023-05-16T13:54:23.165 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.129+0000 7fd52ffff640 1 -- 172.21.15.39:0/1118874747 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd540084f10 con 0x7fd5480b1b00 2023-05-16T13:54:23.165 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.129+0000 7ffa6e004640 1 -- 172.21.15.39:0/3336094051 wait complete. 2023-05-16T13:54:23.165 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.129+0000 7fd546ffd640 1 --2- 172.21.15.39:0/1118874747 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd5340662b0 0x7fd534068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:23.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.129+0000 7f6a5e7fc640 1 --2- 172.21.15.39:0/1858124718 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f6a4c066350 0x7f6a4c068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:23.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.129+0000 7f26c9426640 1 -- 172.21.15.39:0/1248319542 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c00a7b70 con 0x7f26c4158e90 2023-05-16T13:54:23.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.133+0000 7f78fd10b640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f78f806d700 0x7f78f80afcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:23.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.133+0000 7f6a5e7fc640 1 -- 172.21.15.39:0/1858124718 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6a58083870 con 0x7f6a680ccbd0 2023-05-16T13:54:23.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.133+0000 7f6a6dc60640 1 --2- 172.21.15.39:0/1858124718 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f6a4c066350 0x7f6a4c068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:23.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.133+0000 7f78f7fff640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f78f806d700 0x7f78f80afcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:23.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.133+0000 7f78f7fff640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f78f806d700 0x7f78f80afcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.39:35012/0 (socket says 172.21.15.39:35012) 2023-05-16T13:54:23.168 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.133+0000 7f85bbdcb640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85b40b03f0 0x7f85b41f5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:23.168 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.133+0000 7f26c9426640 1 -- 172.21.15.39:0/1248319542 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26c00a7cd0 con 0x7f26c4158e90 2023-05-16T13:54:23.168 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.133+0000 7f26c9426640 1 -- 172.21.15.39:0/1248319542 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c00af660 con 0x7f26c4158e90 2023-05-16T13:54:23.169 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.133+0000 7f78f77fe640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f78f80cb490 0x7f78f806bae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.39:41278/0 (socket says 172.21.15.39:41278) 2023-05-16T13:54:23.169 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.133+0000 7f78f7fff640 1 -- 172.21.15.39:0/2759718821 learned_addr learned my addr 172.21.15.39:0/2759718821 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:23.169 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.133+0000 7ffa6e004640 1 Processor -- start 2023-05-16T13:54:23.169 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.133+0000 7f85bbdcb640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f85b40cb7f0 0x7f85b41f9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:23.170 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.133+0000 7f78fd10b640 1 --2- 172.21.15.39:0/2759718821 >> v2:172.21.15.39:3300/0 conn(0x7f78f80ad7d0 0x7f78f80cd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:23.170 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.133+0000 7f85bbdcb640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85b41603c0 0x7f85b4162a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:23.170 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.133+0000 7fd546ffd640 1 --2- 172.21.15.39:0/1118874747 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd5340662b0 0x7fd534068760 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd53c0ae000 tx=0x7fd53c0b5040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:23.171 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.133+0000 7fd52ffff640 1 -- 172.21.15.39:0/1118874747 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fd540052370 con 0x7fd5480b1b00 2023-05-16T13:54:23.171 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.133+0000 7f85b9b67640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85b40b03f0 0x7f85b41f5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:23.171 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.133+0000 7f85b9b67640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85b40b03f0 0x7f85b41f5720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60020/0 (socket says 172.21.15.39:60020) 2023-05-16T13:54:23.171 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.133+0000 7f6a6dc60640 1 --2- 172.21.15.39:0/1858124718 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f6a4c066350 0x7f6a4c068800 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6a64009870 tx=0x7f6a64008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:23.172 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.133+0000 7f85b9366640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f85b40cb7f0 0x7f85b41f9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:23.172 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.133+0000 7f85b9366640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f85b40cb7f0 0x7f85b41f9cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.39:33642/0 (socket says 172.21.15.39:33642) 2023-05-16T13:54:23.172 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.133+0000 7f85b9b67640 1 -- 172.21.15.39:0/3617955277 learned_addr learned my addr 172.21.15.39:0/3617955277 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:23.172 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.133+0000 7f78fc90a640 1 --2- 172.21.15.39:0/2759718821 >> v2:172.21.15.39:3300/0 conn(0x7f78f80ad7d0 0x7f78f80cd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:23.173 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.133+0000 7f85bbdcb640 1 -- 172.21.15.39:0/3617955277 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85b4161280 con 0x7f85b40b03f0 2023-05-16T13:54:23.173 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.133+0000 7f85bbdcb640 1 -- 172.21.15.39:0/3617955277 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85b40c4580 con 0x7f85b41603c0 2023-05-16T13:54:23.173 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.133+0000 7f85bbdcb640 1 -- 172.21.15.39:0/3617955277 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85b41fa230 con 0x7f85b40cb7f0 2023-05-16T13:54:23.174 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.133+0000 7f78fd10b640 1 -- 172.21.15.39:0/2759718821 --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78f80b21c0 con 0x7f78f80cb490 2023-05-16T13:54:23.174 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.133+0000 7f78fd10b640 1 -- 172.21.15.39:0/2759718821 --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78f809bc90 con 0x7f78f80ad7d0 2023-05-16T13:54:23.174 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.133+0000 7f78fd10b640 1 -- 172.21.15.39:0/2759718821 --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78f809bf50 con 0x7f78f806d700 2023-05-16T13:54:23.174 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.133+0000 7f85ba368640 1 --2- 172.21.15.39:0/3617955277 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85b41603c0 0x7f85b4162a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:23.174 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.133+0000 7f26cc68c640 1 -- 172.21.15.39:0/1248319542 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26c4158e90 msgr2=0x7f26c40704b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:23.175 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.133+0000 7f26cc68c640 1 --2- 172.21.15.39:0/1248319542 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26c4158e90 0x7f26c40704b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f26c0009d90 tx=0x7f26c001eae0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.175 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.133+0000 7f85b9b67640 1 -- 172.21.15.39:0/3617955277 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f85b40cb7f0 msgr2=0x7f85b41f9cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:23.175 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.133+0000 7f85b9b67640 1 --2- 172.21.15.39:0/3617955277 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f85b40cb7f0 0x7f85b41f9cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.175 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.133+0000 7f85b9b67640 1 -- 172.21.15.39:0/3617955277 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85b41603c0 msgr2=0x7f85b4162a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:23.176 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.133+0000 7f85b9b67640 1 --2- 172.21.15.39:0/3617955277 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85b41603c0 0x7f85b4162a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.176 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.133+0000 7f85b9b67640 1 -- 172.21.15.39:0/3617955277 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85ac009a70 con 0x7f85b40b03f0 2023-05-16T13:54:23.176 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.133+0000 7f85ba368640 1 --2- 172.21.15.39:0/3617955277 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85b41603c0 0x7f85b4162a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-16T13:54:23.176 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.133+0000 7f78f7fff640 1 -- 172.21.15.39:0/2759718821 >> v2:172.21.15.39:3300/0 conn(0x7f78f80ad7d0 msgr2=0x7f78f80cd9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:23.176 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.133+0000 7ffa6e004640 1 -- start start 2023-05-16T13:54:23.177 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.133+0000 7f6a5e7fc640 1 -- 172.21.15.39:0/1858124718 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f6a58050d80 con 0x7f6a680ccbd0 2023-05-16T13:54:23.177 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.133+0000 7f26cc68c640 1 -- 172.21.15.39:0/1248319542 shutdown_connections 2023-05-16T13:54:23.177 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.133+0000 7f26cc68c640 1 --2- 172.21.15.39:0/1248319542 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26c40cb2f0 0x7f26c40c9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.177 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.133+0000 7f26cc68c640 1 --2- 172.21.15.39:0/1248319542 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26c4158e90 0x7f26c40704b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.178 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.133+0000 7f26cc68c640 1 -- 172.21.15.39:0/1248319542 >> 172.21.15.39:0/1248319542 conn(0x7f26c4069a50 msgr2=0x7f26c4069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:23.178 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.133+0000 7f43d7fff640 1 -- 172.21.15.39:0/4222637322 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f43e4003960 con 0x7f43e8055700 2023-05-16T13:54:23.178 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.133+0000 7f26cc68c640 1 -- 172.21.15.39:0/1248319542 shutdown_connections 2023-05-16T13:54:23.179 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.133+0000 7f78f7fff640 1 --2- 172.21.15.39:0/2759718821 >> v2:172.21.15.39:3300/0 conn(0x7f78f80ad7d0 0x7f78f80cd9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.179 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.133+0000 7f78f7fff640 1 -- 172.21.15.39:0/2759718821 >> v1:172.21.15.118:6789/0 conn(0x7f78f80cb490 legacy=0x7f78f806bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:23.179 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.133+0000 7f78f7fff640 1 -- 172.21.15.39:0/2759718821 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78f80b1b70 con 0x7f78f806d700 2023-05-16T13:54:23.179 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.133+0000 7f78fc90a640 1 --2- 172.21.15.39:0/2759718821 >> v2:172.21.15.39:3300/0 conn(0x7f78f80ad7d0 0x7f78f80cd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:54:23.179 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.137+0000 7f43d7fff640 1 --2- 172.21.15.39:0/4222637322 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f43dc066350 0x7f43dc068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:23.180 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.137+0000 7f43d7fff640 1 -- 172.21.15.39:0/4222637322 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f43e4083a20 con 0x7f43e8055700 2023-05-16T13:54:23.180 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.137+0000 7ffa6e004640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffa60052820 0x7ffa600d9f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:23.180 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.137+0000 7ffa6e004640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa600e6db0 0x7ffa600da7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:23.180 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.137+0000 7ffa6e004640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffa600eae10 0x7ffa600dacf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:23.181 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.137+0000 7f43ee7fc640 1 --2- 172.21.15.39:0/4222637322 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f43dc066350 0x7f43dc068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:23.181 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.137+0000 7ffa66ffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa600e6db0 0x7ffa600da7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:23.181 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.137+0000 7ffa66ffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa600e6db0 0x7ffa600da7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.39:35028/0 (socket says 172.21.15.39:35028) 2023-05-16T13:54:23.181 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.137+0000 7ffa66ffd640 1 -- 172.21.15.39:0/3795844781 learned_addr learned my addr 172.21.15.39:0/3795844781 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:23.182 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.133+0000 7f26cc68c640 1 -- 172.21.15.39:0/1248319542 wait complete. 2023-05-16T13:54:23.182 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.137+0000 7f26cc68c640 1 Processor -- start 2023-05-16T13:54:23.182 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.137+0000 7ffa6e004640 1 -- 172.21.15.39:0/3795844781 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa600e57e0 con 0x7ffa60052820 2023-05-16T13:54:23.183 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.137+0000 7ffa6e004640 1 -- 172.21.15.39:0/3795844781 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa600dbad0 con 0x7ffa600e6db0 2023-05-16T13:54:23.183 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.137+0000 7ffa6e004640 1 -- 172.21.15.39:0/3795844781 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa600e5a80 con 0x7ffa600eae10 2023-05-16T13:54:23.183 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.137+0000 7ffa67fff640 1 --2- 172.21.15.39:0/3795844781 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffa600eae10 0x7ffa600dacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:23.183 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.137+0000 7ffa677fe640 1 --2- 172.21.15.39:0/3795844781 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffa60052820 0x7ffa600d9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:23.183 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.137+0000 7f85b9b67640 1 --2- 172.21.15.39:0/3617955277 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85b40b03f0 0x7f85b41f5720 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f85b000c4d0 tx=0x7f85b000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:23.184 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.137+0000 7f43ee7fc640 1 --2- 172.21.15.39:0/4222637322 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f43dc066350 0x7f43dc068800 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f43e0009d50 tx=0x7f43e0009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:23.184 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.137+0000 7f43d7fff640 1 -- 172.21.15.39:0/4222637322 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f43e4050f30 con 0x7f43e8055700 2023-05-16T13:54:23.184 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.137+0000 7ffa67fff640 1 -- 172.21.15.39:0/3795844781 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa600e6db0 msgr2=0x7ffa600da7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:23.185 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.137+0000 7ffa67fff640 1 --2- 172.21.15.39:0/3795844781 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa600e6db0 0x7ffa600da7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.185 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.137+0000 7ffa67fff640 1 -- 172.21.15.39:0/3795844781 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffa60052820 msgr2=0x7ffa600d9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:23.185 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.137+0000 7ffa67fff640 1 --2- 172.21.15.39:0/3795844781 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffa60052820 0x7ffa600d9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.185 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.137+0000 7ffa67fff640 1 -- 172.21.15.39:0/3795844781 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa54009420 con 0x7ffa600eae10 2023-05-16T13:54:23.185 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.137+0000 7ffa67fff640 1 --2- 172.21.15.39:0/3795844781 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffa600eae10 0x7ffa600dacf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ffa540ab000 tx=0x7ffa54019190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:23.186 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.141+0000 7f78f7fff640 1 --2- 172.21.15.39:0/2759718821 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78f806d700 0x7f78f80afcf0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f78f80681b0 tx=0x7f78e801de00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9b73969f15ba8ec server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:23.186 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.141+0000 7f78f6ffd640 1 -- 172.21.15.39:0/2759718821 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e800a0d0 con 0x7f78f806d700 2023-05-16T13:54:23.186 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.141+0000 7f78f6ffd640 1 -- 172.21.15.39:0/2759718821 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78e800a230 con 0x7f78f806d700 2023-05-16T13:54:23.186 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.141+0000 7f78f6ffd640 1 -- 172.21.15.39:0/2759718821 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e800a5c0 con 0x7f78f806d700 2023-05-16T13:54:23.186 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.137+0000 7f85aa7fc640 1 -- 172.21.15.39:0/3617955277 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b0005cf0 con 0x7f85b40b03f0 2023-05-16T13:54:23.187 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.137+0000 7f85aa7fc640 1 -- 172.21.15.39:0/3617955277 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b0005e50 con 0x7f85b40b03f0 2023-05-16T13:54:23.187 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.137+0000 7f85aa7fc640 1 -- 172.21.15.39:0/3617955277 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b0007270 con 0x7f85b40b03f0 2023-05-16T13:54:23.187 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.137+0000 7f26cc68c640 1 -- start start 2023-05-16T13:54:23.187 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.141+0000 7ffa66ffd640 1 --2- 172.21.15.39:0/3795844781 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa600e6db0 0x7ffa600da7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-16T13:54:23.188 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.141+0000 7f85bbdcb640 1 -- 172.21.15.39:0/3617955277 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85b40cad10 con 0x7f85b40b03f0 2023-05-16T13:54:23.188 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.141+0000 7f26cc68c640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26c40cb2f0 0x7f26c41476a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:23.188 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.141+0000 7f26cc68c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26c4158e90 0x7f26c415b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:23.188 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.141+0000 7f26cc68c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f26c415d2c0 0x7f26c415ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:23.189 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.141+0000 7f26ca428640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26c40cb2f0 0x7f26c41476a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:23.189 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.141+0000 7f26ca428640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26c40cb2f0 0x7f26c41476a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.39:33654/0 (socket says 172.21.15.39:33654) 2023-05-16T13:54:23.189 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.141+0000 7f26ca428640 1 -- 172.21.15.39:0/3057174413 learned_addr learned my addr 172.21.15.39:0/3057174413 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:23.189 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.141+0000 7f26cc68c640 1 -- 172.21.15.39:0/3057174413 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26c414b030 con 0x7f26c415d2c0 2023-05-16T13:54:23.189 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.141+0000 7f26cc68c640 1 -- 172.21.15.39:0/3057174413 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26c4147be0 con 0x7f26c4158e90 2023-05-16T13:54:23.189 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.141+0000 7f26cc68c640 1 -- 172.21.15.39:0/3057174413 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26c4149f00 con 0x7f26c40cb2f0 2023-05-16T13:54:23.189 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.141+0000 7f26ca428640 1 -- 172.21.15.39:0/3057174413 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26c4158e90 msgr2=0x7f26c415b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:23.189 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.141+0000 7f26c9c27640 1 --2- 172.21.15.39:0/3057174413 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26c4158e90 0x7f26c415b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:23.190 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.141+0000 7f26ca428640 1 --2- 172.21.15.39:0/3057174413 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26c4158e90 0x7f26c415b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.190 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.141+0000 7f26ca428640 1 -- 172.21.15.39:0/3057174413 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f26c415d2c0 msgr2=0x7f26c415ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:23.190 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.141+0000 7f26ca428640 1 --2- 172.21.15.39:0/3057174413 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f26c415d2c0 0x7f26c415ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.190 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.141+0000 7f26ca428640 1 -- 172.21.15.39:0/3057174413 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26c0009a70 con 0x7f26c40cb2f0 2023-05-16T13:54:23.190 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.141+0000 7f26ca428640 1 --2- 172.21.15.39:0/3057174413 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26c40cb2f0 0x7f26c41476a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f26c00b2040 tx=0x7f26c001b880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:23.190 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.141+0000 7f85bbdcb640 1 -- 172.21.15.39:0/3617955277 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85b40c1b00 con 0x7f85b40b03f0 2023-05-16T13:54:23.191 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.141+0000 7f85bbdcb640 1 -- 172.21.15.39:0/3617955277 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85b40caff0 con 0x7f85b40b03f0 2023-05-16T13:54:23.191 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.141+0000 7f85aa7fc640 1 -- 172.21.15.39:0/3617955277 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f85b00073d0 con 0x7f85b40b03f0 2023-05-16T13:54:23.191 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.145+0000 7f78fd10b640 1 -- 172.21.15.39:0/2759718821 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78f806d700 msgr2=0x7f78f80afcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:23.191 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.145+0000 7f78fd10b640 1 --2- 172.21.15.39:0/2759718821 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78f806d700 0x7f78f80afcf0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f78f80681b0 tx=0x7f78e801de00 comp rx=0 tx=0).stop 2023-05-16T13:54:23.192 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.145+0000 7ffa53fff640 1 -- 172.21.15.39:0/3795844781 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa540b9070 con 0x7ffa600eae10 2023-05-16T13:54:23.192 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.145+0000 7f26baffd640 1 -- 172.21.15.39:0/3057174413 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c00a7970 con 0x7f26c40cb2f0 2023-05-16T13:54:23.192 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.145+0000 7f26baffd640 1 -- 172.21.15.39:0/3057174413 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26c00a7ad0 con 0x7f26c40cb2f0 2023-05-16T13:54:23.192 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.145+0000 7f26cc68c640 1 -- 172.21.15.39:0/3057174413 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26c40c8e10 con 0x7f26c40cb2f0 2023-05-16T13:54:23.192 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.145+0000 7f26cc68c640 1 -- 172.21.15.39:0/3057174413 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26c40cd730 con 0x7f26c40cb2f0 2023-05-16T13:54:23.193 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.145+0000 7ffa6e004640 1 -- 172.21.15.39:0/3795844781 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa60053e10 con 0x7ffa600eae10 2023-05-16T13:54:23.193 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.145+0000 7ffa6e004640 1 -- 172.21.15.39:0/3795844781 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa6004f9b0 con 0x7ffa600eae10 2023-05-16T13:54:23.193 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.145+0000 7ffa53fff640 1 -- 172.21.15.39:0/3795844781 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa540abde0 con 0x7ffa600eae10 2023-05-16T13:54:23.193 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.145+0000 7ffa53fff640 1 -- 172.21.15.39:0/3795844781 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa540b4660 con 0x7ffa600eae10 2023-05-16T13:54:23.194 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.145+0000 7f26baffd640 1 -- 172.21.15.39:0/3057174413 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c00b8660 con 0x7f26c40cb2f0 2023-05-16T13:54:23.194 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.145+0000 7f26cc68c640 1 -- 172.21.15.39:0/3057174413 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26ac005260 con 0x7f26c40cb2f0 2023-05-16T13:54:23.194 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.145+0000 7f85aa7fc640 1 --2- 172.21.15.39:0/3617955277 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f85980662d0 0x7f8598068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:23.194 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.145+0000 7f85aa7fc640 1 -- 172.21.15.39:0/3617955277 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f85b0083ad0 con 0x7f85b40b03f0 2023-05-16T13:54:23.194 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.145+0000 7f85b9366640 1 --2- 172.21.15.39:0/3617955277 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f85980662d0 0x7f8598068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:23.195 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.145+0000 7f85b9366640 1 --2- 172.21.15.39:0/3617955277 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f85980662d0 0x7f8598068780 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f85b406fc70 tx=0x7f85a40090e0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:23.195 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.145+0000 7ffa6e004640 1 -- 172.21.15.39:0/3795844781 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa48005260 con 0x7ffa600eae10 2023-05-16T13:54:23.195 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.149+0000 7f26baffd640 1 -- 172.21.15.39:0/3057174413 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f26c00b6070 con 0x7f26c40cb2f0 2023-05-16T13:54:23.195 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.149+0000 7ffa53fff640 1 -- 172.21.15.39:0/3795844781 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ffa540b2040 con 0x7ffa600eae10 2023-05-16T13:54:23.196 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.149+0000 7f26baffd640 1 --2- 172.21.15.39:0/3057174413 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f26a80662d0 0x7f26a8068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:23.196 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.149+0000 7f26baffd640 1 -- 172.21.15.39:0/3057174413 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f26c00a7e40 con 0x7f26c40cb2f0 2023-05-16T13:54:23.196 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.149+0000 7ffa53fff640 1 --2- 172.21.15.39:0/3795844781 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ffa4c066350 0x7ffa4c068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:23.197 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.149+0000 7ffa53fff640 1 -- 172.21.15.39:0/3795844781 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ffa5411d110 con 0x7ffa600eae10 2023-05-16T13:54:23.197 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.149+0000 7f26c9c27640 1 --2- 172.21.15.39:0/3057174413 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f26a80662d0 0x7f26a8068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:23.197 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.149+0000 7f26c9c27640 1 --2- 172.21.15.39:0/3057174413 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f26a80662d0 0x7f26a8068780 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f26c40cf0c0 tx=0x7f26b4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:23.197 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.149+0000 7f85aa7fc640 1 -- 172.21.15.39:0/3617955277 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f85b0050720 con 0x7f85b40b03f0 2023-05-16T13:54:23.198 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.149+0000 7ffa677fe640 1 --2- 172.21.15.39:0/3795844781 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ffa4c066350 0x7ffa4c068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:23.198 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.149+0000 7f78fd10b640 1 -- 172.21.15.39:0/2759718821 shutdown_connections 2023-05-16T13:54:23.198 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.149+0000 7f78fd10b640 1 --2- 172.21.15.39:0/2759718821 >> v2:172.21.15.39:3300/0 conn(0x7f78f80ad7d0 0x7f78f80cd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.198 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.149+0000 7f78fd10b640 1 --2- 172.21.15.39:0/2759718821 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78f806d700 0x7f78f80afcf0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.199 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.149+0000 7f78fd10b640 1 -- 172.21.15.39:0/2759718821 >> 172.21.15.39:0/2759718821 conn(0x7f78f806a660 msgr2=0x7f78f80cacf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:23.199 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.153+0000 7f78fd10b640 1 -- 172.21.15.39:0/2759718821 shutdown_connections 2023-05-16T13:54:23.199 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.153+0000 7f78fd10b640 1 -- 172.21.15.39:0/2759718821 wait complete. 2023-05-16T13:54:23.199 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.153+0000 7ffa677fe640 1 --2- 172.21.15.39:0/3795844781 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ffa4c066350 0x7ffa4c068800 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ffa68073ff0 tx=0x7ffa68067a40 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:23.199 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.153+0000 7f26baffd640 1 -- 172.21.15.39:0/3057174413 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f26c00ec350 con 0x7f26c40cb2f0 2023-05-16T13:54:23.200 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.153+0000 7f78fd10b640 1 Processor -- start 2023-05-16T13:54:23.200 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.153+0000 7f78fd10b640 1 -- start start 2023-05-16T13:54:23.200 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.157+0000 7ffa53fff640 1 -- 172.21.15.39:0/3795844781 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ffa540ea620 con 0x7ffa600eae10 2023-05-16T13:54:23.202 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.157+0000 7f78fd10b640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f78f806d700 0x7f78f8151dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:23.202 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.157+0000 7f78fd10b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f78f80ad7d0 0x7f78f8155c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:23.202 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.157+0000 7f78f7fff640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f78f806d700 0x7f78f8151dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:23.202 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.157+0000 7f78f7fff640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f78f806d700 0x7f78f8151dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.39:33664/0 (socket says 172.21.15.39:33664) 2023-05-16T13:54:23.202 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.157+0000 7f78f77fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f78f80ad7d0 0x7f78f8155c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:23.203 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.157+0000 7f78f77fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f78f80ad7d0 0x7f78f8155c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60034/0 (socket says 172.21.15.39:60034) 2023-05-16T13:54:23.203 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.161+0000 7f78fd10b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78f80cb490 0x7f78f80ac0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:23.203 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.161+0000 7f78fd10b640 1 -- 172.21.15.39:0/3479277792 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78f8151940 con 0x7f78f80ad7d0 2023-05-16T13:54:23.203 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.161+0000 7f78f7fff640 1 -- 172.21.15.39:0/3479277792 learned_addr learned my addr 172.21.15.39:0/3479277792 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:23.203 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.161+0000 7f78fd10b640 1 -- 172.21.15.39:0/3479277792 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78f8156520 con 0x7f78f80cb490 2023-05-16T13:54:23.203 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.161+0000 7f78fd10b640 1 -- 172.21.15.39:0/3479277792 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78f8151010 con 0x7f78f806d700 2023-05-16T13:54:23.203 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.161+0000 7f78fc90a640 1 --2- 172.21.15.39:0/3479277792 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78f80cb490 0x7f78f80ac0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:23.204 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.161+0000 7f78f77fe640 1 -- 172.21.15.39:0/3479277792 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f78f806d700 msgr2=0x7f78f8151dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:23.204 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.161+0000 7f78f77fe640 1 --2- 172.21.15.39:0/3479277792 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f78f806d700 0x7f78f8151dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.204 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.161+0000 7f78f77fe640 1 -- 172.21.15.39:0/3479277792 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78f80cb490 msgr2=0x7f78f80ac0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:23.204 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.161+0000 7f78f77fe640 1 --2- 172.21.15.39:0/3479277792 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78f80cb490 0x7f78f80ac0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.204 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.161+0000 7f78f77fe640 1 -- 172.21.15.39:0/3479277792 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78e800c050 con 0x7f78f80ad7d0 2023-05-16T13:54:23.204 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.161+0000 7f78fc90a640 1 --2- 172.21.15.39:0/3479277792 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78f80cb490 0x7f78f80ac0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-16T13:54:23.204 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.161+0000 7f78f77fe640 1 --2- 172.21.15.39:0/3479277792 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f78f80ad7d0 0x7f78f8155c20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f78f000c390 tx=0x7f78f000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:23.204 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.161+0000 7f78f4ff9640 1 -- 172.21.15.39:0/3479277792 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f00074e0 con 0x7f78f80ad7d0 2023-05-16T13:54:23.205 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.161+0000 7f78f4ff9640 1 -- 172.21.15.39:0/3479277792 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78f0007640 con 0x7f78f80ad7d0 2023-05-16T13:54:23.205 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.161+0000 7f78f4ff9640 1 -- 172.21.15.39:0/3479277792 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f0004a10 con 0x7f78f80ad7d0 2023-05-16T13:54:23.205 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.161+0000 7f78fd10b640 1 -- 172.21.15.39:0/3479277792 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78f80b0640 con 0x7f78f80ad7d0 2023-05-16T13:54:23.205 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.161+0000 7f78fd10b640 1 -- 172.21.15.39:0/3479277792 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78f806ca00 con 0x7f78f80ad7d0 2023-05-16T13:54:23.205 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.161+0000 7f78fd10b640 1 -- 172.21.15.39:0/3479277792 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78dc005260 con 0x7f78f80ad7d0 2023-05-16T13:54:23.205 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.165+0000 7f78f4ff9640 1 -- 172.21.15.39:0/3479277792 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f78f0004b70 con 0x7f78f80ad7d0 2023-05-16T13:54:23.205 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.169+0000 7f78f4ff9640 1 --2- 172.21.15.39:0/3479277792 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f78d8066350 0x7f78d8068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:23.205 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.169+0000 7f78f4ff9640 1 -- 172.21.15.39:0/3479277792 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f78f0083d20 con 0x7f78f80ad7d0 2023-05-16T13:54:23.206 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.169+0000 7f78f7fff640 1 --2- 172.21.15.39:0/3479277792 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f78d8066350 0x7f78d8068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:23.206 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.169+0000 7f78f7fff640 1 --2- 172.21.15.39:0/3479277792 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f78d8066350 0x7f78d8068800 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f78e8000f90 tx=0x7f78e80a8070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:23.206 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.177+0000 7f78f4ff9640 1 -- 172.21.15.39:0/3479277792 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f78f0051180 con 0x7f78f80ad7d0 2023-05-16T13:54:23.410 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.401+0000 7fbce290a640 1 -- 172.21.15.39:0/611967425 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbcdc04ed20 con 0x7fbcdc158050 2023-05-16T13:54:23.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.401+0000 7fbcd8ff9640 1 -- 172.21.15.39:0/611967425 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbccc056cf0 con 0x7fbcdc158050 2023-05-16T13:54:23.414 INFO:teuthology.orchestra.run.smithi039.stdout:60129542149 2023-05-16T13:54:23.414 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.405+0000 7fbcc27fc640 1 -- 172.21.15.39:0/611967425 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fbcc4066500 msgr2=0x7fbcc40689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:23.415 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.405+0000 7fbcc27fc640 1 --2- 172.21.15.39:0/611967425 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fbcc4066500 0x7fbcc40689b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbcd000b9f0 tx=0x7fbcd0008040 comp rx=0 tx=0).stop 2023-05-16T13:54:23.415 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.405+0000 7fbcc27fc640 1 -- 172.21.15.39:0/611967425 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbcdc158050 msgr2=0x7fbcdc157150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:23.415 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.405+0000 7fbcc27fc640 1 --2- 172.21.15.39:0/611967425 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbcdc158050 0x7fbcdc157150 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbccc009d90 tx=0x7fbccc00c430 comp rx=0 tx=0).stop 2023-05-16T13:54:23.416 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.405+0000 7fbcc27fc640 1 -- 172.21.15.39:0/611967425 shutdown_connections 2023-05-16T13:54:23.416 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.405+0000 7fbcc27fc640 1 --2- 172.21.15.39:0/611967425 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fbcc4066500 0x7fbcc40689b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.416 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.405+0000 7fbcc27fc640 1 --2- 172.21.15.39:0/611967425 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbcdc0c88b0 0x7fbcdc0b3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.416 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.405+0000 7fbcc27fc640 1 --2- 172.21.15.39:0/611967425 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbcdc158050 0x7fbcdc157150 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.416 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.405+0000 7fbcc27fc640 1 --2- 172.21.15.39:0/611967425 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbcdc06b7c0 0x7fbcdc14a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.416 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.405+0000 7fbcc27fc640 1 -- 172.21.15.39:0/611967425 >> 172.21.15.39:0/611967425 conn(0x7fbcdc0cb970 msgr2=0x7fbcdc151a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:23.417 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.405+0000 7fbcc27fc640 1 -- 172.21.15.39:0/611967425 shutdown_connections 2023-05-16T13:54:23.417 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.405+0000 7fbcc27fc640 1 -- 172.21.15.39:0/611967425 wait complete. 2023-05-16T13:54:23.446 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542149 for osd.0 2023-05-16T13:54:23.452 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.445+0000 7fd54dcd1640 1 -- 172.21.15.39:0/1118874747 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fd5280057e0 con 0x7fd5480b1b00 2023-05-16T13:54:23.452 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.445+0000 7fd52ffff640 1 -- 172.21.15.39:0/1118874747 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd540018020 con 0x7fd5480b1b00 2023-05-16T13:54:23.453 INFO:teuthology.orchestra.run.smithi039.stdout:64424509445 2023-05-16T13:54:23.454 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.445+0000 7fd54dcd1640 1 -- 172.21.15.39:0/1118874747 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd5340662b0 msgr2=0x7fd534068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:23.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.445+0000 7fd54dcd1640 1 --2- 172.21.15.39:0/1118874747 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd5340662b0 0x7fd534068760 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd53c0ae000 tx=0x7fd53c0b5040 comp rx=0 tx=0).stop 2023-05-16T13:54:23.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.445+0000 7fd54dcd1640 1 -- 172.21.15.39:0/1118874747 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd5480b1b00 msgr2=0x7fd5481564d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:23.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.445+0000 7fd54dcd1640 1 --2- 172.21.15.39:0/1118874747 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd5480b1b00 0x7fd5481564d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd54000efc0 tx=0x7fd54000c490 comp rx=0 tx=0).stop 2023-05-16T13:54:23.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.445+0000 7fd54dcd1640 1 -- 172.21.15.39:0/1118874747 shutdown_connections 2023-05-16T13:54:23.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.445+0000 7fd54dcd1640 1 --2- 172.21.15.39:0/1118874747 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd5340662b0 0x7fd534068760 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.445+0000 7fd54dcd1640 1 --2- 172.21.15.39:0/1118874747 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd5480d0860 0x7fd5480afc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.445+0000 7fd54dcd1640 1 --2- 172.21.15.39:0/1118874747 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd54815fb00 0x7fd548204d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.445+0000 7fd54dcd1640 1 --2- 172.21.15.39:0/1118874747 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd5480b1b00 0x7fd5481564d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.445+0000 7fd54dcd1640 1 -- 172.21.15.39:0/1118874747 >> 172.21.15.39:0/1118874747 conn(0x7fd54808c0f0 msgr2=0x7fd54815e0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:23.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.445+0000 7fd54dcd1640 1 -- 172.21.15.39:0/1118874747 shutdown_connections 2023-05-16T13:54:23.457 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.445+0000 7fd54dcd1640 1 -- 172.21.15.39:0/1118874747 wait complete. 2023-05-16T13:54:23.476 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.5 2023-05-16T13:54:23.482 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.473+0000 7f43f59f0640 1 -- 172.21.15.39:0/4222637322 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f43e8005520 con 0x7f43e8055700 2023-05-16T13:54:23.483 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.473+0000 7f43d7fff640 1 -- 172.21.15.39:0/4222637322 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f43e4017020 con 0x7f43e8055700 2023-05-16T13:54:23.483 INFO:teuthology.orchestra.run.smithi039.stdout:64424509444 2023-05-16T13:54:23.484 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.477+0000 7f6a6fec4640 1 -- 172.21.15.39:0/1858124718 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f6a680b5930 con 0x7f6a680ccbd0 2023-05-16T13:54:23.484 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.477+0000 7f6a5e7fc640 1 -- 172.21.15.39:0/1858124718 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6a58017020 con 0x7f6a680ccbd0 2023-05-16T13:54:23.485 INFO:teuthology.orchestra.run.smithi039.stdout:64424509445 2023-05-16T13:54:23.486 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.477+0000 7f6a6fec4640 1 -- 172.21.15.39:0/1858124718 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f6a4c066350 msgr2=0x7f6a4c068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:23.487 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.477+0000 7f6a6fec4640 1 --2- 172.21.15.39:0/1858124718 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f6a4c066350 0x7f6a4c068800 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6a64009870 tx=0x7f6a64008040 comp rx=0 tx=0).stop 2023-05-16T13:54:23.487 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.477+0000 7f6a6fec4640 1 -- 172.21.15.39:0/1858124718 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6a680ccbd0 msgr2=0x7f6a680b1fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:23.487 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.477+0000 7f6a6fec4640 1 --2- 172.21.15.39:0/1858124718 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6a680ccbd0 0x7f6a680b1fe0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6a5800e8a0 tx=0x7f6a5800ed60 comp rx=0 tx=0).stop 2023-05-16T13:54:23.488 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.477+0000 7f43f59f0640 1 -- 172.21.15.39:0/4222637322 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f43dc066350 msgr2=0x7f43dc068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:23.488 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.477+0000 7f43f59f0640 1 --2- 172.21.15.39:0/4222637322 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f43dc066350 0x7f43dc068800 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f43e0009d50 tx=0x7f43e0009190 comp rx=0 tx=0).stop 2023-05-16T13:54:23.488 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.477+0000 7f43f59f0640 1 -- 172.21.15.39:0/4222637322 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43e8055700 msgr2=0x7f43e80da560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:23.488 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.477+0000 7f43f59f0640 1 --2- 172.21.15.39:0/4222637322 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43e8055700 0x7f43e80da560 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f43e400c400 tx=0x7f43e400c8c0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.488 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.477+0000 7f43f59f0640 1 -- 172.21.15.39:0/4222637322 shutdown_connections 2023-05-16T13:54:23.488 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.477+0000 7f43f59f0640 1 --2- 172.21.15.39:0/4222637322 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43e80e2840 0x7f43e80d4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.488 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.477+0000 7f43f59f0640 1 --2- 172.21.15.39:0/4222637322 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43e8055700 0x7f43e80da560 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.489 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.477+0000 7f43f59f0640 1 --2- 172.21.15.39:0/4222637322 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f43dc066350 0x7f43dc068800 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.489 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.477+0000 7f43f59f0640 1 --2- 172.21.15.39:0/4222637322 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f43e80552d0 0x7f43e80d5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.489 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.477+0000 7f6a6fec4640 1 -- 172.21.15.39:0/1858124718 shutdown_connections 2023-05-16T13:54:23.490 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.477+0000 7f43f59f0640 1 -- 172.21.15.39:0/4222637322 >> 172.21.15.39:0/4222637322 conn(0x7f43e8055c10 msgr2=0x7f43e803bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:23.490 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.477+0000 7f6a6fec4640 1 --2- 172.21.15.39:0/1858124718 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f6a4c066350 0x7f6a4c068800 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.490 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.477+0000 7f6a6fec4640 1 --2- 172.21.15.39:0/1858124718 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6a680ccbd0 0x7f6a680b1fe0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.491 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.477+0000 7f6a6fec4640 1 --2- 172.21.15.39:0/1858124718 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a680cf480 0x7f6a680b2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.491 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.477+0000 7f6a6fec4640 1 --2- 172.21.15.39:0/1858124718 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a680b7f80 0x7f6a681416b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.491 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.477+0000 7f6a6fec4640 1 -- 172.21.15.39:0/1858124718 >> 172.21.15.39:0/1858124718 conn(0x7f6a68065860 msgr2=0x7f6a6815b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:23.491 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.477+0000 7f43f59f0640 1 -- 172.21.15.39:0/4222637322 shutdown_connections 2023-05-16T13:54:23.491 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.477+0000 7f43f59f0640 1 -- 172.21.15.39:0/4222637322 wait complete. 2023-05-16T13:54:23.492 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.477+0000 7f6a6fec4640 1 -- 172.21.15.39:0/1858124718 shutdown_connections 2023-05-16T13:54:23.492 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.481+0000 7f6a6fec4640 1 -- 172.21.15.39:0/1858124718 wait complete. 2023-05-16T13:54:23.492 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.481+0000 7f26cc68c640 1 -- 172.21.15.39:0/3057174413 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f26ac0057e0 con 0x7f26c40cb2f0 2023-05-16T13:54:23.493 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.481+0000 7f26baffd640 1 -- 172.21.15.39:0/3057174413 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f26c00bc090 con 0x7f26c40cb2f0 2023-05-16T13:54:23.493 INFO:teuthology.orchestra.run.smithi039.stdout:64424509445 2023-05-16T13:54:23.493 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.481+0000 7f85bbdcb640 1 -- 172.21.15.39:0/3617955277 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f85b404ed20 con 0x7f85b40b03f0 2023-05-16T13:54:23.494 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.485+0000 7f85aa7fc640 1 -- 172.21.15.39:0/3617955277 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f85b0017090 con 0x7f85b40b03f0 2023-05-16T13:54:23.494 INFO:teuthology.orchestra.run.smithi039.stdout:60129542148 2023-05-16T13:54:23.494 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.485+0000 7f26cc68c640 1 -- 172.21.15.39:0/3057174413 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f26a80662d0 msgr2=0x7f26a8068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:23.495 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.485+0000 7f26cc68c640 1 --2- 172.21.15.39:0/3057174413 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f26a80662d0 0x7f26a8068780 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f26c40cf0c0 tx=0x7f26b4009040 comp rx=0 tx=0).stop 2023-05-16T13:54:23.495 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.485+0000 7f26cc68c640 1 -- 172.21.15.39:0/3057174413 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26c40cb2f0 msgr2=0x7f26c41476a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:23.495 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.485+0000 7f26cc68c640 1 --2- 172.21.15.39:0/3057174413 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26c40cb2f0 0x7f26c41476a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f26c00b2040 tx=0x7f26c001b880 comp rx=0 tx=0).stop 2023-05-16T13:54:23.495 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.485+0000 7f26cc68c640 1 -- 172.21.15.39:0/3057174413 shutdown_connections 2023-05-16T13:54:23.495 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.485+0000 7f26cc68c640 1 --2- 172.21.15.39:0/3057174413 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f26c415d2c0 0x7f26c415ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.495 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.485+0000 7f26cc68c640 1 --2- 172.21.15.39:0/3057174413 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26c4158e90 0x7f26c415b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.495 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.485+0000 7f26cc68c640 1 --2- 172.21.15.39:0/3057174413 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f26a80662d0 0x7f26a8068780 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.496 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.485+0000 7f26cc68c640 1 --2- 172.21.15.39:0/3057174413 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26c40cb2f0 0x7f26c41476a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.496 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.485+0000 7f26cc68c640 1 -- 172.21.15.39:0/3057174413 >> 172.21.15.39:0/3057174413 conn(0x7f26c4069a50 msgr2=0x7f26c4070bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:23.496 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.485+0000 7f26cc68c640 1 -- 172.21.15.39:0/3057174413 shutdown_connections 2023-05-16T13:54:23.496 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.485+0000 7f26cc68c640 1 -- 172.21.15.39:0/3057174413 wait complete. 2023-05-16T13:54:23.497 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.485+0000 7f85bbdcb640 1 -- 172.21.15.39:0/3617955277 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f85980662d0 msgr2=0x7f8598068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:23.497 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.485+0000 7f85bbdcb640 1 --2- 172.21.15.39:0/3617955277 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f85980662d0 0x7f8598068780 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f85b406fc70 tx=0x7f85a40090e0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.497 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.485+0000 7f85bbdcb640 1 -- 172.21.15.39:0/3617955277 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85b40b03f0 msgr2=0x7f85b41f5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:23.497 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.485+0000 7f85bbdcb640 1 --2- 172.21.15.39:0/3617955277 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85b40b03f0 0x7f85b41f5720 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f85b000c4d0 tx=0x7f85b000c990 comp rx=0 tx=0).stop 2023-05-16T13:54:23.497 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.485+0000 7f85bbdcb640 1 -- 172.21.15.39:0/3617955277 shutdown_connections 2023-05-16T13:54:23.497 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.485+0000 7f85bbdcb640 1 --2- 172.21.15.39:0/3617955277 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f85980662d0 0x7f8598068780 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.497 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.485+0000 7f85bbdcb640 1 --2- 172.21.15.39:0/3617955277 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f85b40cb7f0 0x7f85b41f9cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.498 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.485+0000 7f85bbdcb640 1 --2- 172.21.15.39:0/3617955277 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85b41603c0 0x7f85b4162a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.498 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.485+0000 7f85bbdcb640 1 --2- 172.21.15.39:0/3617955277 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85b40b03f0 0x7f85b41f5720 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.498 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.485+0000 7f85bbdcb640 1 -- 172.21.15.39:0/3617955277 >> 172.21.15.39:0/3617955277 conn(0x7f85b4069a50 msgr2=0x7f85b4069e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:23.498 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.489+0000 7f85bbdcb640 1 -- 172.21.15.39:0/3617955277 shutdown_connections 2023-05-16T13:54:23.498 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.489+0000 7f85bbdcb640 1 -- 172.21.15.39:0/3617955277 wait complete. 2023-05-16T13:54:23.501 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.493+0000 7ffa6e004640 1 -- 172.21.15.39:0/3795844781 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ffa48005510 con 0x7ffa600eae10 2023-05-16T13:54:23.502 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.493+0000 7ffa53fff640 1 -- 172.21.15.39:0/3795844781 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ffa540edc40 con 0x7ffa600eae10 2023-05-16T13:54:23.503 INFO:teuthology.orchestra.run.smithi039.stdout:60129542149 2023-05-16T13:54:23.505 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.497+0000 7ffa6e004640 1 -- 172.21.15.39:0/3795844781 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ffa4c066350 msgr2=0x7ffa4c068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:23.506 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.497+0000 7ffa6e004640 1 --2- 172.21.15.39:0/3795844781 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ffa4c066350 0x7ffa4c068800 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ffa68073ff0 tx=0x7ffa68067a40 comp rx=0 tx=0).stop 2023-05-16T13:54:23.506 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.497+0000 7ffa6e004640 1 -- 172.21.15.39:0/3795844781 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffa600eae10 msgr2=0x7ffa600dacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:23.506 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.497+0000 7ffa6e004640 1 --2- 172.21.15.39:0/3795844781 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffa600eae10 0x7ffa600dacf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ffa540ab000 tx=0x7ffa54019190 comp rx=0 tx=0).stop 2023-05-16T13:54:23.506 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.497+0000 7ffa6e004640 1 -- 172.21.15.39:0/3795844781 shutdown_connections 2023-05-16T13:54:23.506 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.497+0000 7ffa6e004640 1 --2- 172.21.15.39:0/3795844781 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ffa4c066350 0x7ffa4c068800 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.506 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.497+0000 7ffa6e004640 1 --2- 172.21.15.39:0/3795844781 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffa600eae10 0x7ffa600dacf0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.506 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.497+0000 7ffa6e004640 1 --2- 172.21.15.39:0/3795844781 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa600e6db0 0x7ffa600da7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.507 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.497+0000 7ffa6e004640 1 --2- 172.21.15.39:0/3795844781 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffa60052820 0x7ffa600d9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.507 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.497+0000 7ffa6e004640 1 -- 172.21.15.39:0/3795844781 >> 172.21.15.39:0/3795844781 conn(0x7ffa600516d0 msgr2=0x7ffa600e9510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:23.507 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.497+0000 7ffa6e004640 1 -- 172.21.15.39:0/3795844781 shutdown_connections 2023-05-16T13:54:23.507 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.497+0000 7ffa6e004640 1 -- 172.21.15.39:0/3795844781 wait complete. 2023-05-16T13:54:23.518 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.7 2023-05-16T13:54:23.525 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509444 for osd.6 2023-05-16T13:54:23.525 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.517+0000 7f78fd10b640 1 -- 172.21.15.39:0/3479277792 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f78dc0057e0 con 0x7f78f80ad7d0 2023-05-16T13:54:23.526 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.517+0000 7f78f4ff9640 1 -- 172.21.15.39:0/3479277792 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f78f00547a0 con 0x7f78f80ad7d0 2023-05-16T13:54:23.526 INFO:teuthology.orchestra.run.smithi039.stdout:60129542149 2023-05-16T13:54:23.528 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.521+0000 7f78fd10b640 1 -- 172.21.15.39:0/3479277792 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f78d8066350 msgr2=0x7f78d8068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:23.528 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.521+0000 7f78fd10b640 1 --2- 172.21.15.39:0/3479277792 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f78d8066350 0x7f78d8068800 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f78e8000f90 tx=0x7f78e80a8070 comp rx=0 tx=0).stop 2023-05-16T13:54:23.529 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.521+0000 7f78fd10b640 1 -- 172.21.15.39:0/3479277792 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f78f80ad7d0 msgr2=0x7f78f8155c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:23.529 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.521+0000 7f78fd10b640 1 --2- 172.21.15.39:0/3479277792 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f78f80ad7d0 0x7f78f8155c20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f78f000c390 tx=0x7f78f000c850 comp rx=0 tx=0).stop 2023-05-16T13:54:23.529 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.521+0000 7f78fd10b640 1 -- 172.21.15.39:0/3479277792 shutdown_connections 2023-05-16T13:54:23.529 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.521+0000 7f78fd10b640 1 --2- 172.21.15.39:0/3479277792 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78f80cb490 0x7f78f80ac0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.529 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.521+0000 7f78fd10b640 1 --2- 172.21.15.39:0/3479277792 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f78f80ad7d0 0x7f78f8155c20 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.529 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.521+0000 7f78fd10b640 1 --2- 172.21.15.39:0/3479277792 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f78d8066350 0x7f78d8068800 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.529 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.521+0000 7f78fd10b640 1 --2- 172.21.15.39:0/3479277792 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f78f806d700 0x7f78f8151dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:23.530 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.521+0000 7f78fd10b640 1 -- 172.21.15.39:0/3479277792 >> 172.21.15.39:0/3479277792 conn(0x7f78f806a660 msgr2=0x7f78f80cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:23.530 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.521+0000 7f78fd10b640 1 -- 172.21.15.39:0/3479277792 shutdown_connections 2023-05-16T13:54:23.530 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:23.521+0000 7f78fd10b640 1 -- 172.21.15.39:0/3479277792 wait complete. 2023-05-16T13:54:23.532 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542148 for osd.1 2023-05-16T13:54:23.533 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542149 for osd.3 2023-05-16T13:54:23.533 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.4 2023-05-16T13:54:23.548 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542149 for osd.2 2023-05-16T13:54:24.447 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-05-16T13:54:24.478 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-05-16T13:54:24.518 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-05-16T13:54:24.526 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-05-16T13:54:24.533 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-05-16T13:54:24.533 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-05-16T13:54:24.534 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-05-16T13:54:24.549 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-05-16T13:54:24.634 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.621+0000 7ff9a898f640 1 Processor -- start 2023-05-16T13:54:24.634 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.621+0000 7ff9a898f640 1 -- start start 2023-05-16T13:54:24.634 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.625+0000 7ff9a898f640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff9a40b0160 0x7ff9a416d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:24.634 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.625+0000 7ff9a898f640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff9a416d5f0 0x7ff9a40b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:24.635 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.625+0000 7ff9a898f640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9a40c8c70 con 0x7ff9a406c880 2023-05-16T13:54:24.635 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.625+0000 7ff9a898f640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9a40c91f0 con 0x7ff9a416d5f0 2023-05-16T13:54:24.635 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.625+0000 7ff9a898f640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a416c9a0 con 0x7ff9a40b0160 2023-05-16T13:54:24.636 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.625+0000 7ff9a259c640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff9a40b0160 0x7ff9a416d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:24.636 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.625+0000 7ff9a259c640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff9a40b0160 0x7ff9a416d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.39:33678/0 (socket says 172.21.15.39:33678) 2023-05-16T13:54:24.636 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.625+0000 7ff9a259c640 1 -- 172.21.15.39:0/3015624894 learned_addr learned my addr 172.21.15.39:0/3015624894 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:24.636 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.625+0000 7ff9a1d9b640 1 --2- 172.21.15.39:0/3015624894 >> v2:172.21.15.118:3300/0 conn(0x7ff9a416d5f0 0x7ff9a40b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:24.636 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.625+0000 7ff9a259c640 1 -- 172.21.15.39:0/3015624894 >> v2:172.21.15.118:3300/0 conn(0x7ff9a416d5f0 msgr2=0x7ff9a40b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:24.637 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.625+0000 7ff9a259c640 1 --2- 172.21.15.39:0/3015624894 >> v2:172.21.15.118:3300/0 conn(0x7ff9a416d5f0 0x7ff9a40b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:24.637 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.625+0000 7ff9a259c640 1 -- 172.21.15.39:0/3015624894 >> v1:172.21.15.118:6789/0 conn(0x7ff9a406c880 legacy=0x7ff9a40ca5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:24.637 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.625+0000 7ff9a259c640 1 -- 172.21.15.39:0/3015624894 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a40c8f10 con 0x7ff9a40b0160 2023-05-16T13:54:24.639 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.629+0000 7ff9a259c640 1 --2- 172.21.15.39:0/3015624894 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff9a40b0160 0x7ff9a416d0b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff99800aa90 tx=0x7ff99801c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebbfb1f63d7e1710 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:24.641 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.633+0000 7ff9a159a640 1 -- 172.21.15.39:0/3015624894 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9980a5740 con 0x7ff9a40b0160 2023-05-16T13:54:24.641 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.633+0000 7ff9a159a640 1 -- 172.21.15.39:0/3015624894 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9980a9070 con 0x7ff9a40b0160 2023-05-16T13:54:24.642 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.633+0000 7ff9a159a640 1 -- 172.21.15.39:0/3015624894 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9980a5ae0 con 0x7ff9a40b0160 2023-05-16T13:54:24.642 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.633+0000 7ff9a898f640 1 -- 172.21.15.39:0/3015624894 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff9a40b0160 msgr2=0x7ff9a416d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:24.643 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.633+0000 7ff9a898f640 1 --2- 172.21.15.39:0/3015624894 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff9a40b0160 0x7ff9a416d0b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff99800aa90 tx=0x7ff99801c810 comp rx=0 tx=0).stop 2023-05-16T13:54:24.643 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.633+0000 7ff9a898f640 1 -- 172.21.15.39:0/3015624894 shutdown_connections 2023-05-16T13:54:24.643 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.633+0000 7ff9a898f640 1 --2- 172.21.15.39:0/3015624894 >> v2:172.21.15.118:3300/0 conn(0x7ff9a416d5f0 0x7ff9a40b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:24.643 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.633+0000 7ff9a898f640 1 --2- 172.21.15.39:0/3015624894 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff9a40b0160 0x7ff9a416d0b0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:24.643 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.633+0000 7ff9a898f640 1 -- 172.21.15.39:0/3015624894 >> 172.21.15.39:0/3015624894 conn(0x7ff9a4069a50 msgr2=0x7ff9a4069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:24.643 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.633+0000 7ff9a898f640 1 -- 172.21.15.39:0/3015624894 shutdown_connections 2023-05-16T13:54:24.643 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.633+0000 7ff9a898f640 1 -- 172.21.15.39:0/3015624894 wait complete. 2023-05-16T13:54:24.647 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.637+0000 7ff9a898f640 1 Processor -- start 2023-05-16T13:54:24.647 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.637+0000 7ff9a898f640 1 -- start start 2023-05-16T13:54:24.648 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.637+0000 7ff9a898f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9a406c880 0x7ff9a40888f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:24.648 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.637+0000 7ff9a898f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff9a40b0160 0x7ff9a41612f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:24.649 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.637+0000 7ff9a898f640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff9a416d5f0 0x7ff9a416b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:24.649 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.637+0000 7ff9a898f640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a4160530 con 0x7ff9a406c880 2023-05-16T13:54:24.649 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.637+0000 7ff9a898f640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a4160810 con 0x7ff9a40b0160 2023-05-16T13:54:24.649 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.637+0000 7ff9a898f640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a4160af0 con 0x7ff9a416d5f0 2023-05-16T13:54:24.650 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.641+0000 7ff9a259c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9a406c880 0x7ff9a40888f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:24.650 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.641+0000 7ff9a259c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9a406c880 0x7ff9a40888f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60036/0 (socket says 172.21.15.39:60036) 2023-05-16T13:54:24.650 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.641+0000 7ff9a259c640 1 -- 172.21.15.39:0/775232298 learned_addr learned my addr 172.21.15.39:0/775232298 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:24.650 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.641+0000 7ff9a1d9b640 1 --2- 172.21.15.39:0/775232298 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff9a40b0160 0x7ff9a41612f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:24.651 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.641+0000 7ff9a2d9d640 1 --2- 172.21.15.39:0/775232298 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff9a416d5f0 0x7ff9a416b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:24.651 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.641+0000 7ff9a259c640 1 -- 172.21.15.39:0/775232298 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff9a416d5f0 msgr2=0x7ff9a416b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:24.651 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.641+0000 7ff9a259c640 1 --2- 172.21.15.39:0/775232298 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff9a416d5f0 0x7ff9a416b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:24.651 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.641+0000 7ff9a259c640 1 -- 172.21.15.39:0/775232298 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff9a40b0160 msgr2=0x7ff9a41612f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:24.651 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.641+0000 7ff9a259c640 1 --2- 172.21.15.39:0/775232298 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff9a40b0160 0x7ff9a41612f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:24.651 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.641+0000 7ff9a259c640 1 -- 172.21.15.39:0/775232298 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff99800a6f0 con 0x7ff9a406c880 2023-05-16T13:54:24.651 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.641+0000 7ff9a259c640 1 --2- 172.21.15.39:0/775232298 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9a406c880 0x7ff9a40888f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff99801a440 tx=0x7ff99800a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:24.652 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.641+0000 7ff992ffd640 1 -- 172.21.15.39:0/775232298 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff998003bf0 con 0x7ff9a406c880 2023-05-16T13:54:24.652 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.641+0000 7ff9a898f640 1 -- 172.21.15.39:0/775232298 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9a4071630 con 0x7ff9a406c880 2023-05-16T13:54:24.652 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.641+0000 7ff992ffd640 1 -- 172.21.15.39:0/775232298 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff998003d50 con 0x7ff9a406c880 2023-05-16T13:54:24.652 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.641+0000 7ff992ffd640 1 -- 172.21.15.39:0/775232298 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9980a5740 con 0x7ff9a406c880 2023-05-16T13:54:24.652 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.641+0000 7ff9a898f640 1 -- 172.21.15.39:0/775232298 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9a40714a0 con 0x7ff9a406c880 2023-05-16T13:54:24.653 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.645+0000 7ff9a898f640 1 -- 172.21.15.39:0/775232298 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9a40717c0 con 0x7ff9a406c880 2023-05-16T13:54:24.663 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.649+0000 7ff992ffd640 1 -- 172.21.15.39:0/775232298 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff9980a58a0 con 0x7ff9a406c880 2023-05-16T13:54:24.663 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.649+0000 7ff992ffd640 1 --2- 172.21.15.39:0/775232298 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ff9840662d0 0x7ff984068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:24.663 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.649+0000 7ff9a1d9b640 1 --2- 172.21.15.39:0/775232298 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ff9840662d0 0x7ff984068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:24.663 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.649+0000 7ff9a1d9b640 1 --2- 172.21.15.39:0/775232298 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ff9840662d0 0x7ff984068780 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff9a4165cc0 tx=0x7ff99400f040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:24.664 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.653+0000 7ff992ffd640 1 -- 172.21.15.39:0/775232298 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff9980f4690 con 0x7ff9a406c880 2023-05-16T13:54:24.664 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.657+0000 7ff992ffd640 1 -- 172.21.15.39:0/775232298 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ff9980ecac0 con 0x7ff9a406c880 2023-05-16T13:54:24.705 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.693+0000 7f4bb1420640 1 Processor -- start 2023-05-16T13:54:24.705 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.693+0000 7f4bb1420640 1 -- start start 2023-05-16T13:54:24.706 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.693+0000 7f4bb1420640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f4bac0ccb00 0x7f4bac0c88b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:24.706 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.693+0000 7f4bb1420640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4bac06bed0 0x7f4bac16c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:24.706 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.693+0000 7f4bb1420640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bac0ceca0 con 0x7f4bac089260 2023-05-16T13:54:24.707 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.693+0000 7f4bb1420640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bac0ce0b0 con 0x7f4bac0ccb00 2023-05-16T13:54:24.707 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.693+0000 7f4bb1420640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac0cdc20 con 0x7f4bac06bed0 2023-05-16T13:54:24.707 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.697+0000 7f4baaffd640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f4bac0ccb00 0x7f4bac0c88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:24.707 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.697+0000 7f4baaffd640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f4bac0ccb00 0x7f4bac0c88b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60048/0 (socket says 172.21.15.39:60048) 2023-05-16T13:54:24.708 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.697+0000 7f4baaffd640 1 -- 172.21.15.39:0/1757899227 learned_addr learned my addr 172.21.15.39:0/1757899227 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:24.708 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.697+0000 7f4bab7fe640 1 --2- 172.21.15.39:0/1757899227 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4bac06bed0 0x7f4bac16c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:24.708 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.697+0000 7f4baaffd640 1 -- 172.21.15.39:0/1757899227 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4bac06bed0 msgr2=0x7f4bac16c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:24.708 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.697+0000 7f4baaffd640 1 --2- 172.21.15.39:0/1757899227 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4bac06bed0 0x7f4bac16c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:24.708 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.697+0000 7f4baaffd640 1 -- 172.21.15.39:0/1757899227 >> v1:172.21.15.39:6789/0 conn(0x7f4bac089260 legacy=0x7f4bac06b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:24.708 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.697+0000 7f4baaffd640 1 -- 172.21.15.39:0/1757899227 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bac0cf1d0 con 0x7f4bac0ccb00 2023-05-16T13:54:24.711 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.701+0000 7f4baaffd640 1 --2- 172.21.15.39:0/1757899227 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4bac0ccb00 0x7f4bac0c88b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4ba4008ec0 tx=0x7f4ba40251e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ebad094dabee805 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:24.712 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.705+0000 7f4ba9ffb640 1 -- 172.21.15.39:0/1757899227 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba40b0610 con 0x7f4bac0ccb00 2023-05-16T13:54:24.712 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.705+0000 7f4ba9ffb640 1 -- 172.21.15.39:0/1757899227 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ba40b0770 con 0x7f4bac0ccb00 2023-05-16T13:54:24.712 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.705+0000 7f4ba9ffb640 1 -- 172.21.15.39:0/1757899227 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba40b0b00 con 0x7f4bac0ccb00 2023-05-16T13:54:24.712 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.705+0000 7f4bb1420640 1 -- 172.21.15.39:0/1757899227 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4bac0ccb00 msgr2=0x7f4bac0c88b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:24.713 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.705+0000 7f4bb1420640 1 --2- 172.21.15.39:0/1757899227 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4bac0ccb00 0x7f4bac0c88b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4ba4008ec0 tx=0x7f4ba40251e0 comp rx=0 tx=0).stop 2023-05-16T13:54:24.713 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.705+0000 7f4bb1420640 1 -- 172.21.15.39:0/1757899227 shutdown_connections 2023-05-16T13:54:24.714 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.705+0000 7f4bb1420640 1 --2- 172.21.15.39:0/1757899227 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4bac06bed0 0x7f4bac16c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:24.714 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.705+0000 7f4bb1420640 1 --2- 172.21.15.39:0/1757899227 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4bac0ccb00 0x7f4bac0c88b0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:24.714 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.705+0000 7f4bb1420640 1 -- 172.21.15.39:0/1757899227 >> 172.21.15.39:0/1757899227 conn(0x7f4bac0cb970 msgr2=0x7f4bac0ce260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:24.714 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.705+0000 7f4bb1420640 1 -- 172.21.15.39:0/1757899227 shutdown_connections 2023-05-16T13:54:24.719 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.705+0000 7f4bb1420640 1 -- 172.21.15.39:0/1757899227 wait complete. 2023-05-16T13:54:24.719 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.709+0000 7f4bb1420640 1 Processor -- start 2023-05-16T13:54:24.720 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.709+0000 7f4bb1420640 1 -- start start 2023-05-16T13:54:24.721 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.709+0000 7f4bb1420640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4bac06bed0 0x7f4bac087340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:24.721 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.709+0000 7f4bb1420640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4bac089260 0x7f4bac0c7f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:24.721 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.709+0000 7f4bb1420640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4bac0ccb00 0x7f4bac165fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:24.722 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.709+0000 7f4bb1420640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac088650 con 0x7f4bac0ccb00 2023-05-16T13:54:24.722 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.709+0000 7f4bb1420640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac0c8440 con 0x7f4bac06bed0 2023-05-16T13:54:24.722 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.709+0000 7f4bb1420640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac0879d0 con 0x7f4bac089260 2023-05-16T13:54:24.722 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.709+0000 7f4bab7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4bac0ccb00 0x7f4bac165fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:24.722 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.709+0000 7f4baa7fc640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4bac089260 0x7f4bac0c7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:24.722 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.709+0000 7f4bab7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4bac0ccb00 0x7f4bac165fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60062/0 (socket says 172.21.15.39:60062) 2023-05-16T13:54:24.722 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.709+0000 7f4bab7fe640 1 -- 172.21.15.39:0/3252358835 learned_addr learned my addr 172.21.15.39:0/3252358835 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:24.723 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.713+0000 7f4baaffd640 1 --2- 172.21.15.39:0/3252358835 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4bac06bed0 0x7f4bac087340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:24.723 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.713+0000 7f4baa7fc640 1 -- 172.21.15.39:0/3252358835 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4bac06bed0 msgr2=0x7f4bac087340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:24.723 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.713+0000 7f4baa7fc640 1 --2- 172.21.15.39:0/3252358835 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4bac06bed0 0x7f4bac087340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:24.723 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.713+0000 7f4baa7fc640 1 -- 172.21.15.39:0/3252358835 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4bac0ccb00 msgr2=0x7f4bac165fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:24.723 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.713+0000 7f4baa7fc640 1 --2- 172.21.15.39:0/3252358835 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4bac0ccb00 0x7f4bac165fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:24.723 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.713+0000 7f4baa7fc640 1 -- 172.21.15.39:0/3252358835 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ba4008b20 con 0x7f4bac089260 2023-05-16T13:54:24.723 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.713+0000 7f4baa7fc640 1 --2- 172.21.15.39:0/3252358835 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4bac089260 0x7f4bac0c7f00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c00c520 tx=0x7f4b9c00c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:24.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.713+0000 7f4b937fe640 1 -- 172.21.15.39:0/3252358835 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c005280 con 0x7f4bac089260 2023-05-16T13:54:24.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.713+0000 7f4bb1420640 1 -- 172.21.15.39:0/3252358835 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bac0cd060 con 0x7f4bac089260 2023-05-16T13:54:24.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.713+0000 7f4b937fe640 1 -- 172.21.15.39:0/3252358835 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b9c0053e0 con 0x7f4bac089260 2023-05-16T13:54:24.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.713+0000 7f4b937fe640 1 -- 172.21.15.39:0/3252358835 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c003840 con 0x7f4bac089260 2023-05-16T13:54:24.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.713+0000 7f4bb1420640 1 -- 172.21.15.39:0/3252358835 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bac0cced0 con 0x7f4bac089260 2023-05-16T13:54:24.727 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.717+0000 7f4b937fe640 1 -- 172.21.15.39:0/3252358835 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4b9c0039a0 con 0x7f4bac089260 2023-05-16T13:54:24.727 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.717+0000 7f4bb1420640 1 -- 172.21.15.39:0/3252358835 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bac16d240 con 0x7f4bac089260 2023-05-16T13:54:24.728 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.721+0000 7f4b937fe640 1 --2- 172.21.15.39:0/3252358835 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f4b98066350 0x7f4b98068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:24.729 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.721+0000 7f4b937fe640 1 -- 172.21.15.39:0/3252358835 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4b9c094170 con 0x7f4bac089260 2023-05-16T13:54:24.729 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.721+0000 7f4baaffd640 1 --2- 172.21.15.39:0/3252358835 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f4b98066350 0x7f4b98068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:24.730 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.721+0000 7f4baaffd640 1 --2- 172.21.15.39:0/3252358835 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f4b98066350 0x7f4b98068800 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4ba40b7000 tx=0x7f4ba40af000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:24.733 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.725+0000 7f4b937fe640 1 -- 172.21.15.39:0/3252358835 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f4b9c061680 con 0x7f4bac089260 2023-05-16T13:54:24.789 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.781+0000 7fe64ed6d640 1 Processor -- start 2023-05-16T13:54:24.789 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.777+0000 7f0a1861f640 1 Processor -- start 2023-05-16T13:54:24.790 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.781+0000 7fe64ed6d640 1 -- start start 2023-05-16T13:54:24.791 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.777+0000 7f0a1861f640 1 -- start start 2023-05-16T13:54:24.791 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.777+0000 7f0a1861f640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f0a100ccb00 0x7f0a100c88b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:24.791 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.777+0000 7f0a1861f640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0a10089260 0x7f0a1006b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:24.792 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.777+0000 7f0a1861f640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a100ceca0 con 0x7f0a1006bd00 2023-05-16T13:54:24.792 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.777+0000 7f0a1861f640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a1006c180 con 0x7f0a100ccb00 2023-05-16T13:54:24.792 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.777+0000 7f0a1861f640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a100ce0b0 con 0x7f0a10089260 2023-05-16T13:54:24.792 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.777+0000 7f0a163bb640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f0a100ccb00 0x7f0a100c88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:24.792 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.777+0000 7f0a163bb640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f0a100ccb00 0x7f0a100c88b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60072/0 (socket says 172.21.15.39:60072) 2023-05-16T13:54:24.792 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.777+0000 7f0a163bb640 1 -- 172.21.15.39:0/4251497505 learned_addr learned my addr 172.21.15.39:0/4251497505 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:24.792 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.781+0000 7f0a153b9640 1 -- 172.21.15.39:0/4251497505 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1869329092 0 0) 0x7f0a100ceca0 con 0x7f0a1006bd00 2023-05-16T13:54:24.793 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.781+0000 7f0a153b9640 1 -- 172.21.15.39:0/4251497505 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09fc005740 con 0x7f0a1006bd00 2023-05-16T13:54:24.793 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.781+0000 7f0a153b9640 1 -- 172.21.15.39:0/4251497505 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1176173222 0 0) 0x7f09fc005740 con 0x7f0a1006bd00 2023-05-16T13:54:24.793 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.781+0000 7f0a153b9640 1 -- 172.21.15.39:0/4251497505 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0a10089260 msgr2=0x7f0a1006b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:24.793 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.781+0000 7f0a15bba640 1 --2- 172.21.15.39:0/4251497505 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0a10089260 0x7f0a1006b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:24.793 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.781+0000 7f0a153b9640 1 --2- 172.21.15.39:0/4251497505 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0a10089260 0x7f0a1006b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:24.793 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.781+0000 7f0a153b9640 1 -- 172.21.15.39:0/4251497505 >> v2:172.21.15.39:3300/0 conn(0x7f0a100ccb00 msgr2=0x7f0a100c88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:24.793 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.781+0000 7f0a153b9640 1 --2- 172.21.15.39:0/4251497505 >> v2:172.21.15.39:3300/0 conn(0x7f0a100ccb00 0x7f0a100c88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:24.794 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.781+0000 7fe64ed6d640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe6480ab8d0 0x7fe64815cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:24.794 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.781+0000 7f0a153b9640 1 -- 172.21.15.39:0/4251497505 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a100cdc20 con 0x7f0a1006bd00 2023-05-16T13:54:24.794 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.781+0000 7f0a153b9640 1 -- 172.21.15.39:0/4251497505 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1738805496 0 0) 0x7f0a08001a00 con 0x7f0a1006bd00 2023-05-16T13:54:24.794 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.781+0000 7f0a153b9640 1 -- 172.21.15.39:0/4251497505 >> v1:172.21.15.39:6789/0 conn(0x7f0a1006bd00 legacy=0x7f0a1006cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:24.795 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.781+0000 7fe64ed6d640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6480ad1c0 con 0x7fe64815fae0 2023-05-16T13:54:24.795 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.781+0000 7f0a153b9640 1 --2- 172.21.15.39:0/4251497505 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09fc005c00 0x7f09fc006010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:24.795 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.781+0000 7f0a153b9640 1 --2- 172.21.15.39:0/4251497505 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f09fc0065a0 0x7f09fc006a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:24.795 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.781+0000 7f0a153b9640 1 --2- 172.21.15.39:0/4251497505 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09fc007290 0x7f09fc00bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:24.796 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.781+0000 7f0a153b9640 1 -- 172.21.15.39:0/4251497505 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1006c180 con 0x7f09fc005c00 2023-05-16T13:54:24.796 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.781+0000 7f0a153b9640 1 -- 172.21.15.39:0/4251497505 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a100ce0b0 con 0x7f09fc007290 2023-05-16T13:54:24.796 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.781+0000 7f0a153b9640 1 -- 172.21.15.39:0/4251497505 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09fc00c280 con 0x7f09fc0065a0 2023-05-16T13:54:24.796 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.781+0000 7f0a163bb640 1 --2- 172.21.15.39:0/4251497505 >> v2:172.21.15.39:3300/0 conn(0x7f0a100ccb00 0x7f0a100c88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:54:24.796 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.781+0000 7f0a16bbc640 1 --2- 172.21.15.39:0/4251497505 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09fc007290 0x7f09fc00bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:24.796 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.781+0000 7f0a15bba640 1 --2- 172.21.15.39:0/4251497505 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0a10089260 0x7f0a1006b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-16T13:54:24.796 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.781+0000 7f0a15bba640 1 --2- 172.21.15.39:0/4251497505 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f09fc0065a0 0x7f09fc006a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:24.797 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.781+0000 7fe64ed6d640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6480ca580 con 0x7fe64806b7c0 2023-05-16T13:54:24.797 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.781+0000 7fe64ed6d640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6480ce0b0 con 0x7fe6480ab8d0 2023-05-16T13:54:24.797 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.781+0000 7f0a163bb640 1 --2- 172.21.15.39:0/4251497505 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09fc005c00 0x7f09fc006010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:24.798 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.781+0000 7f0a16bbc640 1 -- 172.21.15.39:0/4251497505 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f09fc0065a0 msgr2=0x7f09fc006a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:24.798 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.781+0000 7f0a16bbc640 1 --2- 172.21.15.39:0/4251497505 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f09fc0065a0 0x7f09fc006a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:24.798 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.781+0000 7f0a16bbc640 1 -- 172.21.15.39:0/4251497505 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09fc005c00 msgr2=0x7f09fc006010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:24.798 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.781+0000 7f0a16bbc640 1 --2- 172.21.15.39:0/4251497505 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09fc005c00 0x7f09fc006010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:24.798 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.781+0000 7f0a16bbc640 1 -- 172.21.15.39:0/4251497505 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a100cdc20 con 0x7f09fc007290 2023-05-16T13:54:24.799 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.785+0000 7fe64cb09640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fe64806b7c0 0x7fe64806bb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.39:41296/0 (socket says 172.21.15.39:41296) 2023-05-16T13:54:24.799 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.785+0000 7fe647fff640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe6480ab8d0 0x7fe64815cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:24.799 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.785+0000 7fe64cb09640 1 -- 172.21.15.39:0/219866434 learned_addr learned my addr 172.21.15.39:0/219866434 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:24.799 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.785+0000 7fe647fff640 1 -- 172.21.15.39:0/219866434 >> v1:172.21.15.118:6789/0 conn(0x7fe64806b7c0 legacy=0x7fe64806bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:24.799 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.785+0000 7fe647fff640 1 -- 172.21.15.39:0/219866434 >> v1:172.21.15.39:6789/0 conn(0x7fe64815fae0 legacy=0x7fe64815ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:24.799 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.785+0000 7fe647fff640 1 -- 172.21.15.39:0/219866434 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6480ad760 con 0x7fe6480ab8d0 2023-05-16T13:54:24.800 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.785+0000 7f1b3495a640 1 Processor -- start 2023-05-16T13:54:24.800 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.785+0000 7f1b3495a640 1 -- start start 2023-05-16T13:54:24.800 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.785+0000 7f1b3495a640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1b280e6ac0 0x7f1b28053400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:24.800 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.785+0000 7f1b3495a640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1b280366a0 0x7f1b28036ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:24.800 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.785+0000 7f1b3495a640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b28037020 con 0x7f1b280e6e90 2023-05-16T13:54:24.801 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.785+0000 7f1b3495a640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b2804f8f0 con 0x7f1b280366a0 2023-05-16T13:54:24.801 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.785+0000 7f1b3495a640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b28051170 con 0x7f1b280e6ac0 2023-05-16T13:54:24.801 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.789+0000 7fe647fff640 1 --2- 172.21.15.39:0/219866434 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe6480ab8d0 0x7fe64815cfb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe634009770 tx=0x7fe63401c180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5dfd4900c794044c server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:24.801 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.789+0000 7f1b2ffff640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1b280366a0 0x7f1b28036ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:24.802 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.789+0000 7f1b2effd640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f1b280e6e90 0x7f1b28006a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.39:41302/0 (socket says 172.21.15.39:41302) 2023-05-16T13:54:24.802 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.789+0000 7f1b2effd640 1 -- 172.21.15.39:0/3822464226 learned_addr learned my addr 172.21.15.39:0/3822464226 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:24.802 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.789+0000 7f1b2f7fe640 1 --2- 172.21.15.39:0/3822464226 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1b280e6ac0 0x7f1b28053400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:24.802 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.789+0000 7fe6477fe640 1 -- 172.21.15.39:0/219866434 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6340ab600 con 0x7fe6480ab8d0 2023-05-16T13:54:24.803 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.789+0000 7f1b2ffff640 1 -- 172.21.15.39:0/3822464226 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1b280e6ac0 msgr2=0x7f1b28053400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:24.803 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.789+0000 7f1b2ffff640 1 --2- 172.21.15.39:0/3822464226 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1b280e6ac0 0x7f1b28053400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:24.803 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.789+0000 7f1b2ffff640 1 -- 172.21.15.39:0/3822464226 >> v1:172.21.15.118:6789/0 conn(0x7f1b280e6e90 legacy=0x7f1b28006a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:24.803 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.789+0000 7fe6477fe640 1 -- 172.21.15.39:0/219866434 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6340a7050 con 0x7fe6480ab8d0 2023-05-16T13:54:24.804 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.789+0000 7f1b2ffff640 1 -- 172.21.15.39:0/3822464226 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b2804f610 con 0x7f1b280366a0 2023-05-16T13:54:24.804 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.789+0000 7fe6477fe640 1 -- 172.21.15.39:0/219866434 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6340ab980 con 0x7fe6480ab8d0 2023-05-16T13:54:24.804 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.789+0000 7f1b2f7fe640 1 --2- 172.21.15.39:0/3822464226 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1b280e6ac0 0x7f1b28053400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:54:24.805 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.789+0000 7f0a16bbc640 1 --2- 172.21.15.39:0/4251497505 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09fc007290 0x7f09fc00bb90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0a0800c4e0 tx=0x7f0a0801cf40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e5740aaab51fc45 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:24.805 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.789+0000 7fe64ed6d640 1 -- 172.21.15.39:0/219866434 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe6480ab8d0 msgr2=0x7fe64815cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:24.805 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.789+0000 7fe64ed6d640 1 --2- 172.21.15.39:0/219866434 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe6480ab8d0 0x7fe64815cfb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe634009770 tx=0x7fe63401c180 comp rx=0 tx=0).stop 2023-05-16T13:54:24.805 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.789+0000 7f0a153b9640 1 -- 172.21.15.39:0/4251497505 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a080a5c00 con 0x7f09fc007290 2023-05-16T13:54:24.806 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.789+0000 7fe64ed6d640 1 -- 172.21.15.39:0/219866434 shutdown_connections 2023-05-16T13:54:24.806 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.789+0000 7fe64ed6d640 1 --2- 172.21.15.39:0/219866434 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe6480ab8d0 0x7fe64815cfb0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:24.806 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.789+0000 7fe64ed6d640 1 -- 172.21.15.39:0/219866434 >> 172.21.15.39:0/219866434 conn(0x7fe6480cb970 msgr2=0x7fe6480ce260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:24.806 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.789+0000 7f0a153b9640 1 -- 172.21.15.39:0/4251497505 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a080a5d80 con 0x7f09fc007290 2023-05-16T13:54:24.807 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.789+0000 7f0a153b9640 1 -- 172.21.15.39:0/4251497505 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a080ad680 con 0x7f09fc007290 2023-05-16T13:54:24.807 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.789+0000 7fe64ed6d640 1 -- 172.21.15.39:0/219866434 shutdown_connections 2023-05-16T13:54:24.807 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.789+0000 7fe64ed6d640 1 -- 172.21.15.39:0/219866434 wait complete. 2023-05-16T13:54:24.808 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.789+0000 7f0a1861f640 1 -- 172.21.15.39:0/4251497505 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09fc007290 msgr2=0x7f09fc00bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:24.808 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.789+0000 7f0a1861f640 1 --2- 172.21.15.39:0/4251497505 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09fc007290 0x7f09fc00bb90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0a0800c4e0 tx=0x7f0a0801cf40 comp rx=0 tx=0).stop 2023-05-16T13:54:24.808 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.789+0000 7f0a16bbc640 1 -- 172.21.15.39:0/4251497505 reap_dead start 2023-05-16T13:54:24.808 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.789+0000 7f0a1861f640 1 -- 172.21.15.39:0/4251497505 shutdown_connections 2023-05-16T13:54:24.808 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.789+0000 7f0a1861f640 1 -- 172.21.15.39:0/4251497505 >> 172.21.15.39:0/4251497505 conn(0x7f0a100cb970 msgr2=0x7f0a100ce260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:24.809 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.789+0000 7fe64ed6d640 1 Processor -- start 2023-05-16T13:54:24.809 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.793+0000 7fe64ed6d640 1 -- start start 2023-05-16T13:54:24.809 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.793+0000 7fe64ed6d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe64806b7c0 0x7fe6481f1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:24.809 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.793+0000 7fe64ed6d640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe6480ab8d0 0x7fe6480b3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:24.810 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.789+0000 7f0a1861f640 1 -- 172.21.15.39:0/4251497505 shutdown_connections 2023-05-16T13:54:24.810 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.789+0000 7f0a1861f640 1 -- 172.21.15.39:0/4251497505 wait complete. 2023-05-16T13:54:24.810 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.793+0000 7fe64ed6d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe64815fae0 0x7fe648070920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:24.810 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.793+0000 7f1b2ffff640 1 --2- 172.21.15.39:0/3822464226 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b280366a0 0x7f1b28036ae0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1b30067f50 tx=0x7f1b30096130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab1e27e8e5268111 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:24.811 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.793+0000 7fe64cb09640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe64806b7c0 0x7fe6481f1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:24.811 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.793+0000 7fe64cb09640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe64806b7c0 0x7fe6481f1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.39:35126/0 (socket says 172.21.15.39:35126) 2023-05-16T13:54:24.811 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.793+0000 7fe64cb09640 1 -- 172.21.15.39:0/362519033 learned_addr learned my addr 172.21.15.39:0/362519033 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:24.811 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.793+0000 7f0a1861f640 1 Processor -- start 2023-05-16T13:54:24.812 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.793+0000 7fe647fff640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe6480ab8d0 0x7fe6480b3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:24.812 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.793+0000 7f0a1861f640 1 -- start start 2023-05-16T13:54:24.813 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.793+0000 7fe64ed6d640 1 -- 172.21.15.39:0/362519033 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6481f5bd0 con 0x7fe64815fae0 2023-05-16T13:54:24.813 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.793+0000 7fe64ed6d640 1 -- 172.21.15.39:0/362519033 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6481f5300 con 0x7fe64806b7c0 2023-05-16T13:54:24.813 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.793+0000 7fe64ed6d640 1 -- 172.21.15.39:0/362519033 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6481f1bb0 con 0x7fe6480ab8d0 2023-05-16T13:54:24.813 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.793+0000 7f1b2e7fc640 1 -- 172.21.15.39:0/3822464226 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b30125660 con 0x7f1b280366a0 2023-05-16T13:54:24.814 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.793+0000 7f1b2e7fc640 1 -- 172.21.15.39:0/3822464226 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b30121050 con 0x7f1b280366a0 2023-05-16T13:54:24.814 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.793+0000 7f1b2e7fc640 1 -- 172.21.15.39:0/3822464226 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b30125a40 con 0x7f1b280366a0 2023-05-16T13:54:24.814 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.793+0000 7fe64d30a640 1 --2- 172.21.15.39:0/362519033 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe64815fae0 0x7fe648070920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:24.814 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.793+0000 7fe64cb09640 1 -- 172.21.15.39:0/362519033 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe6480ab8d0 msgr2=0x7fe6480b3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:24.814 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.793+0000 7fe64cb09640 1 --2- 172.21.15.39:0/362519033 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe6480ab8d0 0x7fe6480b3470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:24.815 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.793+0000 7fe64cb09640 1 -- 172.21.15.39:0/362519033 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe64815fae0 msgr2=0x7fe648070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:24.815 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.793+0000 7fe64cb09640 1 --2- 172.21.15.39:0/362519033 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe64815fae0 0x7fe648070920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:24.815 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.793+0000 7fe64cb09640 1 -- 172.21.15.39:0/362519033 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe634009420 con 0x7fe64806b7c0 2023-05-16T13:54:24.815 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.793+0000 7f1b3495a640 1 -- 172.21.15.39:0/3822464226 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b280366a0 msgr2=0x7f1b28036ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:24.815 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.793+0000 7f1b3495a640 1 --2- 172.21.15.39:0/3822464226 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b280366a0 0x7f1b28036ae0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1b30067f50 tx=0x7f1b30096130 comp rx=0 tx=0).stop 2023-05-16T13:54:24.816 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.797+0000 7fe64cb09640 1 --2- 172.21.15.39:0/362519033 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe64806b7c0 0x7fe6481f1670 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe63c00c7e0 tx=0x7fe63c00cca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:24.816 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.797+0000 7f1b3495a640 1 -- 172.21.15.39:0/3822464226 shutdown_connections 2023-05-16T13:54:24.816 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.797+0000 7f1b3495a640 1 --2- 172.21.15.39:0/3822464226 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b280366a0 0x7f1b28036ae0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:24.816 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.797+0000 7f1b3495a640 1 --2- 172.21.15.39:0/3822464226 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1b280e6ac0 0x7f1b28053400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:24.817 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.797+0000 7f1b3495a640 1 -- 172.21.15.39:0/3822464226 >> 172.21.15.39:0/3822464226 conn(0x7f1b280516a0 msgr2=0x7f1b28051aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:24.817 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.797+0000 7f1b3495a640 1 -- 172.21.15.39:0/3822464226 shutdown_connections 2023-05-16T13:54:24.817 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.797+0000 7f0a1861f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09fc007290 0x7f0a100c4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:24.817 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.797+0000 7fe6457fa640 1 -- 172.21.15.39:0/362519033 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63c0074e0 con 0x7fe64806b7c0 2023-05-16T13:54:24.818 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.797+0000 7f0a1861f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0a100c5330 0x7f0a10078fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:24.818 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.797+0000 7f0a1861f640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0a10079510 0x7f0a1007c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:24.818 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.797+0000 7f0a1861f640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a100c86e0 con 0x7f09fc007290 2023-05-16T13:54:24.818 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.797+0000 7f0a1861f640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a10079980 con 0x7f0a100c5330 2023-05-16T13:54:24.818 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.797+0000 7f0a1861f640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a100c76c0 con 0x7f0a10079510 2023-05-16T13:54:24.819 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.797+0000 7fe6457fa640 1 -- 172.21.15.39:0/362519033 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe63c007640 con 0x7fe64806b7c0 2023-05-16T13:54:24.819 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.797+0000 7fe6457fa640 1 -- 172.21.15.39:0/362519033 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63c004a30 con 0x7fe64806b7c0 2023-05-16T13:54:24.819 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.797+0000 7f0a163bb640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09fc007290 0x7f0a100c4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:24.820 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.797+0000 7f0a15bba640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0a100c5330 0x7f0a10078fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:24.820 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.797+0000 7f0a15bba640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0a100c5330 0x7f0a10078fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.39:35130/0 (socket says 172.21.15.39:35130) 2023-05-16T13:54:24.820 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.797+0000 7f0a15bba640 1 -- 172.21.15.39:0/2216336938 learned_addr learned my addr 172.21.15.39:0/2216336938 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:24.820 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.797+0000 7f0a163bb640 1 --2- 172.21.15.39:0/2216336938 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09fc007290 0x7f0a100c4c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60110/0 (socket says 172.21.15.39:60110) 2023-05-16T13:54:24.820 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.797+0000 7fe64ed6d640 1 -- 172.21.15.39:0/362519033 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6480ceb90 con 0x7fe64806b7c0 2023-05-16T13:54:24.821 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.797+0000 7f0a15bba640 1 -- 172.21.15.39:0/2216336938 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0a10079510 msgr2=0x7f0a1007c3c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-16T13:54:24.821 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.797+0000 7f0a15bba640 1 --2- 172.21.15.39:0/2216336938 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0a10079510 0x7f0a1007c3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:24.821 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.797+0000 7f0a15bba640 1 -- 172.21.15.39:0/2216336938 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09fc007290 msgr2=0x7f0a100c4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:24.821 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.797+0000 7f0a15bba640 1 --2- 172.21.15.39:0/2216336938 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09fc007290 0x7f0a100c4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:24.821 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.797+0000 7f0a15bba640 1 -- 172.21.15.39:0/2216336938 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a100cd8b0 con 0x7f0a100c5330 2023-05-16T13:54:24.822 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.797+0000 7fe64ed6d640 1 -- 172.21.15.39:0/362519033 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe64815c380 con 0x7fe64806b7c0 2023-05-16T13:54:24.822 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.797+0000 7f0a15bba640 1 --2- 172.21.15.39:0/2216336938 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0a100c5330 0x7f0a10078fd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c00e520 tx=0x7f0a0c00e610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:24.822 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.797+0000 7f1b3495a640 1 -- 172.21.15.39:0/3822464226 wait complete. 2023-05-16T13:54:24.823 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.797+0000 7f0a06ffd640 1 -- 172.21.15.39:0/2216336938 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c00ee40 con 0x7f0a100c5330 2023-05-16T13:54:24.823 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.797+0000 7f0a1861f640 1 -- 172.21.15.39:0/2216336938 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a100cf1d0 con 0x7f0a100c5330 2023-05-16T13:54:24.823 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.797+0000 7f1b3495a640 1 Processor -- start 2023-05-16T13:54:24.824 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.797+0000 7f0a1861f640 1 -- 172.21.15.39:0/2216336938 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a100cc160 con 0x7f0a100c5330 2023-05-16T13:54:24.824 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.797+0000 7f1b3495a640 1 -- start start 2023-05-16T13:54:24.824 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.801+0000 7f0a06ffd640 1 -- 172.21.15.39:0/2216336938 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a0c004020 con 0x7f0a100c5330 2023-05-16T13:54:24.824 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.801+0000 7fe6457fa640 1 -- 172.21.15.39:0/362519033 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe63c004b90 con 0x7fe64806b7c0 2023-05-16T13:54:24.825 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.801+0000 7f0a06ffd640 1 -- 172.21.15.39:0/2216336938 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c004190 con 0x7f0a100c5330 2023-05-16T13:54:24.825 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.801+0000 7f0a1861f640 1 -- 172.21.15.39:0/2216336938 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09f8005260 con 0x7f0a100c5330 2023-05-16T13:54:24.825 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.801+0000 7fe6457fa640 1 --2- 172.21.15.39:0/362519033 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fe62c066350 0x7fe62c068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:24.826 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.801+0000 7fe6457fa640 1 -- 172.21.15.39:0/362519033 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe63c0837e0 con 0x7fe64806b7c0 2023-05-16T13:54:24.826 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.801+0000 7f1b3495a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b280366a0 0x7f1b28035d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:24.826 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.801+0000 7f1b3495a640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1b280e6ac0 0x7f1b280dd980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:24.826 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.801+0000 7f1b3495a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b280e6e90 0x7f1b281876d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:24.826 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.801+0000 7f1b3495a640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b28049c60 con 0x7f1b280e6e90 2023-05-16T13:54:24.827 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.801+0000 7f1b3495a640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b28049f40 con 0x7f1b280366a0 2023-05-16T13:54:24.827 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.801+0000 7f1b3495a640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2804a220 con 0x7f1b280e6ac0 2023-05-16T13:54:24.827 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.801+0000 7f1b2effd640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1b280e6ac0 0x7f1b280dd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:24.827 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.801+0000 7fe647fff640 1 --2- 172.21.15.39:0/362519033 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fe62c066350 0x7fe62c068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:24.828 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.801+0000 7fdef7398640 1 Processor -- start 2023-05-16T13:54:24.828 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.801+0000 7f1b2effd640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1b280e6ac0 0x7f1b280dd980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.39:33760/0 (socket says 172.21.15.39:33760) 2023-05-16T13:54:24.828 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.801+0000 7f1b2effd640 1 -- 172.21.15.39:0/2526429576 learned_addr learned my addr 172.21.15.39:0/2526429576 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:24.828 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.801+0000 7fdef7398640 1 -- start start 2023-05-16T13:54:24.829 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.801+0000 7f0a06ffd640 1 -- 172.21.15.39:0/2216336938 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0a0c0042f0 con 0x7f0a100c5330 2023-05-16T13:54:24.829 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.801+0000 7f1b2effd640 1 -- 172.21.15.39:0/2526429576 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b280366a0 msgr2=0x7f1b28035d50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-16T13:54:24.829 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.801+0000 7f1b2effd640 1 --2- 172.21.15.39:0/2526429576 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b280366a0 0x7f1b28035d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:24.830 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.801+0000 7f1b2effd640 1 -- 172.21.15.39:0/2526429576 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b280e6e90 msgr2=0x7f1b281876d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-16T13:54:24.830 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.801+0000 7f1b2effd640 1 --2- 172.21.15.39:0/2526429576 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b280e6e90 0x7f1b281876d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:24.830 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.801+0000 7f1b2effd640 1 -- 172.21.15.39:0/2526429576 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b2804f270 con 0x7f1b280e6ac0 2023-05-16T13:54:24.830 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.801+0000 7f1b2effd640 1 --2- 172.21.15.39:0/2526429576 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1b280e6ac0 0x7f1b280dd980 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c00c400 tx=0x7f1b1c00c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:24.830 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.801+0000 7fe647fff640 1 --2- 172.21.15.39:0/362519033 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fe62c066350 0x7fe62c068800 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe6340ad000 tx=0x7fe6340a6000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:24.831 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.801+0000 7f1b1bfff640 1 -- 172.21.15.39:0/2526429576 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b1c005cf0 con 0x7f1b280e6ac0 2023-05-16T13:54:24.831 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.801+0000 7f1b1bfff640 1 -- 172.21.15.39:0/2526429576 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b1c005e50 con 0x7f1b280e6ac0 2023-05-16T13:54:24.831 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.805+0000 7f1b1bfff640 1 -- 172.21.15.39:0/2526429576 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b1c0072d0 con 0x7f1b280e6ac0 2023-05-16T13:54:24.831 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.805+0000 7f1b3495a640 1 -- 172.21.15.39:0/2526429576 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b28052ee0 con 0x7f1b280e6ac0 2023-05-16T13:54:24.831 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.805+0000 7f1b3495a640 1 -- 172.21.15.39:0/2526429576 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b28038280 con 0x7f1b280e6ac0 2023-05-16T13:54:24.832 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.805+0000 7fdef7398640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdee8052b90 0x7fdee80540f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:24.832 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.805+0000 7fdef7398640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdee8053050 con 0x7fdee80dead0 2023-05-16T13:54:24.832 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.805+0000 7fdef7398640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdee8053330 con 0x7fdee8054630 2023-05-16T13:54:24.832 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.805+0000 7fdef7398640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdee8053610 con 0x7fdee8052b90 2023-05-16T13:54:24.833 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.805+0000 7f0a06ffd640 1 --2- 172.21.15.39:0/2216336938 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f09f4066350 0x7f09f4068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:24.833 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.805+0000 7fdef4933640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdee8052b90 0x7fdee80540f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:24.833 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.805+0000 7fdef4933640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdee8052b90 0x7fdee80540f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.39:33770/0 (socket says 172.21.15.39:33770) 2023-05-16T13:54:24.833 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.805+0000 7fdef4933640 1 -- 172.21.15.39:0/1312227093 learned_addr learned my addr 172.21.15.39:0/1312227093 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:24.834 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.805+0000 7f0a163bb640 1 --2- 172.21.15.39:0/2216336938 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f09f4066350 0x7f09f4068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:24.834 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.805+0000 7f0a06ffd640 1 -- 172.21.15.39:0/2216336938 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0a0c083750 con 0x7f0a100c5330 2023-05-16T13:54:24.834 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.805+0000 7fdef4933640 1 -- 172.21.15.39:0/1312227093 >> v1:172.21.15.118:6789/0 conn(0x7fdee8054630 legacy=0x7fdee8006ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:24.834 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.805+0000 7fdef4933640 1 -- 172.21.15.39:0/1312227093 >> v1:172.21.15.39:6789/0 conn(0x7fdee80dead0 legacy=0x7fdee803a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:24.835 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.805+0000 7f0a163bb640 1 --2- 172.21.15.39:0/2216336938 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f09f4066350 0x7f09f4068800 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0a000045b0 tx=0x7f0a0000c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:24.835 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.805+0000 7fdef4933640 1 -- 172.21.15.39:0/1312227093 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdee80538f0 con 0x7fdee8052b90 2023-05-16T13:54:24.835 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.805+0000 7fe64ed6d640 1 -- 172.21.15.39:0/362519033 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6480ca560 con 0x7fe64806b7c0 2023-05-16T13:54:24.836 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.805+0000 7fcd007c0640 1 Processor -- start 2023-05-16T13:54:24.836 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.805+0000 7fcd007c0640 1 -- start start 2023-05-16T13:54:24.836 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.805+0000 7f1b1bfff640 1 -- 172.21.15.39:0/2526429576 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1b1c007430 con 0x7f1b280e6ac0 2023-05-16T13:54:24.837 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.805+0000 7f1b3495a640 1 -- 172.21.15.39:0/2526429576 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b280054a0 con 0x7f1b280e6ac0 2023-05-16T13:54:24.837 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.809+0000 7f0a06ffd640 1 -- 172.21.15.39:0/2216336938 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f0a0c050c40 con 0x7f0a100c5330 2023-05-16T13:54:24.837 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.809+0000 7fcd007c0640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fccf8071500 0x7fccf80cc380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:24.838 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.809+0000 7fcd007c0640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fccf80cde40 0x7fccf815d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:24.838 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.809+0000 7fcd007c0640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccf815d700 con 0x7fccf80aff00 2023-05-16T13:54:24.838 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.809+0000 7fcd007c0640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccf80c8be0 con 0x7fccf8071500 2023-05-16T13:54:24.838 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.809+0000 7fcd007c0640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccf80c8ec0 con 0x7fccf80cde40 2023-05-16T13:54:24.838 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.809+0000 7fccfdd5b640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fccf80cde40 0x7fccf815d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:24.838 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.809+0000 7fccfdd5b640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fccf80cde40 0x7fccf815d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.39:33784/0 (socket says 172.21.15.39:33784) 2023-05-16T13:54:24.838 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.809+0000 7fccfdd5b640 1 -- 172.21.15.39:0/752867604 learned_addr learned my addr 172.21.15.39:0/752867604 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:24.839 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.809+0000 7fccfe55c640 1 --2- 172.21.15.39:0/752867604 >> v2:172.21.15.39:3300/0 conn(0x7fccf8071500 0x7fccf80cc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:24.839 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.809+0000 7fccfdd5b640 1 -- 172.21.15.39:0/752867604 >> v2:172.21.15.39:3300/0 conn(0x7fccf8071500 msgr2=0x7fccf80cc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:24.839 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.809+0000 7fccfdd5b640 1 --2- 172.21.15.39:0/752867604 >> v2:172.21.15.39:3300/0 conn(0x7fccf8071500 0x7fccf80cc380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:24.839 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.809+0000 7fccfdd5b640 1 -- 172.21.15.39:0/752867604 >> v1:172.21.15.39:6789/0 conn(0x7fccf80aff00 legacy=0x7fccf81560b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:24.839 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.809+0000 7fccfdd5b640 1 -- 172.21.15.39:0/752867604 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf80ca8a0 con 0x7fccf80cde40 2023-05-16T13:54:24.839 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.809+0000 7fdef4933640 1 --2- 172.21.15.39:0/1312227093 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdee8052b90 0x7fdee80540f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdef004f3a0 tx=0x7fdef0096480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61b12e70e7fcaa78 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:24.840 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.809+0000 7f1b1bfff640 1 --2- 172.21.15.39:0/2526429576 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f1b14066350 0x7f1b14068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:24.840 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.809+0000 7f1b1bfff640 1 -- 172.21.15.39:0/2526429576 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1b1c0831a0 con 0x7f1b280e6ac0 2023-05-16T13:54:24.840 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.809+0000 7f1b2f7fe640 1 --2- 172.21.15.39:0/2526429576 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f1b14066350 0x7f1b14068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:24.840 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.809+0000 7f1b2f7fe640 1 --2- 172.21.15.39:0/2526429576 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f1b14066350 0x7f1b14068800 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1b24009710 tx=0x7f1b24008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:24.841 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.813+0000 7fccfdd5b640 1 --2- 172.21.15.39:0/752867604 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fccf80cde40 0x7fccf815d1c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fcce8009870 tx=0x7fcce801c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62ca6a96230f3ef0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:24.841 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.813+0000 7fdee7fff640 1 -- 172.21.15.39:0/1312227093 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef011eea0 con 0x7fdee8052b90 2023-05-16T13:54:24.841 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.813+0000 7fccfd55a640 1 -- 172.21.15.39:0/752867604 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce80ab650 con 0x7fccf80cde40 2023-05-16T13:54:24.841 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.813+0000 7fccfd55a640 1 -- 172.21.15.39:0/752867604 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcce80ab7b0 con 0x7fccf80cde40 2023-05-16T13:54:24.842 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.813+0000 7fccfd55a640 1 -- 172.21.15.39:0/752867604 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce80abb40 con 0x7fccf80cde40 2023-05-16T13:54:24.842 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.813+0000 7fdee7fff640 1 -- 172.21.15.39:0/1312227093 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdef0121050 con 0x7fdee8052b90 2023-05-16T13:54:24.842 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.813+0000 7f1b1bfff640 1 -- 172.21.15.39:0/2526429576 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f1b1c0506b0 con 0x7f1b280e6ac0 2023-05-16T13:54:24.842 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.813+0000 7fcd007c0640 1 -- 172.21.15.39:0/752867604 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fccf80cde40 msgr2=0x7fccf815d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:24.843 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.813+0000 7fcd007c0640 1 --2- 172.21.15.39:0/752867604 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fccf80cde40 0x7fccf815d1c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fcce8009870 tx=0x7fcce801c540 comp rx=0 tx=0).stop 2023-05-16T13:54:24.843 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.813+0000 7fdef7398640 1 -- 172.21.15.39:0/1312227093 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdee8052b90 msgr2=0x7fdee80540f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:24.843 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.813+0000 7fdef7398640 1 --2- 172.21.15.39:0/1312227093 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdee8052b90 0x7fdee80540f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdef004f3a0 tx=0x7fdef0096480 comp rx=0 tx=0).stop 2023-05-16T13:54:24.844 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.813+0000 7fcd007c0640 1 -- 172.21.15.39:0/752867604 shutdown_connections 2023-05-16T13:54:24.844 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.813+0000 7fcd007c0640 1 --2- 172.21.15.39:0/752867604 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fccf80cde40 0x7fccf815d1c0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:24.844 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.813+0000 7fcd007c0640 1 --2- 172.21.15.39:0/752867604 >> v2:172.21.15.39:3300/0 conn(0x7fccf8071500 0x7fccf80cc380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:24.844 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.813+0000 7fcd007c0640 1 -- 172.21.15.39:0/752867604 >> 172.21.15.39:0/752867604 conn(0x7fccf8069a50 msgr2=0x7fccf8069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:24.844 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.813+0000 7fdef7398640 1 -- 172.21.15.39:0/1312227093 shutdown_connections 2023-05-16T13:54:24.844 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.813+0000 7fdef7398640 1 --2- 172.21.15.39:0/1312227093 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdee8052b90 0x7fdee80540f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:24.845 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.813+0000 7fdef7398640 1 -- 172.21.15.39:0/1312227093 >> 172.21.15.39:0/1312227093 conn(0x7fdee8051590 msgr2=0x7fdee8051990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:24.845 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.813+0000 7fcd007c0640 1 -- 172.21.15.39:0/752867604 shutdown_connections 2023-05-16T13:54:24.845 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.813+0000 7fe6457fa640 1 -- 172.21.15.39:0/362519033 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fe63c050cf0 con 0x7fe64806b7c0 2023-05-16T13:54:24.846 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.813+0000 7fcd007c0640 1 -- 172.21.15.39:0/752867604 wait complete. 2023-05-16T13:54:24.846 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.817+0000 7fcd007c0640 1 Processor -- start 2023-05-16T13:54:24.847 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.817+0000 7fcd007c0640 1 -- start start 2023-05-16T13:54:24.847 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.821+0000 7fcd007c0640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fccf8071500 0x7fccf8152270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:24.847 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.821+0000 7fcd007c0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fccf80aff00 0x7fccf81527b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:24.847 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.821+0000 7fcd007c0640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fccf80cde40 0x7fccf8157e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:24.847 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.821+0000 7fccfe55c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fccf8071500 0x7fccf8152270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:24.847 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.821+0000 7fccfe55c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fccf8071500 0x7fccf8152270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.39:35144/0 (socket says 172.21.15.39:35144) 2023-05-16T13:54:24.847 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.821+0000 7fccfdd5b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fccf80aff00 0x7fccf81527b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:24.847 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.821+0000 7fccfdd5b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fccf80aff00 0x7fccf81527b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60130/0 (socket says 172.21.15.39:60130) 2023-05-16T13:54:24.848 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.821+0000 7fccfed5d640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fccf80cde40 0x7fccf8157e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:24.848 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.821+0000 7fccfed5d640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fccf80cde40 0x7fccf8157e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.39:33808/0 (socket says 172.21.15.39:33808) 2023-05-16T13:54:24.848 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.821+0000 7fccfe55c640 1 -- 172.21.15.39:0/2103271351 learned_addr learned my addr 172.21.15.39:0/2103271351 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:24.848 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.821+0000 7fcd007c0640 1 -- 172.21.15.39:0/2103271351 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf815a390 con 0x7fccf80aff00 2023-05-16T13:54:24.848 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.821+0000 7fcd007c0640 1 -- 172.21.15.39:0/2103271351 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf815a670 con 0x7fccf8071500 2023-05-16T13:54:24.848 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.821+0000 7fcd007c0640 1 -- 172.21.15.39:0/2103271351 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccf80ad0c0 con 0x7fccf80cde40 2023-05-16T13:54:24.849 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.817+0000 7fdef7398640 1 -- 172.21.15.39:0/1312227093 shutdown_connections 2023-05-16T13:54:24.849 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.817+0000 7fdef7398640 1 -- 172.21.15.39:0/1312227093 wait complete. 2023-05-16T13:54:24.849 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.817+0000 7fdef7398640 1 Processor -- start 2023-05-16T13:54:24.849 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.817+0000 7fdef7398640 1 -- start start 2023-05-16T13:54:24.849 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.821+0000 7fdef7398640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdee8052b90 0x7fdee804e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:24.849 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.821+0000 7fdef7398640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdee8054630 0x7fdee804aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:24.850 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.821+0000 7fdef5134640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdee8052b90 0x7fdee804e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:24.850 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.821+0000 7fdef7398640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdee80dead0 0x7fdee80cd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:24.850 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.821+0000 7fdef5134640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdee8052b90 0x7fdee804e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60138/0 (socket says 172.21.15.39:60138) 2023-05-16T13:54:24.850 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.821+0000 7fdef5134640 1 -- 172.21.15.39:0/4054677171 learned_addr learned my addr 172.21.15.39:0/4054677171 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:24.850 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.821+0000 7fdef7398640 1 -- 172.21.15.39:0/4054677171 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdee8034b90 con 0x7fdee8052b90 2023-05-16T13:54:24.850 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.821+0000 7fdef7398640 1 -- 172.21.15.39:0/4054677171 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdee804ebc0 con 0x7fdee80dead0 2023-05-16T13:54:24.850 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.821+0000 7fdef7398640 1 -- 172.21.15.39:0/4054677171 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdee80e1c70 con 0x7fdee8054630 2023-05-16T13:54:24.851 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.821+0000 7fdef5935640 1 --2- 172.21.15.39:0/4054677171 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdee80dead0 0x7fdee80cd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:24.851 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.821+0000 7fdef4933640 1 --2- 172.21.15.39:0/4054677171 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdee8054630 0x7fdee804aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:24.851 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.821+0000 7fccfed5d640 1 -- 172.21.15.39:0/2103271351 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fccf8071500 msgr2=0x7fccf8152270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:24.851 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.821+0000 7fccfed5d640 1 --2- 172.21.15.39:0/2103271351 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fccf8071500 0x7fccf8152270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:24.851 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.821+0000 7fccfed5d640 1 -- 172.21.15.39:0/2103271351 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fccf80aff00 msgr2=0x7fccf81527b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:24.852 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.825+0000 7fccfed5d640 1 --2- 172.21.15.39:0/2103271351 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fccf80aff00 0x7fccf81527b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:24.852 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.825+0000 7fccfed5d640 1 -- 172.21.15.39:0/2103271351 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce80094d0 con 0x7fccf80cde40 2023-05-16T13:54:24.852 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.821+0000 7fdef5134640 1 -- 172.21.15.39:0/4054677171 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdee8054630 msgr2=0x7fdee804aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:24.852 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.821+0000 7fdef5134640 1 --2- 172.21.15.39:0/4054677171 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdee8054630 0x7fdee804aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:24.852 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.821+0000 7fdef5134640 1 -- 172.21.15.39:0/4054677171 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdee80dead0 msgr2=0x7fdee80cd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:24.852 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.821+0000 7fdef5134640 1 --2- 172.21.15.39:0/4054677171 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdee80dead0 0x7fdee80cd9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:24.853 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.825+0000 7fccfdd5b640 1 --2- 172.21.15.39:0/2103271351 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fccf80aff00 0x7fccf81527b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-16T13:54:24.853 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.821+0000 7fdef5134640 1 -- 172.21.15.39:0/4054677171 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdee8007790 con 0x7fdee8052b90 2023-05-16T13:54:24.853 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.821+0000 7fdef4933640 1 --2- 172.21.15.39:0/4054677171 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdee8054630 0x7fdee804aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-16T13:54:24.854 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.821+0000 7fdef5134640 1 --2- 172.21.15.39:0/4054677171 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdee8052b90 0x7fdee804e680 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fdee000b410 tx=0x7fdee000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:24.854 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.821+0000 7fdee5ffb640 1 -- 172.21.15.39:0/4054677171 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee0004020 con 0x7fdee8052b90 2023-05-16T13:54:24.854 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.821+0000 7fdee5ffb640 1 -- 172.21.15.39:0/4054677171 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdee0004180 con 0x7fdee8052b90 2023-05-16T13:54:24.854 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.821+0000 7fdee5ffb640 1 -- 172.21.15.39:0/4054677171 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee0011630 con 0x7fdee8052b90 2023-05-16T13:54:24.854 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.821+0000 7fdef7398640 1 -- 172.21.15.39:0/4054677171 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdee8007600 con 0x7fdee8052b90 2023-05-16T13:54:24.854 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.825+0000 7fdef7398640 1 -- 172.21.15.39:0/4054677171 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdee8037a80 con 0x7fdee8052b90 2023-05-16T13:54:24.855 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.825+0000 7fccfed5d640 1 --2- 172.21.15.39:0/2103271351 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fccf80cde40 0x7fccf8157e70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fccf000c730 tx=0x7fccf000cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:24.855 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.829+0000 7fdee5ffb640 1 -- 172.21.15.39:0/4054677171 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdee0011790 con 0x7fdee8052b90 2023-05-16T13:54:24.855 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.825+0000 7fdef7398640 1 -- 172.21.15.39:0/4054677171 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdee8005350 con 0x7fdee8052b90 2023-05-16T13:54:24.856 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.829+0000 7fdee5ffb640 1 --2- 172.21.15.39:0/4054677171 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fded40662e0 0x7fded4068790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:24.856 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.829+0000 7fdee5ffb640 1 -- 172.21.15.39:0/4054677171 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdee0083a40 con 0x7fdee8052b90 2023-05-16T13:54:24.856 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.829+0000 7fdef4933640 1 --2- 172.21.15.39:0/4054677171 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fded40662e0 0x7fded4068790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:24.856 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.829+0000 7fdef4933640 1 --2- 172.21.15.39:0/4054677171 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fded40662e0 0x7fded4068790 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdee800c510 tx=0x7fdef0127040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:24.857 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.833+0000 7fcceeffd640 1 -- 172.21.15.39:0/2103271351 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf0003b80 con 0x7fccf80cde40 2023-05-16T13:54:24.857 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.833+0000 7fcceeffd640 1 -- 172.21.15.39:0/2103271351 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf0003ce0 con 0x7fccf80cde40 2023-05-16T13:54:24.857 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.837+0000 7fcceeffd640 1 -- 172.21.15.39:0/2103271351 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf000aa30 con 0x7fccf80cde40 2023-05-16T13:54:24.857 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.837+0000 7fcd007c0640 1 -- 172.21.15.39:0/2103271351 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccf80718d0 con 0x7fccf80cde40 2023-05-16T13:54:24.857 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.837+0000 7fcd007c0640 1 -- 172.21.15.39:0/2103271351 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccf80ca550 con 0x7fccf80cde40 2023-05-16T13:54:24.857 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.837+0000 7fcd007c0640 1 -- 172.21.15.39:0/2103271351 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccf80b0710 con 0x7fccf80cde40 2023-05-16T13:54:24.857 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.837+0000 7fcceeffd640 1 -- 172.21.15.39:0/2103271351 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fccf000ab90 con 0x7fccf80cde40 2023-05-16T13:54:24.858 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.841+0000 7fcceeffd640 1 --2- 172.21.15.39:0/2103271351 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fccdc066350 0x7fccdc068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:24.858 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.841+0000 7fcceeffd640 1 -- 172.21.15.39:0/2103271351 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fccf00838e0 con 0x7fccf80cde40 2023-05-16T13:54:24.858 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.841+0000 7fdee5ffb640 1 -- 172.21.15.39:0/4054677171 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fdee0050f30 con 0x7fdee8052b90 2023-05-16T13:54:24.858 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.841+0000 7fccfe55c640 1 --2- 172.21.15.39:0/2103271351 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fccdc066350 0x7fccdc068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:24.859 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.841+0000 7fccfe55c640 1 --2- 172.21.15.39:0/2103271351 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fccdc066350 0x7fccdc068800 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fccf4009b80 tx=0x7fccf4009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:24.859 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.845+0000 7fcceeffd640 1 -- 172.21.15.39:0/2103271351 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fccf0050e80 con 0x7fccf80cde40 2023-05-16T13:54:24.866 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.857+0000 7f200fdbc640 1 Processor -- start 2023-05-16T13:54:24.866 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.857+0000 7f200fdbc640 1 -- start start 2023-05-16T13:54:24.869 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.861+0000 7f200fdbc640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2000038560 0x7f20000553c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:24.869 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.861+0000 7f200fdbc640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20000570b0 0x7f2000057530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:24.870 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.861+0000 7f200db58640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f200003ab80 0x7f200003af50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.39:41312/0 (socket says 172.21.15.39:41312) 2023-05-16T13:54:24.870 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.861+0000 7f200fdbc640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f200003bf50 con 0x7f200003ab80 2023-05-16T13:54:24.870 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.861+0000 7f200fdbc640 1 -- 172.21.15.39:0/3955265244 --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2000053ff0 con 0x7f2000038560 2023-05-16T13:54:24.870 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.861+0000 7f200fdbc640 1 -- 172.21.15.39:0/3955265244 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2000053750 con 0x7f20000570b0 2023-05-16T13:54:24.871 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.861+0000 7f200db58640 1 -- 172.21.15.39:0/3955265244 learned_addr learned my addr 172.21.15.39:0/3955265244 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:24.871 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.861+0000 7f200e359640 1 --2- 172.21.15.39:0/3955265244 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20000570b0 0x7f2000057530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:24.871 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.861+0000 7f200d357640 1 --2- 172.21.15.39:0/3955265244 >> v2:172.21.15.118:3300/0 conn(0x7f2000038560 0x7f20000553c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:24.871 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.861+0000 7f200e359640 1 -- 172.21.15.39:0/3955265244 >> v2:172.21.15.118:3300/0 conn(0x7f2000038560 msgr2=0x7f20000553c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:24.872 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.861+0000 7f200e359640 1 --2- 172.21.15.39:0/3955265244 >> v2:172.21.15.118:3300/0 conn(0x7f2000038560 0x7f20000553c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:24.872 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.861+0000 7f200e359640 1 -- 172.21.15.39:0/3955265244 >> v1:172.21.15.118:6789/0 conn(0x7f200003ab80 legacy=0x7f200003af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:24.872 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.861+0000 7f200e359640 1 -- 172.21.15.39:0/3955265244 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2000007100 con 0x7f20000570b0 2023-05-16T13:54:24.875 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.865+0000 7f200e359640 1 --2- 172.21.15.39:0/3955265244 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20000570b0 0x7f2000057530 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2008067f50 tx=0x7f20080961f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66e8db58678f62e3 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:24.875 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.865+0000 7f200cb56640 1 -- 172.21.15.39:0/3955265244 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2008126440 con 0x7f20000570b0 2023-05-16T13:54:24.876 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.869+0000 7f200cb56640 1 -- 172.21.15.39:0/3955265244 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2000058280 con 0x7f20000570b0 2023-05-16T13:54:24.876 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.869+0000 7f200fdbc640 1 -- 172.21.15.39:0/3955265244 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20000570b0 msgr2=0x7f2000057530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:24.877 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.869+0000 7f200fdbc640 1 --2- 172.21.15.39:0/3955265244 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20000570b0 0x7f2000057530 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2008067f50 tx=0x7f20080961f0 comp rx=0 tx=0).stop 2023-05-16T13:54:24.877 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.869+0000 7f200fdbc640 1 -- 172.21.15.39:0/3955265244 shutdown_connections 2023-05-16T13:54:24.877 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.869+0000 7f200fdbc640 1 --2- 172.21.15.39:0/3955265244 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20000570b0 0x7f2000057530 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:24.877 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.869+0000 7f200fdbc640 1 --2- 172.21.15.39:0/3955265244 >> v2:172.21.15.118:3300/0 conn(0x7f2000038560 0x7f20000553c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:24.877 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.869+0000 7f200fdbc640 1 -- 172.21.15.39:0/3955265244 >> 172.21.15.39:0/3955265244 conn(0x7f2000055b80 msgr2=0x7f2000055f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:24.878 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.869+0000 7f200fdbc640 1 -- 172.21.15.39:0/3955265244 shutdown_connections 2023-05-16T13:54:24.878 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.869+0000 7f200fdbc640 1 -- 172.21.15.39:0/3955265244 wait complete. 2023-05-16T13:54:24.880 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.873+0000 7f200fdbc640 1 Processor -- start 2023-05-16T13:54:24.880 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.873+0000 7f200fdbc640 1 -- start start 2023-05-16T13:54:24.882 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.873+0000 7f200fdbc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2000038560 0x7f20000dd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:24.882 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.873+0000 7f200fdbc640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f200003ab80 0x7f20000ddee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:24.883 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.873+0000 7f200fdbc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f20000df4d0 0x7f2000038a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:24.883 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.873+0000 7f200fdbc640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20000ddd30 con 0x7f20000df4d0 2023-05-16T13:54:24.883 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.873+0000 7f200fdbc640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20000de850 con 0x7f2000038560 2023-05-16T13:54:24.883 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.873+0000 7f200fdbc640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20000deb30 con 0x7f200003ab80 2023-05-16T13:54:24.883 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.873+0000 7f200db58640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2000038560 0x7f20000dd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:24.883 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.873+0000 7f200d357640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f200003ab80 0x7f20000ddee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:24.884 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.873+0000 7f200d357640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f200003ab80 0x7f20000ddee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.39:33826/0 (socket says 172.21.15.39:33826) 2023-05-16T13:54:24.884 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.873+0000 7f200d357640 1 -- 172.21.15.39:0/4278158625 learned_addr learned my addr 172.21.15.39:0/4278158625 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:24.884 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.873+0000 7f200e359640 1 --2- 172.21.15.39:0/4278158625 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f20000df4d0 0x7f2000038a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:24.885 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.877+0000 7f200d357640 1 -- 172.21.15.39:0/4278158625 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2000038560 msgr2=0x7f20000dd7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:24.885 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.877+0000 7f200d357640 1 --2- 172.21.15.39:0/4278158625 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2000038560 0x7f20000dd7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:24.885 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.877+0000 7f200d357640 1 -- 172.21.15.39:0/4278158625 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f20000df4d0 msgr2=0x7f2000038a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:24.885 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.877+0000 7f200d357640 1 --2- 172.21.15.39:0/4278158625 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f20000df4d0 0x7f2000038a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:24.885 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.877+0000 7f200d357640 1 -- 172.21.15.39:0/4278158625 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2000006cd0 con 0x7f200003ab80 2023-05-16T13:54:24.885 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.877+0000 7f200db58640 1 --2- 172.21.15.39:0/4278158625 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2000038560 0x7f20000dd7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-16T13:54:24.885 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.877+0000 7f200e359640 1 --2- 172.21.15.39:0/4278158625 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f20000df4d0 0x7f2000038a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-16T13:54:24.886 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.877+0000 7f200d357640 1 --2- 172.21.15.39:0/4278158625 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f200003ab80 0x7f20000ddee0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1ff800e870 tx=0x7f1ff800ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:24.886 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.877+0000 7f1ffe7fc640 1 -- 172.21.15.39:0/4278158625 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff800ee60 con 0x7f200003ab80 2023-05-16T13:54:24.886 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.877+0000 7f200fdbc640 1 -- 172.21.15.39:0/4278158625 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f200003ec70 con 0x7f200003ab80 2023-05-16T13:54:24.887 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.877+0000 7f200fdbc640 1 -- 172.21.15.39:0/4278158625 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2000006e60 con 0x7f200003ab80 2023-05-16T13:54:24.887 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.877+0000 7f1ffe7fc640 1 -- 172.21.15.39:0/4278158625 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ff800c940 con 0x7f200003ab80 2023-05-16T13:54:24.887 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.877+0000 7f1ffe7fc640 1 -- 172.21.15.39:0/4278158625 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff800ccf0 con 0x7f200003ab80 2023-05-16T13:54:24.887 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.877+0000 7f200fdbc640 1 -- 172.21.15.39:0/4278158625 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ff0005260 con 0x7f200003ab80 2023-05-16T13:54:24.890 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.881+0000 7f1ffe7fc640 1 -- 172.21.15.39:0/4278158625 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1ff8013470 con 0x7f200003ab80 2023-05-16T13:54:24.890 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.881+0000 7f1ffe7fc640 1 --2- 172.21.15.39:0/4278158625 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f1fec066350 0x7f1fec068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:24.891 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.881+0000 7f200db58640 1 --2- 172.21.15.39:0/4278158625 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f1fec066350 0x7f1fec068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:24.892 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.885+0000 7f200db58640 1 --2- 172.21.15.39:0/4278158625 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f1fec066350 0x7f1fec068800 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2000038170 tx=0x7f2004009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:24.892 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.885+0000 7f1ffe7fc640 1 -- 172.21.15.39:0/4278158625 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1ff8083d50 con 0x7f200003ab80 2023-05-16T13:54:24.894 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.885+0000 7f1ffe7fc640 1 -- 172.21.15.39:0/4278158625 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f1ff8051260 con 0x7f200003ab80 2023-05-16T13:54:24.990 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.981+0000 7ff9a898f640 1 -- 172.21.15.39:0/775232298 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff9a4160670 con 0x7ff9a406c880 2023-05-16T13:54:24.991 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.985+0000 7ff992ffd640 1 -- 172.21.15.39:0/775232298 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff9a4160670 con 0x7ff9a406c880 2023-05-16T13:54:24.996 INFO:teuthology.orchestra.run.smithi039.stdout:60129542151 2023-05-16T13:54:24.998 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.989+0000 7ff9a898f640 1 -- 172.21.15.39:0/775232298 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ff9840662d0 msgr2=0x7ff984068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:24.998 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.989+0000 7ff9a898f640 1 --2- 172.21.15.39:0/775232298 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ff9840662d0 0x7ff984068780 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff9a4165cc0 tx=0x7ff99400f040 comp rx=0 tx=0).stop 2023-05-16T13:54:24.998 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.989+0000 7ff9a898f640 1 -- 172.21.15.39:0/775232298 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9a406c880 msgr2=0x7ff9a40888f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:24.998 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.989+0000 7ff9a898f640 1 --2- 172.21.15.39:0/775232298 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9a406c880 0x7ff9a40888f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff99801a440 tx=0x7ff99800a3f0 comp rx=0 tx=0).stop 2023-05-16T13:54:24.999 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.989+0000 7ff9a898f640 1 -- 172.21.15.39:0/775232298 shutdown_connections 2023-05-16T13:54:24.999 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.989+0000 7ff9a898f640 1 --2- 172.21.15.39:0/775232298 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ff9840662d0 0x7ff984068780 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:24.999 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.989+0000 7ff9a898f640 1 --2- 172.21.15.39:0/775232298 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff9a416d5f0 0x7ff9a416b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:24.999 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.989+0000 7ff9a898f640 1 --2- 172.21.15.39:0/775232298 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff9a40b0160 0x7ff9a41612f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:25.000 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.989+0000 7ff9a898f640 1 --2- 172.21.15.39:0/775232298 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9a406c880 0x7ff9a40888f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:25.000 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.989+0000 7ff9a898f640 1 -- 172.21.15.39:0/775232298 >> 172.21.15.39:0/775232298 conn(0x7ff9a4069a50 msgr2=0x7ff9a40adee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:25.000 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.989+0000 7ff9a898f640 1 -- 172.21.15.39:0/775232298 shutdown_connections 2023-05-16T13:54:25.000 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:24.989+0000 7ff9a898f640 1 -- 172.21.15.39:0/775232298 wait complete. 2023-05-16T13:54:25.031 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.0 2023-05-16T13:54:25.090 DEBUG:teuthology.parallel:result is None 2023-05-16T13:54:25.090 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.065+0000 7f4bb1420640 1 -- 172.21.15.39:0/3252358835 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f4bac04ed20 con 0x7f4bac089260 2023-05-16T13:54:25.091 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.065+0000 7f4b937fe640 1 -- 172.21.15.39:0/3252358835 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4b9c028020 con 0x7f4bac089260 2023-05-16T13:54:25.091 INFO:teuthology.orchestra.run.smithi039.stdout:64424509447 2023-05-16T13:54:25.093 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.069+0000 7f4bb1420640 1 -- 172.21.15.39:0/3252358835 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f4b98066350 msgr2=0x7f4b98068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:25.093 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.069+0000 7f4bb1420640 1 --2- 172.21.15.39:0/3252358835 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f4b98066350 0x7f4b98068800 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4ba40b7000 tx=0x7f4ba40af000 comp rx=0 tx=0).stop 2023-05-16T13:54:25.093 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.069+0000 7f4bb1420640 1 -- 172.21.15.39:0/3252358835 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4bac089260 msgr2=0x7f4bac0c7f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:25.094 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.069+0000 7f4bb1420640 1 --2- 172.21.15.39:0/3252358835 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4bac089260 0x7f4bac0c7f00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c00c520 tx=0x7f4b9c00c9e0 comp rx=0 tx=0).stop 2023-05-16T13:54:25.094 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.069+0000 7f4bb1420640 1 -- 172.21.15.39:0/3252358835 shutdown_connections 2023-05-16T13:54:25.094 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.069+0000 7f4bb1420640 1 --2- 172.21.15.39:0/3252358835 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f4b98066350 0x7f4b98068800 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:25.095 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.069+0000 7f4bb1420640 1 --2- 172.21.15.39:0/3252358835 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4bac089260 0x7f4bac0c7f00 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:25.095 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.069+0000 7f4bb1420640 1 --2- 172.21.15.39:0/3252358835 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4bac0ccb00 0x7f4bac165fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:25.096 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.069+0000 7f4bb1420640 1 --2- 172.21.15.39:0/3252358835 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4bac06bed0 0x7f4bac087340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:25.096 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.069+0000 7f4bb1420640 1 -- 172.21.15.39:0/3252358835 >> 172.21.15.39:0/3252358835 conn(0x7f4bac0cb970 msgr2=0x7f4bac0b30a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:25.096 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.069+0000 7f4bb1420640 1 -- 172.21.15.39:0/3252358835 shutdown_connections 2023-05-16T13:54:25.097 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.069+0000 7f4bb1420640 1 -- 172.21.15.39:0/3252358835 wait complete. 2023-05-16T13:54:25.101 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.093+0000 7fdef7398640 1 -- 172.21.15.39:0/4054677171 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fdee804b420 con 0x7fdee8052b90 2023-05-16T13:54:25.102 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.093+0000 7fdee5ffb640 1 -- 172.21.15.39:0/4054677171 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdee0015020 con 0x7fdee8052b90 2023-05-16T13:54:25.102 INFO:teuthology.orchestra.run.smithi039.stdout:60129542151 2023-05-16T13:54:25.104 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.097+0000 7fdef7398640 1 -- 172.21.15.39:0/4054677171 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fded40662e0 msgr2=0x7fded4068790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:25.104 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.097+0000 7fdef7398640 1 --2- 172.21.15.39:0/4054677171 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fded40662e0 0x7fded4068790 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdee800c510 tx=0x7fdef0127040 comp rx=0 tx=0).stop 2023-05-16T13:54:25.104 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.097+0000 7fdef7398640 1 -- 172.21.15.39:0/4054677171 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdee8052b90 msgr2=0x7fdee804e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:25.104 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.097+0000 7fdef7398640 1 --2- 172.21.15.39:0/4054677171 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdee8052b90 0x7fdee804e680 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fdee000b410 tx=0x7fdee000b8d0 comp rx=0 tx=0).stop 2023-05-16T13:54:25.105 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.097+0000 7fdef7398640 1 -- 172.21.15.39:0/4054677171 shutdown_connections 2023-05-16T13:54:25.106 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.097+0000 7fdef7398640 1 --2- 172.21.15.39:0/4054677171 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fded40662e0 0x7fded4068790 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:25.106 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.097+0000 7fdef7398640 1 --2- 172.21.15.39:0/4054677171 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdee8054630 0x7fdee804aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:25.106 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.097+0000 7fdef7398640 1 --2- 172.21.15.39:0/4054677171 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdee80dead0 0x7fdee80cd9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:25.106 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.097+0000 7fdef7398640 1 --2- 172.21.15.39:0/4054677171 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdee8052b90 0x7fdee804e680 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:25.107 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.097+0000 7fdef7398640 1 -- 172.21.15.39:0/4054677171 >> 172.21.15.39:0/4054677171 conn(0x7fdee8051590 msgr2=0x7fdee80cfed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:25.107 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.097+0000 7fdef7398640 1 -- 172.21.15.39:0/4054677171 shutdown_connections 2023-05-16T13:54:25.107 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.097+0000 7fdef7398640 1 -- 172.21.15.39:0/4054677171 wait complete. 2023-05-16T13:54:25.110 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509447 for osd.5 2023-05-16T13:54:25.110 DEBUG:teuthology.parallel:result is None 2023-05-16T13:54:25.124 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.3 2023-05-16T13:54:25.125 DEBUG:teuthology.parallel:result is None 2023-05-16T13:54:25.127 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.117+0000 7fe64ed6d640 1 -- 172.21.15.39:0/362519033 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe64804ed20 con 0x7fe64806b7c0 2023-05-16T13:54:25.128 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.121+0000 7fe6457fa640 1 -- 172.21.15.39:0/362519033 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe63c018020 con 0x7fe64806b7c0 2023-05-16T13:54:25.128 INFO:teuthology.orchestra.run.smithi039.stdout:60129542150 2023-05-16T13:54:25.130 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.121+0000 7fe64ed6d640 1 -- 172.21.15.39:0/362519033 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fe62c066350 msgr2=0x7fe62c068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:25.130 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.121+0000 7fe64ed6d640 1 --2- 172.21.15.39:0/362519033 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fe62c066350 0x7fe62c068800 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe6340ad000 tx=0x7fe6340a6000 comp rx=0 tx=0).stop 2023-05-16T13:54:25.130 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.121+0000 7fe64ed6d640 1 -- 172.21.15.39:0/362519033 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe64806b7c0 msgr2=0x7fe6481f1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:25.130 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.121+0000 7fe64ed6d640 1 --2- 172.21.15.39:0/362519033 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe64806b7c0 0x7fe6481f1670 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe63c00c7e0 tx=0x7fe63c00cca0 comp rx=0 tx=0).stop 2023-05-16T13:54:25.131 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.121+0000 7fe64ed6d640 1 -- 172.21.15.39:0/362519033 shutdown_connections 2023-05-16T13:54:25.131 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.121+0000 7fe64ed6d640 1 --2- 172.21.15.39:0/362519033 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fe62c066350 0x7fe62c068800 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:25.131 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.121+0000 7fe64ed6d640 1 --2- 172.21.15.39:0/362519033 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe6480ab8d0 0x7fe6480b3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:25.131 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.121+0000 7fe64ed6d640 1 --2- 172.21.15.39:0/362519033 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe64815fae0 0x7fe648070920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:25.131 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.121+0000 7fe64ed6d640 1 --2- 172.21.15.39:0/362519033 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe64806b7c0 0x7fe6481f1670 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:25.132 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.121+0000 7fe64ed6d640 1 -- 172.21.15.39:0/362519033 >> 172.21.15.39:0/362519033 conn(0x7fe6480cb970 msgr2=0x7fe6480c9230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:25.132 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.121+0000 7fe64ed6d640 1 -- 172.21.15.39:0/362519033 shutdown_connections 2023-05-16T13:54:25.132 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.121+0000 7fe64ed6d640 1 -- 172.21.15.39:0/362519033 wait complete. 2023-05-16T13:54:25.136 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.129+0000 7f0a1861f640 1 -- 172.21.15.39:0/2216336938 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f09f8005510 con 0x7f0a100c5330 2023-05-16T13:54:25.136 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.129+0000 7f0a06ffd640 1 -- 172.21.15.39:0/2216336938 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0a0c054260 con 0x7f0a100c5330 2023-05-16T13:54:25.137 INFO:teuthology.orchestra.run.smithi039.stdout:64424509447 2023-05-16T13:54:25.140 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.133+0000 7f0a1861f640 1 -- 172.21.15.39:0/2216336938 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f09f4066350 msgr2=0x7f09f4068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:25.140 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.133+0000 7f0a1861f640 1 --2- 172.21.15.39:0/2216336938 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f09f4066350 0x7f09f4068800 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0a000045b0 tx=0x7f0a0000c040 comp rx=0 tx=0).stop 2023-05-16T13:54:25.140 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.133+0000 7f0a1861f640 1 -- 172.21.15.39:0/2216336938 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0a100c5330 msgr2=0x7f0a10078fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:25.140 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.133+0000 7f0a1861f640 1 --2- 172.21.15.39:0/2216336938 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0a100c5330 0x7f0a10078fd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c00e520 tx=0x7f0a0c00e610 comp rx=0 tx=0).stop 2023-05-16T13:54:25.141 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.133+0000 7f0a1861f640 1 -- 172.21.15.39:0/2216336938 shutdown_connections 2023-05-16T13:54:25.141 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.133+0000 7f0a1861f640 1 --2- 172.21.15.39:0/2216336938 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f09f4066350 0x7f09f4068800 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:25.141 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.133+0000 7f0a1861f640 1 --2- 172.21.15.39:0/2216336938 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0a10079510 0x7f0a1007c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:25.141 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.133+0000 7f0a1861f640 1 --2- 172.21.15.39:0/2216336938 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0a100c5330 0x7f0a10078fd0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:25.141 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.133+0000 7f0a1861f640 1 --2- 172.21.15.39:0/2216336938 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09fc007290 0x7f0a100c4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:25.141 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.133+0000 7f0a1861f640 1 -- 172.21.15.39:0/2216336938 >> 172.21.15.39:0/2216336938 conn(0x7f0a100cb970 msgr2=0x7f0a1016adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:25.141 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.133+0000 7f0a1861f640 1 -- 172.21.15.39:0/2216336938 shutdown_connections 2023-05-16T13:54:25.141 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.133+0000 7f0a1861f640 1 -- 172.21.15.39:0/2216336938 wait complete. 2023-05-16T13:54:25.149 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.141+0000 7f1b3495a640 1 -- 172.21.15.39:0/2526429576 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f1b2804a360 con 0x7f1b280e6ac0 2023-05-16T13:54:25.151 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.1 2023-05-16T13:54:25.151 DEBUG:teuthology.parallel:result is None 2023-05-16T13:54:25.151 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.141+0000 7f1b1bfff640 1 -- 172.21.15.39:0/2526429576 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1b2804a360 con 0x7f1b280e6ac0 2023-05-16T13:54:25.152 INFO:teuthology.orchestra.run.smithi039.stdout:64424509446 2023-05-16T13:54:25.153 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.145+0000 7f1b3495a640 1 -- 172.21.15.39:0/2526429576 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f1b14066350 msgr2=0x7f1b14068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:25.154 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.145+0000 7f1b3495a640 1 --2- 172.21.15.39:0/2526429576 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f1b14066350 0x7f1b14068800 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1b24009710 tx=0x7f1b24008040 comp rx=0 tx=0).stop 2023-05-16T13:54:25.154 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.145+0000 7f1b3495a640 1 -- 172.21.15.39:0/2526429576 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1b280e6ac0 msgr2=0x7f1b280dd980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:25.154 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.145+0000 7f1b3495a640 1 --2- 172.21.15.39:0/2526429576 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1b280e6ac0 0x7f1b280dd980 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c00c400 tx=0x7f1b1c00c8c0 comp rx=0 tx=0).stop 2023-05-16T13:54:25.154 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.145+0000 7f1b3495a640 1 -- 172.21.15.39:0/2526429576 shutdown_connections 2023-05-16T13:54:25.154 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.145+0000 7f1b3495a640 1 --2- 172.21.15.39:0/2526429576 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f1b14066350 0x7f1b14068800 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:25.154 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.145+0000 7f1b3495a640 1 --2- 172.21.15.39:0/2526429576 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1b280e6ac0 0x7f1b280dd980 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:25.154 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.145+0000 7f1b3495a640 1 --2- 172.21.15.39:0/2526429576 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b280e6e90 0x7f1b281876d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:25.155 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.145+0000 7f1b3495a640 1 --2- 172.21.15.39:0/2526429576 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b280366a0 0x7f1b28035d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:25.155 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.145+0000 7f1b3495a640 1 -- 172.21.15.39:0/2526429576 >> 172.21.15.39:0/2526429576 conn(0x7f1b280516a0 msgr2=0x7f1b28033990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:25.155 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.145+0000 7f1b3495a640 1 -- 172.21.15.39:0/2526429576 shutdown_connections 2023-05-16T13:54:25.155 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.145+0000 7f1b3495a640 1 -- 172.21.15.39:0/2526429576 wait complete. 2023-05-16T13:54:25.161 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509447 for osd.7 2023-05-16T13:54:25.162 DEBUG:teuthology.parallel:result is None 2023-05-16T13:54:25.173 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509446 for osd.6 2023-05-16T13:54:25.173 DEBUG:teuthology.parallel:result is None 2023-05-16T13:54:25.185 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.177+0000 7fcd007c0640 1 -- 172.21.15.39:0/2103271351 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fccf8073c90 con 0x7fccf80cde40 2023-05-16T13:54:25.186 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.177+0000 7fcceeffd640 1 -- 172.21.15.39:0/2103271351 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fccf00544a0 con 0x7fccf80cde40 2023-05-16T13:54:25.186 INFO:teuthology.orchestra.run.smithi039.stdout:64424509447 2023-05-16T13:54:25.188 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.181+0000 7fcd007c0640 1 -- 172.21.15.39:0/2103271351 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fccdc066350 msgr2=0x7fccdc068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:25.188 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.181+0000 7fcd007c0640 1 --2- 172.21.15.39:0/2103271351 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fccdc066350 0x7fccdc068800 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fccf4009b80 tx=0x7fccf4009190 comp rx=0 tx=0).stop 2023-05-16T13:54:25.188 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.181+0000 7fcd007c0640 1 -- 172.21.15.39:0/2103271351 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fccf80cde40 msgr2=0x7fccf8157e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:25.188 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.181+0000 7fcd007c0640 1 --2- 172.21.15.39:0/2103271351 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fccf80cde40 0x7fccf8157e70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fccf000c730 tx=0x7fccf000cbf0 comp rx=0 tx=0).stop 2023-05-16T13:54:25.189 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.181+0000 7fcd007c0640 1 -- 172.21.15.39:0/2103271351 shutdown_connections 2023-05-16T13:54:25.189 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.181+0000 7fcd007c0640 1 --2- 172.21.15.39:0/2103271351 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fccdc066350 0x7fccdc068800 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:25.189 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.181+0000 7fcd007c0640 1 --2- 172.21.15.39:0/2103271351 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fccf80cde40 0x7fccf8157e70 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:25.189 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.181+0000 7fcd007c0640 1 --2- 172.21.15.39:0/2103271351 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fccf80aff00 0x7fccf81527b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:25.189 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.181+0000 7fcd007c0640 1 --2- 172.21.15.39:0/2103271351 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fccf8071500 0x7fccf8152270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:25.189 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.181+0000 7fcd007c0640 1 -- 172.21.15.39:0/2103271351 >> 172.21.15.39:0/2103271351 conn(0x7fccf8069a50 msgr2=0x7fccf80704f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:25.189 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.181+0000 7fcd007c0640 1 -- 172.21.15.39:0/2103271351 shutdown_connections 2023-05-16T13:54:25.190 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.181+0000 7fcd007c0640 1 -- 172.21.15.39:0/2103271351 wait complete. 2023-05-16T13:54:25.201 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.193+0000 7f200fdbc640 1 -- 172.21.15.39:0/4278158625 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1ff0005510 con 0x7f200003ab80 2023-05-16T13:54:25.201 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.193+0000 7f1ffe7fc640 1 -- 172.21.15.39:0/4278158625 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1ff8017090 con 0x7f200003ab80 2023-05-16T13:54:25.201 INFO:teuthology.orchestra.run.smithi039.stdout:60129542151 2023-05-16T13:54:25.203 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.193+0000 7f200fdbc640 1 -- 172.21.15.39:0/4278158625 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f1fec066350 msgr2=0x7f1fec068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:25.204 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.193+0000 7f200fdbc640 1 --2- 172.21.15.39:0/4278158625 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f1fec066350 0x7f1fec068800 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2000038170 tx=0x7f2004009040 comp rx=0 tx=0).stop 2023-05-16T13:54:25.204 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.193+0000 7f200fdbc640 1 -- 172.21.15.39:0/4278158625 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f200003ab80 msgr2=0x7f20000ddee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:25.204 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.193+0000 7f200fdbc640 1 --2- 172.21.15.39:0/4278158625 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f200003ab80 0x7f20000ddee0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1ff800e870 tx=0x7f1ff800ed30 comp rx=0 tx=0).stop 2023-05-16T13:54:25.204 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.193+0000 7f200fdbc640 1 -- 172.21.15.39:0/4278158625 shutdown_connections 2023-05-16T13:54:25.204 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.193+0000 7f200fdbc640 1 --2- 172.21.15.39:0/4278158625 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f1fec066350 0x7f1fec068800 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:25.204 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.193+0000 7f200fdbc640 1 --2- 172.21.15.39:0/4278158625 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f200003ab80 0x7f20000ddee0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:25.204 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.193+0000 7f200fdbc640 1 --2- 172.21.15.39:0/4278158625 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f20000df4d0 0x7f2000038a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:25.205 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.193+0000 7f200fdbc640 1 --2- 172.21.15.39:0/4278158625 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2000038560 0x7f20000dd7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:25.205 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.193+0000 7f200fdbc640 1 -- 172.21.15.39:0/4278158625 >> 172.21.15.39:0/4278158625 conn(0x7f2000055b80 msgr2=0x7f20000501d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:25.205 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.193+0000 7f200fdbc640 1 -- 172.21.15.39:0/4278158625 shutdown_connections 2023-05-16T13:54:25.205 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.197+0000 7f200fdbc640 1 -- 172.21.15.39:0/4278158625 wait complete. 2023-05-16T13:54:25.207 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509447 for osd.4 2023-05-16T13:54:25.207 DEBUG:teuthology.parallel:result is None 2023-05-16T13:54:25.222 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.2 2023-05-16T13:54:25.222 DEBUG:teuthology.parallel:result is None 2023-05-16T13:54:25.222 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-05-16T13:54:25.223 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-16T13:54:25.398 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.389+0000 7fbbe442d640 1 Processor -- start 2023-05-16T13:54:25.399 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.389+0000 7fbbe442d640 1 -- start start 2023-05-16T13:54:25.400 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.393+0000 7fbbe442d640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fbbdc158bf0 0x7fbbdc15d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:25.400 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.393+0000 7fbbe442d640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbbdc0cb4c0 0x7fbbdc0ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:25.400 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.393+0000 7fbbe442d640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbdc15d6a0 con 0x7fbbdc0703b0 2023-05-16T13:54:25.400 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.393+0000 7fbbe442d640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbdc070870 con 0x7fbbdc158bf0 2023-05-16T13:54:25.401 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.393+0000 7fbbe442d640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbdc070b50 con 0x7fbbdc0cb4c0 2023-05-16T13:54:25.401 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.393+0000 7fbbe21c9640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fbbdc158bf0 0x7fbbdc15d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:25.401 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.393+0000 7fbbe19c8640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fbbdc0703b0 0x7fbbdc0cadb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:60832/0 (socket says 172.21.15.39:60832) 2023-05-16T13:54:25.401 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.393+0000 7fbbe21c9640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fbbdc158bf0 0x7fbbdc15d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60166/0 (socket says 172.21.15.39:60166) 2023-05-16T13:54:25.401 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.393+0000 7fbbe19c8640 1 -- 172.21.15.39:0/3003297234 learned_addr learned my addr 172.21.15.39:0/3003297234 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:25.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.393+0000 7fbbe29ca640 1 --2- 172.21.15.39:0/3003297234 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbbdc0cb4c0 0x7fbbdc0ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:25.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.393+0000 7fbbe21c9640 1 -- 172.21.15.39:0/3003297234 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbbdc0cb4c0 msgr2=0x7fbbdc0ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:25.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.393+0000 7fbbe21c9640 1 --2- 172.21.15.39:0/3003297234 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbbdc0cb4c0 0x7fbbdc0ccda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:25.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.393+0000 7fbbe21c9640 1 -- 172.21.15.39:0/3003297234 >> v1:172.21.15.39:6789/0 conn(0x7fbbdc0703b0 legacy=0x7fbbdc0cadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:25.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.393+0000 7fbbe21c9640 1 -- 172.21.15.39:0/3003297234 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbdc070e30 con 0x7fbbdc158bf0 2023-05-16T13:54:25.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.393+0000 7fbbe11c7640 1 -- 172.21.15.39:0/3003297234 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2141112003 0 0) 0x7fbbcc001120 con 0x7fbbdc0703b0 2023-05-16T13:54:25.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.393+0000 7fbbe21c9640 1 --2- 172.21.15.39:0/3003297234 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbbdc158bf0 0x7fbbdc15d160 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbbd80097c0 tx=0x7fbbd801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcaf61cf49c349cf server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:25.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.397+0000 7fbbe11c7640 1 -- 172.21.15.39:0/3003297234 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd80ac620 con 0x7fbbdc158bf0 2023-05-16T13:54:25.404 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.397+0000 7fbbe11c7640 1 -- 172.21.15.39:0/3003297234 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd80ac780 con 0x7fbbdc158bf0 2023-05-16T13:54:25.404 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.397+0000 7fbbe11c7640 1 -- 172.21.15.39:0/3003297234 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd80acb10 con 0x7fbbdc158bf0 2023-05-16T13:54:25.404 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.397+0000 7fbbe442d640 1 -- 172.21.15.39:0/3003297234 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbbdc158bf0 msgr2=0x7fbbdc15d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:25.405 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.397+0000 7fbbe442d640 1 --2- 172.21.15.39:0/3003297234 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbbdc158bf0 0x7fbbdc15d160 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbbd80097c0 tx=0x7fbbd801c3c0 comp rx=0 tx=0).stop 2023-05-16T13:54:25.405 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.397+0000 7fbbe442d640 1 -- 172.21.15.39:0/3003297234 shutdown_connections 2023-05-16T13:54:25.405 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.397+0000 7fbbe442d640 1 --2- 172.21.15.39:0/3003297234 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbbdc0cb4c0 0x7fbbdc0ccda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:25.405 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.397+0000 7fbbe442d640 1 --2- 172.21.15.39:0/3003297234 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbbdc158bf0 0x7fbbdc15d160 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:25.405 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.397+0000 7fbbe442d640 1 -- 172.21.15.39:0/3003297234 >> 172.21.15.39:0/3003297234 conn(0x7fbbdc069a50 msgr2=0x7fbbdc069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:25.405 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.397+0000 7fbbe442d640 1 -- 172.21.15.39:0/3003297234 shutdown_connections 2023-05-16T13:54:25.405 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.397+0000 7fbbe442d640 1 -- 172.21.15.39:0/3003297234 wait complete. 2023-05-16T13:54:25.406 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.397+0000 7fbbe442d640 1 Processor -- start 2023-05-16T13:54:25.406 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.397+0000 7fbbe442d640 1 -- start start 2023-05-16T13:54:25.407 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.397+0000 7fbbe442d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbbdc0703b0 0x7fbbdc0c4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:25.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.397+0000 7fbbe442d640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbbdc0cb4c0 0x7fbbdc0afa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:25.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.397+0000 7fbbe442d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbbdc158bf0 0x7fbbdc0c9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:25.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.397+0000 7fbbe442d640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbdc159150 con 0x7fbbdc158bf0 2023-05-16T13:54:25.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.397+0000 7fbbe442d640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbdc0b00d0 con 0x7fbbdc0703b0 2023-05-16T13:54:25.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.397+0000 7fbbe442d640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbdc0b03b0 con 0x7fbbdc0cb4c0 2023-05-16T13:54:25.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.397+0000 7fbbe29ca640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbbdc158bf0 0x7fbbdc0c9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:25.409 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.397+0000 7fbbe29ca640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbbdc158bf0 0x7fbbdc0c9bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60168/0 (socket says 172.21.15.39:60168) 2023-05-16T13:54:25.409 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.397+0000 7fbbe29ca640 1 -- 172.21.15.39:0/3361987852 learned_addr learned my addr 172.21.15.39:0/3361987852 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:25.409 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.397+0000 7fbbe19c8640 1 --2- 172.21.15.39:0/3361987852 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbbdc0cb4c0 0x7fbbdc0afa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:25.409 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.397+0000 7fbbe21c9640 1 --2- 172.21.15.39:0/3361987852 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbbdc0703b0 0x7fbbdc0c4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:25.409 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.401+0000 7fbbe29ca640 1 -- 172.21.15.39:0/3361987852 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbbdc0cb4c0 msgr2=0x7fbbdc0afa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:25.409 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.401+0000 7fbbe29ca640 1 --2- 172.21.15.39:0/3361987852 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbbdc0cb4c0 0x7fbbdc0afa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:25.409 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.401+0000 7fbbe29ca640 1 -- 172.21.15.39:0/3361987852 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbbdc0703b0 msgr2=0x7fbbdc0c4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:25.410 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.401+0000 7fbbe29ca640 1 --2- 172.21.15.39:0/3361987852 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbbdc0703b0 0x7fbbdc0c4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:25.410 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.401+0000 7fbbe29ca640 1 -- 172.21.15.39:0/3361987852 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd8009420 con 0x7fbbdc158bf0 2023-05-16T13:54:25.410 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.401+0000 7fbbe21c9640 1 --2- 172.21.15.39:0/3361987852 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbbdc0703b0 0x7fbbdc0c4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:54:25.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.401+0000 7fbbe29ca640 1 --2- 172.21.15.39:0/3361987852 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbbdc158bf0 0x7fbbdc0c9bf0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbbd4007e30 tx=0x7fbbd400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:25.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.401+0000 7fbbd2ffd640 1 -- 172.21.15.39:0/3361987852 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd4014620 con 0x7fbbdc158bf0 2023-05-16T13:54:25.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.401+0000 7fbbd2ffd640 1 -- 172.21.15.39:0/3361987852 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd400ee90 con 0x7fbbdc158bf0 2023-05-16T13:54:25.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.401+0000 7fbbd2ffd640 1 -- 172.21.15.39:0/3361987852 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd40149c0 con 0x7fbbdc158bf0 2023-05-16T13:54:25.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.401+0000 7fbbe442d640 1 -- 172.21.15.39:0/3361987852 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbdc0ad950 con 0x7fbbdc158bf0 2023-05-16T13:54:25.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.401+0000 7fbbe442d640 1 -- 172.21.15.39:0/3361987852 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbdc158fc0 con 0x7fbbdc158bf0 2023-05-16T13:54:25.412 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.401+0000 7fbbe442d640 1 -- 172.21.15.39:0/3361987852 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbdc0cdaf0 con 0x7fbbdc158bf0 2023-05-16T13:54:25.412 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.401+0000 7fbbd2ffd640 1 -- 172.21.15.39:0/3361987852 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbbd4014b20 con 0x7fbbdc158bf0 2023-05-16T13:54:25.412 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.401+0000 7fbbd2ffd640 1 --2- 172.21.15.39:0/3361987852 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fbbc0066280 0x7fbbc0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:25.413 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.401+0000 7fbbd2ffd640 1 -- 172.21.15.39:0/3361987852 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbbd40846a0 con 0x7fbbdc158bf0 2023-05-16T13:54:25.413 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.401+0000 7fbbe21c9640 1 --2- 172.21.15.39:0/3361987852 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fbbc0066280 0x7fbbc0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:25.413 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.405+0000 7fbbe21c9640 1 --2- 172.21.15.39:0/3361987852 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fbbc0066280 0x7fbbc0068730 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbbd80ae000 tx=0x7fbbd80a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:25.415 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.405+0000 7fbbd2ffd640 1 -- 172.21.15.39:0/3361987852 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fbbd4051a80 con 0x7fbbdc158bf0 2023-05-16T13:54:25.568 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.561+0000 7fbbe442d640 1 -- 172.21.15.39:0/3361987852 --> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbbdc073c90 con 0x7fbbc0066280 2023-05-16T13:54:25.575 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.569+0000 7fbbd2ffd640 1 -- 172.21.15.39:0/3361987852 <== mgr.4098 v2:172.21.15.39:6832/288296800 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286654 (secure 0 0 0) 0x7fbbdc073c90 con 0x7fbbc0066280 2023-05-16T13:54:25.578 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:54:25.579 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2023-05-16T13:54:25.580 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.569+0000 7fbbe442d640 1 -- 172.21.15.39:0/3361987852 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fbbc0066280 msgr2=0x7fbbc0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:25.580 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.569+0000 7fbbe442d640 1 --2- 172.21.15.39:0/3361987852 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fbbc0066280 0x7fbbc0068730 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbbd80ae000 tx=0x7fbbd80a7000 comp rx=0 tx=0).stop 2023-05-16T13:54:25.580 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.569+0000 7fbbe442d640 1 -- 172.21.15.39:0/3361987852 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbbdc158bf0 msgr2=0x7fbbdc0c9bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:25.580 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.569+0000 7fbbe442d640 1 --2- 172.21.15.39:0/3361987852 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbbdc158bf0 0x7fbbdc0c9bf0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbbd4007e30 tx=0x7fbbd400e4b0 comp rx=0 tx=0).stop 2023-05-16T13:54:25.581 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.569+0000 7fbbe442d640 1 -- 172.21.15.39:0/3361987852 shutdown_connections 2023-05-16T13:54:25.581 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.569+0000 7fbbe442d640 1 --2- 172.21.15.39:0/3361987852 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fbbc0066280 0x7fbbc0068730 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:25.581 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.569+0000 7fbbe442d640 1 --2- 172.21.15.39:0/3361987852 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbbdc0cb4c0 0x7fbbdc0afa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:25.581 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.569+0000 7fbbe442d640 1 --2- 172.21.15.39:0/3361987852 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbbdc158bf0 0x7fbbdc0c9bf0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:25.581 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.569+0000 7fbbe442d640 1 --2- 172.21.15.39:0/3361987852 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbbdc0703b0 0x7fbbdc0c4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:25.581 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.569+0000 7fbbe442d640 1 -- 172.21.15.39:0/3361987852 >> 172.21.15.39:0/3361987852 conn(0x7fbbdc069a50 msgr2=0x7fbbdc157860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:25.581 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.569+0000 7fbbe442d640 1 -- 172.21.15.39:0/3361987852 shutdown_connections 2023-05-16T13:54:25.582 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.569+0000 7fbbe442d640 1 -- 172.21.15.39:0/3361987852 wait complete. 2023-05-16T13:54:25.598 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2023-05-16T13:54:24.831390+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":90952,"kb_used_data":3144,"kb_used_omap":0,"kb_used_meta":87744,"kb_avail":754883768,"statfs":{"total":773094113280,"available":773000978432,"internally_reserved":0,"allocated":3219456,"data_stored":1915524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":89849856},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.635974"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.593210+0000","last_change":"2023-05-16T13:54:15.211201+0000","last_active":"2023-05-16T13:54:16.593210+0000","last_peered":"2023-05-16T13:54:16.593210+0000","last_clean":"2023-05-16T13:54:16.593210+0000","last_became_active":"2023-05-16T13:54:15.210864+0000","last_became_peered":"2023-05-16T13:54:15.210864+0000","last_unstale":"2023-05-16T13:54:16.593210+0000","last_undegraded":"2023-05-16T13:54:16.593210+0000","last_fullsized":"2023-05-16T13:54:16.593210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:00:33.678077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.095018+0000","last_change":"2023-05-16T13:54:15.225613+0000","last_active":"2023-05-16T13:54:17.095018+0000","last_peered":"2023-05-16T13:54:17.095018+0000","last_clean":"2023-05-16T13:54:17.095018+0000","last_became_active":"2023-05-16T13:54:15.225255+0000","last_became_peered":"2023-05-16T13:54:15.225255+0000","last_unstale":"2023-05-16T13:54:17.095018+0000","last_undegraded":"2023-05-16T13:54:17.095018+0000","last_fullsized":"2023-05-16T13:54:17.095018+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:23:36.578764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.203170+0000","last_change":"2023-05-16T13:54:15.228669+0000","last_active":"2023-05-16T13:54:16.203170+0000","last_peered":"2023-05-16T13:54:16.203170+0000","last_clean":"2023-05-16T13:54:16.203170+0000","last_became_active":"2023-05-16T13:54:15.228389+0000","last_became_peered":"2023-05-16T13:54:15.228389+0000","last_unstale":"2023-05-16T13:54:16.203170+0000","last_undegraded":"2023-05-16T13:54:16.203170+0000","last_fullsized":"2023-05-16T13:54:16.203170+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:58:10.666710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.201977+0000","last_change":"2023-05-16T13:54:15.228352+0000","last_active":"2023-05-16T13:54:16.201977+0000","last_peered":"2023-05-16T13:54:16.201977+0000","last_clean":"2023-05-16T13:54:16.201977+0000","last_became_active":"2023-05-16T13:54:15.228013+0000","last_became_peered":"2023-05-16T13:54:15.228013+0000","last_unstale":"2023-05-16T13:54:16.201977+0000","last_undegraded":"2023-05-16T13:54:16.201977+0000","last_fullsized":"2023-05-16T13:54:16.201977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:43:13.895642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.094813+0000","last_change":"2023-05-16T13:54:15.232326+0000","last_active":"2023-05-16T13:54:17.094813+0000","last_peered":"2023-05-16T13:54:17.094813+0000","last_clean":"2023-05-16T13:54:17.094813+0000","last_became_active":"2023-05-16T13:54:15.231852+0000","last_became_peered":"2023-05-16T13:54:15.231852+0000","last_unstale":"2023-05-16T13:54:17.094813+0000","last_undegraded":"2023-05-16T13:54:17.094813+0000","last_fullsized":"2023-05-16T13:54:17.094813+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T23:24:29.119212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.202661+0000","last_change":"2023-05-16T13:54:15.228982+0000","last_active":"2023-05-16T13:54:16.202661+0000","last_peered":"2023-05-16T13:54:16.202661+0000","last_clean":"2023-05-16T13:54:16.202661+0000","last_became_active":"2023-05-16T13:54:15.228468+0000","last_became_peered":"2023-05-16T13:54:15.228468+0000","last_unstale":"2023-05-16T13:54:16.202661+0000","last_undegraded":"2023-05-16T13:54:16.202661+0000","last_fullsized":"2023-05-16T13:54:16.202661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T16:19:34.312806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.234289+0000","last_change":"2023-05-16T13:54:15.217211+0000","last_active":"2023-05-16T13:54:16.234289+0000","last_peered":"2023-05-16T13:54:16.234289+0000","last_clean":"2023-05-16T13:54:16.234289+0000","last_became_active":"2023-05-16T13:54:15.216921+0000","last_became_peered":"2023-05-16T13:54:15.216921+0000","last_unstale":"2023-05-16T13:54:16.234289+0000","last_undegraded":"2023-05-16T13:54:16.234289+0000","last_fullsized":"2023-05-16T13:54:16.234289+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:05:33.250909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.094630+0000","last_change":"2023-05-16T13:54:15.220276+0000","last_active":"2023-05-16T13:54:17.094630+0000","last_peered":"2023-05-16T13:54:17.094630+0000","last_clean":"2023-05-16T13:54:17.094630+0000","last_became_active":"2023-05-16T13:54:15.219893+0000","last_became_peered":"2023-05-16T13:54:15.219893+0000","last_unstale":"2023-05-16T13:54:17.094630+0000","last_undegraded":"2023-05-16T13:54:17.094630+0000","last_fullsized":"2023-05-16T13:54:17.094630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:56:30.067725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.095064+0000","last_change":"2023-05-16T13:54:15.233844+0000","last_active":"2023-05-16T13:54:17.095064+0000","last_peered":"2023-05-16T13:54:17.095064+0000","last_clean":"2023-05-16T13:54:17.095064+0000","last_became_active":"2023-05-16T13:54:15.232864+0000","last_became_peered":"2023-05-16T13:54:15.232864+0000","last_unstale":"2023-05-16T13:54:17.095064+0000","last_undegraded":"2023-05-16T13:54:17.095064+0000","last_fullsized":"2023-05-16T13:54:17.095064+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:33:13.438730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.094911+0000","last_change":"2023-05-16T13:54:15.229695+0000","last_active":"2023-05-16T13:54:17.094911+0000","last_peered":"2023-05-16T13:54:17.094911+0000","last_clean":"2023-05-16T13:54:17.094911+0000","last_became_active":"2023-05-16T13:54:15.229428+0000","last_became_peered":"2023-05-16T13:54:15.229428+0000","last_unstale":"2023-05-16T13:54:17.094911+0000","last_undegraded":"2023-05-16T13:54:17.094911+0000","last_fullsized":"2023-05-16T13:54:17.094911+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:57:22.154305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.203185+0000","last_change":"2023-05-16T13:54:15.223655+0000","last_active":"2023-05-16T13:54:16.203185+0000","last_peered":"2023-05-16T13:54:16.203185+0000","last_clean":"2023-05-16T13:54:16.203185+0000","last_became_active":"2023-05-16T13:54:15.223324+0000","last_became_peered":"2023-05-16T13:54:15.223324+0000","last_unstale":"2023-05-16T13:54:16.203185+0000","last_undegraded":"2023-05-16T13:54:16.203185+0000","last_fullsized":"2023-05-16T13:54:16.203185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:34:27.280408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.593211+0000","last_change":"2023-05-16T13:54:15.231258+0000","last_active":"2023-05-16T13:54:16.593211+0000","last_peered":"2023-05-16T13:54:16.593211+0000","last_clean":"2023-05-16T13:54:16.593211+0000","last_became_active":"2023-05-16T13:54:15.230996+0000","last_became_peered":"2023-05-16T13:54:15.230996+0000","last_unstale":"2023-05-16T13:54:16.593211+0000","last_undegraded":"2023-05-16T13:54:16.593211+0000","last_fullsized":"2023-05-16T13:54:16.593211+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:27:26.622822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.593055+0000","last_change":"2023-05-16T13:54:15.211137+0000","last_active":"2023-05-16T13:54:16.593055+0000","last_peered":"2023-05-16T13:54:16.593055+0000","last_clean":"2023-05-16T13:54:16.593055+0000","last_became_active":"2023-05-16T13:54:15.210834+0000","last_became_peered":"2023-05-16T13:54:15.210834+0000","last_unstale":"2023-05-16T13:54:16.593055+0000","last_undegraded":"2023-05-16T13:54:16.593055+0000","last_fullsized":"2023-05-16T13:54:16.593055+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:19:30.585369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.095011+0000","last_change":"2023-05-16T13:54:15.222527+0000","last_active":"2023-05-16T13:54:17.095011+0000","last_peered":"2023-05-16T13:54:17.095011+0000","last_clean":"2023-05-16T13:54:17.095011+0000","last_became_active":"2023-05-16T13:54:15.222111+0000","last_became_peered":"2023-05-16T13:54:15.222111+0000","last_unstale":"2023-05-16T13:54:17.095011+0000","last_undegraded":"2023-05-16T13:54:17.095011+0000","last_fullsized":"2023-05-16T13:54:17.095011+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T14:08:36.668941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.234380+0000","last_change":"2023-05-16T13:54:15.224759+0000","last_active":"2023-05-16T13:54:16.234380+0000","last_peered":"2023-05-16T13:54:16.234380+0000","last_clean":"2023-05-16T13:54:16.234380+0000","last_became_active":"2023-05-16T13:54:15.224486+0000","last_became_peered":"2023-05-16T13:54:15.224486+0000","last_unstale":"2023-05-16T13:54:16.234380+0000","last_undegraded":"2023-05-16T13:54:16.234380+0000","last_fullsized":"2023-05-16T13:54:16.234380+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:23:36.578764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.201645+0000","last_change":"2023-05-16T13:54:15.231690+0000","last_active":"2023-05-16T13:54:16.201645+0000","last_peered":"2023-05-16T13:54:16.201645+0000","last_clean":"2023-05-16T13:54:16.201645+0000","last_became_active":"2023-05-16T13:54:15.231041+0000","last_became_peered":"2023-05-16T13:54:15.231041+0000","last_unstale":"2023-05-16T13:54:16.201645+0000","last_undegraded":"2023-05-16T13:54:16.201645+0000","last_fullsized":"2023-05-16T13:54:16.201645+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:58:22.882260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.095207+0000","last_change":"2023-05-16T13:54:15.234033+0000","last_active":"2023-05-16T13:54:17.095207+0000","last_peered":"2023-05-16T13:54:17.095207+0000","last_clean":"2023-05-16T13:54:17.095207+0000","last_became_active":"2023-05-16T13:54:15.233573+0000","last_became_peered":"2023-05-16T13:54:15.233573+0000","last_unstale":"2023-05-16T13:54:17.095207+0000","last_undegraded":"2023-05-16T13:54:17.095207+0000","last_fullsized":"2023-05-16T13:54:17.095207+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T14:58:42.042361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.203259+0000","last_change":"2023-05-16T13:54:15.217992+0000","last_active":"2023-05-16T13:54:16.203259+0000","last_peered":"2023-05-16T13:54:16.203259+0000","last_clean":"2023-05-16T13:54:16.203259+0000","last_became_active":"2023-05-16T13:54:15.217320+0000","last_became_peered":"2023-05-16T13:54:15.217320+0000","last_unstale":"2023-05-16T13:54:16.203259+0000","last_undegraded":"2023-05-16T13:54:16.203259+0000","last_fullsized":"2023-05-16T13:54:16.203259+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:03:24.701966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.593152+0000","last_change":"2023-05-16T13:54:15.209420+0000","last_active":"2023-05-16T13:54:16.593152+0000","last_peered":"2023-05-16T13:54:16.593152+0000","last_clean":"2023-05-16T13:54:16.593152+0000","last_became_active":"2023-05-16T13:54:15.208345+0000","last_became_peered":"2023-05-16T13:54:15.208345+0000","last_unstale":"2023-05-16T13:54:16.593152+0000","last_undegraded":"2023-05-16T13:54:16.593152+0000","last_fullsized":"2023-05-16T13:54:16.593152+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T18:23:15.082235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.202730+0000","last_change":"2023-05-16T13:54:15.214941+0000","last_active":"2023-05-16T13:54:16.202730+0000","last_peered":"2023-05-16T13:54:16.202730+0000","last_clean":"2023-05-16T13:54:16.202730+0000","last_became_active":"2023-05-16T13:54:15.214581+0000","last_became_peered":"2023-05-16T13:54:15.214581+0000","last_unstale":"2023-05-16T13:54:16.202730+0000","last_undegraded":"2023-05-16T13:54:16.202730+0000","last_fullsized":"2023-05-16T13:54:16.202730+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:53:50.523933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.234462+0000","last_change":"2023-05-16T13:54:15.222860+0000","last_active":"2023-05-16T13:54:16.234462+0000","last_peered":"2023-05-16T13:54:16.234462+0000","last_clean":"2023-05-16T13:54:16.234462+0000","last_became_active":"2023-05-16T13:54:15.222149+0000","last_became_peered":"2023-05-16T13:54:15.222149+0000","last_unstale":"2023-05-16T13:54:16.234462+0000","last_undegraded":"2023-05-16T13:54:16.234462+0000","last_fullsized":"2023-05-16T13:54:16.234462+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:51:04.272951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.095156+0000","last_change":"2023-05-16T13:54:15.228300+0000","last_active":"2023-05-16T13:54:17.095156+0000","last_peered":"2023-05-16T13:54:17.095156+0000","last_clean":"2023-05-16T13:54:17.095156+0000","last_became_active":"2023-05-16T13:54:15.227773+0000","last_became_peered":"2023-05-16T13:54:15.227773+0000","last_unstale":"2023-05-16T13:54:17.095156+0000","last_undegraded":"2023-05-16T13:54:17.095156+0000","last_fullsized":"2023-05-16T13:54:17.095156+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T14:57:07.445671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.200316+0000","last_change":"2023-05-16T13:54:15.228240+0000","last_active":"2023-05-16T13:54:16.200316+0000","last_peered":"2023-05-16T13:54:16.200316+0000","last_clean":"2023-05-16T13:54:16.200316+0000","last_became_active":"2023-05-16T13:54:15.227927+0000","last_became_peered":"2023-05-16T13:54:15.227927+0000","last_unstale":"2023-05-16T13:54:16.200316+0000","last_undegraded":"2023-05-16T13:54:16.200316+0000","last_fullsized":"2023-05-16T13:54:16.200316+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T15:50:58.482925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.234446+0000","last_change":"2023-05-16T13:54:15.221851+0000","last_active":"2023-05-16T13:54:16.234446+0000","last_peered":"2023-05-16T13:54:16.234446+0000","last_clean":"2023-05-16T13:54:16.234446+0000","last_became_active":"2023-05-16T13:54:15.221511+0000","last_became_peered":"2023-05-16T13:54:15.221511+0000","last_unstale":"2023-05-16T13:54:16.234446+0000","last_undegraded":"2023-05-16T13:54:16.234446+0000","last_fullsized":"2023-05-16T13:54:16.234446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:18:56.753459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.094440+0000","last_change":"2023-05-16T13:54:15.224061+0000","last_active":"2023-05-16T13:54:17.094440+0000","last_peered":"2023-05-16T13:54:17.094440+0000","last_clean":"2023-05-16T13:54:17.094440+0000","last_became_active":"2023-05-16T13:54:15.223626+0000","last_became_peered":"2023-05-16T13:54:15.223626+0000","last_unstale":"2023-05-16T13:54:17.094440+0000","last_undegraded":"2023-05-16T13:54:17.094440+0000","last_fullsized":"2023-05-16T13:54:17.094440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T23:24:29.119212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.094898+0000","last_change":"2023-05-16T13:54:15.216383+0000","last_active":"2023-05-16T13:54:17.094898+0000","last_peered":"2023-05-16T13:54:17.094898+0000","last_clean":"2023-05-16T13:54:17.094898+0000","last_became_active":"2023-05-16T13:54:15.216056+0000","last_became_peered":"2023-05-16T13:54:15.216056+0000","last_unstale":"2023-05-16T13:54:17.094898+0000","last_undegraded":"2023-05-16T13:54:17.094898+0000","last_fullsized":"2023-05-16T13:54:17.094898+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T14:57:07.445671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.094905+0000","last_change":"2023-05-16T13:54:15.223638+0000","last_active":"2023-05-16T13:54:17.094905+0000","last_peered":"2023-05-16T13:54:17.094905+0000","last_clean":"2023-05-16T13:54:17.094905+0000","last_became_active":"2023-05-16T13:54:15.223140+0000","last_became_peered":"2023-05-16T13:54:15.223140+0000","last_unstale":"2023-05-16T13:54:17.094905+0000","last_undegraded":"2023-05-16T13:54:17.094905+0000","last_fullsized":"2023-05-16T13:54:17.094905+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:18:56.753459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.095505+0000","last_change":"2023-05-16T13:54:15.215238+0000","last_active":"2023-05-16T13:54:17.095505+0000","last_peered":"2023-05-16T13:54:17.095505+0000","last_clean":"2023-05-16T13:54:17.095505+0000","last_became_active":"2023-05-16T13:54:15.214974+0000","last_became_peered":"2023-05-16T13:54:15.214974+0000","last_unstale":"2023-05-16T13:54:17.095505+0000","last_undegraded":"2023-05-16T13:54:17.095505+0000","last_fullsized":"2023-05-16T13:54:17.095505+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T15:29:06.983258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.201046+0000","last_change":"2023-05-16T13:54:15.220178+0000","last_active":"2023-05-16T13:54:16.201046+0000","last_peered":"2023-05-16T13:54:16.201046+0000","last_clean":"2023-05-16T13:54:16.201046+0000","last_became_active":"2023-05-16T13:54:15.219892+0000","last_became_peered":"2023-05-16T13:54:15.219892+0000","last_unstale":"2023-05-16T13:54:16.201046+0000","last_undegraded":"2023-05-16T13:54:16.201046+0000","last_fullsized":"2023-05-16T13:54:16.201046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T14:08:36.668941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.202938+0000","last_change":"2023-05-16T13:54:15.211537+0000","last_active":"2023-05-16T13:54:16.202938+0000","last_peered":"2023-05-16T13:54:16.202938+0000","last_clean":"2023-05-16T13:54:16.202938+0000","last_became_active":"2023-05-16T13:54:15.211186+0000","last_became_peered":"2023-05-16T13:54:15.211186+0000","last_unstale":"2023-05-16T13:54:16.202938+0000","last_undegraded":"2023-05-16T13:54:16.202938+0000","last_fullsized":"2023-05-16T13:54:16.202938+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:23:36.578764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.200428+0000","last_change":"2023-05-16T13:54:15.217651+0000","last_active":"2023-05-16T13:54:16.200428+0000","last_peered":"2023-05-16T13:54:16.200428+0000","last_clean":"2023-05-16T13:54:16.200428+0000","last_became_active":"2023-05-16T13:54:15.217294+0000","last_became_peered":"2023-05-16T13:54:15.217294+0000","last_unstale":"2023-05-16T13:54:16.200428+0000","last_undegraded":"2023-05-16T13:54:16.200428+0000","last_fullsized":"2023-05-16T13:54:16.200428+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:38:13.293626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.201794+0000","last_change":"2023-05-16T13:54:15.217531+0000","last_active":"2023-05-16T13:54:16.201794+0000","last_peered":"2023-05-16T13:54:16.201794+0000","last_clean":"2023-05-16T13:54:16.201794+0000","last_became_active":"2023-05-16T13:54:15.217002+0000","last_became_peered":"2023-05-16T13:54:15.217002+0000","last_unstale":"2023-05-16T13:54:16.201794+0000","last_undegraded":"2023-05-16T13:54:16.201794+0000","last_fullsized":"2023-05-16T13:54:16.201794+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:10:29.866761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.201209+0000","last_change":"2023-05-16T13:54:15.223492+0000","last_active":"2023-05-16T13:54:16.201209+0000","last_peered":"2023-05-16T13:54:16.201209+0000","last_clean":"2023-05-16T13:54:16.201209+0000","last_became_active":"2023-05-16T13:54:15.223220+0000","last_became_peered":"2023-05-16T13:54:15.223220+0000","last_unstale":"2023-05-16T13:54:16.201209+0000","last_undegraded":"2023-05-16T13:54:16.201209+0000","last_fullsized":"2023-05-16T13:54:16.201209+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:51:04.272951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.234538+0000","last_change":"2023-05-16T13:54:14.826021+0000","last_active":"2023-05-16T13:54:16.234538+0000","last_peered":"2023-05-16T13:54:16.234538+0000","last_clean":"2023-05-16T13:54:16.234538+0000","last_became_active":"2023-05-16T13:54:14.820310+0000","last_became_peered":"2023-05-16T13:54:14.820310+0000","last_unstale":"2023-05-16T13:54:16.234538+0000","last_undegraded":"2023-05-16T13:54:16.234538+0000","last_fullsized":"2023-05-16T13:54:16.234538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:58:09.660328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.095001+0000","last_change":"2023-05-16T13:54:15.223399+0000","last_active":"2023-05-16T13:54:17.095001+0000","last_peered":"2023-05-16T13:54:17.095001+0000","last_clean":"2023-05-16T13:54:17.095001+0000","last_became_active":"2023-05-16T13:54:15.222860+0000","last_became_peered":"2023-05-16T13:54:15.222860+0000","last_unstale":"2023-05-16T13:54:17.095001+0000","last_undegraded":"2023-05-16T13:54:17.095001+0000","last_fullsized":"2023-05-16T13:54:17.095001+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:05:33.250909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.095312+0000","last_change":"2023-05-16T13:54:14.811666+0000","last_active":"2023-05-16T13:54:17.095312+0000","last_peered":"2023-05-16T13:54:17.095312+0000","last_clean":"2023-05-16T13:54:17.095312+0000","last_became_active":"2023-05-16T13:54:14.811282+0000","last_became_peered":"2023-05-16T13:54:14.811282+0000","last_unstale":"2023-05-16T13:54:17.095312+0000","last_undegraded":"2023-05-16T13:54:17.095312+0000","last_fullsized":"2023-05-16T13:54:17.095312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T14:27:24.383997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.095188+0000","last_change":"2023-05-16T13:54:15.229301+0000","last_active":"2023-05-16T13:54:17.095188+0000","last_peered":"2023-05-16T13:54:17.095188+0000","last_clean":"2023-05-16T13:54:17.095188+0000","last_became_active":"2023-05-16T13:54:15.228861+0000","last_became_peered":"2023-05-16T13:54:15.228861+0000","last_unstale":"2023-05-16T13:54:17.095188+0000","last_undegraded":"2023-05-16T13:54:17.095188+0000","last_fullsized":"2023-05-16T13:54:17.095188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T20:50:05.973113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.234451+0000","last_change":"2023-05-16T13:54:14.822092+0000","last_active":"2023-05-16T13:54:16.234451+0000","last_peered":"2023-05-16T13:54:16.234451+0000","last_clean":"2023-05-16T13:54:16.234451+0000","last_became_active":"2023-05-16T13:54:14.820716+0000","last_became_peered":"2023-05-16T13:54:14.820716+0000","last_unstale":"2023-05-16T13:54:16.234451+0000","last_undegraded":"2023-05-16T13:54:16.234451+0000","last_fullsized":"2023-05-16T13:54:16.234451+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T20:40:58.823162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.201018+0000","last_change":"2023-05-16T13:54:15.222372+0000","last_active":"2023-05-16T13:54:16.201018+0000","last_peered":"2023-05-16T13:54:16.201018+0000","last_clean":"2023-05-16T13:54:16.201018+0000","last_became_active":"2023-05-16T13:54:15.219602+0000","last_became_peered":"2023-05-16T13:54:15.219602+0000","last_unstale":"2023-05-16T13:54:16.201018+0000","last_undegraded":"2023-05-16T13:54:16.201018+0000","last_fullsized":"2023-05-16T13:54:16.201018+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:05:33.250909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.201862+0000","last_change":"2023-05-16T13:54:14.814991+0000","last_active":"2023-05-16T13:54:16.201862+0000","last_peered":"2023-05-16T13:54:16.201862+0000","last_clean":"2023-05-16T13:54:16.201862+0000","last_became_active":"2023-05-16T13:54:14.814571+0000","last_became_peered":"2023-05-16T13:54:14.814571+0000","last_unstale":"2023-05-16T13:54:16.201862+0000","last_undegraded":"2023-05-16T13:54:16.201862+0000","last_fullsized":"2023-05-16T13:54:16.201862+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T16:38:02.634625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.234878+0000","last_change":"2023-05-16T13:54:14.821745+0000","last_active":"2023-05-16T13:54:16.234878+0000","last_peered":"2023-05-16T13:54:16.234878+0000","last_clean":"2023-05-16T13:54:16.234878+0000","last_became_active":"2023-05-16T13:54:14.820978+0000","last_became_peered":"2023-05-16T13:54:14.820978+0000","last_unstale":"2023-05-16T13:54:16.234878+0000","last_undegraded":"2023-05-16T13:54:16.234878+0000","last_fullsized":"2023-05-16T13:54:16.234878+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:15:56.752324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.094630+0000","last_change":"2023-05-16T13:54:15.220768+0000","last_active":"2023-05-16T13:54:17.094630+0000","last_peered":"2023-05-16T13:54:17.094630+0000","last_clean":"2023-05-16T13:54:17.094630+0000","last_became_active":"2023-05-16T13:54:15.220494+0000","last_became_peered":"2023-05-16T13:54:15.220494+0000","last_unstale":"2023-05-16T13:54:17.094630+0000","last_undegraded":"2023-05-16T13:54:17.094630+0000","last_fullsized":"2023-05-16T13:54:17.094630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:38:13.293626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.234833+0000","last_change":"2023-05-16T13:54:14.821942+0000","last_active":"2023-05-16T13:54:16.234833+0000","last_peered":"2023-05-16T13:54:16.234833+0000","last_clean":"2023-05-16T13:54:16.234833+0000","last_became_active":"2023-05-16T13:54:14.821539+0000","last_became_peered":"2023-05-16T13:54:14.821539+0000","last_unstale":"2023-05-16T13:54:16.234833+0000","last_undegraded":"2023-05-16T13:54:16.234833+0000","last_fullsized":"2023-05-16T13:54:16.234833+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T23:19:38.774487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.201687+0000","last_change":"2023-05-16T13:54:15.218507+0000","last_active":"2023-05-16T13:54:16.201687+0000","last_peered":"2023-05-16T13:54:16.201687+0000","last_clean":"2023-05-16T13:54:16.201687+0000","last_became_active":"2023-05-16T13:54:15.218014+0000","last_became_peered":"2023-05-16T13:54:15.218014+0000","last_unstale":"2023-05-16T13:54:16.201687+0000","last_undegraded":"2023-05-16T13:54:16.201687+0000","last_fullsized":"2023-05-16T13:54:16.201687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:12:06.609266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.234688+0000","last_change":"2023-05-16T13:54:14.824383+0000","last_active":"2023-05-16T13:54:16.234688+0000","last_peered":"2023-05-16T13:54:16.234688+0000","last_clean":"2023-05-16T13:54:16.234688+0000","last_became_active":"2023-05-16T13:54:14.824117+0000","last_became_peered":"2023-05-16T13:54:14.824117+0000","last_unstale":"2023-05-16T13:54:16.234688+0000","last_undegraded":"2023-05-16T13:54:16.234688+0000","last_fullsized":"2023-05-16T13:54:16.234688+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:32:07.899174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.202234+0000","last_change":"2023-05-16T13:54:15.219224+0000","last_active":"2023-05-16T13:54:16.202234+0000","last_peered":"2023-05-16T13:54:16.202234+0000","last_clean":"2023-05-16T13:54:16.202234+0000","last_became_active":"2023-05-16T13:54:15.218672+0000","last_became_peered":"2023-05-16T13:54:15.218672+0000","last_unstale":"2023-05-16T13:54:16.202234+0000","last_undegraded":"2023-05-16T13:54:16.202234+0000","last_fullsized":"2023-05-16T13:54:16.202234+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T18:27:40.065469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.094859+0000","last_change":"2023-05-16T13:54:14.821843+0000","last_active":"2023-05-16T13:54:17.094859+0000","last_peered":"2023-05-16T13:54:17.094859+0000","last_clean":"2023-05-16T13:54:17.094859+0000","last_became_active":"2023-05-16T13:54:14.821386+0000","last_became_peered":"2023-05-16T13:54:14.821386+0000","last_unstale":"2023-05-16T13:54:17.094859+0000","last_undegraded":"2023-05-16T13:54:17.094859+0000","last_fullsized":"2023-05-16T13:54:17.094859+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:53:49.517551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.094498+0000","last_change":"2023-05-16T13:54:15.232203+0000","last_active":"2023-05-16T13:54:17.094498+0000","last_peered":"2023-05-16T13:54:17.094498+0000","last_clean":"2023-05-16T13:54:17.094498+0000","last_became_active":"2023-05-16T13:54:15.231644+0000","last_became_peered":"2023-05-16T13:54:15.231644+0000","last_unstale":"2023-05-16T13:54:17.094498+0000","last_undegraded":"2023-05-16T13:54:17.094498+0000","last_fullsized":"2023-05-16T13:54:17.094498+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T18:51:58.566752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.201131+0000","last_change":"2023-05-16T13:54:14.819498+0000","last_active":"2023-05-16T13:54:16.201131+0000","last_peered":"2023-05-16T13:54:16.201131+0000","last_clean":"2023-05-16T13:54:16.201131+0000","last_became_active":"2023-05-16T13:54:14.819147+0000","last_became_peered":"2023-05-16T13:54:14.819147+0000","last_unstale":"2023-05-16T13:54:16.201131+0000","last_undegraded":"2023-05-16T13:54:16.201131+0000","last_fullsized":"2023-05-16T13:54:16.201131+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T20:40:58.823162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.202789+0000","last_change":"2023-05-16T13:54:15.217792+0000","last_active":"2023-05-16T13:54:16.202789+0000","last_peered":"2023-05-16T13:54:16.202789+0000","last_clean":"2023-05-16T13:54:16.202789+0000","last_became_active":"2023-05-16T13:54:15.216858+0000","last_became_peered":"2023-05-16T13:54:15.216858+0000","last_unstale":"2023-05-16T13:54:16.202789+0000","last_undegraded":"2023-05-16T13:54:16.202789+0000","last_fullsized":"2023-05-16T13:54:16.202789+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T23:50:22.458202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.202400+0000","last_change":"2023-05-16T13:54:14.819120+0000","last_active":"2023-05-16T13:54:16.202400+0000","last_peered":"2023-05-16T13:54:16.202400+0000","last_clean":"2023-05-16T13:54:16.202400+0000","last_became_active":"2023-05-16T13:54:14.818822+0000","last_became_peered":"2023-05-16T13:54:14.818822+0000","last_unstale":"2023-05-16T13:54:16.202400+0000","last_undegraded":"2023-05-16T13:54:16.202400+0000","last_fullsized":"2023-05-16T13:54:16.202400+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:13:17.386163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.203317+0000","last_change":"2023-05-16T13:54:15.217748+0000","last_active":"2023-05-16T13:54:16.203317+0000","last_peered":"2023-05-16T13:54:16.203317+0000","last_clean":"2023-05-16T13:54:16.203317+0000","last_became_active":"2023-05-16T13:54:15.216101+0000","last_became_peered":"2023-05-16T13:54:15.216101+0000","last_unstale":"2023-05-16T13:54:16.203317+0000","last_undegraded":"2023-05-16T13:54:16.203317+0000","last_fullsized":"2023-05-16T13:54:16.203317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:21:33.710987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.202468+0000","last_change":"2023-05-16T13:54:14.812220+0000","last_active":"2023-05-16T13:54:16.202468+0000","last_peered":"2023-05-16T13:54:16.202468+0000","last_clean":"2023-05-16T13:54:16.202468+0000","last_became_active":"2023-05-16T13:54:14.811901+0000","last_became_peered":"2023-05-16T13:54:14.811901+0000","last_unstale":"2023-05-16T13:54:16.202468+0000","last_undegraded":"2023-05-16T13:54:16.202468+0000","last_fullsized":"2023-05-16T13:54:16.202468+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:38:12.287244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.203309+0000","last_change":"2023-05-16T13:54:15.210585+0000","last_active":"2023-05-16T13:54:16.203309+0000","last_peered":"2023-05-16T13:54:16.203309+0000","last_clean":"2023-05-16T13:54:16.203309+0000","last_became_active":"2023-05-16T13:54:15.210268+0000","last_became_peered":"2023-05-16T13:54:15.210268+0000","last_unstale":"2023-05-16T13:54:16.203309+0000","last_undegraded":"2023-05-16T13:54:16.203309+0000","last_fullsized":"2023-05-16T13:54:16.203309+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:32:08.905557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.200407+0000","last_change":"2023-05-16T13:54:14.818548+0000","last_active":"2023-05-16T13:54:16.200407+0000","last_peered":"2023-05-16T13:54:16.200407+0000","last_clean":"2023-05-16T13:54:16.200407+0000","last_became_active":"2023-05-16T13:54:14.818253+0000","last_became_peered":"2023-05-16T13:54:14.818253+0000","last_unstale":"2023-05-16T13:54:16.200407+0000","last_undegraded":"2023-05-16T13:54:16.200407+0000","last_fullsized":"2023-05-16T13:54:16.200407+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:56:29.061343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.094603+0000","last_change":"2023-05-16T13:54:15.221849+0000","last_active":"2023-05-16T13:54:17.094603+0000","last_peered":"2023-05-16T13:54:17.094603+0000","last_clean":"2023-05-16T13:54:17.094603+0000","last_became_active":"2023-05-16T13:54:15.221542+0000","last_became_peered":"2023-05-16T13:54:15.221542+0000","last_unstale":"2023-05-16T13:54:17.094603+0000","last_undegraded":"2023-05-16T13:54:17.094603+0000","last_fullsized":"2023-05-16T13:54:17.094603+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:21:12.096751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":175,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.234530+0000","last_change":"2023-05-16T13:54:03.495814+0000","last_active":"2023-05-16T13:54:16.234530+0000","last_peered":"2023-05-16T13:54:16.234530+0000","last_clean":"2023-05-16T13:54:16.234530+0000","last_became_active":"2023-05-16T13:54:03.494265+0000","last_became_peered":"2023-05-16T13:54:03.494265+0000","last_unstale":"2023-05-16T13:54:16.234530+0000","last_undegraded":"2023-05-16T13:54:16.234530+0000","last_fullsized":"2023-05-16T13:54:16.234530+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:01.722051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:01.722051+0000","last_clean_scrub_stamp":"2023-05-16T13:54:01.722051+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:34:14.214601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.094642+0000","last_change":"2023-05-16T13:54:09.770727+0000","last_active":"2023-05-16T13:54:17.094642+0000","last_peered":"2023-05-16T13:54:17.094642+0000","last_clean":"2023-05-16T13:54:17.094642+0000","last_became_active":"2023-05-16T13:54:09.770179+0000","last_became_peered":"2023-05-16T13:54:09.770179+0000","last_unstale":"2023-05-16T13:54:17.094642+0000","last_undegraded":"2023-05-16T13:54:17.094642+0000","last_fullsized":"2023-05-16T13:54:17.094642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T16:19:28.279537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.200541+0000","last_change":"2023-05-16T13:54:14.817341+0000","last_active":"2023-05-16T13:54:16.200541+0000","last_peered":"2023-05-16T13:54:16.200541+0000","last_clean":"2023-05-16T13:54:16.200541+0000","last_became_active":"2023-05-16T13:54:14.816323+0000","last_became_peered":"2023-05-16T13:54:14.816323+0000","last_unstale":"2023-05-16T13:54:16.200541+0000","last_undegraded":"2023-05-16T13:54:16.200541+0000","last_fullsized":"2023-05-16T13:54:16.200541+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:53:49.517551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.202234+0000","last_change":"2023-05-16T13:54:15.211549+0000","last_active":"2023-05-16T13:54:16.202234+0000","last_peered":"2023-05-16T13:54:16.202234+0000","last_clean":"2023-05-16T13:54:16.202234+0000","last_became_active":"2023-05-16T13:54:15.211277+0000","last_became_peered":"2023-05-16T13:54:15.211277+0000","last_unstale":"2023-05-16T13:54:16.202234+0000","last_undegraded":"2023-05-16T13:54:16.202234+0000","last_fullsized":"2023-05-16T13:54:16.202234+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T20:48:13.566178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.234295+0000","last_change":"2023-05-16T13:54:09.768888+0000","last_active":"2023-05-16T13:54:16.234295+0000","last_peered":"2023-05-16T13:54:16.234295+0000","last_clean":"2023-05-16T13:54:16.234295+0000","last_became_active":"2023-05-16T13:54:09.768463+0000","last_became_peered":"2023-05-16T13:54:09.768463+0000","last_unstale":"2023-05-16T13:54:16.234295+0000","last_undegraded":"2023-05-16T13:54:16.234295+0000","last_fullsized":"2023-05-16T13:54:16.234295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T14:08:30.635672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.094302+0000","last_change":"2023-05-16T13:54:14.821190+0000","last_active":"2023-05-16T13:54:17.094302+0000","last_peered":"2023-05-16T13:54:17.094302+0000","last_clean":"2023-05-16T13:54:17.094302+0000","last_became_active":"2023-05-16T13:54:14.820901+0000","last_became_peered":"2023-05-16T13:54:14.820901+0000","last_unstale":"2023-05-16T13:54:17.094302+0000","last_undegraded":"2023-05-16T13:54:17.094302+0000","last_fullsized":"2023-05-16T13:54:17.094302+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:52:14.097165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.095050+0000","last_change":"2023-05-16T13:54:15.229018+0000","last_active":"2023-05-16T13:54:17.095050+0000","last_peered":"2023-05-16T13:54:17.095050+0000","last_clean":"2023-05-16T13:54:17.095050+0000","last_became_active":"2023-05-16T13:54:15.228331+0000","last_became_peered":"2023-05-16T13:54:15.228331+0000","last_unstale":"2023-05-16T13:54:17.095050+0000","last_undegraded":"2023-05-16T13:54:17.095050+0000","last_fullsized":"2023-05-16T13:54:17.095050+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:55:43.543739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.593061+0000","last_change":"2023-05-16T13:54:09.821010+0000","last_active":"2023-05-16T13:54:16.593061+0000","last_peered":"2023-05-16T13:54:16.593061+0000","last_clean":"2023-05-16T13:54:16.593061+0000","last_became_active":"2023-05-16T13:54:09.820636+0000","last_became_peered":"2023-05-16T13:54:09.820636+0000","last_unstale":"2023-05-16T13:54:16.593061+0000","last_undegraded":"2023-05-16T13:54:16.593061+0000","last_fullsized":"2023-05-16T13:54:16.593061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:22:51.153577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.094349+0000","last_change":"2023-05-16T13:54:14.813276+0000","last_active":"2023-05-16T13:54:17.094349+0000","last_peered":"2023-05-16T13:54:17.094349+0000","last_clean":"2023-05-16T13:54:17.094349+0000","last_became_active":"2023-05-16T13:54:14.812929+0000","last_became_peered":"2023-05-16T13:54:14.812929+0000","last_unstale":"2023-05-16T13:54:17.094349+0000","last_undegraded":"2023-05-16T13:54:17.094349+0000","last_fullsized":"2023-05-16T13:54:17.094349+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T18:48:52.011265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.095499+0000","last_change":"2023-05-16T13:54:15.223291+0000","last_active":"2023-05-16T13:54:17.095499+0000","last_peered":"2023-05-16T13:54:17.095499+0000","last_clean":"2023-05-16T13:54:17.095499+0000","last_became_active":"2023-05-16T13:54:15.222994+0000","last_became_peered":"2023-05-16T13:54:15.222994+0000","last_unstale":"2023-05-16T13:54:17.095499+0000","last_undegraded":"2023-05-16T13:54:17.095499+0000","last_fullsized":"2023-05-16T13:54:17.095499+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T18:44:00.903883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.095083+0000","last_change":"2023-05-16T13:54:09.771040+0000","last_active":"2023-05-16T13:54:17.095083+0000","last_peered":"2023-05-16T13:54:17.095083+0000","last_clean":"2023-05-16T13:54:17.095083+0000","last_became_active":"2023-05-16T13:54:09.770433+0000","last_became_peered":"2023-05-16T13:54:09.770433+0000","last_unstale":"2023-05-16T13:54:17.095083+0000","last_undegraded":"2023-05-16T13:54:17.095083+0000","last_fullsized":"2023-05-16T13:54:17.095083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T20:40:53.796275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.203109+0000","last_change":"2023-05-16T13:54:14.819218+0000","last_active":"2023-05-16T13:54:16.203109+0000","last_peered":"2023-05-16T13:54:16.203109+0000","last_clean":"2023-05-16T13:54:16.203109+0000","last_became_active":"2023-05-16T13:54:14.818575+0000","last_became_peered":"2023-05-16T13:54:14.818575+0000","last_unstale":"2023-05-16T13:54:16.203109+0000","last_undegraded":"2023-05-16T13:54:16.203109+0000","last_fullsized":"2023-05-16T13:54:16.203109+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:51:03.266568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.095323+0000","last_change":"2023-05-16T13:54:15.214918+0000","last_active":"2023-05-16T13:54:17.095323+0000","last_peered":"2023-05-16T13:54:17.095323+0000","last_clean":"2023-05-16T13:54:17.095323+0000","last_became_active":"2023-05-16T13:54:15.214604+0000","last_became_peered":"2023-05-16T13:54:15.214604+0000","last_unstale":"2023-05-16T13:54:17.095323+0000","last_undegraded":"2023-05-16T13:54:17.095323+0000","last_fullsized":"2023-05-16T13:54:17.095323+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:55:32.146414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.095166+0000","last_change":"2023-05-16T13:54:14.823582+0000","last_active":"2023-05-16T13:54:17.095166+0000","last_peered":"2023-05-16T13:54:17.095166+0000","last_clean":"2023-05-16T13:54:17.095166+0000","last_became_active":"2023-05-16T13:54:14.822465+0000","last_became_peered":"2023-05-16T13:54:14.822465+0000","last_unstale":"2023-05-16T13:54:17.095166+0000","last_undegraded":"2023-05-16T13:54:17.095166+0000","last_fullsized":"2023-05-16T13:54:17.095166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:34:26.274026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.095485+0000","last_change":"2023-05-16T13:54:09.813177+0000","last_active":"2023-05-16T13:54:17.095485+0000","last_peered":"2023-05-16T13:54:17.095485+0000","last_clean":"2023-05-16T13:54:17.095485+0000","last_became_active":"2023-05-16T13:54:09.812487+0000","last_became_peered":"2023-05-16T13:54:09.812487+0000","last_unstale":"2023-05-16T13:54:17.095485+0000","last_undegraded":"2023-05-16T13:54:17.095485+0000","last_fullsized":"2023-05-16T13:54:17.095485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:01:26.897824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.094988+0000","last_change":"2023-05-16T13:54:15.223198+0000","last_active":"2023-05-16T13:54:17.094988+0000","last_peered":"2023-05-16T13:54:17.094988+0000","last_clean":"2023-05-16T13:54:17.094988+0000","last_became_active":"2023-05-16T13:54:15.222906+0000","last_became_peered":"2023-05-16T13:54:15.222906+0000","last_unstale":"2023-05-16T13:54:17.094988+0000","last_undegraded":"2023-05-16T13:54:17.094988+0000","last_fullsized":"2023-05-16T13:54:17.094988+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T20:50:05.973113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.095335+0000","last_change":"2023-05-16T13:54:14.814607+0000","last_active":"2023-05-16T13:54:17.095335+0000","last_peered":"2023-05-16T13:54:17.095335+0000","last_clean":"2023-05-16T13:54:17.095335+0000","last_became_active":"2023-05-16T13:54:14.814268+0000","last_became_peered":"2023-05-16T13:54:14.814268+0000","last_unstale":"2023-05-16T13:54:17.095335+0000","last_undegraded":"2023-05-16T13:54:17.095335+0000","last_fullsized":"2023-05-16T13:54:17.095335+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T14:27:24.383997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.234780+0000","last_change":"2023-05-16T13:54:09.813305+0000","last_active":"2023-05-16T13:54:16.234780+0000","last_peered":"2023-05-16T13:54:16.234780+0000","last_clean":"2023-05-16T13:54:16.234780+0000","last_became_active":"2023-05-16T13:54:09.812931+0000","last_became_peered":"2023-05-16T13:54:09.812931+0000","last_unstale":"2023-05-16T13:54:16.234780+0000","last_undegraded":"2023-05-16T13:54:16.234780+0000","last_fullsized":"2023-05-16T13:54:16.234780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:21:27.677717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.094622+0000","last_change":"2023-05-16T13:54:15.232010+0000","last_active":"2023-05-16T13:54:17.094622+0000","last_peered":"2023-05-16T13:54:17.094622+0000","last_clean":"2023-05-16T13:54:17.094622+0000","last_became_active":"2023-05-16T13:54:15.231424+0000","last_became_peered":"2023-05-16T13:54:15.231424+0000","last_unstale":"2023-05-16T13:54:17.094622+0000","last_undegraded":"2023-05-16T13:54:17.094622+0000","last_fullsized":"2023-05-16T13:54:17.094622+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T14:37:02.189524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.201092+0000","last_change":"2023-05-16T13:54:14.815504+0000","last_active":"2023-05-16T13:54:16.201092+0000","last_peered":"2023-05-16T13:54:16.201092+0000","last_clean":"2023-05-16T13:54:16.201092+0000","last_became_active":"2023-05-16T13:54:14.814336+0000","last_became_peered":"2023-05-16T13:54:14.814336+0000","last_unstale":"2023-05-16T13:54:16.201092+0000","last_undegraded":"2023-05-16T13:54:16.201092+0000","last_fullsized":"2023-05-16T13:54:16.201092+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:23:35.572381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.095041+0000","last_change":"2023-05-16T13:54:09.768257+0000","last_active":"2023-05-16T13:54:17.095041+0000","last_peered":"2023-05-16T13:54:17.095041+0000","last_clean":"2023-05-16T13:54:17.095041+0000","last_became_active":"2023-05-16T13:54:09.767879+0000","last_became_peered":"2023-05-16T13:54:09.767879+0000","last_unstale":"2023-05-16T13:54:17.095041+0000","last_undegraded":"2023-05-16T13:54:17.095041+0000","last_fullsized":"2023-05-16T13:54:17.095041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T14:58:36.009092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.200295+0000","last_change":"2023-05-16T13:54:15.219094+0000","last_active":"2023-05-16T13:54:16.200295+0000","last_peered":"2023-05-16T13:54:16.200295+0000","last_clean":"2023-05-16T13:54:16.200295+0000","last_became_active":"2023-05-16T13:54:15.210545+0000","last_became_peered":"2023-05-16T13:54:15.210545+0000","last_unstale":"2023-05-16T13:54:16.200295+0000","last_undegraded":"2023-05-16T13:54:16.200295+0000","last_fullsized":"2023-05-16T13:54:16.200295+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:58:22.882260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"24'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.095331+0000","last_change":"2023-05-16T13:54:14.815739+0000","last_active":"2023-05-16T13:54:17.095331+0000","last_peered":"2023-05-16T13:54:17.095331+0000","last_clean":"2023-05-16T13:54:17.095331+0000","last_became_active":"2023-05-16T13:54:14.815433+0000","last_became_peered":"2023-05-16T13:54:14.815433+0000","last_unstale":"2023-05-16T13:54:17.095331+0000","last_undegraded":"2023-05-16T13:54:17.095331+0000","last_fullsized":"2023-05-16T13:54:17.095331+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:55:31.140031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.202058+0000","last_change":"2023-05-16T13:54:09.768603+0000","last_active":"2023-05-16T13:54:16.202058+0000","last_peered":"2023-05-16T13:54:16.202058+0000","last_clean":"2023-05-16T13:54:16.202058+0000","last_became_active":"2023-05-16T13:54:09.768323+0000","last_became_peered":"2023-05-16T13:54:09.768323+0000","last_unstale":"2023-05-16T13:54:16.202058+0000","last_undegraded":"2023-05-16T13:54:16.202058+0000","last_fullsized":"2023-05-16T13:54:16.202058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T15:06:40.038271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.202380+0000","last_change":"2023-05-16T13:54:15.221843+0000","last_active":"2023-05-16T13:54:16.202380+0000","last_peered":"2023-05-16T13:54:16.202380+0000","last_clean":"2023-05-16T13:54:16.202380+0000","last_became_active":"2023-05-16T13:54:15.221485+0000","last_became_peered":"2023-05-16T13:54:15.221485+0000","last_unstale":"2023-05-16T13:54:16.202380+0000","last_undegraded":"2023-05-16T13:54:16.202380+0000","last_fullsized":"2023-05-16T13:54:16.202380+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:56:30.067725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.202990+0000","last_change":"2023-05-16T13:54:15.211685+0000","last_active":"2023-05-16T13:54:16.202990+0000","last_peered":"2023-05-16T13:54:16.202990+0000","last_clean":"2023-05-16T13:54:16.202990+0000","last_became_active":"2023-05-16T13:54:15.210427+0000","last_became_peered":"2023-05-16T13:54:15.210427+0000","last_unstale":"2023-05-16T13:54:16.202990+0000","last_undegraded":"2023-05-16T13:54:16.202990+0000","last_fullsized":"2023-05-16T13:54:16.202990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:18:56.753459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"23'6","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.202865+0000","last_change":"2023-05-16T13:54:14.818519+0000","last_active":"2023-05-16T13:54:16.202865+0000","last_peered":"2023-05-16T13:54:16.202865+0000","last_clean":"2023-05-16T13:54:16.202865+0000","last_became_active":"2023-05-16T13:54:14.818006+0000","last_became_peered":"2023-05-16T13:54:14.818006+0000","last_unstale":"2023-05-16T13:54:16.202865+0000","last_undegraded":"2023-05-16T13:54:16.202865+0000","last_fullsized":"2023-05-16T13:54:16.202865+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T14:08:35.662558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.094876+0000","last_change":"2023-05-16T13:54:15.217209+0000","last_active":"2023-05-16T13:54:17.094876+0000","last_peered":"2023-05-16T13:54:17.094876+0000","last_clean":"2023-05-16T13:54:17.094876+0000","last_became_active":"2023-05-16T13:54:15.216903+0000","last_became_peered":"2023-05-16T13:54:15.216903+0000","last_unstale":"2023-05-16T13:54:17.094876+0000","last_undegraded":"2023-05-16T13:54:17.094876+0000","last_fullsized":"2023-05-16T13:54:17.094876+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:33:13.438730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.234591+0000","last_change":"2023-05-16T13:54:14.819409+0000","last_active":"2023-05-16T13:54:16.234591+0000","last_peered":"2023-05-16T13:54:16.234591+0000","last_clean":"2023-05-16T13:54:16.234591+0000","last_became_active":"2023-05-16T13:54:14.818998+0000","last_became_peered":"2023-05-16T13:54:14.818998+0000","last_unstale":"2023-05-16T13:54:16.234591+0000","last_undegraded":"2023-05-16T13:54:16.234591+0000","last_fullsized":"2023-05-16T13:54:16.234591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:03:23.695584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.095104+0000","last_change":"2023-05-16T13:54:14.826757+0000","last_active":"2023-05-16T13:54:17.095104+0000","last_peered":"2023-05-16T13:54:17.095104+0000","last_clean":"2023-05-16T13:54:17.095104+0000","last_became_active":"2023-05-16T13:54:14.826437+0000","last_became_peered":"2023-05-16T13:54:14.826437+0000","last_unstale":"2023-05-16T13:54:17.095104+0000","last_undegraded":"2023-05-16T13:54:17.095104+0000","last_fullsized":"2023-05-16T13:54:17.095104+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:51:03.266568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.200454+0000","last_change":"2023-05-16T13:54:15.217104+0000","last_active":"2023-05-16T13:54:16.200454+0000","last_peered":"2023-05-16T13:54:16.200454+0000","last_clean":"2023-05-16T13:54:16.200454+0000","last_became_active":"2023-05-16T13:54:15.212495+0000","last_became_peered":"2023-05-16T13:54:15.212495+0000","last_unstale":"2023-05-16T13:54:16.200454+0000","last_undegraded":"2023-05-16T13:54:16.200454+0000","last_fullsized":"2023-05-16T13:54:16.200454+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T16:19:34.312806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.095461+0000","last_change":"2023-05-16T13:54:14.828109+0000","last_active":"2023-05-16T13:54:17.095461+0000","last_peered":"2023-05-16T13:54:17.095461+0000","last_clean":"2023-05-16T13:54:17.095461+0000","last_became_active":"2023-05-16T13:54:14.827726+0000","last_became_peered":"2023-05-16T13:54:14.827726+0000","last_unstale":"2023-05-16T13:54:17.095461+0000","last_undegraded":"2023-05-16T13:54:17.095461+0000","last_fullsized":"2023-05-16T13:54:17.095461+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T18:43:59.897500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.200225+0000","last_change":"2023-05-16T13:54:15.219614+0000","last_active":"2023-05-16T13:54:16.200225+0000","last_peered":"2023-05-16T13:54:16.200225+0000","last_clean":"2023-05-16T13:54:16.200225+0000","last_became_active":"2023-05-16T13:54:15.219282+0000","last_became_peered":"2023-05-16T13:54:15.219282+0000","last_unstale":"2023-05-16T13:54:16.200225+0000","last_undegraded":"2023-05-16T13:54:16.200225+0000","last_fullsized":"2023-05-16T13:54:16.200225+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:05:39.511506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.202073+0000","last_change":"2023-05-16T13:54:15.223067+0000","last_active":"2023-05-16T13:54:16.202073+0000","last_peered":"2023-05-16T13:54:16.202073+0000","last_clean":"2023-05-16T13:54:16.202073+0000","last_became_active":"2023-05-16T13:54:15.222802+0000","last_became_peered":"2023-05-16T13:54:15.222802+0000","last_unstale":"2023-05-16T13:54:16.202073+0000","last_undegraded":"2023-05-16T13:54:16.202073+0000","last_fullsized":"2023-05-16T13:54:16.202073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:20:01.628237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.200355+0000","last_change":"2023-05-16T13:54:14.818182+0000","last_active":"2023-05-16T13:54:16.200355+0000","last_peered":"2023-05-16T13:54:16.200355+0000","last_clean":"2023-05-16T13:54:16.200355+0000","last_became_active":"2023-05-16T13:54:14.817829+0000","last_became_peered":"2023-05-16T13:54:14.817829+0000","last_unstale":"2023-05-16T13:54:16.200355+0000","last_undegraded":"2023-05-16T13:54:16.200355+0000","last_fullsized":"2023-05-16T13:54:16.200355+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:12:05.602884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.094904+0000","last_change":"2023-05-16T13:54:15.229143+0000","last_active":"2023-05-16T13:54:17.094904+0000","last_peered":"2023-05-16T13:54:17.094904+0000","last_clean":"2023-05-16T13:54:17.094904+0000","last_became_active":"2023-05-16T13:54:15.228615+0000","last_became_peered":"2023-05-16T13:54:15.228615+0000","last_unstale":"2023-05-16T13:54:17.094904+0000","last_undegraded":"2023-05-16T13:54:17.094904+0000","last_fullsized":"2023-05-16T13:54:17.094904+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:21:12.096751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.094748+0000","last_change":"2023-05-16T13:54:14.820677+0000","last_active":"2023-05-16T13:54:17.094748+0000","last_peered":"2023-05-16T13:54:17.094748+0000","last_clean":"2023-05-16T13:54:17.094748+0000","last_became_active":"2023-05-16T13:54:14.820386+0000","last_became_peered":"2023-05-16T13:54:14.820386+0000","last_unstale":"2023-05-16T13:54:17.094748+0000","last_undegraded":"2023-05-16T13:54:17.094748+0000","last_fullsized":"2023-05-16T13:54:17.094748+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:55:42.537356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.200740+0000","last_change":"2023-05-16T13:54:15.219472+0000","last_active":"2023-05-16T13:54:16.200740+0000","last_peered":"2023-05-16T13:54:16.200740+0000","last_clean":"2023-05-16T13:54:16.200740+0000","last_became_active":"2023-05-16T13:54:15.219173+0000","last_became_peered":"2023-05-16T13:54:15.219173+0000","last_unstale":"2023-05-16T13:54:16.200740+0000","last_undegraded":"2023-05-16T13:54:16.200740+0000","last_fullsized":"2023-05-16T13:54:16.200740+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:57:22.154305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.202997+0000","last_change":"2023-05-16T13:54:14.814610+0000","last_active":"2023-05-16T13:54:16.202997+0000","last_peered":"2023-05-16T13:54:16.202997+0000","last_clean":"2023-05-16T13:54:16.202997+0000","last_became_active":"2023-05-16T13:54:14.814132+0000","last_became_peered":"2023-05-16T13:54:14.814132+0000","last_unstale":"2023-05-16T13:54:16.202997+0000","last_undegraded":"2023-05-16T13:54:16.202997+0000","last_fullsized":"2023-05-16T13:54:16.202997+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T20:40:58.823162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.593191+0000","last_change":"2023-05-16T13:54:15.218356+0000","last_active":"2023-05-16T13:54:16.593191+0000","last_peered":"2023-05-16T13:54:16.593191+0000","last_clean":"2023-05-16T13:54:16.593191+0000","last_became_active":"2023-05-16T13:54:15.218043+0000","last_became_peered":"2023-05-16T13:54:15.218043+0000","last_unstale":"2023-05-16T13:54:16.593191+0000","last_undegraded":"2023-05-16T13:54:16.593191+0000","last_fullsized":"2023-05-16T13:54:16.593191+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T16:13:53.275348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.094796+0000","last_change":"2023-05-16T13:54:14.822015+0000","last_active":"2023-05-16T13:54:17.094796+0000","last_peered":"2023-05-16T13:54:17.094796+0000","last_clean":"2023-05-16T13:54:17.094796+0000","last_became_active":"2023-05-16T13:54:14.821739+0000","last_became_peered":"2023-05-16T13:54:14.821739+0000","last_unstale":"2023-05-16T13:54:17.094796+0000","last_undegraded":"2023-05-16T13:54:17.094796+0000","last_fullsized":"2023-05-16T13:54:17.094796+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T18:48:52.011265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.202799+0000","last_change":"2023-05-16T13:54:15.223263+0000","last_active":"2023-05-16T13:54:16.202799+0000","last_peered":"2023-05-16T13:54:16.202799+0000","last_clean":"2023-05-16T13:54:16.202799+0000","last_became_active":"2023-05-16T13:54:15.222945+0000","last_became_peered":"2023-05-16T13:54:15.222945+0000","last_unstale":"2023-05-16T13:54:16.202799+0000","last_undegraded":"2023-05-16T13:54:16.202799+0000","last_fullsized":"2023-05-16T13:54:16.202799+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:57:22.154305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.094847+0000","last_change":"2023-05-16T13:54:14.825328+0000","last_active":"2023-05-16T13:54:17.094847+0000","last_peered":"2023-05-16T13:54:17.094847+0000","last_clean":"2023-05-16T13:54:17.094847+0000","last_became_active":"2023-05-16T13:54:14.820763+0000","last_became_peered":"2023-05-16T13:54:14.820763+0000","last_unstale":"2023-05-16T13:54:17.094847+0000","last_undegraded":"2023-05-16T13:54:17.094847+0000","last_fullsized":"2023-05-16T13:54:17.094847+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T23:50:21.451820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.202804+0000","last_change":"2023-05-16T13:54:15.223253+0000","last_active":"2023-05-16T13:54:16.202804+0000","last_peered":"2023-05-16T13:54:16.202804+0000","last_clean":"2023-05-16T13:54:16.202804+0000","last_became_active":"2023-05-16T13:54:15.222884+0000","last_became_peered":"2023-05-16T13:54:15.222884+0000","last_unstale":"2023-05-16T13:54:16.202804+0000","last_undegraded":"2023-05-16T13:54:16.202804+0000","last_fullsized":"2023-05-16T13:54:16.202804+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:05:33.250909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.095153+0000","last_change":"2023-05-16T13:54:14.827946+0000","last_active":"2023-05-16T13:54:17.095153+0000","last_peered":"2023-05-16T13:54:17.095153+0000","last_clean":"2023-05-16T13:54:17.095153+0000","last_became_active":"2023-05-16T13:54:14.822920+0000","last_became_peered":"2023-05-16T13:54:14.822920+0000","last_unstale":"2023-05-16T13:54:17.095153+0000","last_undegraded":"2023-05-16T13:54:17.095153+0000","last_fullsized":"2023-05-16T13:54:17.095153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:58:09.660328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.200586+0000","last_change":"2023-05-16T13:54:15.218282+0000","last_active":"2023-05-16T13:54:16.200586+0000","last_peered":"2023-05-16T13:54:16.200586+0000","last_clean":"2023-05-16T13:54:16.200586+0000","last_became_active":"2023-05-16T13:54:15.217961+0000","last_became_peered":"2023-05-16T13:54:15.217961+0000","last_unstale":"2023-05-16T13:54:16.200586+0000","last_undegraded":"2023-05-16T13:54:16.200586+0000","last_fullsized":"2023-05-16T13:54:16.200586+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T23:50:22.458202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.200669+0000","last_change":"2023-05-16T13:54:14.810916+0000","last_active":"2023-05-16T13:54:16.200669+0000","last_peered":"2023-05-16T13:54:16.200669+0000","last_clean":"2023-05-16T13:54:16.200669+0000","last_became_active":"2023-05-16T13:54:14.810471+0000","last_became_peered":"2023-05-16T13:54:14.810471+0000","last_unstale":"2023-05-16T13:54:16.200669+0000","last_undegraded":"2023-05-16T13:54:16.200669+0000","last_fullsized":"2023-05-16T13:54:16.200669+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:18:55.747077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.201687+0000","last_change":"2023-05-16T13:54:15.219216+0000","last_active":"2023-05-16T13:54:16.201687+0000","last_peered":"2023-05-16T13:54:16.201687+0000","last_clean":"2023-05-16T13:54:16.201687+0000","last_became_active":"2023-05-16T13:54:15.217942+0000","last_became_peered":"2023-05-16T13:54:15.217942+0000","last_unstale":"2023-05-16T13:54:16.201687+0000","last_undegraded":"2023-05-16T13:54:16.201687+0000","last_fullsized":"2023-05-16T13:54:16.201687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T15:50:58.482925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.095345+0000","last_change":"2023-05-16T13:54:14.816978+0000","last_active":"2023-05-16T13:54:17.095345+0000","last_peered":"2023-05-16T13:54:17.095345+0000","last_clean":"2023-05-16T13:54:17.095345+0000","last_became_active":"2023-05-16T13:54:14.816681+0000","last_became_peered":"2023-05-16T13:54:14.816681+0000","last_unstale":"2023-05-16T13:54:17.095345+0000","last_undegraded":"2023-05-16T13:54:17.095345+0000","last_fullsized":"2023-05-16T13:54:17.095345+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:01:31.924710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13208,"kb_used_data":848,"kb_used_omap":0,"kb_used_meta":12352,"kb_avail":94358632,"statfs":{"total":96636764160,"available":96623239168,"internally_reserved":0,"allocated":868352,"data_stored":683406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12648448},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]}]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12088,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":11840,"kb_avail":94359752,"statfs":{"total":96636764160,"available":96624386048,"internally_reserved":0,"allocated":245760,"data_stored":91258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12124160},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]}]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12096,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":11840,"kb_avail":94359744,"statfs":{"total":96636764160,"available":96624377856,"internally_reserved":0,"allocated":253952,"data_stored":91910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12124160},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12172,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":11904,"kb_avail":94359668,"statfs":{"total":96636764160,"available":96624300032,"internally_reserved":0,"allocated":266240,"data_stored":92878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12189696},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.379}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93799999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.155}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]}]},{"osd":3,"up_from":14,"seq":60129542151,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12156,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":11904,"kb_avail":94359684,"statfs":{"total":96636764160,"available":96624316416,"internally_reserved":0,"allocated":249856,"data_stored":91348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12189696},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95799999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.111}]}]},{"osd":2,"up_from":14,"seq":60129542151,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7992,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363848,"statfs":{"total":96636764160,"available":96628580352,"internally_reserved":0,"allocated":245760,"data_stored":91258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12152,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":11904,"kb_avail":94359688,"statfs":{"total":96636764160,"available":96624320512,"internally_reserved":0,"allocated":245760,"data_stored":91258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12189696},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95899999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]}]},{"osd":0,"up_from":14,"seq":60129542151,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9088,"kb_used_data":824,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362752,"statfs":{"total":96636764160,"available":96627458048,"internally_reserved":0,"allocated":843776,"data_stored":682208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94599999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-16T13:54:25.605 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-16T13:54:25.781 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.773+0000 7fcd1d48c640 1 Processor -- start 2023-05-16T13:54:25.781 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.773+0000 7fcd1d48c640 1 -- start start 2023-05-16T13:54:25.782 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.773+0000 7fcd1d48c640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fcd1815c470 0x7fcd180d0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:25.782 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.773+0000 7fcd1d48c640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fcd180b49b0 0x7fcd180ce5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:25.782 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.773+0000 7fcd1d48c640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd180ce150 con 0x7fcd180b5670 2023-05-16T13:54:25.782 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.773+0000 7fcd1d48c640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd180cd890 con 0x7fcd180b49b0 2023-05-16T13:54:25.783 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.773+0000 7fcd1d48c640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd180d0c60 con 0x7fcd1815c470 2023-05-16T13:54:25.783 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.773+0000 7fcd177fe640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fcd180b49b0 0x7fcd180ce5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:25.783 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.773+0000 7fcd177fe640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fcd180b49b0 0x7fcd180ce5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60176/0 (socket says 172.21.15.39:60176) 2023-05-16T13:54:25.783 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.773+0000 7fcd177fe640 1 -- 172.21.15.39:0/4231363118 learned_addr learned my addr 172.21.15.39:0/4231363118 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:25.783 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.773+0000 7fcd0ffff640 1 --1- 172.21.15.39:0/4231363118 >> v1:172.21.15.39:6789/0 conn(0x7fcd180b5670 0x7fcd180b42a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:60834/0 (socket says 172.21.15.39:60834) 2023-05-16T13:54:25.784 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.773+0000 7fcd16ffd640 1 --2- 172.21.15.39:0/4231363118 >> v2:172.21.15.118:3300/0 conn(0x7fcd1815c470 0x7fcd180d0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:25.784 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.773+0000 7fcd177fe640 1 -- 172.21.15.39:0/4231363118 >> v2:172.21.15.118:3300/0 conn(0x7fcd1815c470 msgr2=0x7fcd180d0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:25.784 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.773+0000 7fcd177fe640 1 --2- 172.21.15.39:0/4231363118 >> v2:172.21.15.118:3300/0 conn(0x7fcd1815c470 0x7fcd180d0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:25.784 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.773+0000 7fcd177fe640 1 -- 172.21.15.39:0/4231363118 >> v1:172.21.15.39:6789/0 conn(0x7fcd180b5670 legacy=0x7fcd180b42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:25.784 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.773+0000 7fcd177fe640 1 -- 172.21.15.39:0/4231363118 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd180cdb00 con 0x7fcd180b49b0 2023-05-16T13:54:25.784 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.773+0000 7fcd167fc640 1 -- 172.21.15.39:0/4231363118 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1095458748 0 0) 0x7fcd180ce150 con 0x7fcd180b5670 2023-05-16T13:54:25.785 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.777+0000 7fcd177fe640 1 --2- 172.21.15.39:0/4231363118 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd180b49b0 0x7fcd180ce5e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fcd18073210 tx=0x7fcd1001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30bb011d47a12050 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:25.786 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.777+0000 7fcd167fc640 1 -- 172.21.15.39:0/4231363118 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd100aa5f0 con 0x7fcd180b49b0 2023-05-16T13:54:25.786 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.777+0000 7fcd167fc640 1 -- 172.21.15.39:0/4231363118 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd100aa750 con 0x7fcd180b49b0 2023-05-16T13:54:25.786 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.777+0000 7fcd167fc640 1 -- 172.21.15.39:0/4231363118 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd100aaae0 con 0x7fcd180b49b0 2023-05-16T13:54:25.787 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.777+0000 7fcd1d48c640 1 -- 172.21.15.39:0/4231363118 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd180b49b0 msgr2=0x7fcd180ce5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:25.787 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.777+0000 7fcd1d48c640 1 --2- 172.21.15.39:0/4231363118 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd180b49b0 0x7fcd180ce5e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fcd18073210 tx=0x7fcd1001c4d0 comp rx=0 tx=0).stop 2023-05-16T13:54:25.787 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.777+0000 7fcd1d48c640 1 -- 172.21.15.39:0/4231363118 shutdown_connections 2023-05-16T13:54:25.787 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.777+0000 7fcd1d48c640 1 --2- 172.21.15.39:0/4231363118 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd180b49b0 0x7fcd180ce5e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:25.787 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.777+0000 7fcd1d48c640 1 --2- 172.21.15.39:0/4231363118 >> v2:172.21.15.118:3300/0 conn(0x7fcd1815c470 0x7fcd180d0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:25.787 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.777+0000 7fcd1d48c640 1 -- 172.21.15.39:0/4231363118 >> 172.21.15.39:0/4231363118 conn(0x7fcd1809bae0 msgr2=0x7fcd180d2820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:25.787 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.777+0000 7fcd1d48c640 1 -- 172.21.15.39:0/4231363118 shutdown_connections 2023-05-16T13:54:25.788 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.777+0000 7fcd1d48c640 1 -- 172.21.15.39:0/4231363118 wait complete. 2023-05-16T13:54:25.788 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.781+0000 7fcd1d48c640 1 Processor -- start 2023-05-16T13:54:25.788 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.781+0000 7fcd1d48c640 1 -- start start 2023-05-16T13:54:25.789 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.781+0000 7fcd1d48c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd180b49b0 0x7fcd1815ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:25.789 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.781+0000 7fcd1d48c640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd180b5670 0x7fcd1815cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:25.789 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.781+0000 7fcd1d48c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd1815c470 0x7fcd180cf230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:25.790 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.781+0000 7fcd1d48c640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1815f4b0 con 0x7fcd1815c470 2023-05-16T13:54:25.790 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.781+0000 7fcd1d48c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1815df30 con 0x7fcd180b49b0 2023-05-16T13:54:25.790 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.781+0000 7fcd1d48c640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1815d3b0 con 0x7fcd180b5670 2023-05-16T13:54:25.790 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.781+0000 7fcd177fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd1815c470 0x7fcd180cf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:25.790 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.781+0000 7fcd177fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd1815c470 0x7fcd180cf230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60186/0 (socket says 172.21.15.39:60186) 2023-05-16T13:54:25.790 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.781+0000 7fcd177fe640 1 -- 172.21.15.39:0/1333864496 learned_addr learned my addr 172.21.15.39:0/1333864496 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:25.791 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.781+0000 7fcd177fe640 1 -- 172.21.15.39:0/1333864496 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd180b5670 msgr2=0x7fcd1815cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:25.792 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.781+0000 7fcd177fe640 1 --2- 172.21.15.39:0/1333864496 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd180b5670 0x7fcd1815cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:25.792 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.781+0000 7fcd177fe640 1 -- 172.21.15.39:0/1333864496 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd180b49b0 msgr2=0x7fcd1815ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:25.792 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.781+0000 7fcd16ffd640 1 --2- 172.21.15.39:0/1333864496 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd180b49b0 0x7fcd1815ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:25.792 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.781+0000 7fcd177fe640 1 --2- 172.21.15.39:0/1333864496 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd180b49b0 0x7fcd1815ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:25.792 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.781+0000 7fcd177fe640 1 -- 172.21.15.39:0/1333864496 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd100094d0 con 0x7fcd1815c470 2023-05-16T13:54:25.792 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.781+0000 7fcd16ffd640 1 --2- 172.21.15.39:0/1333864496 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd180b49b0 0x7fcd1815ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-16T13:54:25.792 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.781+0000 7fcd177fe640 1 --2- 172.21.15.39:0/1333864496 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd1815c470 0x7fcd180cf230 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fcd100ac040 tx=0x7fcd1001ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:25.793 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.781+0000 7fcd0f7fe640 1 -- 172.21.15.39:0/1333864496 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd100b3800 con 0x7fcd1815c470 2023-05-16T13:54:25.793 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.781+0000 7fcd0f7fe640 1 -- 172.21.15.39:0/1333864496 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd100b3960 con 0x7fcd1815c470 2023-05-16T13:54:25.793 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.781+0000 7fcd0f7fe640 1 -- 172.21.15.39:0/1333864496 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd100b3cd0 con 0x7fcd1815c470 2023-05-16T13:54:25.793 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.781+0000 7fcd1d48c640 1 -- 172.21.15.39:0/1333864496 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd1809bf70 con 0x7fcd1815c470 2023-05-16T13:54:25.793 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.781+0000 7fcd1d48c640 1 -- 172.21.15.39:0/1333864496 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd180cef30 con 0x7fcd1815c470 2023-05-16T13:54:25.793 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.781+0000 7fcd1d48c640 1 -- 172.21.15.39:0/1333864496 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd180d0ee0 con 0x7fcd1815c470 2023-05-16T13:54:25.794 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.785+0000 7fcd0f7fe640 1 -- 172.21.15.39:0/1333864496 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcd100b2380 con 0x7fcd1815c470 2023-05-16T13:54:25.794 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.785+0000 7fcd0f7fe640 1 --2- 172.21.15.39:0/1333864496 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fccf8066280 0x7fccf8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:25.794 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.785+0000 7fcd0f7fe640 1 -- 172.21.15.39:0/1333864496 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcd100a7070 con 0x7fcd1815c470 2023-05-16T13:54:25.794 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.785+0000 7fcd16ffd640 1 --2- 172.21.15.39:0/1333864496 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fccf8066280 0x7fccf8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:25.794 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.785+0000 7fcd16ffd640 1 --2- 172.21.15.39:0/1333864496 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fccf8066280 0x7fccf8068730 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcd08007380 tx=0x7fcd0800b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:25.797 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.789+0000 7fcd0f7fe640 1 -- 172.21.15.39:0/1333864496 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fcd100eb6f0 con 0x7fcd1815c470 2023-05-16T13:54:25.949 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.941+0000 7fcd1d48c640 1 -- 172.21.15.39:0/1333864496 --> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcd18155d90 con 0x7fccf8066280 2023-05-16T13:54:25.956 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.949+0000 7fcd0f7fe640 1 -- 172.21.15.39:0/1333864496 <== mgr.4098 v2:172.21.15.39:6832/288296800 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286654 (secure 0 0 0) 0x7fcd18155d90 con 0x7fccf8066280 2023-05-16T13:54:25.959 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:54:25.960 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2023-05-16T13:54:25.961 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.953+0000 7fcd1d48c640 1 -- 172.21.15.39:0/1333864496 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fccf8066280 msgr2=0x7fccf8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:25.961 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.953+0000 7fcd1d48c640 1 --2- 172.21.15.39:0/1333864496 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fccf8066280 0x7fccf8068730 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcd08007380 tx=0x7fcd0800b040 comp rx=0 tx=0).stop 2023-05-16T13:54:25.961 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.953+0000 7fcd1d48c640 1 -- 172.21.15.39:0/1333864496 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd1815c470 msgr2=0x7fcd180cf230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:25.961 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.953+0000 7fcd1d48c640 1 --2- 172.21.15.39:0/1333864496 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd1815c470 0x7fcd180cf230 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fcd100ac040 tx=0x7fcd1001ad10 comp rx=0 tx=0).stop 2023-05-16T13:54:25.962 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.953+0000 7fcd1d48c640 1 -- 172.21.15.39:0/1333864496 shutdown_connections 2023-05-16T13:54:25.962 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.953+0000 7fcd1d48c640 1 --2- 172.21.15.39:0/1333864496 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fccf8066280 0x7fccf8068730 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:25.962 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.953+0000 7fcd1d48c640 1 --2- 172.21.15.39:0/1333864496 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd180b5670 0x7fcd1815cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:25.962 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.953+0000 7fcd1d48c640 1 --2- 172.21.15.39:0/1333864496 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd1815c470 0x7fcd180cf230 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:25.962 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.953+0000 7fcd1d48c640 1 --2- 172.21.15.39:0/1333864496 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd180b49b0 0x7fcd1815ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:25.962 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.953+0000 7fcd1d48c640 1 -- 172.21.15.39:0/1333864496 >> 172.21.15.39:0/1333864496 conn(0x7fcd1809bae0 msgr2=0x7fcd180b42a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:25.962 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.953+0000 7fcd1d48c640 1 -- 172.21.15.39:0/1333864496 shutdown_connections 2023-05-16T13:54:25.962 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:25.953+0000 7fcd1d48c640 1 -- 172.21.15.39:0/1333864496 wait complete. 2023-05-16T13:54:25.979 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2023-05-16T13:54:24.831390+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":90952,"kb_used_data":3144,"kb_used_omap":0,"kb_used_meta":87744,"kb_avail":754883768,"statfs":{"total":773094113280,"available":773000978432,"internally_reserved":0,"allocated":3219456,"data_stored":1915524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":89849856},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.635974"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.593210+0000","last_change":"2023-05-16T13:54:15.211201+0000","last_active":"2023-05-16T13:54:16.593210+0000","last_peered":"2023-05-16T13:54:16.593210+0000","last_clean":"2023-05-16T13:54:16.593210+0000","last_became_active":"2023-05-16T13:54:15.210864+0000","last_became_peered":"2023-05-16T13:54:15.210864+0000","last_unstale":"2023-05-16T13:54:16.593210+0000","last_undegraded":"2023-05-16T13:54:16.593210+0000","last_fullsized":"2023-05-16T13:54:16.593210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:00:33.678077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.095018+0000","last_change":"2023-05-16T13:54:15.225613+0000","last_active":"2023-05-16T13:54:17.095018+0000","last_peered":"2023-05-16T13:54:17.095018+0000","last_clean":"2023-05-16T13:54:17.095018+0000","last_became_active":"2023-05-16T13:54:15.225255+0000","last_became_peered":"2023-05-16T13:54:15.225255+0000","last_unstale":"2023-05-16T13:54:17.095018+0000","last_undegraded":"2023-05-16T13:54:17.095018+0000","last_fullsized":"2023-05-16T13:54:17.095018+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:23:36.578764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.203170+0000","last_change":"2023-05-16T13:54:15.228669+0000","last_active":"2023-05-16T13:54:16.203170+0000","last_peered":"2023-05-16T13:54:16.203170+0000","last_clean":"2023-05-16T13:54:16.203170+0000","last_became_active":"2023-05-16T13:54:15.228389+0000","last_became_peered":"2023-05-16T13:54:15.228389+0000","last_unstale":"2023-05-16T13:54:16.203170+0000","last_undegraded":"2023-05-16T13:54:16.203170+0000","last_fullsized":"2023-05-16T13:54:16.203170+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:58:10.666710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.201977+0000","last_change":"2023-05-16T13:54:15.228352+0000","last_active":"2023-05-16T13:54:16.201977+0000","last_peered":"2023-05-16T13:54:16.201977+0000","last_clean":"2023-05-16T13:54:16.201977+0000","last_became_active":"2023-05-16T13:54:15.228013+0000","last_became_peered":"2023-05-16T13:54:15.228013+0000","last_unstale":"2023-05-16T13:54:16.201977+0000","last_undegraded":"2023-05-16T13:54:16.201977+0000","last_fullsized":"2023-05-16T13:54:16.201977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:43:13.895642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.094813+0000","last_change":"2023-05-16T13:54:15.232326+0000","last_active":"2023-05-16T13:54:17.094813+0000","last_peered":"2023-05-16T13:54:17.094813+0000","last_clean":"2023-05-16T13:54:17.094813+0000","last_became_active":"2023-05-16T13:54:15.231852+0000","last_became_peered":"2023-05-16T13:54:15.231852+0000","last_unstale":"2023-05-16T13:54:17.094813+0000","last_undegraded":"2023-05-16T13:54:17.094813+0000","last_fullsized":"2023-05-16T13:54:17.094813+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T23:24:29.119212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.202661+0000","last_change":"2023-05-16T13:54:15.228982+0000","last_active":"2023-05-16T13:54:16.202661+0000","last_peered":"2023-05-16T13:54:16.202661+0000","last_clean":"2023-05-16T13:54:16.202661+0000","last_became_active":"2023-05-16T13:54:15.228468+0000","last_became_peered":"2023-05-16T13:54:15.228468+0000","last_unstale":"2023-05-16T13:54:16.202661+0000","last_undegraded":"2023-05-16T13:54:16.202661+0000","last_fullsized":"2023-05-16T13:54:16.202661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T16:19:34.312806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.234289+0000","last_change":"2023-05-16T13:54:15.217211+0000","last_active":"2023-05-16T13:54:16.234289+0000","last_peered":"2023-05-16T13:54:16.234289+0000","last_clean":"2023-05-16T13:54:16.234289+0000","last_became_active":"2023-05-16T13:54:15.216921+0000","last_became_peered":"2023-05-16T13:54:15.216921+0000","last_unstale":"2023-05-16T13:54:16.234289+0000","last_undegraded":"2023-05-16T13:54:16.234289+0000","last_fullsized":"2023-05-16T13:54:16.234289+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:05:33.250909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.094630+0000","last_change":"2023-05-16T13:54:15.220276+0000","last_active":"2023-05-16T13:54:17.094630+0000","last_peered":"2023-05-16T13:54:17.094630+0000","last_clean":"2023-05-16T13:54:17.094630+0000","last_became_active":"2023-05-16T13:54:15.219893+0000","last_became_peered":"2023-05-16T13:54:15.219893+0000","last_unstale":"2023-05-16T13:54:17.094630+0000","last_undegraded":"2023-05-16T13:54:17.094630+0000","last_fullsized":"2023-05-16T13:54:17.094630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:56:30.067725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.095064+0000","last_change":"2023-05-16T13:54:15.233844+0000","last_active":"2023-05-16T13:54:17.095064+0000","last_peered":"2023-05-16T13:54:17.095064+0000","last_clean":"2023-05-16T13:54:17.095064+0000","last_became_active":"2023-05-16T13:54:15.232864+0000","last_became_peered":"2023-05-16T13:54:15.232864+0000","last_unstale":"2023-05-16T13:54:17.095064+0000","last_undegraded":"2023-05-16T13:54:17.095064+0000","last_fullsized":"2023-05-16T13:54:17.095064+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:33:13.438730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.094911+0000","last_change":"2023-05-16T13:54:15.229695+0000","last_active":"2023-05-16T13:54:17.094911+0000","last_peered":"2023-05-16T13:54:17.094911+0000","last_clean":"2023-05-16T13:54:17.094911+0000","last_became_active":"2023-05-16T13:54:15.229428+0000","last_became_peered":"2023-05-16T13:54:15.229428+0000","last_unstale":"2023-05-16T13:54:17.094911+0000","last_undegraded":"2023-05-16T13:54:17.094911+0000","last_fullsized":"2023-05-16T13:54:17.094911+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:57:22.154305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.203185+0000","last_change":"2023-05-16T13:54:15.223655+0000","last_active":"2023-05-16T13:54:16.203185+0000","last_peered":"2023-05-16T13:54:16.203185+0000","last_clean":"2023-05-16T13:54:16.203185+0000","last_became_active":"2023-05-16T13:54:15.223324+0000","last_became_peered":"2023-05-16T13:54:15.223324+0000","last_unstale":"2023-05-16T13:54:16.203185+0000","last_undegraded":"2023-05-16T13:54:16.203185+0000","last_fullsized":"2023-05-16T13:54:16.203185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:34:27.280408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.593211+0000","last_change":"2023-05-16T13:54:15.231258+0000","last_active":"2023-05-16T13:54:16.593211+0000","last_peered":"2023-05-16T13:54:16.593211+0000","last_clean":"2023-05-16T13:54:16.593211+0000","last_became_active":"2023-05-16T13:54:15.230996+0000","last_became_peered":"2023-05-16T13:54:15.230996+0000","last_unstale":"2023-05-16T13:54:16.593211+0000","last_undegraded":"2023-05-16T13:54:16.593211+0000","last_fullsized":"2023-05-16T13:54:16.593211+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:27:26.622822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.593055+0000","last_change":"2023-05-16T13:54:15.211137+0000","last_active":"2023-05-16T13:54:16.593055+0000","last_peered":"2023-05-16T13:54:16.593055+0000","last_clean":"2023-05-16T13:54:16.593055+0000","last_became_active":"2023-05-16T13:54:15.210834+0000","last_became_peered":"2023-05-16T13:54:15.210834+0000","last_unstale":"2023-05-16T13:54:16.593055+0000","last_undegraded":"2023-05-16T13:54:16.593055+0000","last_fullsized":"2023-05-16T13:54:16.593055+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:19:30.585369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.095011+0000","last_change":"2023-05-16T13:54:15.222527+0000","last_active":"2023-05-16T13:54:17.095011+0000","last_peered":"2023-05-16T13:54:17.095011+0000","last_clean":"2023-05-16T13:54:17.095011+0000","last_became_active":"2023-05-16T13:54:15.222111+0000","last_became_peered":"2023-05-16T13:54:15.222111+0000","last_unstale":"2023-05-16T13:54:17.095011+0000","last_undegraded":"2023-05-16T13:54:17.095011+0000","last_fullsized":"2023-05-16T13:54:17.095011+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T14:08:36.668941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.234380+0000","last_change":"2023-05-16T13:54:15.224759+0000","last_active":"2023-05-16T13:54:16.234380+0000","last_peered":"2023-05-16T13:54:16.234380+0000","last_clean":"2023-05-16T13:54:16.234380+0000","last_became_active":"2023-05-16T13:54:15.224486+0000","last_became_peered":"2023-05-16T13:54:15.224486+0000","last_unstale":"2023-05-16T13:54:16.234380+0000","last_undegraded":"2023-05-16T13:54:16.234380+0000","last_fullsized":"2023-05-16T13:54:16.234380+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:23:36.578764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.201645+0000","last_change":"2023-05-16T13:54:15.231690+0000","last_active":"2023-05-16T13:54:16.201645+0000","last_peered":"2023-05-16T13:54:16.201645+0000","last_clean":"2023-05-16T13:54:16.201645+0000","last_became_active":"2023-05-16T13:54:15.231041+0000","last_became_peered":"2023-05-16T13:54:15.231041+0000","last_unstale":"2023-05-16T13:54:16.201645+0000","last_undegraded":"2023-05-16T13:54:16.201645+0000","last_fullsized":"2023-05-16T13:54:16.201645+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:58:22.882260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.095207+0000","last_change":"2023-05-16T13:54:15.234033+0000","last_active":"2023-05-16T13:54:17.095207+0000","last_peered":"2023-05-16T13:54:17.095207+0000","last_clean":"2023-05-16T13:54:17.095207+0000","last_became_active":"2023-05-16T13:54:15.233573+0000","last_became_peered":"2023-05-16T13:54:15.233573+0000","last_unstale":"2023-05-16T13:54:17.095207+0000","last_undegraded":"2023-05-16T13:54:17.095207+0000","last_fullsized":"2023-05-16T13:54:17.095207+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T14:58:42.042361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.203259+0000","last_change":"2023-05-16T13:54:15.217992+0000","last_active":"2023-05-16T13:54:16.203259+0000","last_peered":"2023-05-16T13:54:16.203259+0000","last_clean":"2023-05-16T13:54:16.203259+0000","last_became_active":"2023-05-16T13:54:15.217320+0000","last_became_peered":"2023-05-16T13:54:15.217320+0000","last_unstale":"2023-05-16T13:54:16.203259+0000","last_undegraded":"2023-05-16T13:54:16.203259+0000","last_fullsized":"2023-05-16T13:54:16.203259+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:03:24.701966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.593152+0000","last_change":"2023-05-16T13:54:15.209420+0000","last_active":"2023-05-16T13:54:16.593152+0000","last_peered":"2023-05-16T13:54:16.593152+0000","last_clean":"2023-05-16T13:54:16.593152+0000","last_became_active":"2023-05-16T13:54:15.208345+0000","last_became_peered":"2023-05-16T13:54:15.208345+0000","last_unstale":"2023-05-16T13:54:16.593152+0000","last_undegraded":"2023-05-16T13:54:16.593152+0000","last_fullsized":"2023-05-16T13:54:16.593152+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T18:23:15.082235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.202730+0000","last_change":"2023-05-16T13:54:15.214941+0000","last_active":"2023-05-16T13:54:16.202730+0000","last_peered":"2023-05-16T13:54:16.202730+0000","last_clean":"2023-05-16T13:54:16.202730+0000","last_became_active":"2023-05-16T13:54:15.214581+0000","last_became_peered":"2023-05-16T13:54:15.214581+0000","last_unstale":"2023-05-16T13:54:16.202730+0000","last_undegraded":"2023-05-16T13:54:16.202730+0000","last_fullsized":"2023-05-16T13:54:16.202730+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:53:50.523933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.234462+0000","last_change":"2023-05-16T13:54:15.222860+0000","last_active":"2023-05-16T13:54:16.234462+0000","last_peered":"2023-05-16T13:54:16.234462+0000","last_clean":"2023-05-16T13:54:16.234462+0000","last_became_active":"2023-05-16T13:54:15.222149+0000","last_became_peered":"2023-05-16T13:54:15.222149+0000","last_unstale":"2023-05-16T13:54:16.234462+0000","last_undegraded":"2023-05-16T13:54:16.234462+0000","last_fullsized":"2023-05-16T13:54:16.234462+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:51:04.272951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.095156+0000","last_change":"2023-05-16T13:54:15.228300+0000","last_active":"2023-05-16T13:54:17.095156+0000","last_peered":"2023-05-16T13:54:17.095156+0000","last_clean":"2023-05-16T13:54:17.095156+0000","last_became_active":"2023-05-16T13:54:15.227773+0000","last_became_peered":"2023-05-16T13:54:15.227773+0000","last_unstale":"2023-05-16T13:54:17.095156+0000","last_undegraded":"2023-05-16T13:54:17.095156+0000","last_fullsized":"2023-05-16T13:54:17.095156+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T14:57:07.445671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.200316+0000","last_change":"2023-05-16T13:54:15.228240+0000","last_active":"2023-05-16T13:54:16.200316+0000","last_peered":"2023-05-16T13:54:16.200316+0000","last_clean":"2023-05-16T13:54:16.200316+0000","last_became_active":"2023-05-16T13:54:15.227927+0000","last_became_peered":"2023-05-16T13:54:15.227927+0000","last_unstale":"2023-05-16T13:54:16.200316+0000","last_undegraded":"2023-05-16T13:54:16.200316+0000","last_fullsized":"2023-05-16T13:54:16.200316+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T15:50:58.482925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.234446+0000","last_change":"2023-05-16T13:54:15.221851+0000","last_active":"2023-05-16T13:54:16.234446+0000","last_peered":"2023-05-16T13:54:16.234446+0000","last_clean":"2023-05-16T13:54:16.234446+0000","last_became_active":"2023-05-16T13:54:15.221511+0000","last_became_peered":"2023-05-16T13:54:15.221511+0000","last_unstale":"2023-05-16T13:54:16.234446+0000","last_undegraded":"2023-05-16T13:54:16.234446+0000","last_fullsized":"2023-05-16T13:54:16.234446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:18:56.753459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.094440+0000","last_change":"2023-05-16T13:54:15.224061+0000","last_active":"2023-05-16T13:54:17.094440+0000","last_peered":"2023-05-16T13:54:17.094440+0000","last_clean":"2023-05-16T13:54:17.094440+0000","last_became_active":"2023-05-16T13:54:15.223626+0000","last_became_peered":"2023-05-16T13:54:15.223626+0000","last_unstale":"2023-05-16T13:54:17.094440+0000","last_undegraded":"2023-05-16T13:54:17.094440+0000","last_fullsized":"2023-05-16T13:54:17.094440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T23:24:29.119212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.094898+0000","last_change":"2023-05-16T13:54:15.216383+0000","last_active":"2023-05-16T13:54:17.094898+0000","last_peered":"2023-05-16T13:54:17.094898+0000","last_clean":"2023-05-16T13:54:17.094898+0000","last_became_active":"2023-05-16T13:54:15.216056+0000","last_became_peered":"2023-05-16T13:54:15.216056+0000","last_unstale":"2023-05-16T13:54:17.094898+0000","last_undegraded":"2023-05-16T13:54:17.094898+0000","last_fullsized":"2023-05-16T13:54:17.094898+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T14:57:07.445671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.094905+0000","last_change":"2023-05-16T13:54:15.223638+0000","last_active":"2023-05-16T13:54:17.094905+0000","last_peered":"2023-05-16T13:54:17.094905+0000","last_clean":"2023-05-16T13:54:17.094905+0000","last_became_active":"2023-05-16T13:54:15.223140+0000","last_became_peered":"2023-05-16T13:54:15.223140+0000","last_unstale":"2023-05-16T13:54:17.094905+0000","last_undegraded":"2023-05-16T13:54:17.094905+0000","last_fullsized":"2023-05-16T13:54:17.094905+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:18:56.753459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.095505+0000","last_change":"2023-05-16T13:54:15.215238+0000","last_active":"2023-05-16T13:54:17.095505+0000","last_peered":"2023-05-16T13:54:17.095505+0000","last_clean":"2023-05-16T13:54:17.095505+0000","last_became_active":"2023-05-16T13:54:15.214974+0000","last_became_peered":"2023-05-16T13:54:15.214974+0000","last_unstale":"2023-05-16T13:54:17.095505+0000","last_undegraded":"2023-05-16T13:54:17.095505+0000","last_fullsized":"2023-05-16T13:54:17.095505+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T15:29:06.983258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.201046+0000","last_change":"2023-05-16T13:54:15.220178+0000","last_active":"2023-05-16T13:54:16.201046+0000","last_peered":"2023-05-16T13:54:16.201046+0000","last_clean":"2023-05-16T13:54:16.201046+0000","last_became_active":"2023-05-16T13:54:15.219892+0000","last_became_peered":"2023-05-16T13:54:15.219892+0000","last_unstale":"2023-05-16T13:54:16.201046+0000","last_undegraded":"2023-05-16T13:54:16.201046+0000","last_fullsized":"2023-05-16T13:54:16.201046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T14:08:36.668941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.202938+0000","last_change":"2023-05-16T13:54:15.211537+0000","last_active":"2023-05-16T13:54:16.202938+0000","last_peered":"2023-05-16T13:54:16.202938+0000","last_clean":"2023-05-16T13:54:16.202938+0000","last_became_active":"2023-05-16T13:54:15.211186+0000","last_became_peered":"2023-05-16T13:54:15.211186+0000","last_unstale":"2023-05-16T13:54:16.202938+0000","last_undegraded":"2023-05-16T13:54:16.202938+0000","last_fullsized":"2023-05-16T13:54:16.202938+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:23:36.578764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.200428+0000","last_change":"2023-05-16T13:54:15.217651+0000","last_active":"2023-05-16T13:54:16.200428+0000","last_peered":"2023-05-16T13:54:16.200428+0000","last_clean":"2023-05-16T13:54:16.200428+0000","last_became_active":"2023-05-16T13:54:15.217294+0000","last_became_peered":"2023-05-16T13:54:15.217294+0000","last_unstale":"2023-05-16T13:54:16.200428+0000","last_undegraded":"2023-05-16T13:54:16.200428+0000","last_fullsized":"2023-05-16T13:54:16.200428+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:38:13.293626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.201794+0000","last_change":"2023-05-16T13:54:15.217531+0000","last_active":"2023-05-16T13:54:16.201794+0000","last_peered":"2023-05-16T13:54:16.201794+0000","last_clean":"2023-05-16T13:54:16.201794+0000","last_became_active":"2023-05-16T13:54:15.217002+0000","last_became_peered":"2023-05-16T13:54:15.217002+0000","last_unstale":"2023-05-16T13:54:16.201794+0000","last_undegraded":"2023-05-16T13:54:16.201794+0000","last_fullsized":"2023-05-16T13:54:16.201794+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:10:29.866761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.201209+0000","last_change":"2023-05-16T13:54:15.223492+0000","last_active":"2023-05-16T13:54:16.201209+0000","last_peered":"2023-05-16T13:54:16.201209+0000","last_clean":"2023-05-16T13:54:16.201209+0000","last_became_active":"2023-05-16T13:54:15.223220+0000","last_became_peered":"2023-05-16T13:54:15.223220+0000","last_unstale":"2023-05-16T13:54:16.201209+0000","last_undegraded":"2023-05-16T13:54:16.201209+0000","last_fullsized":"2023-05-16T13:54:16.201209+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:51:04.272951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.234538+0000","last_change":"2023-05-16T13:54:14.826021+0000","last_active":"2023-05-16T13:54:16.234538+0000","last_peered":"2023-05-16T13:54:16.234538+0000","last_clean":"2023-05-16T13:54:16.234538+0000","last_became_active":"2023-05-16T13:54:14.820310+0000","last_became_peered":"2023-05-16T13:54:14.820310+0000","last_unstale":"2023-05-16T13:54:16.234538+0000","last_undegraded":"2023-05-16T13:54:16.234538+0000","last_fullsized":"2023-05-16T13:54:16.234538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:58:09.660328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.095001+0000","last_change":"2023-05-16T13:54:15.223399+0000","last_active":"2023-05-16T13:54:17.095001+0000","last_peered":"2023-05-16T13:54:17.095001+0000","last_clean":"2023-05-16T13:54:17.095001+0000","last_became_active":"2023-05-16T13:54:15.222860+0000","last_became_peered":"2023-05-16T13:54:15.222860+0000","last_unstale":"2023-05-16T13:54:17.095001+0000","last_undegraded":"2023-05-16T13:54:17.095001+0000","last_fullsized":"2023-05-16T13:54:17.095001+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:05:33.250909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.095312+0000","last_change":"2023-05-16T13:54:14.811666+0000","last_active":"2023-05-16T13:54:17.095312+0000","last_peered":"2023-05-16T13:54:17.095312+0000","last_clean":"2023-05-16T13:54:17.095312+0000","last_became_active":"2023-05-16T13:54:14.811282+0000","last_became_peered":"2023-05-16T13:54:14.811282+0000","last_unstale":"2023-05-16T13:54:17.095312+0000","last_undegraded":"2023-05-16T13:54:17.095312+0000","last_fullsized":"2023-05-16T13:54:17.095312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T14:27:24.383997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.095188+0000","last_change":"2023-05-16T13:54:15.229301+0000","last_active":"2023-05-16T13:54:17.095188+0000","last_peered":"2023-05-16T13:54:17.095188+0000","last_clean":"2023-05-16T13:54:17.095188+0000","last_became_active":"2023-05-16T13:54:15.228861+0000","last_became_peered":"2023-05-16T13:54:15.228861+0000","last_unstale":"2023-05-16T13:54:17.095188+0000","last_undegraded":"2023-05-16T13:54:17.095188+0000","last_fullsized":"2023-05-16T13:54:17.095188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T20:50:05.973113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.234451+0000","last_change":"2023-05-16T13:54:14.822092+0000","last_active":"2023-05-16T13:54:16.234451+0000","last_peered":"2023-05-16T13:54:16.234451+0000","last_clean":"2023-05-16T13:54:16.234451+0000","last_became_active":"2023-05-16T13:54:14.820716+0000","last_became_peered":"2023-05-16T13:54:14.820716+0000","last_unstale":"2023-05-16T13:54:16.234451+0000","last_undegraded":"2023-05-16T13:54:16.234451+0000","last_fullsized":"2023-05-16T13:54:16.234451+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T20:40:58.823162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.201018+0000","last_change":"2023-05-16T13:54:15.222372+0000","last_active":"2023-05-16T13:54:16.201018+0000","last_peered":"2023-05-16T13:54:16.201018+0000","last_clean":"2023-05-16T13:54:16.201018+0000","last_became_active":"2023-05-16T13:54:15.219602+0000","last_became_peered":"2023-05-16T13:54:15.219602+0000","last_unstale":"2023-05-16T13:54:16.201018+0000","last_undegraded":"2023-05-16T13:54:16.201018+0000","last_fullsized":"2023-05-16T13:54:16.201018+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:05:33.250909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.201862+0000","last_change":"2023-05-16T13:54:14.814991+0000","last_active":"2023-05-16T13:54:16.201862+0000","last_peered":"2023-05-16T13:54:16.201862+0000","last_clean":"2023-05-16T13:54:16.201862+0000","last_became_active":"2023-05-16T13:54:14.814571+0000","last_became_peered":"2023-05-16T13:54:14.814571+0000","last_unstale":"2023-05-16T13:54:16.201862+0000","last_undegraded":"2023-05-16T13:54:16.201862+0000","last_fullsized":"2023-05-16T13:54:16.201862+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T16:38:02.634625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.234878+0000","last_change":"2023-05-16T13:54:14.821745+0000","last_active":"2023-05-16T13:54:16.234878+0000","last_peered":"2023-05-16T13:54:16.234878+0000","last_clean":"2023-05-16T13:54:16.234878+0000","last_became_active":"2023-05-16T13:54:14.820978+0000","last_became_peered":"2023-05-16T13:54:14.820978+0000","last_unstale":"2023-05-16T13:54:16.234878+0000","last_undegraded":"2023-05-16T13:54:16.234878+0000","last_fullsized":"2023-05-16T13:54:16.234878+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:15:56.752324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.094630+0000","last_change":"2023-05-16T13:54:15.220768+0000","last_active":"2023-05-16T13:54:17.094630+0000","last_peered":"2023-05-16T13:54:17.094630+0000","last_clean":"2023-05-16T13:54:17.094630+0000","last_became_active":"2023-05-16T13:54:15.220494+0000","last_became_peered":"2023-05-16T13:54:15.220494+0000","last_unstale":"2023-05-16T13:54:17.094630+0000","last_undegraded":"2023-05-16T13:54:17.094630+0000","last_fullsized":"2023-05-16T13:54:17.094630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:38:13.293626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.234833+0000","last_change":"2023-05-16T13:54:14.821942+0000","last_active":"2023-05-16T13:54:16.234833+0000","last_peered":"2023-05-16T13:54:16.234833+0000","last_clean":"2023-05-16T13:54:16.234833+0000","last_became_active":"2023-05-16T13:54:14.821539+0000","last_became_peered":"2023-05-16T13:54:14.821539+0000","last_unstale":"2023-05-16T13:54:16.234833+0000","last_undegraded":"2023-05-16T13:54:16.234833+0000","last_fullsized":"2023-05-16T13:54:16.234833+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T23:19:38.774487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.201687+0000","last_change":"2023-05-16T13:54:15.218507+0000","last_active":"2023-05-16T13:54:16.201687+0000","last_peered":"2023-05-16T13:54:16.201687+0000","last_clean":"2023-05-16T13:54:16.201687+0000","last_became_active":"2023-05-16T13:54:15.218014+0000","last_became_peered":"2023-05-16T13:54:15.218014+0000","last_unstale":"2023-05-16T13:54:16.201687+0000","last_undegraded":"2023-05-16T13:54:16.201687+0000","last_fullsized":"2023-05-16T13:54:16.201687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:12:06.609266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.234688+0000","last_change":"2023-05-16T13:54:14.824383+0000","last_active":"2023-05-16T13:54:16.234688+0000","last_peered":"2023-05-16T13:54:16.234688+0000","last_clean":"2023-05-16T13:54:16.234688+0000","last_became_active":"2023-05-16T13:54:14.824117+0000","last_became_peered":"2023-05-16T13:54:14.824117+0000","last_unstale":"2023-05-16T13:54:16.234688+0000","last_undegraded":"2023-05-16T13:54:16.234688+0000","last_fullsized":"2023-05-16T13:54:16.234688+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:32:07.899174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.202234+0000","last_change":"2023-05-16T13:54:15.219224+0000","last_active":"2023-05-16T13:54:16.202234+0000","last_peered":"2023-05-16T13:54:16.202234+0000","last_clean":"2023-05-16T13:54:16.202234+0000","last_became_active":"2023-05-16T13:54:15.218672+0000","last_became_peered":"2023-05-16T13:54:15.218672+0000","last_unstale":"2023-05-16T13:54:16.202234+0000","last_undegraded":"2023-05-16T13:54:16.202234+0000","last_fullsized":"2023-05-16T13:54:16.202234+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T18:27:40.065469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.094859+0000","last_change":"2023-05-16T13:54:14.821843+0000","last_active":"2023-05-16T13:54:17.094859+0000","last_peered":"2023-05-16T13:54:17.094859+0000","last_clean":"2023-05-16T13:54:17.094859+0000","last_became_active":"2023-05-16T13:54:14.821386+0000","last_became_peered":"2023-05-16T13:54:14.821386+0000","last_unstale":"2023-05-16T13:54:17.094859+0000","last_undegraded":"2023-05-16T13:54:17.094859+0000","last_fullsized":"2023-05-16T13:54:17.094859+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:53:49.517551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.094498+0000","last_change":"2023-05-16T13:54:15.232203+0000","last_active":"2023-05-16T13:54:17.094498+0000","last_peered":"2023-05-16T13:54:17.094498+0000","last_clean":"2023-05-16T13:54:17.094498+0000","last_became_active":"2023-05-16T13:54:15.231644+0000","last_became_peered":"2023-05-16T13:54:15.231644+0000","last_unstale":"2023-05-16T13:54:17.094498+0000","last_undegraded":"2023-05-16T13:54:17.094498+0000","last_fullsized":"2023-05-16T13:54:17.094498+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T18:51:58.566752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.201131+0000","last_change":"2023-05-16T13:54:14.819498+0000","last_active":"2023-05-16T13:54:16.201131+0000","last_peered":"2023-05-16T13:54:16.201131+0000","last_clean":"2023-05-16T13:54:16.201131+0000","last_became_active":"2023-05-16T13:54:14.819147+0000","last_became_peered":"2023-05-16T13:54:14.819147+0000","last_unstale":"2023-05-16T13:54:16.201131+0000","last_undegraded":"2023-05-16T13:54:16.201131+0000","last_fullsized":"2023-05-16T13:54:16.201131+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T20:40:58.823162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.202789+0000","last_change":"2023-05-16T13:54:15.217792+0000","last_active":"2023-05-16T13:54:16.202789+0000","last_peered":"2023-05-16T13:54:16.202789+0000","last_clean":"2023-05-16T13:54:16.202789+0000","last_became_active":"2023-05-16T13:54:15.216858+0000","last_became_peered":"2023-05-16T13:54:15.216858+0000","last_unstale":"2023-05-16T13:54:16.202789+0000","last_undegraded":"2023-05-16T13:54:16.202789+0000","last_fullsized":"2023-05-16T13:54:16.202789+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T23:50:22.458202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.202400+0000","last_change":"2023-05-16T13:54:14.819120+0000","last_active":"2023-05-16T13:54:16.202400+0000","last_peered":"2023-05-16T13:54:16.202400+0000","last_clean":"2023-05-16T13:54:16.202400+0000","last_became_active":"2023-05-16T13:54:14.818822+0000","last_became_peered":"2023-05-16T13:54:14.818822+0000","last_unstale":"2023-05-16T13:54:16.202400+0000","last_undegraded":"2023-05-16T13:54:16.202400+0000","last_fullsized":"2023-05-16T13:54:16.202400+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:13:17.386163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.203317+0000","last_change":"2023-05-16T13:54:15.217748+0000","last_active":"2023-05-16T13:54:16.203317+0000","last_peered":"2023-05-16T13:54:16.203317+0000","last_clean":"2023-05-16T13:54:16.203317+0000","last_became_active":"2023-05-16T13:54:15.216101+0000","last_became_peered":"2023-05-16T13:54:15.216101+0000","last_unstale":"2023-05-16T13:54:16.203317+0000","last_undegraded":"2023-05-16T13:54:16.203317+0000","last_fullsized":"2023-05-16T13:54:16.203317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:21:33.710987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.202468+0000","last_change":"2023-05-16T13:54:14.812220+0000","last_active":"2023-05-16T13:54:16.202468+0000","last_peered":"2023-05-16T13:54:16.202468+0000","last_clean":"2023-05-16T13:54:16.202468+0000","last_became_active":"2023-05-16T13:54:14.811901+0000","last_became_peered":"2023-05-16T13:54:14.811901+0000","last_unstale":"2023-05-16T13:54:16.202468+0000","last_undegraded":"2023-05-16T13:54:16.202468+0000","last_fullsized":"2023-05-16T13:54:16.202468+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:38:12.287244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.203309+0000","last_change":"2023-05-16T13:54:15.210585+0000","last_active":"2023-05-16T13:54:16.203309+0000","last_peered":"2023-05-16T13:54:16.203309+0000","last_clean":"2023-05-16T13:54:16.203309+0000","last_became_active":"2023-05-16T13:54:15.210268+0000","last_became_peered":"2023-05-16T13:54:15.210268+0000","last_unstale":"2023-05-16T13:54:16.203309+0000","last_undegraded":"2023-05-16T13:54:16.203309+0000","last_fullsized":"2023-05-16T13:54:16.203309+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:32:08.905557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.200407+0000","last_change":"2023-05-16T13:54:14.818548+0000","last_active":"2023-05-16T13:54:16.200407+0000","last_peered":"2023-05-16T13:54:16.200407+0000","last_clean":"2023-05-16T13:54:16.200407+0000","last_became_active":"2023-05-16T13:54:14.818253+0000","last_became_peered":"2023-05-16T13:54:14.818253+0000","last_unstale":"2023-05-16T13:54:16.200407+0000","last_undegraded":"2023-05-16T13:54:16.200407+0000","last_fullsized":"2023-05-16T13:54:16.200407+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:56:29.061343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.094603+0000","last_change":"2023-05-16T13:54:15.221849+0000","last_active":"2023-05-16T13:54:17.094603+0000","last_peered":"2023-05-16T13:54:17.094603+0000","last_clean":"2023-05-16T13:54:17.094603+0000","last_became_active":"2023-05-16T13:54:15.221542+0000","last_became_peered":"2023-05-16T13:54:15.221542+0000","last_unstale":"2023-05-16T13:54:17.094603+0000","last_undegraded":"2023-05-16T13:54:17.094603+0000","last_fullsized":"2023-05-16T13:54:17.094603+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:21:12.096751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":175,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.234530+0000","last_change":"2023-05-16T13:54:03.495814+0000","last_active":"2023-05-16T13:54:16.234530+0000","last_peered":"2023-05-16T13:54:16.234530+0000","last_clean":"2023-05-16T13:54:16.234530+0000","last_became_active":"2023-05-16T13:54:03.494265+0000","last_became_peered":"2023-05-16T13:54:03.494265+0000","last_unstale":"2023-05-16T13:54:16.234530+0000","last_undegraded":"2023-05-16T13:54:16.234530+0000","last_fullsized":"2023-05-16T13:54:16.234530+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:01.722051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:01.722051+0000","last_clean_scrub_stamp":"2023-05-16T13:54:01.722051+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:34:14.214601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.094642+0000","last_change":"2023-05-16T13:54:09.770727+0000","last_active":"2023-05-16T13:54:17.094642+0000","last_peered":"2023-05-16T13:54:17.094642+0000","last_clean":"2023-05-16T13:54:17.094642+0000","last_became_active":"2023-05-16T13:54:09.770179+0000","last_became_peered":"2023-05-16T13:54:09.770179+0000","last_unstale":"2023-05-16T13:54:17.094642+0000","last_undegraded":"2023-05-16T13:54:17.094642+0000","last_fullsized":"2023-05-16T13:54:17.094642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T16:19:28.279537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.200541+0000","last_change":"2023-05-16T13:54:14.817341+0000","last_active":"2023-05-16T13:54:16.200541+0000","last_peered":"2023-05-16T13:54:16.200541+0000","last_clean":"2023-05-16T13:54:16.200541+0000","last_became_active":"2023-05-16T13:54:14.816323+0000","last_became_peered":"2023-05-16T13:54:14.816323+0000","last_unstale":"2023-05-16T13:54:16.200541+0000","last_undegraded":"2023-05-16T13:54:16.200541+0000","last_fullsized":"2023-05-16T13:54:16.200541+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:53:49.517551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.202234+0000","last_change":"2023-05-16T13:54:15.211549+0000","last_active":"2023-05-16T13:54:16.202234+0000","last_peered":"2023-05-16T13:54:16.202234+0000","last_clean":"2023-05-16T13:54:16.202234+0000","last_became_active":"2023-05-16T13:54:15.211277+0000","last_became_peered":"2023-05-16T13:54:15.211277+0000","last_unstale":"2023-05-16T13:54:16.202234+0000","last_undegraded":"2023-05-16T13:54:16.202234+0000","last_fullsized":"2023-05-16T13:54:16.202234+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T20:48:13.566178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.234295+0000","last_change":"2023-05-16T13:54:09.768888+0000","last_active":"2023-05-16T13:54:16.234295+0000","last_peered":"2023-05-16T13:54:16.234295+0000","last_clean":"2023-05-16T13:54:16.234295+0000","last_became_active":"2023-05-16T13:54:09.768463+0000","last_became_peered":"2023-05-16T13:54:09.768463+0000","last_unstale":"2023-05-16T13:54:16.234295+0000","last_undegraded":"2023-05-16T13:54:16.234295+0000","last_fullsized":"2023-05-16T13:54:16.234295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T14:08:30.635672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.094302+0000","last_change":"2023-05-16T13:54:14.821190+0000","last_active":"2023-05-16T13:54:17.094302+0000","last_peered":"2023-05-16T13:54:17.094302+0000","last_clean":"2023-05-16T13:54:17.094302+0000","last_became_active":"2023-05-16T13:54:14.820901+0000","last_became_peered":"2023-05-16T13:54:14.820901+0000","last_unstale":"2023-05-16T13:54:17.094302+0000","last_undegraded":"2023-05-16T13:54:17.094302+0000","last_fullsized":"2023-05-16T13:54:17.094302+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:52:14.097165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.095050+0000","last_change":"2023-05-16T13:54:15.229018+0000","last_active":"2023-05-16T13:54:17.095050+0000","last_peered":"2023-05-16T13:54:17.095050+0000","last_clean":"2023-05-16T13:54:17.095050+0000","last_became_active":"2023-05-16T13:54:15.228331+0000","last_became_peered":"2023-05-16T13:54:15.228331+0000","last_unstale":"2023-05-16T13:54:17.095050+0000","last_undegraded":"2023-05-16T13:54:17.095050+0000","last_fullsized":"2023-05-16T13:54:17.095050+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:55:43.543739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.593061+0000","last_change":"2023-05-16T13:54:09.821010+0000","last_active":"2023-05-16T13:54:16.593061+0000","last_peered":"2023-05-16T13:54:16.593061+0000","last_clean":"2023-05-16T13:54:16.593061+0000","last_became_active":"2023-05-16T13:54:09.820636+0000","last_became_peered":"2023-05-16T13:54:09.820636+0000","last_unstale":"2023-05-16T13:54:16.593061+0000","last_undegraded":"2023-05-16T13:54:16.593061+0000","last_fullsized":"2023-05-16T13:54:16.593061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:22:51.153577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.094349+0000","last_change":"2023-05-16T13:54:14.813276+0000","last_active":"2023-05-16T13:54:17.094349+0000","last_peered":"2023-05-16T13:54:17.094349+0000","last_clean":"2023-05-16T13:54:17.094349+0000","last_became_active":"2023-05-16T13:54:14.812929+0000","last_became_peered":"2023-05-16T13:54:14.812929+0000","last_unstale":"2023-05-16T13:54:17.094349+0000","last_undegraded":"2023-05-16T13:54:17.094349+0000","last_fullsized":"2023-05-16T13:54:17.094349+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T18:48:52.011265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.095499+0000","last_change":"2023-05-16T13:54:15.223291+0000","last_active":"2023-05-16T13:54:17.095499+0000","last_peered":"2023-05-16T13:54:17.095499+0000","last_clean":"2023-05-16T13:54:17.095499+0000","last_became_active":"2023-05-16T13:54:15.222994+0000","last_became_peered":"2023-05-16T13:54:15.222994+0000","last_unstale":"2023-05-16T13:54:17.095499+0000","last_undegraded":"2023-05-16T13:54:17.095499+0000","last_fullsized":"2023-05-16T13:54:17.095499+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T18:44:00.903883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.095083+0000","last_change":"2023-05-16T13:54:09.771040+0000","last_active":"2023-05-16T13:54:17.095083+0000","last_peered":"2023-05-16T13:54:17.095083+0000","last_clean":"2023-05-16T13:54:17.095083+0000","last_became_active":"2023-05-16T13:54:09.770433+0000","last_became_peered":"2023-05-16T13:54:09.770433+0000","last_unstale":"2023-05-16T13:54:17.095083+0000","last_undegraded":"2023-05-16T13:54:17.095083+0000","last_fullsized":"2023-05-16T13:54:17.095083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T20:40:53.796275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.203109+0000","last_change":"2023-05-16T13:54:14.819218+0000","last_active":"2023-05-16T13:54:16.203109+0000","last_peered":"2023-05-16T13:54:16.203109+0000","last_clean":"2023-05-16T13:54:16.203109+0000","last_became_active":"2023-05-16T13:54:14.818575+0000","last_became_peered":"2023-05-16T13:54:14.818575+0000","last_unstale":"2023-05-16T13:54:16.203109+0000","last_undegraded":"2023-05-16T13:54:16.203109+0000","last_fullsized":"2023-05-16T13:54:16.203109+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:51:03.266568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.095323+0000","last_change":"2023-05-16T13:54:15.214918+0000","last_active":"2023-05-16T13:54:17.095323+0000","last_peered":"2023-05-16T13:54:17.095323+0000","last_clean":"2023-05-16T13:54:17.095323+0000","last_became_active":"2023-05-16T13:54:15.214604+0000","last_became_peered":"2023-05-16T13:54:15.214604+0000","last_unstale":"2023-05-16T13:54:17.095323+0000","last_undegraded":"2023-05-16T13:54:17.095323+0000","last_fullsized":"2023-05-16T13:54:17.095323+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:55:32.146414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.095166+0000","last_change":"2023-05-16T13:54:14.823582+0000","last_active":"2023-05-16T13:54:17.095166+0000","last_peered":"2023-05-16T13:54:17.095166+0000","last_clean":"2023-05-16T13:54:17.095166+0000","last_became_active":"2023-05-16T13:54:14.822465+0000","last_became_peered":"2023-05-16T13:54:14.822465+0000","last_unstale":"2023-05-16T13:54:17.095166+0000","last_undegraded":"2023-05-16T13:54:17.095166+0000","last_fullsized":"2023-05-16T13:54:17.095166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:34:26.274026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.095485+0000","last_change":"2023-05-16T13:54:09.813177+0000","last_active":"2023-05-16T13:54:17.095485+0000","last_peered":"2023-05-16T13:54:17.095485+0000","last_clean":"2023-05-16T13:54:17.095485+0000","last_became_active":"2023-05-16T13:54:09.812487+0000","last_became_peered":"2023-05-16T13:54:09.812487+0000","last_unstale":"2023-05-16T13:54:17.095485+0000","last_undegraded":"2023-05-16T13:54:17.095485+0000","last_fullsized":"2023-05-16T13:54:17.095485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:01:26.897824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.094988+0000","last_change":"2023-05-16T13:54:15.223198+0000","last_active":"2023-05-16T13:54:17.094988+0000","last_peered":"2023-05-16T13:54:17.094988+0000","last_clean":"2023-05-16T13:54:17.094988+0000","last_became_active":"2023-05-16T13:54:15.222906+0000","last_became_peered":"2023-05-16T13:54:15.222906+0000","last_unstale":"2023-05-16T13:54:17.094988+0000","last_undegraded":"2023-05-16T13:54:17.094988+0000","last_fullsized":"2023-05-16T13:54:17.094988+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T20:50:05.973113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.095335+0000","last_change":"2023-05-16T13:54:14.814607+0000","last_active":"2023-05-16T13:54:17.095335+0000","last_peered":"2023-05-16T13:54:17.095335+0000","last_clean":"2023-05-16T13:54:17.095335+0000","last_became_active":"2023-05-16T13:54:14.814268+0000","last_became_peered":"2023-05-16T13:54:14.814268+0000","last_unstale":"2023-05-16T13:54:17.095335+0000","last_undegraded":"2023-05-16T13:54:17.095335+0000","last_fullsized":"2023-05-16T13:54:17.095335+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T14:27:24.383997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.234780+0000","last_change":"2023-05-16T13:54:09.813305+0000","last_active":"2023-05-16T13:54:16.234780+0000","last_peered":"2023-05-16T13:54:16.234780+0000","last_clean":"2023-05-16T13:54:16.234780+0000","last_became_active":"2023-05-16T13:54:09.812931+0000","last_became_peered":"2023-05-16T13:54:09.812931+0000","last_unstale":"2023-05-16T13:54:16.234780+0000","last_undegraded":"2023-05-16T13:54:16.234780+0000","last_fullsized":"2023-05-16T13:54:16.234780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:21:27.677717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.094622+0000","last_change":"2023-05-16T13:54:15.232010+0000","last_active":"2023-05-16T13:54:17.094622+0000","last_peered":"2023-05-16T13:54:17.094622+0000","last_clean":"2023-05-16T13:54:17.094622+0000","last_became_active":"2023-05-16T13:54:15.231424+0000","last_became_peered":"2023-05-16T13:54:15.231424+0000","last_unstale":"2023-05-16T13:54:17.094622+0000","last_undegraded":"2023-05-16T13:54:17.094622+0000","last_fullsized":"2023-05-16T13:54:17.094622+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T14:37:02.189524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.201092+0000","last_change":"2023-05-16T13:54:14.815504+0000","last_active":"2023-05-16T13:54:16.201092+0000","last_peered":"2023-05-16T13:54:16.201092+0000","last_clean":"2023-05-16T13:54:16.201092+0000","last_became_active":"2023-05-16T13:54:14.814336+0000","last_became_peered":"2023-05-16T13:54:14.814336+0000","last_unstale":"2023-05-16T13:54:16.201092+0000","last_undegraded":"2023-05-16T13:54:16.201092+0000","last_fullsized":"2023-05-16T13:54:16.201092+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:23:35.572381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.095041+0000","last_change":"2023-05-16T13:54:09.768257+0000","last_active":"2023-05-16T13:54:17.095041+0000","last_peered":"2023-05-16T13:54:17.095041+0000","last_clean":"2023-05-16T13:54:17.095041+0000","last_became_active":"2023-05-16T13:54:09.767879+0000","last_became_peered":"2023-05-16T13:54:09.767879+0000","last_unstale":"2023-05-16T13:54:17.095041+0000","last_undegraded":"2023-05-16T13:54:17.095041+0000","last_fullsized":"2023-05-16T13:54:17.095041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T14:58:36.009092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.200295+0000","last_change":"2023-05-16T13:54:15.219094+0000","last_active":"2023-05-16T13:54:16.200295+0000","last_peered":"2023-05-16T13:54:16.200295+0000","last_clean":"2023-05-16T13:54:16.200295+0000","last_became_active":"2023-05-16T13:54:15.210545+0000","last_became_peered":"2023-05-16T13:54:15.210545+0000","last_unstale":"2023-05-16T13:54:16.200295+0000","last_undegraded":"2023-05-16T13:54:16.200295+0000","last_fullsized":"2023-05-16T13:54:16.200295+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:58:22.882260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"24'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.095331+0000","last_change":"2023-05-16T13:54:14.815739+0000","last_active":"2023-05-16T13:54:17.095331+0000","last_peered":"2023-05-16T13:54:17.095331+0000","last_clean":"2023-05-16T13:54:17.095331+0000","last_became_active":"2023-05-16T13:54:14.815433+0000","last_became_peered":"2023-05-16T13:54:14.815433+0000","last_unstale":"2023-05-16T13:54:17.095331+0000","last_undegraded":"2023-05-16T13:54:17.095331+0000","last_fullsized":"2023-05-16T13:54:17.095331+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:55:31.140031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.202058+0000","last_change":"2023-05-16T13:54:09.768603+0000","last_active":"2023-05-16T13:54:16.202058+0000","last_peered":"2023-05-16T13:54:16.202058+0000","last_clean":"2023-05-16T13:54:16.202058+0000","last_became_active":"2023-05-16T13:54:09.768323+0000","last_became_peered":"2023-05-16T13:54:09.768323+0000","last_unstale":"2023-05-16T13:54:16.202058+0000","last_undegraded":"2023-05-16T13:54:16.202058+0000","last_fullsized":"2023-05-16T13:54:16.202058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T15:06:40.038271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.202380+0000","last_change":"2023-05-16T13:54:15.221843+0000","last_active":"2023-05-16T13:54:16.202380+0000","last_peered":"2023-05-16T13:54:16.202380+0000","last_clean":"2023-05-16T13:54:16.202380+0000","last_became_active":"2023-05-16T13:54:15.221485+0000","last_became_peered":"2023-05-16T13:54:15.221485+0000","last_unstale":"2023-05-16T13:54:16.202380+0000","last_undegraded":"2023-05-16T13:54:16.202380+0000","last_fullsized":"2023-05-16T13:54:16.202380+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:56:30.067725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.202990+0000","last_change":"2023-05-16T13:54:15.211685+0000","last_active":"2023-05-16T13:54:16.202990+0000","last_peered":"2023-05-16T13:54:16.202990+0000","last_clean":"2023-05-16T13:54:16.202990+0000","last_became_active":"2023-05-16T13:54:15.210427+0000","last_became_peered":"2023-05-16T13:54:15.210427+0000","last_unstale":"2023-05-16T13:54:16.202990+0000","last_undegraded":"2023-05-16T13:54:16.202990+0000","last_fullsized":"2023-05-16T13:54:16.202990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:18:56.753459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"23'6","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.202865+0000","last_change":"2023-05-16T13:54:14.818519+0000","last_active":"2023-05-16T13:54:16.202865+0000","last_peered":"2023-05-16T13:54:16.202865+0000","last_clean":"2023-05-16T13:54:16.202865+0000","last_became_active":"2023-05-16T13:54:14.818006+0000","last_became_peered":"2023-05-16T13:54:14.818006+0000","last_unstale":"2023-05-16T13:54:16.202865+0000","last_undegraded":"2023-05-16T13:54:16.202865+0000","last_fullsized":"2023-05-16T13:54:16.202865+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T14:08:35.662558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.094876+0000","last_change":"2023-05-16T13:54:15.217209+0000","last_active":"2023-05-16T13:54:17.094876+0000","last_peered":"2023-05-16T13:54:17.094876+0000","last_clean":"2023-05-16T13:54:17.094876+0000","last_became_active":"2023-05-16T13:54:15.216903+0000","last_became_peered":"2023-05-16T13:54:15.216903+0000","last_unstale":"2023-05-16T13:54:17.094876+0000","last_undegraded":"2023-05-16T13:54:17.094876+0000","last_fullsized":"2023-05-16T13:54:17.094876+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:33:13.438730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.234591+0000","last_change":"2023-05-16T13:54:14.819409+0000","last_active":"2023-05-16T13:54:16.234591+0000","last_peered":"2023-05-16T13:54:16.234591+0000","last_clean":"2023-05-16T13:54:16.234591+0000","last_became_active":"2023-05-16T13:54:14.818998+0000","last_became_peered":"2023-05-16T13:54:14.818998+0000","last_unstale":"2023-05-16T13:54:16.234591+0000","last_undegraded":"2023-05-16T13:54:16.234591+0000","last_fullsized":"2023-05-16T13:54:16.234591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:03:23.695584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.095104+0000","last_change":"2023-05-16T13:54:14.826757+0000","last_active":"2023-05-16T13:54:17.095104+0000","last_peered":"2023-05-16T13:54:17.095104+0000","last_clean":"2023-05-16T13:54:17.095104+0000","last_became_active":"2023-05-16T13:54:14.826437+0000","last_became_peered":"2023-05-16T13:54:14.826437+0000","last_unstale":"2023-05-16T13:54:17.095104+0000","last_undegraded":"2023-05-16T13:54:17.095104+0000","last_fullsized":"2023-05-16T13:54:17.095104+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:51:03.266568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.200454+0000","last_change":"2023-05-16T13:54:15.217104+0000","last_active":"2023-05-16T13:54:16.200454+0000","last_peered":"2023-05-16T13:54:16.200454+0000","last_clean":"2023-05-16T13:54:16.200454+0000","last_became_active":"2023-05-16T13:54:15.212495+0000","last_became_peered":"2023-05-16T13:54:15.212495+0000","last_unstale":"2023-05-16T13:54:16.200454+0000","last_undegraded":"2023-05-16T13:54:16.200454+0000","last_fullsized":"2023-05-16T13:54:16.200454+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T16:19:34.312806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.095461+0000","last_change":"2023-05-16T13:54:14.828109+0000","last_active":"2023-05-16T13:54:17.095461+0000","last_peered":"2023-05-16T13:54:17.095461+0000","last_clean":"2023-05-16T13:54:17.095461+0000","last_became_active":"2023-05-16T13:54:14.827726+0000","last_became_peered":"2023-05-16T13:54:14.827726+0000","last_unstale":"2023-05-16T13:54:17.095461+0000","last_undegraded":"2023-05-16T13:54:17.095461+0000","last_fullsized":"2023-05-16T13:54:17.095461+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T18:43:59.897500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.200225+0000","last_change":"2023-05-16T13:54:15.219614+0000","last_active":"2023-05-16T13:54:16.200225+0000","last_peered":"2023-05-16T13:54:16.200225+0000","last_clean":"2023-05-16T13:54:16.200225+0000","last_became_active":"2023-05-16T13:54:15.219282+0000","last_became_peered":"2023-05-16T13:54:15.219282+0000","last_unstale":"2023-05-16T13:54:16.200225+0000","last_undegraded":"2023-05-16T13:54:16.200225+0000","last_fullsized":"2023-05-16T13:54:16.200225+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:05:39.511506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.202073+0000","last_change":"2023-05-16T13:54:15.223067+0000","last_active":"2023-05-16T13:54:16.202073+0000","last_peered":"2023-05-16T13:54:16.202073+0000","last_clean":"2023-05-16T13:54:16.202073+0000","last_became_active":"2023-05-16T13:54:15.222802+0000","last_became_peered":"2023-05-16T13:54:15.222802+0000","last_unstale":"2023-05-16T13:54:16.202073+0000","last_undegraded":"2023-05-16T13:54:16.202073+0000","last_fullsized":"2023-05-16T13:54:16.202073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:20:01.628237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.200355+0000","last_change":"2023-05-16T13:54:14.818182+0000","last_active":"2023-05-16T13:54:16.200355+0000","last_peered":"2023-05-16T13:54:16.200355+0000","last_clean":"2023-05-16T13:54:16.200355+0000","last_became_active":"2023-05-16T13:54:14.817829+0000","last_became_peered":"2023-05-16T13:54:14.817829+0000","last_unstale":"2023-05-16T13:54:16.200355+0000","last_undegraded":"2023-05-16T13:54:16.200355+0000","last_fullsized":"2023-05-16T13:54:16.200355+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:12:05.602884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.094904+0000","last_change":"2023-05-16T13:54:15.229143+0000","last_active":"2023-05-16T13:54:17.094904+0000","last_peered":"2023-05-16T13:54:17.094904+0000","last_clean":"2023-05-16T13:54:17.094904+0000","last_became_active":"2023-05-16T13:54:15.228615+0000","last_became_peered":"2023-05-16T13:54:15.228615+0000","last_unstale":"2023-05-16T13:54:17.094904+0000","last_undegraded":"2023-05-16T13:54:17.094904+0000","last_fullsized":"2023-05-16T13:54:17.094904+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:21:12.096751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.094748+0000","last_change":"2023-05-16T13:54:14.820677+0000","last_active":"2023-05-16T13:54:17.094748+0000","last_peered":"2023-05-16T13:54:17.094748+0000","last_clean":"2023-05-16T13:54:17.094748+0000","last_became_active":"2023-05-16T13:54:14.820386+0000","last_became_peered":"2023-05-16T13:54:14.820386+0000","last_unstale":"2023-05-16T13:54:17.094748+0000","last_undegraded":"2023-05-16T13:54:17.094748+0000","last_fullsized":"2023-05-16T13:54:17.094748+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:55:42.537356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.200740+0000","last_change":"2023-05-16T13:54:15.219472+0000","last_active":"2023-05-16T13:54:16.200740+0000","last_peered":"2023-05-16T13:54:16.200740+0000","last_clean":"2023-05-16T13:54:16.200740+0000","last_became_active":"2023-05-16T13:54:15.219173+0000","last_became_peered":"2023-05-16T13:54:15.219173+0000","last_unstale":"2023-05-16T13:54:16.200740+0000","last_undegraded":"2023-05-16T13:54:16.200740+0000","last_fullsized":"2023-05-16T13:54:16.200740+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:57:22.154305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.202997+0000","last_change":"2023-05-16T13:54:14.814610+0000","last_active":"2023-05-16T13:54:16.202997+0000","last_peered":"2023-05-16T13:54:16.202997+0000","last_clean":"2023-05-16T13:54:16.202997+0000","last_became_active":"2023-05-16T13:54:14.814132+0000","last_became_peered":"2023-05-16T13:54:14.814132+0000","last_unstale":"2023-05-16T13:54:16.202997+0000","last_undegraded":"2023-05-16T13:54:16.202997+0000","last_fullsized":"2023-05-16T13:54:16.202997+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T20:40:58.823162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.593191+0000","last_change":"2023-05-16T13:54:15.218356+0000","last_active":"2023-05-16T13:54:16.593191+0000","last_peered":"2023-05-16T13:54:16.593191+0000","last_clean":"2023-05-16T13:54:16.593191+0000","last_became_active":"2023-05-16T13:54:15.218043+0000","last_became_peered":"2023-05-16T13:54:15.218043+0000","last_unstale":"2023-05-16T13:54:16.593191+0000","last_undegraded":"2023-05-16T13:54:16.593191+0000","last_fullsized":"2023-05-16T13:54:16.593191+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T16:13:53.275348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.094796+0000","last_change":"2023-05-16T13:54:14.822015+0000","last_active":"2023-05-16T13:54:17.094796+0000","last_peered":"2023-05-16T13:54:17.094796+0000","last_clean":"2023-05-16T13:54:17.094796+0000","last_became_active":"2023-05-16T13:54:14.821739+0000","last_became_peered":"2023-05-16T13:54:14.821739+0000","last_unstale":"2023-05-16T13:54:17.094796+0000","last_undegraded":"2023-05-16T13:54:17.094796+0000","last_fullsized":"2023-05-16T13:54:17.094796+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T18:48:52.011265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.202799+0000","last_change":"2023-05-16T13:54:15.223263+0000","last_active":"2023-05-16T13:54:16.202799+0000","last_peered":"2023-05-16T13:54:16.202799+0000","last_clean":"2023-05-16T13:54:16.202799+0000","last_became_active":"2023-05-16T13:54:15.222945+0000","last_became_peered":"2023-05-16T13:54:15.222945+0000","last_unstale":"2023-05-16T13:54:16.202799+0000","last_undegraded":"2023-05-16T13:54:16.202799+0000","last_fullsized":"2023-05-16T13:54:16.202799+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:57:22.154305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.094847+0000","last_change":"2023-05-16T13:54:14.825328+0000","last_active":"2023-05-16T13:54:17.094847+0000","last_peered":"2023-05-16T13:54:17.094847+0000","last_clean":"2023-05-16T13:54:17.094847+0000","last_became_active":"2023-05-16T13:54:14.820763+0000","last_became_peered":"2023-05-16T13:54:14.820763+0000","last_unstale":"2023-05-16T13:54:17.094847+0000","last_undegraded":"2023-05-16T13:54:17.094847+0000","last_fullsized":"2023-05-16T13:54:17.094847+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T23:50:21.451820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.202804+0000","last_change":"2023-05-16T13:54:15.223253+0000","last_active":"2023-05-16T13:54:16.202804+0000","last_peered":"2023-05-16T13:54:16.202804+0000","last_clean":"2023-05-16T13:54:16.202804+0000","last_became_active":"2023-05-16T13:54:15.222884+0000","last_became_peered":"2023-05-16T13:54:15.222884+0000","last_unstale":"2023-05-16T13:54:16.202804+0000","last_undegraded":"2023-05-16T13:54:16.202804+0000","last_fullsized":"2023-05-16T13:54:16.202804+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:05:33.250909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.095153+0000","last_change":"2023-05-16T13:54:14.827946+0000","last_active":"2023-05-16T13:54:17.095153+0000","last_peered":"2023-05-16T13:54:17.095153+0000","last_clean":"2023-05-16T13:54:17.095153+0000","last_became_active":"2023-05-16T13:54:14.822920+0000","last_became_peered":"2023-05-16T13:54:14.822920+0000","last_unstale":"2023-05-16T13:54:17.095153+0000","last_undegraded":"2023-05-16T13:54:17.095153+0000","last_fullsized":"2023-05-16T13:54:17.095153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:58:09.660328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.200586+0000","last_change":"2023-05-16T13:54:15.218282+0000","last_active":"2023-05-16T13:54:16.200586+0000","last_peered":"2023-05-16T13:54:16.200586+0000","last_clean":"2023-05-16T13:54:16.200586+0000","last_became_active":"2023-05-16T13:54:15.217961+0000","last_became_peered":"2023-05-16T13:54:15.217961+0000","last_unstale":"2023-05-16T13:54:16.200586+0000","last_undegraded":"2023-05-16T13:54:16.200586+0000","last_fullsized":"2023-05-16T13:54:16.200586+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T23:50:22.458202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.200669+0000","last_change":"2023-05-16T13:54:14.810916+0000","last_active":"2023-05-16T13:54:16.200669+0000","last_peered":"2023-05-16T13:54:16.200669+0000","last_clean":"2023-05-16T13:54:16.200669+0000","last_became_active":"2023-05-16T13:54:14.810471+0000","last_became_peered":"2023-05-16T13:54:14.810471+0000","last_unstale":"2023-05-16T13:54:16.200669+0000","last_undegraded":"2023-05-16T13:54:16.200669+0000","last_fullsized":"2023-05-16T13:54:16.200669+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:18:55.747077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:16.201687+0000","last_change":"2023-05-16T13:54:15.219216+0000","last_active":"2023-05-16T13:54:16.201687+0000","last_peered":"2023-05-16T13:54:16.201687+0000","last_clean":"2023-05-16T13:54:16.201687+0000","last_became_active":"2023-05-16T13:54:15.217942+0000","last_became_peered":"2023-05-16T13:54:15.217942+0000","last_unstale":"2023-05-16T13:54:16.201687+0000","last_undegraded":"2023-05-16T13:54:16.201687+0000","last_fullsized":"2023-05-16T13:54:16.201687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:14.787858+0000","last_clean_scrub_stamp":"2023-05-16T13:54:14.787858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T15:50:58.482925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-05-16T13:54:17.095345+0000","last_change":"2023-05-16T13:54:14.816978+0000","last_active":"2023-05-16T13:54:17.095345+0000","last_peered":"2023-05-16T13:54:17.095345+0000","last_clean":"2023-05-16T13:54:17.095345+0000","last_became_active":"2023-05-16T13:54:14.816681+0000","last_became_peered":"2023-05-16T13:54:14.816681+0000","last_unstale":"2023-05-16T13:54:17.095345+0000","last_undegraded":"2023-05-16T13:54:17.095345+0000","last_fullsized":"2023-05-16T13:54:17.095345+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:13.781476+0000","last_clean_scrub_stamp":"2023-05-16T13:54:13.781476+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:01:31.924710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13208,"kb_used_data":848,"kb_used_omap":0,"kb_used_meta":12352,"kb_avail":94358632,"statfs":{"total":96636764160,"available":96623239168,"internally_reserved":0,"allocated":868352,"data_stored":683406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12648448},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]}]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12088,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":11840,"kb_avail":94359752,"statfs":{"total":96636764160,"available":96624386048,"internally_reserved":0,"allocated":245760,"data_stored":91258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12124160},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]}]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12096,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":11840,"kb_avail":94359744,"statfs":{"total":96636764160,"available":96624377856,"internally_reserved":0,"allocated":253952,"data_stored":91910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12124160},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12172,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":11904,"kb_avail":94359668,"statfs":{"total":96636764160,"available":96624300032,"internally_reserved":0,"allocated":266240,"data_stored":92878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12189696},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.379}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93799999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.155}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]}]},{"osd":3,"up_from":14,"seq":60129542151,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12156,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":11904,"kb_avail":94359684,"statfs":{"total":96636764160,"available":96624316416,"internally_reserved":0,"allocated":249856,"data_stored":91348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12189696},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95799999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.111}]}]},{"osd":2,"up_from":14,"seq":60129542151,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7992,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363848,"statfs":{"total":96636764160,"available":96628580352,"internally_reserved":0,"allocated":245760,"data_stored":91258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12152,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":11904,"kb_avail":94359688,"statfs":{"total":96636764160,"available":96624320512,"internally_reserved":0,"allocated":245760,"data_stored":91258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12189696},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95899999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]}]},{"osd":0,"up_from":14,"seq":60129542151,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9088,"kb_used_data":824,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362752,"statfs":{"total":96636764160,"available":96627458048,"internally_reserved":0,"allocated":843776,"data_stored":682208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94599999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-16T13:54:25.985 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-05-16T13:54:25.985 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-05-16T13:54:25.985 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-05-16T13:54:25.986 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-05-16T13:54:26.154 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.145+0000 7f8bdd1e1640 1 Processor -- start 2023-05-16T13:54:26.154 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.145+0000 7f8bdd1e1640 1 -- start start 2023-05-16T13:54:26.155 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.145+0000 7f8bdd1e1640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f8bd80c49e0 0x7f8bd806fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:26.156 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.145+0000 7f8bdd1e1640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8bd814f630 0x7f8bd814fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:26.156 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.145+0000 7f8bdd1e1640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bd815cf10 con 0x7f8bd80c4610 2023-05-16T13:54:26.156 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.145+0000 7f8bdd1e1640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bd80cc2e0 con 0x7f8bd80c49e0 2023-05-16T13:54:26.156 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.145+0000 7f8bdd1e1640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd815d1f0 con 0x7f8bd814f630 2023-05-16T13:54:26.156 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.149+0000 7f8bce59c640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f8bd80c49e0 0x7f8bd806fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:26.156 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.149+0000 7f8bd6d9d640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f8bd80c4610 0x7f8bd815c730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:60844/0 (socket says 172.21.15.39:60844) 2023-05-16T13:54:26.156 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.149+0000 7f8bd6d9d640 1 -- 172.21.15.39:0/65550106 learned_addr learned my addr 172.21.15.39:0/65550106 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:26.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.149+0000 7f8bd759e640 1 --2- 172.21.15.39:0/65550106 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8bd814f630 0x7f8bd814fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:26.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.149+0000 7f8bce59c640 1 -- 172.21.15.39:0/65550106 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8bd814f630 msgr2=0x7f8bd814fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:26.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.149+0000 7f8bce59c640 1 --2- 172.21.15.39:0/65550106 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8bd814f630 0x7f8bd814fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:26.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.149+0000 7f8bce59c640 1 -- 172.21.15.39:0/65550106 >> v1:172.21.15.39:6789/0 conn(0x7f8bd80c4610 legacy=0x7f8bd815c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:26.158 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.149+0000 7f8bce59c640 1 -- 172.21.15.39:0/65550106 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bd815d4d0 con 0x7f8bd80c49e0 2023-05-16T13:54:26.159 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.149+0000 7f8bce59c640 1 --2- 172.21.15.39:0/65550106 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8bd80c49e0 0x7f8bd806fb60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8bc00097c0 tx=0x7f8bc001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=901b7dc83952132c server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:26.159 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.149+0000 7f8bd659c640 1 -- 172.21.15.39:0/65550106 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc00a7070 con 0x7f8bd80c49e0 2023-05-16T13:54:26.159 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.149+0000 7f8bd659c640 1 -- 172.21.15.39:0/65550106 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bc00ab430 con 0x7f8bd80c49e0 2023-05-16T13:54:26.159 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.149+0000 7f8bd659c640 1 -- 172.21.15.39:0/65550106 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc00ab7c0 con 0x7f8bd80c49e0 2023-05-16T13:54:26.160 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.153+0000 7f8bdd1e1640 1 -- 172.21.15.39:0/65550106 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8bd80c49e0 msgr2=0x7f8bd806fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:26.160 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.153+0000 7f8bdd1e1640 1 --2- 172.21.15.39:0/65550106 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8bd80c49e0 0x7f8bd806fb60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8bc00097c0 tx=0x7f8bc001c450 comp rx=0 tx=0).stop 2023-05-16T13:54:26.161 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.153+0000 7f8bdd1e1640 1 -- 172.21.15.39:0/65550106 shutdown_connections 2023-05-16T13:54:26.161 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.153+0000 7f8bdd1e1640 1 --2- 172.21.15.39:0/65550106 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8bd814f630 0x7f8bd814fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:26.161 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.153+0000 7f8bdd1e1640 1 --2- 172.21.15.39:0/65550106 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8bd80c49e0 0x7f8bd806fb60 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:26.161 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.153+0000 7f8bdd1e1640 1 -- 172.21.15.39:0/65550106 >> 172.21.15.39:0/65550106 conn(0x7f8bd8069a50 msgr2=0x7f8bd8069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:26.161 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.153+0000 7f8bdd1e1640 1 -- 172.21.15.39:0/65550106 shutdown_connections 2023-05-16T13:54:26.161 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.153+0000 7f8bdd1e1640 1 -- 172.21.15.39:0/65550106 wait complete. 2023-05-16T13:54:26.162 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.153+0000 7f8bdd1e1640 1 Processor -- start 2023-05-16T13:54:26.162 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.153+0000 7f8bdd1e1640 1 -- start start 2023-05-16T13:54:26.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.153+0000 7f8bdd1e1640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8bd80c4610 0x7f8bd813fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:26.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.153+0000 7f8bdd1e1640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8bd80c49e0 0x7f8bd814ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:26.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.153+0000 7f8bdd1e1640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8bd814f630 0x7f8bd8148cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:26.164 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.153+0000 7f8bdd1e1640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd8147780 con 0x7f8bd814f630 2023-05-16T13:54:26.164 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.153+0000 7f8bdd1e1640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd81474a0 con 0x7f8bd80c4610 2023-05-16T13:54:26.164 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.153+0000 7f8bdd1e1640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd815b460 con 0x7f8bd80c49e0 2023-05-16T13:54:26.164 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.153+0000 7f8bd759e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8bd814f630 0x7f8bd8148cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:26.164 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.153+0000 7f8bd759e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8bd814f630 0x7f8bd8148cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60202/0 (socket says 172.21.15.39:60202) 2023-05-16T13:54:26.164 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.153+0000 7f8bd759e640 1 -- 172.21.15.39:0/447628490 learned_addr learned my addr 172.21.15.39:0/447628490 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:26.164 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.153+0000 7f8bce59c640 1 --2- 172.21.15.39:0/447628490 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8bd80c49e0 0x7f8bd814ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:26.165 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.153+0000 7f8bd6d9d640 1 --2- 172.21.15.39:0/447628490 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8bd80c4610 0x7f8bd813fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:26.165 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.157+0000 7f8bd759e640 1 -- 172.21.15.39:0/447628490 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8bd80c49e0 msgr2=0x7f8bd814ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:26.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.157+0000 7f8bd759e640 1 --2- 172.21.15.39:0/447628490 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8bd80c49e0 0x7f8bd814ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:26.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.157+0000 7f8bd759e640 1 -- 172.21.15.39:0/447628490 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8bd80c4610 msgr2=0x7f8bd813fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:26.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.157+0000 7f8bd759e640 1 --2- 172.21.15.39:0/447628490 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8bd80c4610 0x7f8bd813fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:26.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.157+0000 7f8bd759e640 1 -- 172.21.15.39:0/447628490 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bc0009420 con 0x7f8bd814f630 2023-05-16T13:54:26.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.157+0000 7f8bd759e640 1 --2- 172.21.15.39:0/447628490 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8bd814f630 0x7f8bd8148cb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8bd0007e60 tx=0x7f8bd000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:26.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.157+0000 7f8bcffff640 1 -- 172.21.15.39:0/447628490 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd0014420 con 0x7f8bd814f630 2023-05-16T13:54:26.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.157+0000 7f8bcffff640 1 -- 172.21.15.39:0/447628490 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bd00145a0 con 0x7f8bd814f630 2023-05-16T13:54:26.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.157+0000 7f8bcffff640 1 -- 172.21.15.39:0/447628490 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd0014950 con 0x7f8bd814f630 2023-05-16T13:54:26.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.157+0000 7f8bdd1e1640 1 -- 172.21.15.39:0/447628490 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bd80b0960 con 0x7f8bd814f630 2023-05-16T13:54:26.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.157+0000 7f8bdd1e1640 1 -- 172.21.15.39:0/447628490 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bd80b07d0 con 0x7f8bd814f630 2023-05-16T13:54:26.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.157+0000 7f8bdd1e1640 1 -- 172.21.15.39:0/447628490 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bd80b0af0 con 0x7f8bd814f630 2023-05-16T13:54:26.168 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.157+0000 7f8bcffff640 1 -- 172.21.15.39:0/447628490 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8bd0014ab0 con 0x7f8bd814f630 2023-05-16T13:54:26.168 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.157+0000 7f8bcffff640 1 --2- 172.21.15.39:0/447628490 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f8bb8066280 0x7f8bb8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:26.168 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.157+0000 7f8bcffff640 1 -- 172.21.15.39:0/447628490 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8bd0084510 con 0x7f8bd814f630 2023-05-16T13:54:26.168 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.157+0000 7f8bd6d9d640 1 --2- 172.21.15.39:0/447628490 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f8bb8066280 0x7f8bb8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:26.168 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.161+0000 7f8bd6d9d640 1 --2- 172.21.15.39:0/447628490 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f8bb8066280 0x7f8bb8068730 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8bc8005890 tx=0x7f8bc8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:26.170 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.161+0000 7f8bcffff640 1 -- 172.21.15.39:0/447628490 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f8bd00554c0 con 0x7f8bd814f630 2023-05-16T13:54:26.363 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.353+0000 7f8bdd1e1640 1 -- 172.21.15.39:0/447628490 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f8bd8073c90 con 0x7f8bd814f630 2023-05-16T13:54:26.364 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.357+0000 7f8bcffff640 1 -- 172.21.15.39:0/447628490 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f8bd0055050 con 0x7f8bd814f630 2023-05-16T13:54:26.364 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:54:26.364 INFO:teuthology.orchestra.run.smithi039.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-05-16T13:54:26.366 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.357+0000 7f8bdd1e1640 1 -- 172.21.15.39:0/447628490 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f8bb8066280 msgr2=0x7f8bb8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:26.366 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.357+0000 7f8bdd1e1640 1 --2- 172.21.15.39:0/447628490 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f8bb8066280 0x7f8bb8068730 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8bc8005890 tx=0x7f8bc8009040 comp rx=0 tx=0).stop 2023-05-16T13:54:26.366 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.357+0000 7f8bdd1e1640 1 -- 172.21.15.39:0/447628490 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8bd814f630 msgr2=0x7f8bd8148cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:26.366 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.357+0000 7f8bdd1e1640 1 --2- 172.21.15.39:0/447628490 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8bd814f630 0x7f8bd8148cb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8bd0007e60 tx=0x7f8bd000e4b0 comp rx=0 tx=0).stop 2023-05-16T13:54:26.366 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.357+0000 7f8bdd1e1640 1 -- 172.21.15.39:0/447628490 shutdown_connections 2023-05-16T13:54:26.366 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.357+0000 7f8bdd1e1640 1 --2- 172.21.15.39:0/447628490 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f8bb8066280 0x7f8bb8068730 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:26.366 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.357+0000 7f8bdd1e1640 1 --2- 172.21.15.39:0/447628490 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8bd80c49e0 0x7f8bd814ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:26.367 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.357+0000 7f8bdd1e1640 1 --2- 172.21.15.39:0/447628490 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8bd814f630 0x7f8bd8148cb0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:26.367 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.357+0000 7f8bdd1e1640 1 --2- 172.21.15.39:0/447628490 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8bd80c4610 0x7f8bd813fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:26.367 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.357+0000 7f8bdd1e1640 1 -- 172.21.15.39:0/447628490 >> 172.21.15.39:0/447628490 conn(0x7f8bd8069a50 msgr2=0x7f8bd8070bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:26.367 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.357+0000 7f8bdd1e1640 1 -- 172.21.15.39:0/447628490 shutdown_connections 2023-05-16T13:54:26.367 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.357+0000 7f8bdd1e1640 1 -- 172.21.15.39:0/447628490 wait complete. 2023-05-16T13:54:26.384 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-05-16T13:54:26.385 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-16T13:54:26.523 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.513+0000 7efdf79bc640 1 Processor -- start 2023-05-16T13:54:26.523 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.513+0000 7efdf79bc640 1 -- start start 2023-05-16T13:54:26.524 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.517+0000 7efdf79bc640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7efdf00703b0 0x7efdf015d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:26.524 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.517+0000 7efdf79bc640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdf015d6a0 con 0x7efdf00cb4c0 2023-05-16T13:54:26.525 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.517+0000 7efdf79bc640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdf0070870 con 0x7efdf0158bf0 2023-05-16T13:54:26.525 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.517+0000 7efdf79bc640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdf0070b50 con 0x7efdf00703b0 2023-05-16T13:54:26.525 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.517+0000 7efdf4f57640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7efdf00cb4c0 0x7efdf00ccda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:60850/0 (socket says 172.21.15.39:60850) 2023-05-16T13:54:26.525 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.517+0000 7efdf4f57640 1 -- 172.21.15.39:0/2424843171 learned_addr learned my addr 172.21.15.39:0/2424843171 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:26.525 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.517+0000 7efdf5f59640 1 --2- 172.21.15.39:0/2424843171 >> v2:172.21.15.39:3300/0 conn(0x7efdf00703b0 0x7efdf015d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:26.526 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.517+0000 7efde7fff640 1 -- 172.21.15.39:0/2424843171 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 800233622 0 0) 0x7efde0001120 con 0x7efdf00cb4c0 2023-05-16T13:54:26.526 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.517+0000 7efdf5f59640 1 -- 172.21.15.39:0/2424843171 >> v1:172.21.15.118:6789/0 conn(0x7efdf0158bf0 legacy=0x7efdf00cadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:26.526 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.517+0000 7efdf5f59640 1 -- 172.21.15.39:0/2424843171 >> v1:172.21.15.39:6789/0 conn(0x7efdf00cb4c0 legacy=0x7efdf00ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:26.526 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.517+0000 7efdf5f59640 1 -- 172.21.15.39:0/2424843171 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf0070e30 con 0x7efdf00703b0 2023-05-16T13:54:26.527 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.521+0000 7efdf5f59640 1 --2- 172.21.15.39:0/2424843171 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efdf00703b0 0x7efdf015d160 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7efde8009d90 tx=0x7efde801c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32991292f4c14eb1 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:26.528 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.521+0000 7efde7fff640 1 -- 172.21.15.39:0/2424843171 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde80a5950 con 0x7efdf00703b0 2023-05-16T13:54:26.528 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.521+0000 7efde7fff640 1 -- 172.21.15.39:0/2424843171 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde80a5ab0 con 0x7efdf00703b0 2023-05-16T13:54:26.528 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.521+0000 7efde7fff640 1 -- 172.21.15.39:0/2424843171 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde80a5e40 con 0x7efdf00703b0 2023-05-16T13:54:26.529 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.521+0000 7efdf79bc640 1 -- 172.21.15.39:0/2424843171 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efdf00703b0 msgr2=0x7efdf015d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:26.529 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.521+0000 7efdf79bc640 1 --2- 172.21.15.39:0/2424843171 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efdf00703b0 0x7efdf015d160 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7efde8009d90 tx=0x7efde801c890 comp rx=0 tx=0).stop 2023-05-16T13:54:26.529 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.521+0000 7efdf79bc640 1 -- 172.21.15.39:0/2424843171 shutdown_connections 2023-05-16T13:54:26.529 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.521+0000 7efdf79bc640 1 --2- 172.21.15.39:0/2424843171 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efdf00703b0 0x7efdf015d160 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:26.529 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.521+0000 7efdf79bc640 1 -- 172.21.15.39:0/2424843171 >> 172.21.15.39:0/2424843171 conn(0x7efdf0069a50 msgr2=0x7efdf0069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:26.530 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.521+0000 7efdf79bc640 1 -- 172.21.15.39:0/2424843171 shutdown_connections 2023-05-16T13:54:26.530 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.521+0000 7efdf79bc640 1 -- 172.21.15.39:0/2424843171 wait complete. 2023-05-16T13:54:26.530 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.521+0000 7efdf79bc640 1 Processor -- start 2023-05-16T13:54:26.530 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.521+0000 7efdf79bc640 1 -- start start 2023-05-16T13:54:26.531 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.521+0000 7efdf79bc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efdf00703b0 0x7efdf00c7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:26.532 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.521+0000 7efdf79bc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efdf00cb4c0 0x7efdf01564e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:26.532 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.521+0000 7efdf79bc640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efdf0158bf0 0x7efdf0150640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:26.532 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.521+0000 7efdf79bc640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf00acd30 con 0x7efdf00703b0 2023-05-16T13:54:26.532 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.521+0000 7efdf79bc640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf00ad010 con 0x7efdf00cb4c0 2023-05-16T13:54:26.532 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.521+0000 7efdf79bc640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdf0156f70 con 0x7efdf0158bf0 2023-05-16T13:54:26.532 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.525+0000 7efdf5758640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efdf00703b0 0x7efdf00c7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:26.532 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.525+0000 7efdf5758640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efdf00703b0 0x7efdf00c7bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60228/0 (socket says 172.21.15.39:60228) 2023-05-16T13:54:26.533 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.525+0000 7efdf5758640 1 -- 172.21.15.39:0/2018264901 learned_addr learned my addr 172.21.15.39:0/2018264901 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:26.533 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.525+0000 7efdf5f59640 1 --2- 172.21.15.39:0/2018264901 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efdf0158bf0 0x7efdf0150640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:26.534 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.525+0000 7efdf4f57640 1 --2- 172.21.15.39:0/2018264901 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efdf00cb4c0 0x7efdf01564e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:26.534 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.525+0000 7efdf5758640 1 -- 172.21.15.39:0/2018264901 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efdf0158bf0 msgr2=0x7efdf0150640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:26.534 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.525+0000 7efdf5758640 1 --2- 172.21.15.39:0/2018264901 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efdf0158bf0 0x7efdf0150640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:26.534 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.525+0000 7efdf5758640 1 -- 172.21.15.39:0/2018264901 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efdf00cb4c0 msgr2=0x7efdf01564e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:26.534 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.525+0000 7efdf5758640 1 --2- 172.21.15.39:0/2018264901 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efdf00cb4c0 0x7efdf01564e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:26.534 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.525+0000 7efdf5758640 1 -- 172.21.15.39:0/2018264901 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde8009a70 con 0x7efdf00703b0 2023-05-16T13:54:26.534 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.525+0000 7efdf5f59640 1 --2- 172.21.15.39:0/2018264901 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efdf0158bf0 0x7efdf0150640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-16T13:54:26.535 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.525+0000 7efdf4f57640 1 --2- 172.21.15.39:0/2018264901 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efdf00cb4c0 0x7efdf01564e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-16T13:54:26.535 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.525+0000 7efdf5758640 1 --2- 172.21.15.39:0/2018264901 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efdf00703b0 0x7efdf00c7bc0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7efdec00c3c0 tx=0x7efdec00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:26.535 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.525+0000 7efde5ffb640 1 -- 172.21.15.39:0/2018264901 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdec0052d0 con 0x7efdf00703b0 2023-05-16T13:54:26.535 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.525+0000 7efde5ffb640 1 -- 172.21.15.39:0/2018264901 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdec005430 con 0x7efdf00703b0 2023-05-16T13:54:26.535 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.525+0000 7efde5ffb640 1 -- 172.21.15.39:0/2018264901 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdec003840 con 0x7efdf00703b0 2023-05-16T13:54:26.535 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.525+0000 7efdf79bc640 1 -- 172.21.15.39:0/2018264901 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdf00ad950 con 0x7efdf00703b0 2023-05-16T13:54:26.535 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.525+0000 7efdf79bc640 1 -- 172.21.15.39:0/2018264901 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdf0158fc0 con 0x7efdf00703b0 2023-05-16T13:54:26.536 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.525+0000 7efdf79bc640 1 -- 172.21.15.39:0/2018264901 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdf00cdcc0 con 0x7efdf00703b0 2023-05-16T13:54:26.536 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.525+0000 7efde5ffb640 1 -- 172.21.15.39:0/2018264901 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7efdec0039a0 con 0x7efdf00703b0 2023-05-16T13:54:26.536 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.525+0000 7efde5ffb640 1 --2- 172.21.15.39:0/2018264901 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7efdd4066280 0x7efdd4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:26.537 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.525+0000 7efde5ffb640 1 -- 172.21.15.39:0/2018264901 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efdec083270 con 0x7efdf00703b0 2023-05-16T13:54:26.537 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.529+0000 7efdf4f57640 1 --2- 172.21.15.39:0/2018264901 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7efdd4066280 0x7efdd4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:26.537 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.529+0000 7efdf4f57640 1 --2- 172.21.15.39:0/2018264901 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7efdd4066280 0x7efdd4068730 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7efde0007fd0 tx=0x7efde0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:26.539 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.529+0000 7efde5ffb640 1 -- 172.21.15.39:0/2018264901 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7efdec0506f0 con 0x7efdf00703b0 2023-05-16T13:54:26.696 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.689+0000 7efdf79bc640 1 -- 172.21.15.39:0/2018264901 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efdf0073c90 con 0x7efdf00703b0 2023-05-16T13:54:26.697 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.689+0000 7efde5ffb640 1 -- 172.21.15.39:0/2018264901 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18279 (secure 0 0 0) 0x7efdec053d10 con 0x7efdf00703b0 2023-05-16T13:54:26.698 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:54:26.698 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":24,"fsid":"9c1e210b-c515-4ea4-a065-397956895c68","created":"2023-05-16T13:53:48.955290+0000","modified":"2023-05-16T13:54:16.194544+0000","last_up_change":"2023-05-16T13:54:01.722051+0000","last_in_change":"2023-05-16T13:53:52.331336+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-16T13:54:00.885009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-16T13:54:08.327895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-16T13:54:12.864823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-16T13:54:14.180225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4ce0f0ba-c4bf-4405-8c95-d2e9a62878ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6809","nonce":3462013698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6811","nonce":3462013698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6815","nonce":3462013698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6813","nonce":3462013698}]},"public_addr":"172.21.15.39:6809/3462013698","cluster_addr":"172.21.15.39:6811/3462013698","heartbeat_back_addr":"172.21.15.39:6815/3462013698","heartbeat_front_addr":"172.21.15.39:6813/3462013698","state":["exists","up"]},{"osd":1,"uuid":"53fdc1ac-2473-472d-af32-2760fdf6e476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6801","nonce":2829970892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6803","nonce":2829970892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6807","nonce":2829970892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6805","nonce":2829970892}]},"public_addr":"172.21.15.39:6801/2829970892","cluster_addr":"172.21.15.39:6803/2829970892","heartbeat_back_addr":"172.21.15.39:6807/2829970892","heartbeat_front_addr":"172.21.15.39:6805/2829970892","state":["exists","up"]},{"osd":2,"uuid":"0b92d770-7030-42fa-a19f-4f7f1ac113c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6817","nonce":3888067413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6819","nonce":3888067413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6823","nonce":3888067413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6821","nonce":3888067413}]},"public_addr":"172.21.15.39:6817/3888067413","cluster_addr":"172.21.15.39:6819/3888067413","heartbeat_back_addr":"172.21.15.39:6823/3888067413","heartbeat_front_addr":"172.21.15.39:6821/3888067413","state":["exists","up"]},{"osd":3,"uuid":"000d9506-cbb2-4017-b875-deca579860ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6825","nonce":405003958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6827","nonce":405003958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6831","nonce":405003958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6829","nonce":405003958}]},"public_addr":"172.21.15.39:6825/405003958","cluster_addr":"172.21.15.39:6827/405003958","heartbeat_back_addr":"172.21.15.39:6831/405003958","heartbeat_front_addr":"172.21.15.39:6829/405003958","state":["exists","up"]},{"osd":4,"uuid":"70f0dacb-e960-40c5-bf6a-183e52bbe2ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6801","nonce":3895278838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6805","nonce":3895278838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6813","nonce":3895278838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6809","nonce":3895278838}]},"public_addr":"172.21.15.118:6801/3895278838","cluster_addr":"172.21.15.118:6805/3895278838","heartbeat_back_addr":"172.21.15.118:6813/3895278838","heartbeat_front_addr":"172.21.15.118:6809/3895278838","state":["exists","up"]},{"osd":5,"uuid":"756feb54-c3ae-4a2a-8f74-85c291ba707c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6804","nonce":3513592808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6808","nonce":3513592808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6815","nonce":3513592808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6812","nonce":3513592808}]},"public_addr":"172.21.15.118:6804/3513592808","cluster_addr":"172.21.15.118:6808/3513592808","heartbeat_back_addr":"172.21.15.118:6815/3513592808","heartbeat_front_addr":"172.21.15.118:6812/3513592808","state":["exists","up"]},{"osd":6,"uuid":"c4a982c1-f497-4b0f-8a23-c77372e4621e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6824","nonce":1863656053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6827","nonce":1863656053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6831","nonce":1863656053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6829","nonce":1863656053}]},"public_addr":"172.21.15.118:6824/1863656053","cluster_addr":"172.21.15.118:6827/1863656053","heartbeat_back_addr":"172.21.15.118:6831/1863656053","heartbeat_front_addr":"172.21.15.118:6829/1863656053","state":["exists","up"]},{"osd":7,"uuid":"6f2888aa-a7ac-4e26-9159-e31817934f44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6817","nonce":3636642904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6819","nonce":3636642904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6825","nonce":3636642904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6821","nonce":3636642904}]},"public_addr":"172.21.15.118:6817/3636642904","cluster_addr":"172.21.15.118:6819/3636642904","heartbeat_back_addr":"172.21.15.118:6825/3636642904","heartbeat_front_addr":"172.21.15.118:6821/3636642904","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.717636+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.724036+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.739144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:58.079275+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:58.073921+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.930466+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.987813+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.941098+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-16T13:54:26.699 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.689+0000 7efdf79bc640 1 -- 172.21.15.39:0/2018264901 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7efdd4066280 msgr2=0x7efdd4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:26.700 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.689+0000 7efdf79bc640 1 --2- 172.21.15.39:0/2018264901 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7efdd4066280 0x7efdd4068730 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7efde0007fd0 tx=0x7efde0009040 comp rx=0 tx=0).stop 2023-05-16T13:54:26.700 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.689+0000 7efdf79bc640 1 -- 172.21.15.39:0/2018264901 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efdf00703b0 msgr2=0x7efdf00c7bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:26.700 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.689+0000 7efdf79bc640 1 --2- 172.21.15.39:0/2018264901 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efdf00703b0 0x7efdf00c7bc0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7efdec00c3c0 tx=0x7efdec00c880 comp rx=0 tx=0).stop 2023-05-16T13:54:26.700 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.689+0000 7efdf79bc640 1 -- 172.21.15.39:0/2018264901 shutdown_connections 2023-05-16T13:54:26.700 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.689+0000 7efdf79bc640 1 --2- 172.21.15.39:0/2018264901 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7efdd4066280 0x7efdd4068730 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:26.700 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.689+0000 7efdf79bc640 1 --2- 172.21.15.39:0/2018264901 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efdf0158bf0 0x7efdf0150640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:26.700 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.689+0000 7efdf79bc640 1 --2- 172.21.15.39:0/2018264901 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efdf00cb4c0 0x7efdf01564e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:26.701 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.689+0000 7efdf79bc640 1 --2- 172.21.15.39:0/2018264901 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efdf00703b0 0x7efdf00c7bc0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:26.701 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.689+0000 7efdf79bc640 1 -- 172.21.15.39:0/2018264901 >> 172.21.15.39:0/2018264901 conn(0x7efdf0069a50 msgr2=0x7efdf0069e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:26.701 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.693+0000 7efdf79bc640 1 -- 172.21.15.39:0/2018264901 shutdown_connections 2023-05-16T13:54:26.701 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.693+0000 7efdf79bc640 1 -- 172.21.15.39:0/2018264901 wait complete. 2023-05-16T13:54:26.718 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-16T13:54:00.885009+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-16T13:54:08.327895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-16T13:54:12.864823+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-16T13:54:14.180225+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-16T13:54:26.719 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-16T13:54:26.860 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.853+0000 7f9183396640 1 Processor -- start 2023-05-16T13:54:26.860 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.853+0000 7f9183396640 1 -- start start 2023-05-16T13:54:26.862 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.853+0000 7f9183396640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f917c1589f0 0x7f917c065690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:26.862 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.853+0000 7f9183396640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f917c071330 con 0x7f917c06ccb0 2023-05-16T13:54:26.863 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.853+0000 7f9183396640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f917c0c96e0 con 0x7f917c0cb2d0 2023-05-16T13:54:26.863 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.853+0000 7f9183396640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f917c0c99c0 con 0x7f917c1589f0 2023-05-16T13:54:26.863 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.853+0000 7f9181132640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f917c1589f0 0x7f917c065690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:26.863 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.853+0000 7f9181933640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f917c06ccb0 0x7f917c070600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:60860/0 (socket says 172.21.15.39:60860) 2023-05-16T13:54:26.863 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.853+0000 7f9181132640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f917c1589f0 0x7f917c065690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60244/0 (socket says 172.21.15.39:60244) 2023-05-16T13:54:26.863 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.853+0000 7f9181933640 1 -- 172.21.15.39:0/442228979 learned_addr learned my addr 172.21.15.39:0/442228979 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:26.863 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.853+0000 7f9181132640 1 -- 172.21.15.39:0/442228979 >> v1:172.21.15.118:6789/0 conn(0x7f917c0cb2d0 legacy=0x7f917c06c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:26.864 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.853+0000 7f9181132640 1 -- 172.21.15.39:0/442228979 >> v1:172.21.15.39:6789/0 conn(0x7f917c06ccb0 legacy=0x7f917c070600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:26.864 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.853+0000 7f9181132640 1 -- 172.21.15.39:0/442228979 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f917c0c9ca0 con 0x7f917c1589f0 2023-05-16T13:54:26.864 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.857+0000 7f9181132640 1 --2- 172.21.15.39:0/442228979 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f917c1589f0 0x7f917c065690 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f917800ba60 tx=0x7f9178021340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11e5a371af04a751 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:26.865 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.857+0000 7f9173fff640 1 -- 172.21.15.39:0/442228979 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91780b1600 con 0x7f917c1589f0 2023-05-16T13:54:26.865 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.857+0000 7f9173fff640 1 -- 172.21.15.39:0/442228979 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91780ad050 con 0x7f917c1589f0 2023-05-16T13:54:26.866 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.857+0000 7f9173fff640 1 -- 172.21.15.39:0/442228979 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91780b1980 con 0x7f917c1589f0 2023-05-16T13:54:26.866 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.857+0000 7f9183396640 1 -- 172.21.15.39:0/442228979 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f917c1589f0 msgr2=0x7f917c065690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:26.866 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.857+0000 7f9183396640 1 --2- 172.21.15.39:0/442228979 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f917c1589f0 0x7f917c065690 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f917800ba60 tx=0x7f9178021340 comp rx=0 tx=0).stop 2023-05-16T13:54:26.866 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.857+0000 7f9183396640 1 -- 172.21.15.39:0/442228979 shutdown_connections 2023-05-16T13:54:26.866 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.857+0000 7f9183396640 1 --2- 172.21.15.39:0/442228979 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f917c1589f0 0x7f917c065690 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:26.866 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.857+0000 7f9183396640 1 -- 172.21.15.39:0/442228979 >> 172.21.15.39:0/442228979 conn(0x7f917c0b14a0 msgr2=0x7f917c0cec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:26.867 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.857+0000 7f9183396640 1 -- 172.21.15.39:0/442228979 shutdown_connections 2023-05-16T13:54:26.867 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.857+0000 7f9183396640 1 -- 172.21.15.39:0/442228979 wait complete. 2023-05-16T13:54:26.867 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.857+0000 7f9183396640 1 Processor -- start 2023-05-16T13:54:26.868 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.857+0000 7f9183396640 1 -- start start 2023-05-16T13:54:26.868 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.861+0000 7f9183396640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f917c06ccb0 0x7f917c152ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:26.869 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.861+0000 7f9183396640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f917c0cb2d0 0x7f917c0c2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:26.869 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.861+0000 7f9183396640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f917c1589f0 0x7f917c070490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:26.869 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.861+0000 7f9183396640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f917c0c4090 con 0x7f917c06ccb0 2023-05-16T13:54:26.869 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.861+0000 7f9183396640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f917c0c5130 con 0x7f917c0cb2d0 2023-05-16T13:54:26.869 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.861+0000 7f9183396640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f917c0c3410 con 0x7f917c1589f0 2023-05-16T13:54:26.870 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.861+0000 7f9181132640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f917c06ccb0 0x7f917c152ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:26.870 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.861+0000 7f9181132640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f917c06ccb0 0x7f917c152ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60260/0 (socket says 172.21.15.39:60260) 2023-05-16T13:54:26.870 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.861+0000 7f9181132640 1 -- 172.21.15.39:0/4266390472 learned_addr learned my addr 172.21.15.39:0/4266390472 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:26.870 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.861+0000 7f9181933640 1 --2- 172.21.15.39:0/4266390472 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f917c1589f0 0x7f917c070490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:26.870 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.861+0000 7f9180931640 1 --2- 172.21.15.39:0/4266390472 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f917c0cb2d0 0x7f917c0c2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:26.871 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.861+0000 7f9181132640 1 -- 172.21.15.39:0/4266390472 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f917c1589f0 msgr2=0x7f917c070490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:26.872 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.861+0000 7f9181132640 1 --2- 172.21.15.39:0/4266390472 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f917c1589f0 0x7f917c070490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:26.872 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.861+0000 7f9181132640 1 -- 172.21.15.39:0/4266390472 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f917c0cb2d0 msgr2=0x7f917c0c2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:26.872 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.861+0000 7f9181132640 1 --2- 172.21.15.39:0/4266390472 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f917c0cb2d0 0x7f917c0c2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:26.872 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.861+0000 7f9181132640 1 -- 172.21.15.39:0/4266390472 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f917800b6c0 con 0x7f917c06ccb0 2023-05-16T13:54:26.872 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.861+0000 7f9181132640 1 --2- 172.21.15.39:0/4266390472 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f917c06ccb0 0x7f917c152ab0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f91780b4040 tx=0x7f917801e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:26.873 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.861+0000 7f9171ffb640 1 -- 172.21.15.39:0/4266390472 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91780b97d0 con 0x7f917c06ccb0 2023-05-16T13:54:26.873 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.861+0000 7f9171ffb640 1 -- 172.21.15.39:0/4266390472 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91780b9930 con 0x7f917c06ccb0 2023-05-16T13:54:26.873 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.861+0000 7f9171ffb640 1 -- 172.21.15.39:0/4266390472 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91780b9ce0 con 0x7f917c06ccb0 2023-05-16T13:54:26.873 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.861+0000 7f9183396640 1 -- 172.21.15.39:0/4266390472 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f917c065bd0 con 0x7f917c06ccb0 2023-05-16T13:54:26.873 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.861+0000 7f9183396640 1 -- 172.21.15.39:0/4266390472 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f917c0c93d0 con 0x7f917c06ccb0 2023-05-16T13:54:26.874 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.861+0000 7f9183396640 1 -- 172.21.15.39:0/4266390472 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f917c065d60 con 0x7f917c06ccb0 2023-05-16T13:54:26.874 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.865+0000 7f9171ffb640 1 -- 172.21.15.39:0/4266390472 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f91780b8070 con 0x7f917c06ccb0 2023-05-16T13:54:26.875 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.865+0000 7f9171ffb640 1 --2- 172.21.15.39:0/4266390472 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f9160066280 0x7f9160068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:26.875 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.865+0000 7f9171ffb640 1 -- 172.21.15.39:0/4266390472 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f91780aae40 con 0x7f917c06ccb0 2023-05-16T13:54:26.876 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.865+0000 7f9180931640 1 --2- 172.21.15.39:0/4266390472 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f9160066280 0x7f9160068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:26.876 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.865+0000 7f9180931640 1 --2- 172.21.15.39:0/4266390472 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f9160066280 0x7f9160068730 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f917c070fe0 tx=0x7f916c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:26.877 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:26.869+0000 7f9171ffb640 1 -- 172.21.15.39:0/4266390472 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f91780ef620 con 0x7f917c06ccb0 2023-05-16T13:54:27.033 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.025+0000 7f9183396640 1 -- 172.21.15.39:0/4266390472 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f917c073c90 con 0x7f917c06ccb0 2023-05-16T13:54:27.033 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.025+0000 7f9171ffb640 1 -- 172.21.15.39:0/4266390472 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f91780c1310 con 0x7f917c06ccb0 2023-05-16T13:54:27.034 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2023-05-16T13:54:27.035 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.025+0000 7f9183396640 1 -- 172.21.15.39:0/4266390472 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f9160066280 msgr2=0x7f9160068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:27.035 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.025+0000 7f9183396640 1 --2- 172.21.15.39:0/4266390472 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f9160066280 0x7f9160068730 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f917c070fe0 tx=0x7f916c009040 comp rx=0 tx=0).stop 2023-05-16T13:54:27.036 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.025+0000 7f9183396640 1 -- 172.21.15.39:0/4266390472 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f917c06ccb0 msgr2=0x7f917c152ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:27.036 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.025+0000 7f9183396640 1 --2- 172.21.15.39:0/4266390472 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f917c06ccb0 0x7f917c152ab0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f91780b4040 tx=0x7f917801e0e0 comp rx=0 tx=0).stop 2023-05-16T13:54:27.036 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.025+0000 7f9183396640 1 -- 172.21.15.39:0/4266390472 shutdown_connections 2023-05-16T13:54:27.036 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.025+0000 7f9183396640 1 --2- 172.21.15.39:0/4266390472 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f9160066280 0x7f9160068730 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:27.036 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.025+0000 7f9183396640 1 --2- 172.21.15.39:0/4266390472 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f917c1589f0 0x7f917c070490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:27.036 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.025+0000 7f9183396640 1 --2- 172.21.15.39:0/4266390472 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f917c0cb2d0 0x7f917c0c2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:27.037 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.025+0000 7f9183396640 1 --2- 172.21.15.39:0/4266390472 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f917c06ccb0 0x7f917c152ab0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:27.037 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.025+0000 7f9183396640 1 -- 172.21.15.39:0/4266390472 >> 172.21.15.39:0/4266390472 conn(0x7f917c0b14a0 msgr2=0x7f917c06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:27.037 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.025+0000 7f9183396640 1 -- 172.21.15.39:0/4266390472 shutdown_connections 2023-05-16T13:54:27.037 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.025+0000 7f9183396640 1 -- 172.21.15.39:0/4266390472 wait complete. 2023-05-16T13:54:27.054 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-16T13:54:27.194 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.185+0000 7faaece41640 1 Processor -- start 2023-05-16T13:54:27.194 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.185+0000 7faaece41640 1 -- start start 2023-05-16T13:54:27.195 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.185+0000 7faaece41640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7faae80cb0f0 0x7faae8160430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:27.195 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.185+0000 7faaece41640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faae8160970 0x7faae80718a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:27.195 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.185+0000 7faaece41640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7faae8071de0 0x7faae8069a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:27.196 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.185+0000 7faaece41640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faae80cd490 con 0x7faae80cb0f0 2023-05-16T13:54:27.196 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.185+0000 7faaece41640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faae80cee40 con 0x7faae8071de0 2023-05-16T13:54:27.196 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.185+0000 7faaece41640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faae80cf120 con 0x7faae8160970 2023-05-16T13:54:27.196 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.185+0000 7faae659c640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7faae80cb0f0 0x7faae8160430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:27.196 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.185+0000 7faae659c640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7faae80cb0f0 0x7faae8160430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60270/0 (socket says 172.21.15.39:60270) 2023-05-16T13:54:27.196 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.185+0000 7faae659c640 1 -- 172.21.15.39:0/220890479 learned_addr learned my addr 172.21.15.39:0/220890479 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:27.197 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.189+0000 7faae6d9d640 1 --2- 172.21.15.39:0/220890479 >> v2:172.21.15.118:3300/0 conn(0x7faae8071de0 0x7faae8069a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:27.197 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.189+0000 7faadffff640 1 --2- 172.21.15.39:0/220890479 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faae8160970 0x7faae80718a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:27.198 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.189+0000 7faae659c640 1 -- 172.21.15.39:0/220890479 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faae8160970 msgr2=0x7faae80718a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:27.198 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.189+0000 7faae659c640 1 --2- 172.21.15.39:0/220890479 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faae8160970 0x7faae80718a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:27.198 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.189+0000 7faae659c640 1 -- 172.21.15.39:0/220890479 >> v2:172.21.15.118:3300/0 conn(0x7faae8071de0 msgr2=0x7faae8069a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:27.198 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.189+0000 7faae659c640 1 --2- 172.21.15.39:0/220890479 >> v2:172.21.15.118:3300/0 conn(0x7faae8071de0 0x7faae8069a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:27.198 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.189+0000 7faae659c640 1 -- 172.21.15.39:0/220890479 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faae80cf400 con 0x7faae80cb0f0 2023-05-16T13:54:27.198 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.189+0000 7faae6d9d640 1 --2- 172.21.15.39:0/220890479 >> v2:172.21.15.118:3300/0 conn(0x7faae8071de0 0x7faae8069a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:54:27.199 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.189+0000 7faae659c640 1 --2- 172.21.15.39:0/220890479 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faae80cb0f0 0x7faae8160430 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7faae80cd0c0 tx=0x7faad801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1b78b8ccb7a413e server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:27.199 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.189+0000 7faae5d9b640 1 -- 172.21.15.39:0/220890479 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad80ac630 con 0x7faae80cb0f0 2023-05-16T13:54:27.199 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.189+0000 7faae5d9b640 1 -- 172.21.15.39:0/220890479 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faad80ac790 con 0x7faae80cb0f0 2023-05-16T13:54:27.199 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.189+0000 7faae5d9b640 1 -- 172.21.15.39:0/220890479 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad80acb20 con 0x7faae80cb0f0 2023-05-16T13:54:27.200 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.189+0000 7faaece41640 1 -- 172.21.15.39:0/220890479 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faae80cb0f0 msgr2=0x7faae8160430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:27.200 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.189+0000 7faaece41640 1 --2- 172.21.15.39:0/220890479 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faae80cb0f0 0x7faae8160430 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7faae80cd0c0 tx=0x7faad801c500 comp rx=0 tx=0).stop 2023-05-16T13:54:27.201 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.193+0000 7faaece41640 1 -- 172.21.15.39:0/220890479 shutdown_connections 2023-05-16T13:54:27.201 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.193+0000 7faaece41640 1 --2- 172.21.15.39:0/220890479 >> v2:172.21.15.118:3300/0 conn(0x7faae8071de0 0x7faae8069a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:27.201 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.193+0000 7faaece41640 1 --2- 172.21.15.39:0/220890479 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faae8160970 0x7faae80718a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:27.201 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.193+0000 7faaece41640 1 --2- 172.21.15.39:0/220890479 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faae80cb0f0 0x7faae8160430 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:27.201 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.193+0000 7faaece41640 1 -- 172.21.15.39:0/220890479 >> 172.21.15.39:0/220890479 conn(0x7faae806ce40 msgr2=0x7faae806d240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:27.201 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.193+0000 7faaece41640 1 -- 172.21.15.39:0/220890479 shutdown_connections 2023-05-16T13:54:27.202 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.193+0000 7faaece41640 1 -- 172.21.15.39:0/220890479 wait complete. 2023-05-16T13:54:27.203 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.193+0000 7faaece41640 1 Processor -- start 2023-05-16T13:54:27.204 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.193+0000 7faaece41640 1 -- start start 2023-05-16T13:54:27.204 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.193+0000 7faaece41640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faae8071de0 0x7faae8158b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:27.204 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.193+0000 7faaece41640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faae80cb0f0 0x7faae80c6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:27.204 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.193+0000 7faaece41640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faae8160970 0x7faae80c6b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:27.204 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.193+0000 7faaece41640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae8151800 con 0x7faae8160970 2023-05-16T13:54:27.205 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.193+0000 7faaece41640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae80c94f0 con 0x7faae8071de0 2023-05-16T13:54:27.205 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.193+0000 7faaece41640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faae80c8d30 con 0x7faae80cb0f0 2023-05-16T13:54:27.205 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.193+0000 7faae6d9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faae8160970 0x7faae80c6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:27.205 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.193+0000 7faae6d9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faae8160970 0x7faae80c6b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60276/0 (socket says 172.21.15.39:60276) 2023-05-16T13:54:27.205 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.193+0000 7faae6d9d640 1 -- 172.21.15.39:0/1619551258 learned_addr learned my addr 172.21.15.39:0/1619551258 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:27.205 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.193+0000 7faae659c640 1 --2- 172.21.15.39:0/1619551258 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faae8071de0 0x7faae8158b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:27.205 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.193+0000 7faadffff640 1 --2- 172.21.15.39:0/1619551258 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faae80cb0f0 0x7faae80c6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:27.206 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.193+0000 7faae6d9d640 1 -- 172.21.15.39:0/1619551258 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faae80cb0f0 msgr2=0x7faae80c6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:27.206 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.193+0000 7faae6d9d640 1 --2- 172.21.15.39:0/1619551258 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faae80cb0f0 0x7faae80c6640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:27.206 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.193+0000 7faae6d9d640 1 -- 172.21.15.39:0/1619551258 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faae8071de0 msgr2=0x7faae8158b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:27.206 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.193+0000 7faae6d9d640 1 --2- 172.21.15.39:0/1619551258 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faae8071de0 0x7faae8158b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:27.206 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.193+0000 7faae6d9d640 1 -- 172.21.15.39:0/1619551258 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad80094d0 con 0x7faae8160970 2023-05-16T13:54:27.206 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.193+0000 7faae6d9d640 1 --2- 172.21.15.39:0/1619551258 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faae8160970 0x7faae80c6b80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7faae0007ef0 tx=0x7faae000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:27.206 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.197+0000 7faadeffd640 1 -- 172.21.15.39:0/1619551258 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae0003ba0 con 0x7faae8160970 2023-05-16T13:54:27.207 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.197+0000 7faadeffd640 1 -- 172.21.15.39:0/1619551258 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faae000f040 con 0x7faae8160970 2023-05-16T13:54:27.207 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.197+0000 7faadeffd640 1 -- 172.21.15.39:0/1619551258 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae000de80 con 0x7faae8160970 2023-05-16T13:54:27.207 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.197+0000 7faaece41640 1 -- 172.21.15.39:0/1619551258 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faae80ceaa0 con 0x7faae8160970 2023-05-16T13:54:27.207 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.197+0000 7faaece41640 1 -- 172.21.15.39:0/1619551258 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faae80cb4c0 con 0x7faae8160970 2023-05-16T13:54:27.208 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.197+0000 7faaece41640 1 -- 172.21.15.39:0/1619551258 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faae806e850 con 0x7faae8160970 2023-05-16T13:54:27.208 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.197+0000 7faadeffd640 1 -- 172.21.15.39:0/1619551258 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7faae0004030 con 0x7faae8160970 2023-05-16T13:54:27.208 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.197+0000 7faadeffd640 1 --2- 172.21.15.39:0/1619551258 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7faac8066280 0x7faac8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:27.208 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.197+0000 7faadeffd640 1 -- 172.21.15.39:0/1619551258 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7faae0083f60 con 0x7faae8160970 2023-05-16T13:54:27.208 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.197+0000 7faae659c640 1 --2- 172.21.15.39:0/1619551258 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7faac8066280 0x7faac8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:27.209 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.197+0000 7faae659c640 1 --2- 172.21.15.39:0/1619551258 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7faac8066280 0x7faac8068730 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7faad80ae000 tx=0x7faad80a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:27.210 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.201+0000 7faadeffd640 1 -- 172.21.15.39:0/1619551258 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7faae0051500 con 0x7faae8160970 2023-05-16T13:54:27.366 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.357+0000 7faaece41640 1 -- 172.21.15.39:0/1619551258 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7faae80cfe30 con 0x7faae8160970 2023-05-16T13:54:27.367 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.357+0000 7faadeffd640 1 -- 172.21.15.39:0/1619551258 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7faae001a0a0 con 0x7faae8160970 2023-05-16T13:54:27.367 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 8 2023-05-16T13:54:27.368 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.361+0000 7faaece41640 1 -- 172.21.15.39:0/1619551258 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7faac8066280 msgr2=0x7faac8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:27.368 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.361+0000 7faaece41640 1 --2- 172.21.15.39:0/1619551258 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7faac8066280 0x7faac8068730 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7faad80ae000 tx=0x7faad80a7000 comp rx=0 tx=0).stop 2023-05-16T13:54:27.369 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.361+0000 7faaece41640 1 -- 172.21.15.39:0/1619551258 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faae8160970 msgr2=0x7faae80c6b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:27.369 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.361+0000 7faaece41640 1 --2- 172.21.15.39:0/1619551258 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faae8160970 0x7faae80c6b80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7faae0007ef0 tx=0x7faae000d4a0 comp rx=0 tx=0).stop 2023-05-16T13:54:27.369 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.361+0000 7faaece41640 1 -- 172.21.15.39:0/1619551258 shutdown_connections 2023-05-16T13:54:27.369 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.361+0000 7faaece41640 1 --2- 172.21.15.39:0/1619551258 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7faac8066280 0x7faac8068730 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:27.369 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.361+0000 7faaece41640 1 --2- 172.21.15.39:0/1619551258 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faae80cb0f0 0x7faae80c6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:27.369 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.361+0000 7faaece41640 1 --2- 172.21.15.39:0/1619551258 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faae8160970 0x7faae80c6b80 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:27.370 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.361+0000 7faaece41640 1 --2- 172.21.15.39:0/1619551258 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faae8071de0 0x7faae8158b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:27.370 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.361+0000 7faaece41640 1 -- 172.21.15.39:0/1619551258 >> 172.21.15.39:0/1619551258 conn(0x7faae806ce40 msgr2=0x7faae806d210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:27.370 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.361+0000 7faaece41640 1 -- 172.21.15.39:0/1619551258 shutdown_connections 2023-05-16T13:54:27.370 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.361+0000 7faaece41640 1 -- 172.21.15.39:0/1619551258 wait complete. 2023-05-16T13:54:27.388 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-16T13:54:27.527 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.517+0000 7fcebe125640 1 Processor -- start 2023-05-16T13:54:27.528 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.521+0000 7fcebe125640 1 -- start start 2023-05-16T13:54:27.529 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.521+0000 7fcebe125640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fceb80b0710 0x7fceb815d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:27.529 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.521+0000 7fcebe125640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fceb80b4030 0x7fceb8071460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:27.529 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.521+0000 7fcebe125640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fceb80719a0 0x7fceb80ce420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:27.530 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.521+0000 7fcebe125640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceb815e910 con 0x7fceb80b4030 2023-05-16T13:54:27.530 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.521+0000 7fcebe125640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceb815de40 con 0x7fceb80719a0 2023-05-16T13:54:27.530 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.521+0000 7fcebe125640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceb80b0ae0 con 0x7fceb80b0710 2023-05-16T13:54:27.530 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.521+0000 7fceb6ffd640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fceb80b4030 0x7fceb8071460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:27.530 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.521+0000 7fceb6ffd640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fceb80b4030 0x7fceb8071460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60280/0 (socket says 172.21.15.39:60280) 2023-05-16T13:54:27.530 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.521+0000 7fceb6ffd640 1 -- 172.21.15.39:0/2586359134 learned_addr learned my addr 172.21.15.39:0/2586359134 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:27.531 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.521+0000 7fceb7fff640 1 --2- 172.21.15.39:0/2586359134 >> v2:172.21.15.118:3300/0 conn(0x7fceb80719a0 0x7fceb80ce420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:27.531 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.521+0000 7fceb77fe640 1 --2- 172.21.15.39:0/2586359134 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fceb80b0710 0x7fceb815d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:27.531 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.521+0000 7fceb6ffd640 1 -- 172.21.15.39:0/2586359134 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fceb80b0710 msgr2=0x7fceb815d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:27.532 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.521+0000 7fceb6ffd640 1 --2- 172.21.15.39:0/2586359134 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fceb80b0710 0x7fceb815d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:27.532 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.521+0000 7fceb6ffd640 1 -- 172.21.15.39:0/2586359134 >> v2:172.21.15.118:3300/0 conn(0x7fceb80719a0 msgr2=0x7fceb80ce420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:27.532 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.521+0000 7fceb6ffd640 1 --2- 172.21.15.39:0/2586359134 >> v2:172.21.15.118:3300/0 conn(0x7fceb80719a0 0x7fceb80ce420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:27.532 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.521+0000 7fceb6ffd640 1 -- 172.21.15.39:0/2586359134 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb815e070 con 0x7fceb80b4030 2023-05-16T13:54:27.532 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.521+0000 7fceb77fe640 1 --2- 172.21.15.39:0/2586359134 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fceb80b0710 0x7fceb815d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:54:27.533 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.525+0000 7fceb6ffd640 1 --2- 172.21.15.39:0/2586359134 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fceb80b4030 0x7fceb8071460 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fceb80b1030 tx=0x7fceac01c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd411a7f45645acc server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:27.534 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.525+0000 7fceb67fc640 1 -- 172.21.15.39:0/2586359134 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceac0ab600 con 0x7fceb80b4030 2023-05-16T13:54:27.534 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.525+0000 7fceb67fc640 1 -- 172.21.15.39:0/2586359134 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceac0a7050 con 0x7fceb80b4030 2023-05-16T13:54:27.534 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.525+0000 7fceb67fc640 1 -- 172.21.15.39:0/2586359134 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceac0ab980 con 0x7fceb80b4030 2023-05-16T13:54:27.534 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.525+0000 7fcebe125640 1 -- 172.21.15.39:0/2586359134 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fceb80b4030 msgr2=0x7fceb8071460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:27.535 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.525+0000 7fcebe125640 1 --2- 172.21.15.39:0/2586359134 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fceb80b4030 0x7fceb8071460 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fceb80b1030 tx=0x7fceac01c240 comp rx=0 tx=0).stop 2023-05-16T13:54:27.535 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.525+0000 7fcebe125640 1 -- 172.21.15.39:0/2586359134 shutdown_connections 2023-05-16T13:54:27.535 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.525+0000 7fcebe125640 1 --2- 172.21.15.39:0/2586359134 >> v2:172.21.15.118:3300/0 conn(0x7fceb80719a0 0x7fceb80ce420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:27.535 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.525+0000 7fcebe125640 1 --2- 172.21.15.39:0/2586359134 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fceb80b4030 0x7fceb8071460 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:27.536 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.525+0000 7fcebe125640 1 --2- 172.21.15.39:0/2586359134 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fceb80b0710 0x7fceb815d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:27.536 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.525+0000 7fcebe125640 1 -- 172.21.15.39:0/2586359134 >> 172.21.15.39:0/2586359134 conn(0x7fceb8069a50 msgr2=0x7fceb8069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:27.536 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.525+0000 7fcebe125640 1 -- 172.21.15.39:0/2586359134 shutdown_connections 2023-05-16T13:54:27.537 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.525+0000 7fcebe125640 1 -- 172.21.15.39:0/2586359134 wait complete. 2023-05-16T13:54:27.539 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.525+0000 7fcebe125640 1 Processor -- start 2023-05-16T13:54:27.539 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.525+0000 7fcebe125640 1 -- start start 2023-05-16T13:54:27.539 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.529+0000 7fcebe125640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fceb80719a0 0x7fceb81f8620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:27.539 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.529+0000 7fcebe125640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fceb80b0710 0x7fceb81f3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:27.539 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.529+0000 7fcebe125640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fceb80b4030 0x7fceb80cd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:27.539 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.529+0000 7fcebe125640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb81f8b60 con 0x7fceb80719a0 2023-05-16T13:54:27.539 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.529+0000 7fcebe125640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb80cc440 con 0x7fceb80b0710 2023-05-16T13:54:27.540 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.529+0000 7fcebe125640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceb80cc720 con 0x7fceb80b4030 2023-05-16T13:54:27.540 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.529+0000 7fceb77fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fceb80719a0 0x7fceb81f8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:27.540 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.529+0000 7fceb77fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fceb80719a0 0x7fceb81f8620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60286/0 (socket says 172.21.15.39:60286) 2023-05-16T13:54:27.541 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.529+0000 7fceb77fe640 1 -- 172.21.15.39:0/2533306167 learned_addr learned my addr 172.21.15.39:0/2533306167 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:27.541 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.529+0000 7fceb7fff640 1 --2- 172.21.15.39:0/2533306167 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fceb80b4030 0x7fceb80cd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:27.541 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.529+0000 7fceb6ffd640 1 --2- 172.21.15.39:0/2533306167 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fceb80b0710 0x7fceb81f3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:27.541 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.529+0000 7fceb77fe640 1 -- 172.21.15.39:0/2533306167 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fceb80b4030 msgr2=0x7fceb80cd4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:27.541 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.529+0000 7fceb77fe640 1 --2- 172.21.15.39:0/2533306167 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fceb80b4030 0x7fceb80cd4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:27.542 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.529+0000 7fceb77fe640 1 -- 172.21.15.39:0/2533306167 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fceb80b0710 msgr2=0x7fceb81f3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:27.542 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.529+0000 7fceb77fe640 1 --2- 172.21.15.39:0/2533306167 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fceb80b0710 0x7fceb81f3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:27.542 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.529+0000 7fceb77fe640 1 -- 172.21.15.39:0/2533306167 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceac0094d0 con 0x7fceb80719a0 2023-05-16T13:54:27.542 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.529+0000 7fceb6ffd640 1 --2- 172.21.15.39:0/2533306167 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fceb80b0710 0x7fceb81f3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:54:27.542 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.529+0000 7fceb7fff640 1 --2- 172.21.15.39:0/2533306167 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fceb80b4030 0x7fceb80cd4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:54:27.542 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.529+0000 7fceb77fe640 1 --2- 172.21.15.39:0/2533306167 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fceb80719a0 0x7fceb81f8620 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fcea800e810 tx=0x7fcea800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:27.543 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.529+0000 7fce9ffff640 1 -- 172.21.15.39:0/2533306167 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea800c8d0 con 0x7fceb80719a0 2023-05-16T13:54:27.543 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.529+0000 7fce9ffff640 1 -- 172.21.15.39:0/2533306167 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea800ca30 con 0x7fceb80719a0 2023-05-16T13:54:27.543 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.529+0000 7fce9ffff640 1 -- 172.21.15.39:0/2533306167 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea800cdc0 con 0x7fceb80719a0 2023-05-16T13:54:27.543 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.529+0000 7fcebe125640 1 -- 172.21.15.39:0/2533306167 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceb8071da0 con 0x7fceb80719a0 2023-05-16T13:54:27.543 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.529+0000 7fcebe125640 1 -- 172.21.15.39:0/2533306167 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceb80c8ca0 con 0x7fceb80719a0 2023-05-16T13:54:27.543 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.529+0000 7fcebe125640 1 -- 172.21.15.39:0/2533306167 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceb80c91c0 con 0x7fceb80719a0 2023-05-16T13:54:27.544 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.529+0000 7fce9ffff640 1 -- 172.21.15.39:0/2533306167 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcea8013410 con 0x7fceb80719a0 2023-05-16T13:54:27.544 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.533+0000 7fce9ffff640 1 --2- 172.21.15.39:0/2533306167 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fcea4066280 0x7fcea4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:27.544 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.533+0000 7fce9ffff640 1 -- 172.21.15.39:0/2533306167 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcea8083ae0 con 0x7fceb80719a0 2023-05-16T13:54:27.545 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.533+0000 7fceb6ffd640 1 --2- 172.21.15.39:0/2533306167 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fcea4066280 0x7fcea4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:27.545 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.533+0000 7fceb6ffd640 1 --2- 172.21.15.39:0/2533306167 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fcea4066280 0x7fcea4068730 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fceac0ad000 tx=0x7fceac008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:27.545 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.537+0000 7fce9ffff640 1 -- 172.21.15.39:0/2533306167 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fcea8050ff0 con 0x7fceb80719a0 2023-05-16T13:54:27.695 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.685+0000 7fcebe125640 1 -- 172.21.15.39:0/2533306167 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fceb8073c90 con 0x7fceb80719a0 2023-05-16T13:54:27.695 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.685+0000 7fce9ffff640 1 -- 172.21.15.39:0/2533306167 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcea8009480 con 0x7fceb80719a0 2023-05-16T13:54:27.696 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2023-05-16T13:54:27.697 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.689+0000 7fcebe125640 1 -- 172.21.15.39:0/2533306167 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fcea4066280 msgr2=0x7fcea4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:27.697 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.689+0000 7fcebe125640 1 --2- 172.21.15.39:0/2533306167 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fcea4066280 0x7fcea4068730 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fceac0ad000 tx=0x7fceac008040 comp rx=0 tx=0).stop 2023-05-16T13:54:27.698 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.689+0000 7fcebe125640 1 -- 172.21.15.39:0/2533306167 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fceb80719a0 msgr2=0x7fceb81f8620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:27.698 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.689+0000 7fcebe125640 1 --2- 172.21.15.39:0/2533306167 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fceb80719a0 0x7fceb81f8620 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fcea800e810 tx=0x7fcea800ecd0 comp rx=0 tx=0).stop 2023-05-16T13:54:27.698 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.689+0000 7fcebe125640 1 -- 172.21.15.39:0/2533306167 shutdown_connections 2023-05-16T13:54:27.698 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.689+0000 7fcebe125640 1 --2- 172.21.15.39:0/2533306167 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fcea4066280 0x7fcea4068730 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:27.698 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.689+0000 7fcebe125640 1 --2- 172.21.15.39:0/2533306167 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fceb80b4030 0x7fceb80cd4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:27.698 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.689+0000 7fcebe125640 1 --2- 172.21.15.39:0/2533306167 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fceb80b0710 0x7fceb81f3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:27.698 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.689+0000 7fcebe125640 1 --2- 172.21.15.39:0/2533306167 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fceb80719a0 0x7fceb81f8620 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:27.699 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.689+0000 7fcebe125640 1 -- 172.21.15.39:0/2533306167 >> 172.21.15.39:0/2533306167 conn(0x7fceb8069a50 msgr2=0x7fceb80ad750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:27.699 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.689+0000 7fcebe125640 1 -- 172.21.15.39:0/2533306167 shutdown_connections 2023-05-16T13:54:27.699 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.689+0000 7fcebe125640 1 -- 172.21.15.39:0/2533306167 wait complete. 2023-05-16T13:54:27.716 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-16T13:54:27.857 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.849+0000 7f93d7d39640 1 Processor -- start 2023-05-16T13:54:27.857 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.849+0000 7f93d7d39640 1 -- start start 2023-05-16T13:54:27.858 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.849+0000 7f93d7d39640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93d00b10a0 0x7f93d00d2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:27.859 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.849+0000 7f93d7d39640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f93d00d0b20 0x7f93d00af490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:27.859 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.849+0000 7f93d7d39640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93d006c610 con 0x7f93d00d2ed0 2023-05-16T13:54:27.859 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.849+0000 7f93d7d39640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93d006caa0 con 0x7f93d00d0b20 2023-05-16T13:54:27.859 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.849+0000 7f93d7d39640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93d006ba00 con 0x7f93d00b10a0 2023-05-16T13:54:27.859 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.849+0000 7f93d52d4640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f93d00d2ed0 0x7f93d00d0410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:60864/0 (socket says 172.21.15.39:60864) 2023-05-16T13:54:27.859 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.849+0000 7f93d52d4640 1 -- 172.21.15.39:0/1025474856 learned_addr learned my addr 172.21.15.39:0/1025474856 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:27.861 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.849+0000 7f93d62d6640 1 --2- 172.21.15.39:0/1025474856 >> v2:172.21.15.118:3300/0 conn(0x7f93d00d0b20 0x7f93d00af490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:27.862 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.849+0000 7f93d5ad5640 1 --2- 172.21.15.39:0/1025474856 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93d00b10a0 0x7f93d00d2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:27.862 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.849+0000 7f93d4ad3640 1 -- 172.21.15.39:0/1025474856 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1793702143 0 0) 0x7f93d006c610 con 0x7f93d00d2ed0 2023-05-16T13:54:27.862 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.849+0000 7f93d4ad3640 1 -- 172.21.15.39:0/1025474856 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93bc003530 con 0x7f93d00d2ed0 2023-05-16T13:54:27.862 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.849+0000 7f93d4ad3640 1 -- 172.21.15.39:0/1025474856 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1522547717 0 0) 0x7f93bc003530 con 0x7f93d00d2ed0 2023-05-16T13:54:27.862 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.849+0000 7f93d4ad3640 1 -- 172.21.15.39:0/1025474856 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93d00b10a0 msgr2=0x7f93d00d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:27.863 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.849+0000 7f93d4ad3640 1 --2- 172.21.15.39:0/1025474856 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93d00b10a0 0x7f93d00d2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:27.863 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.849+0000 7f93d4ad3640 1 -- 172.21.15.39:0/1025474856 >> v2:172.21.15.118:3300/0 conn(0x7f93d00d0b20 msgr2=0x7f93d00af490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:27.863 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.849+0000 7f93d4ad3640 1 --2- 172.21.15.39:0/1025474856 >> v2:172.21.15.118:3300/0 conn(0x7f93d00d0b20 0x7f93d00af490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:27.863 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.849+0000 7f93d4ad3640 1 -- 172.21.15.39:0/1025474856 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d006bce0 con 0x7f93d00d2ed0 2023-05-16T13:54:27.863 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.849+0000 7f93d4ad3640 1 -- 172.21.15.39:0/1025474856 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1738805496 0 0) 0x7f93c0001680 con 0x7f93d00d2ed0 2023-05-16T13:54:27.864 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.849+0000 7f93d4ad3640 1 -- 172.21.15.39:0/1025474856 >> v1:172.21.15.39:6789/0 conn(0x7f93d00d2ed0 legacy=0x7f93d00d0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:27.864 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.849+0000 7f93d4ad3640 1 --2- 172.21.15.39:0/1025474856 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93bc003980 0x7f93bc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:27.864 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.849+0000 7f93d4ad3640 1 --2- 172.21.15.39:0/1025474856 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93d00b10a0 0x7f93bc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:27.864 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.849+0000 7f93d4ad3640 1 --2- 172.21.15.39:0/1025474856 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93bc004d10 0x7f93bc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:27.864 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.849+0000 7f93d4ad3640 1 -- 172.21.15.39:0/1025474856 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d006caa0 con 0x7f93bc003980 2023-05-16T13:54:27.865 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.849+0000 7f93d4ad3640 1 -- 172.21.15.39:0/1025474856 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d006ba00 con 0x7f93bc004d10 2023-05-16T13:54:27.865 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.849+0000 7f93d4ad3640 1 -- 172.21.15.39:0/1025474856 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93bc00b990 con 0x7f93d00b10a0 2023-05-16T13:54:27.865 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.853+0000 7f93d62d6640 1 --2- 172.21.15.39:0/1025474856 >> v2:172.21.15.118:3300/0 conn(0x7f93d00d0b20 0x7f93d00af490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-16T13:54:27.865 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.853+0000 7f93d5ad5640 1 --2- 172.21.15.39:0/1025474856 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93bc003980 0x7f93bc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:27.865 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.853+0000 7f93d52d4640 1 --2- 172.21.15.39:0/1025474856 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93d00b10a0 0x7f93bc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:27.865 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.853+0000 7f93d62d6640 1 --2- 172.21.15.39:0/1025474856 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93bc004d10 0x7f93bc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:27.865 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.853+0000 7f93d5ad5640 1 -- 172.21.15.39:0/1025474856 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93d00b10a0 msgr2=0x7f93bc0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:27.866 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.853+0000 7f93d5ad5640 1 --2- 172.21.15.39:0/1025474856 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93d00b10a0 0x7f93bc0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:27.866 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.853+0000 7f93d5ad5640 1 -- 172.21.15.39:0/1025474856 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93bc004d10 msgr2=0x7f93bc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:27.866 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.853+0000 7f93d5ad5640 1 --2- 172.21.15.39:0/1025474856 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93bc004d10 0x7f93bc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:27.866 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.853+0000 7f93d5ad5640 1 -- 172.21.15.39:0/1025474856 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93bc003530 con 0x7f93bc003980 2023-05-16T13:54:27.868 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.853+0000 7f93d5ad5640 1 --2- 172.21.15.39:0/1025474856 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93bc003980 0x7f93bc003d90 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f93cc009ae0 tx=0x7f93cc01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcfaf1934a2bc24c server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:27.868 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.853+0000 7f93d4ad3640 1 -- 172.21.15.39:0/1025474856 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93cc0a6510 con 0x7f93bc003980 2023-05-16T13:54:27.868 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.853+0000 7f93d4ad3640 1 -- 172.21.15.39:0/1025474856 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93cc0a6670 con 0x7f93bc003980 2023-05-16T13:54:27.869 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.853+0000 7f93d4ad3640 1 -- 172.21.15.39:0/1025474856 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93cc0a6a20 con 0x7f93bc003980 2023-05-16T13:54:27.869 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.853+0000 7f93d7d39640 1 -- 172.21.15.39:0/1025474856 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93bc003980 msgr2=0x7f93bc003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:27.869 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.853+0000 7f93d7d39640 1 --2- 172.21.15.39:0/1025474856 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93bc003980 0x7f93bc003d90 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f93cc009ae0 tx=0x7f93cc01c9c0 comp rx=0 tx=0).stop 2023-05-16T13:54:27.869 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.853+0000 7f93d62d6640 1 -- 172.21.15.39:0/1025474856 reap_dead start 2023-05-16T13:54:27.869 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.853+0000 7f93d7d39640 1 -- 172.21.15.39:0/1025474856 shutdown_connections 2023-05-16T13:54:27.869 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.857+0000 7f93d7d39640 1 -- 172.21.15.39:0/1025474856 >> 172.21.15.39:0/1025474856 conn(0x7f93d009bba0 msgr2=0x7f93d0089fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:27.869 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.857+0000 7f93d7d39640 1 -- 172.21.15.39:0/1025474856 shutdown_connections 2023-05-16T13:54:27.870 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.857+0000 7f93d7d39640 1 -- 172.21.15.39:0/1025474856 wait complete. 2023-05-16T13:54:27.870 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.857+0000 7f93d7d39640 1 Processor -- start 2023-05-16T13:54:27.870 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.857+0000 7f93d7d39640 1 -- start start 2023-05-16T13:54:27.870 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.857+0000 7f93d7d39640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93bc003980 0x7f93d015dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:27.870 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.857+0000 7f93d7d39640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93d01e7940 0x7f93d01e7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:27.870 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.857+0000 7f93d7d39640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93d01e9aa0 0x7f93d01e9f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:27.871 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.857+0000 7f93d7d39640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d01ea7f0 con 0x7f93d01e9aa0 2023-05-16T13:54:27.871 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.857+0000 7f93d7d39640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d01eaad0 con 0x7f93d01e7940 2023-05-16T13:54:27.871 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.857+0000 7f93d7d39640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93d01eadb0 con 0x7f93bc003980 2023-05-16T13:54:27.871 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.857+0000 7f93d62d6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93d01e9aa0 0x7f93d01e9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:27.871 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.857+0000 7f93d62d6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93d01e9aa0 0x7f93d01e9f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60312/0 (socket says 172.21.15.39:60312) 2023-05-16T13:54:27.871 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.857+0000 7f93d62d6640 1 -- 172.21.15.39:0/1219081940 learned_addr learned my addr 172.21.15.39:0/1219081940 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:27.872 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.857+0000 7f93d52d4640 1 --2- 172.21.15.39:0/1219081940 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93d01e7940 0x7f93d01e7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:27.872 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.857+0000 7f93d5ad5640 1 --2- 172.21.15.39:0/1219081940 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93bc003980 0x7f93d015dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:27.872 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.857+0000 7f93d62d6640 1 -- 172.21.15.39:0/1219081940 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93bc003980 msgr2=0x7f93d015dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:27.872 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.857+0000 7f93d62d6640 1 --2- 172.21.15.39:0/1219081940 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93bc003980 0x7f93d015dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:27.872 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.857+0000 7f93d62d6640 1 -- 172.21.15.39:0/1219081940 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93d01e7940 msgr2=0x7f93d01e7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:27.872 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.857+0000 7f93d62d6640 1 --2- 172.21.15.39:0/1219081940 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93d01e7940 0x7f93d01e7db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:27.873 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.857+0000 7f93d62d6640 1 -- 172.21.15.39:0/1219081940 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d006b620 con 0x7f93d01e9aa0 2023-05-16T13:54:27.873 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.857+0000 7f93d62d6640 1 --2- 172.21.15.39:0/1219081940 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93d01e9aa0 0x7f93d01e9f20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f93d00d0ef0 tx=0x7f93c8009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:27.873 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.861+0000 7f93c67fc640 1 -- 172.21.15.39:0/1219081940 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c800e070 con 0x7f93d01e9aa0 2023-05-16T13:54:27.873 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.861+0000 7f93c67fc640 1 -- 172.21.15.39:0/1219081940 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93c8003bb0 con 0x7f93d01e9aa0 2023-05-16T13:54:27.873 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.861+0000 7f93c67fc640 1 -- 172.21.15.39:0/1219081940 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c8003d40 con 0x7f93d01e9aa0 2023-05-16T13:54:27.873 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.861+0000 7f93d7d39640 1 -- 172.21.15.39:0/1219081940 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93d00b1470 con 0x7f93d01e9aa0 2023-05-16T13:54:27.874 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.861+0000 7f93d7d39640 1 -- 172.21.15.39:0/1219081940 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93d006b7b0 con 0x7f93d01e9aa0 2023-05-16T13:54:27.875 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.861+0000 7f93d7d39640 1 -- 172.21.15.39:0/1219081940 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93d00b52a0 con 0x7f93d01e9aa0 2023-05-16T13:54:27.875 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.861+0000 7f93c67fc640 1 -- 172.21.15.39:0/1219081940 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f93c8004030 con 0x7f93d01e9aa0 2023-05-16T13:54:27.876 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.861+0000 7f93c67fc640 1 --2- 172.21.15.39:0/1219081940 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f93b4066280 0x7f93b4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:27.876 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.861+0000 7f93c67fc640 1 -- 172.21.15.39:0/1219081940 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f93c8083ea0 con 0x7f93d01e9aa0 2023-05-16T13:54:27.876 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.861+0000 7f93d5ad5640 1 --2- 172.21.15.39:0/1219081940 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f93b4066280 0x7f93b4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:27.876 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.861+0000 7f93d5ad5640 1 --2- 172.21.15.39:0/1219081940 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f93b4066280 0x7f93b4068730 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f93cc0af000 tx=0x7f93cc0046d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:27.877 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:27.865+0000 7f93c67fc640 1 -- 172.21.15.39:0/1219081940 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f93c8051330 con 0x7f93d01e9aa0 2023-05-16T13:54:28.030 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.021+0000 7f93d7d39640 1 -- 172.21.15.39:0/1219081940 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f93d0160980 con 0x7f93d01e9aa0 2023-05-16T13:54:28.031 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.021+0000 7f93c67fc640 1 -- 172.21.15.39:0/1219081940 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f93c8054950 con 0x7f93d01e9aa0 2023-05-16T13:54:28.031 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 64 2023-05-16T13:54:28.033 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.025+0000 7f93d7d39640 1 -- 172.21.15.39:0/1219081940 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f93b4066280 msgr2=0x7f93b4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:28.033 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.025+0000 7f93d7d39640 1 --2- 172.21.15.39:0/1219081940 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f93b4066280 0x7f93b4068730 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f93cc0af000 tx=0x7f93cc0046d0 comp rx=0 tx=0).stop 2023-05-16T13:54:28.033 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.025+0000 7f93d7d39640 1 -- 172.21.15.39:0/1219081940 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93d01e9aa0 msgr2=0x7f93d01e9f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:28.033 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.025+0000 7f93d7d39640 1 --2- 172.21.15.39:0/1219081940 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93d01e9aa0 0x7f93d01e9f20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f93d00d0ef0 tx=0x7f93c8009f90 comp rx=0 tx=0).stop 2023-05-16T13:54:28.033 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.025+0000 7f93d7d39640 1 -- 172.21.15.39:0/1219081940 shutdown_connections 2023-05-16T13:54:28.033 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.025+0000 7f93d7d39640 1 --2- 172.21.15.39:0/1219081940 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93d01e9aa0 0x7f93d01e9f20 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:28.034 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.025+0000 7f93d7d39640 1 --2- 172.21.15.39:0/1219081940 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93d01e7940 0x7f93d01e7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:28.034 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.025+0000 7f93d7d39640 1 --2- 172.21.15.39:0/1219081940 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f93b4066280 0x7f93b4068730 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:28.034 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.025+0000 7f93d7d39640 1 --2- 172.21.15.39:0/1219081940 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93bc003980 0x7f93d015dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:28.034 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.025+0000 7f93d7d39640 1 -- 172.21.15.39:0/1219081940 >> 172.21.15.39:0/1219081940 conn(0x7f93d009bba0 msgr2=0x7f93d00b8020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:28.034 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.025+0000 7f93d7d39640 1 -- 172.21.15.39:0/1219081940 shutdown_connections 2023-05-16T13:54:28.034 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.025+0000 7f93d7d39640 1 -- 172.21.15.39:0/1219081940 wait complete. 2023-05-16T13:54:28.051 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-16T13:54:28.189 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.181+0000 7f3d988c4640 1 Processor -- start 2023-05-16T13:54:28.189 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.181+0000 7f3d988c4640 1 -- start start 2023-05-16T13:54:28.190 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.181+0000 7f3d988c4640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3d94160670 0x7f3d94071330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:28.190 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.181+0000 7f3d988c4640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d940ca3c0 con 0x7f3d941602a0 2023-05-16T13:54:28.190 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.181+0000 7f3d988c4640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d94164c70 con 0x7f3d940c89f0 2023-05-16T13:54:28.191 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.181+0000 7f3d988c4640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d940ca640 con 0x7f3d94160670 2023-05-16T13:54:28.191 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.181+0000 7f3d9259c640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f3d941602a0 0x7f3d94070c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:60880/0 (socket says 172.21.15.39:60880) 2023-05-16T13:54:28.191 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.181+0000 7f3d9259c640 1 -- 172.21.15.39:0/422614836 learned_addr learned my addr 172.21.15.39:0/422614836 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:28.193 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.181+0000 7f3d8bfff640 1 --2- 172.21.15.39:0/422614836 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3d94160670 0x7f3d94071330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:28.193 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.181+0000 7f3d91d9b640 1 -- 172.21.15.39:0/422614836 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3347896335 0 0) 0x7f3d940ca3c0 con 0x7f3d941602a0 2023-05-16T13:54:28.193 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.181+0000 7f3d91d9b640 1 -- 172.21.15.39:0/422614836 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d80003530 con 0x7f3d941602a0 2023-05-16T13:54:28.194 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.181+0000 7f3d91d9b640 1 -- 172.21.15.39:0/422614836 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1284912816 0 0) 0x7f3d94164c70 con 0x7f3d940c89f0 2023-05-16T13:54:28.194 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.181+0000 7f3d91d9b640 1 -- 172.21.15.39:0/422614836 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d940ca3c0 con 0x7f3d940c89f0 2023-05-16T13:54:28.194 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.181+0000 7f3d91d9b640 1 -- 172.21.15.39:0/422614836 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 907632903 0 0) 0x7f3d80003530 con 0x7f3d941602a0 2023-05-16T13:54:28.194 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.181+0000 7f3d91d9b640 1 -- 172.21.15.39:0/422614836 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3d94160670 msgr2=0x7f3d94071330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:28.194 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.181+0000 7f3d91d9b640 1 --2- 172.21.15.39:0/422614836 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3d94160670 0x7f3d94071330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:28.194 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.181+0000 7f3d91d9b640 1 -- 172.21.15.39:0/422614836 >> v1:172.21.15.118:6789/0 conn(0x7f3d940c89f0 legacy=0x7f3d940cac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:28.195 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.181+0000 7f3d91d9b640 1 -- 172.21.15.39:0/422614836 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d940ca920 con 0x7f3d941602a0 2023-05-16T13:54:28.195 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.181+0000 7f3d91d9b640 1 -- 172.21.15.39:0/422614836 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1738805496 0 0) 0x7f3d84001680 con 0x7f3d941602a0 2023-05-16T13:54:28.195 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.181+0000 7f3d91d9b640 1 -- 172.21.15.39:0/422614836 >> v1:172.21.15.39:6789/0 conn(0x7f3d941602a0 legacy=0x7f3d94070c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:28.195 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.181+0000 7f3d91d9b640 1 --2- 172.21.15.39:0/422614836 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d80003bb0 0x7f3d80003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:28.195 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.181+0000 7f3d91d9b640 1 --2- 172.21.15.39:0/422614836 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3d94160670 0x7f3d800047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:28.195 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.181+0000 7f3d91d9b640 1 --2- 172.21.15.39:0/422614836 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d80004d10 0x7f3d80005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:28.195 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.181+0000 7f3d91d9b640 1 -- 172.21.15.39:0/422614836 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d940ca640 con 0x7f3d80004d10 2023-05-16T13:54:28.196 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.181+0000 7f3d91d9b640 1 -- 172.21.15.39:0/422614836 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8000ba70 con 0x7f3d80003bb0 2023-05-16T13:54:28.196 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.181+0000 7f3d91d9b640 1 -- 172.21.15.39:0/422614836 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8000bc30 con 0x7f3d94160670 2023-05-16T13:54:28.196 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.181+0000 7f3d92d9d640 1 --2- 172.21.15.39:0/422614836 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d80004d10 0x7f3d80005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:28.196 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.185+0000 7f3d9259c640 1 --2- 172.21.15.39:0/422614836 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d80003bb0 0x7f3d80003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:28.196 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.185+0000 7f3d8bfff640 1 --2- 172.21.15.39:0/422614836 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3d94160670 0x7f3d800047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:28.196 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.185+0000 7f3d92d9d640 1 -- 172.21.15.39:0/422614836 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3d94160670 msgr2=0x7f3d800047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:28.196 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.185+0000 7f3d92d9d640 1 --2- 172.21.15.39:0/422614836 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3d94160670 0x7f3d800047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:28.197 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.185+0000 7f3d92d9d640 1 -- 172.21.15.39:0/422614836 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d80003bb0 msgr2=0x7f3d80003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:28.197 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.185+0000 7f3d92d9d640 1 --2- 172.21.15.39:0/422614836 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d80003bb0 0x7f3d80003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:28.197 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.185+0000 7f3d92d9d640 1 -- 172.21.15.39:0/422614836 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d80003530 con 0x7f3d80004d10 2023-05-16T13:54:28.198 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.185+0000 7f3d92d9d640 1 --2- 172.21.15.39:0/422614836 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d80004d10 0x7f3d80005180 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c001fd0 tx=0x7f3d8c01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a864311ff22481f server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:28.198 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.185+0000 7f3d91d9b640 1 -- 172.21.15.39:0/422614836 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c003b80 con 0x7f3d80004d10 2023-05-16T13:54:28.198 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.185+0000 7f3d91d9b640 1 -- 172.21.15.39:0/422614836 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d8c003d00 con 0x7f3d80004d10 2023-05-16T13:54:28.198 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.185+0000 7f3d91d9b640 1 -- 172.21.15.39:0/422614836 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c005310 con 0x7f3d80004d10 2023-05-16T13:54:28.199 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.189+0000 7f3d988c4640 1 -- 172.21.15.39:0/422614836 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d80004d10 msgr2=0x7f3d80005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:28.199 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.189+0000 7f3d988c4640 1 --2- 172.21.15.39:0/422614836 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d80004d10 0x7f3d80005180 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c001fd0 tx=0x7f3d8c01c8e0 comp rx=0 tx=0).stop 2023-05-16T13:54:28.199 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.189+0000 7f3d92d9d640 1 -- 172.21.15.39:0/422614836 reap_dead start 2023-05-16T13:54:28.199 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.189+0000 7f3d988c4640 1 -- 172.21.15.39:0/422614836 shutdown_connections 2023-05-16T13:54:28.199 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.189+0000 7f3d988c4640 1 -- 172.21.15.39:0/422614836 >> 172.21.15.39:0/422614836 conn(0x7f3d94069a50 msgr2=0x7f3d94069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:28.199 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.189+0000 7f3d988c4640 1 -- 172.21.15.39:0/422614836 shutdown_connections 2023-05-16T13:54:28.199 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.189+0000 7f3d988c4640 1 -- 172.21.15.39:0/422614836 wait complete. 2023-05-16T13:54:28.200 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.189+0000 7f3d988c4640 1 Processor -- start 2023-05-16T13:54:28.200 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.189+0000 7f3d988c4640 1 -- start start 2023-05-16T13:54:28.202 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.189+0000 7f3d988c4640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d80004d10 0x7f3d94154820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:28.202 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.189+0000 7f3d988c4640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3d940ae2d0 0x7f3d940ae720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:28.202 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.189+0000 7f3d988c4640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d940b1230 0x7f3d940b16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:28.202 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.189+0000 7f3d988c4640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d940aec60 con 0x7f3d80004d10 2023-05-16T13:54:28.202 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.189+0000 7f3d988c4640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d940c7190 con 0x7f3d940b1230 2023-05-16T13:54:28.203 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.189+0000 7f3d988c4640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d940c7470 con 0x7f3d940ae2d0 2023-05-16T13:54:28.203 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.189+0000 7f3d9259c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d80004d10 0x7f3d94154820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:28.203 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.189+0000 7f3d9259c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d80004d10 0x7f3d94154820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60330/0 (socket says 172.21.15.39:60330) 2023-05-16T13:54:28.203 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.189+0000 7f3d9259c640 1 -- 172.21.15.39:0/3263602258 learned_addr learned my addr 172.21.15.39:0/3263602258 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:28.203 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.189+0000 7f3d92d9d640 1 --2- 172.21.15.39:0/3263602258 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d940b1230 0x7f3d940b16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:28.203 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.189+0000 7f3d8bfff640 1 --2- 172.21.15.39:0/3263602258 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3d940ae2d0 0x7f3d940ae720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:28.203 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.189+0000 7f3d9259c640 1 -- 172.21.15.39:0/3263602258 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3d940ae2d0 msgr2=0x7f3d940ae720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:28.204 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.189+0000 7f3d9259c640 1 --2- 172.21.15.39:0/3263602258 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3d940ae2d0 0x7f3d940ae720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:28.204 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.189+0000 7f3d9259c640 1 -- 172.21.15.39:0/3263602258 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d940b1230 msgr2=0x7f3d940b16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:28.204 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.189+0000 7f3d9259c640 1 --2- 172.21.15.39:0/3263602258 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d940b1230 0x7f3d940b16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:28.204 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.189+0000 7f3d9259c640 1 -- 172.21.15.39:0/3263602258 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d940ce540 con 0x7f3d80004d10 2023-05-16T13:54:28.204 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.193+0000 7f3d9259c640 1 --2- 172.21.15.39:0/3263602258 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d80004d10 0x7f3d94154820 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3d84004f50 tx=0x7f3d840074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:28.204 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.193+0000 7f3d8affd640 1 -- 172.21.15.39:0/3263602258 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d84007740 con 0x7f3d80004d10 2023-05-16T13:54:28.204 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.193+0000 7f3d8affd640 1 -- 172.21.15.39:0/3263602258 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d8400f940 con 0x7f3d80004d10 2023-05-16T13:54:28.205 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.193+0000 7f3d8affd640 1 -- 172.21.15.39:0/3263602258 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8400fcf0 con 0x7f3d80004d10 2023-05-16T13:54:28.205 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.193+0000 7f3d988c4640 1 -- 172.21.15.39:0/3263602258 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d94164960 con 0x7f3d80004d10 2023-05-16T13:54:28.205 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.193+0000 7f3d988c4640 1 -- 172.21.15.39:0/3263602258 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d940ce6d0 con 0x7f3d80004d10 2023-05-16T13:54:28.205 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.193+0000 7f3d988c4640 1 -- 172.21.15.39:0/3263602258 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d94073c90 con 0x7f3d80004d10 2023-05-16T13:54:28.205 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.193+0000 7f3d8affd640 1 -- 172.21.15.39:0/3263602258 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3d8401d460 con 0x7f3d80004d10 2023-05-16T13:54:28.206 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.193+0000 7f3d8affd640 1 --2- 172.21.15.39:0/3263602258 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f3d740662b0 0x7f3d74068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:28.206 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.193+0000 7f3d8affd640 1 -- 172.21.15.39:0/3263602258 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3d84083cd0 con 0x7f3d80004d10 2023-05-16T13:54:28.206 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.193+0000 7f3d8bfff640 1 --2- 172.21.15.39:0/3263602258 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f3d740662b0 0x7f3d74068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:28.206 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.197+0000 7f3d8bfff640 1 --2- 172.21.15.39:0/3263602258 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f3d740662b0 0x7f3d74068760 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3d940c5100 tx=0x7f3d7c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:28.207 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.197+0000 7f3d8affd640 1 -- 172.21.15.39:0/3263602258 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f3d840511e0 con 0x7f3d80004d10 2023-05-16T13:54:28.392 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.385+0000 7f3d988c4640 1 -- 172.21.15.39:0/3263602258 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3d9406c370 con 0x7f3d80004d10 2023-05-16T13:54:28.392 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.385+0000 7f3d8affd640 1 -- 172.21.15.39:0/3263602258 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4668 (secure 0 0 0) 0x7f3d84054800 con 0x7f3d80004d10 2023-05-16T13:54:28.393 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:54:28.393 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2374269620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":2374269620},{"type":"v1","addr":"172.21.15.118:6835","nonce":2374269620}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/3803055359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3803055359},{"type":"v1","addr":"172.21.15.118:6833","nonce":3803055359}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4308,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6836/3259535605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":3259535605},{"type":"v1","addr":"172.21.15.39:6836","nonce":3259535605}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-16T13:54:15.191894+0000","modified":"2023-05-16T13:54:18.210603+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4311},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4311":{"gid":4311,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.39:6837/616280162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6835","nonce":616280162},{"type":"v1","addr":"172.21.15.39:6837","nonce":616280162}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-16T13:54:28.393 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 8 2023-05-16T13:54:28.395 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.385+0000 7f3d988c4640 1 -- 172.21.15.39:0/3263602258 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f3d740662b0 msgr2=0x7f3d74068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:28.395 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.385+0000 7f3d988c4640 1 --2- 172.21.15.39:0/3263602258 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f3d740662b0 0x7f3d74068760 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3d940c5100 tx=0x7f3d7c008040 comp rx=0 tx=0).stop 2023-05-16T13:54:28.395 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.385+0000 7f3d988c4640 1 -- 172.21.15.39:0/3263602258 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d80004d10 msgr2=0x7f3d94154820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:28.395 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.385+0000 7f3d988c4640 1 --2- 172.21.15.39:0/3263602258 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d80004d10 0x7f3d94154820 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3d84004f50 tx=0x7f3d840074f0 comp rx=0 tx=0).stop 2023-05-16T13:54:28.395 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.385+0000 7f3d988c4640 1 -- 172.21.15.39:0/3263602258 shutdown_connections 2023-05-16T13:54:28.395 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.385+0000 7f3d988c4640 1 --2- 172.21.15.39:0/3263602258 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f3d740662b0 0x7f3d74068760 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:28.395 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.385+0000 7f3d988c4640 1 --2- 172.21.15.39:0/3263602258 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3d940ae2d0 0x7f3d940ae720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:28.396 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.385+0000 7f3d988c4640 1 --2- 172.21.15.39:0/3263602258 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3d940b1230 0x7f3d940b16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:28.396 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.385+0000 7f3d988c4640 1 --2- 172.21.15.39:0/3263602258 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d80004d10 0x7f3d94154820 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:28.396 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.385+0000 7f3d988c4640 1 -- 172.21.15.39:0/3263602258 >> 172.21.15.39:0/3263602258 conn(0x7f3d94069a50 msgr2=0x7f3d94070c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:28.396 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.385+0000 7f3d988c4640 1 -- 172.21.15.39:0/3263602258 shutdown_connections 2023-05-16T13:54:28.396 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.385+0000 7f3d988c4640 1 -- 172.21.15.39:0/3263602258 wait complete. 2023-05-16T13:54:28.413 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-16T13:54:28.549 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.541+0000 7f67d54fc640 1 Processor -- start 2023-05-16T13:54:28.550 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.541+0000 7f67d54fc640 1 -- start start 2023-05-16T13:54:28.551 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.541+0000 7f67d54fc640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f67d0158bf0 0x7f67d015d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:28.551 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.541+0000 7f67d54fc640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f67d00703b0 0x7f67d00cadb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:28.552 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.541+0000 7f67d54fc640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f67d00cb2f0 0x7f67d006bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:28.552 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.541+0000 7f67d54fc640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67d015d6a0 con 0x7f67d00cb2f0 2023-05-16T13:54:28.552 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.541+0000 7f67d54fc640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67d00cb730 con 0x7f67d00703b0 2023-05-16T13:54:28.552 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.541+0000 7f67d54fc640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67d0070870 con 0x7f67d0158bf0 2023-05-16T13:54:28.552 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.541+0000 7f67cf7fe640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f67d00cb2f0 0x7f67d006bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:28.552 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.541+0000 7f67cf7fe640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f67d00cb2f0 0x7f67d006bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60338/0 (socket says 172.21.15.39:60338) 2023-05-16T13:54:28.553 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.541+0000 7f67cf7fe640 1 -- 172.21.15.39:0/1300545788 learned_addr learned my addr 172.21.15.39:0/1300545788 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:28.553 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.541+0000 7f67cf7fe640 1 -- 172.21.15.39:0/1300545788 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f67d0158bf0 msgr2=0x7f67d015d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:28.553 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.541+0000 7f67cf7fe640 1 --2- 172.21.15.39:0/1300545788 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f67d0158bf0 0x7f67d015d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:28.553 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.541+0000 7f67cf7fe640 1 -- 172.21.15.39:0/1300545788 >> v2:172.21.15.118:3300/0 conn(0x7f67d00703b0 msgr2=0x7f67d00cadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:28.553 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.541+0000 7f67cf7fe640 1 --2- 172.21.15.39:0/1300545788 >> v2:172.21.15.118:3300/0 conn(0x7f67d00703b0 0x7f67d00cadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:28.553 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.541+0000 7f67cf7fe640 1 -- 172.21.15.39:0/1300545788 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67d0070b50 con 0x7f67d00cb2f0 2023-05-16T13:54:28.554 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.545+0000 7f67cf7fe640 1 --2- 172.21.15.39:0/1300545788 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f67d00cb2f0 0x7f67d006bc00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f67d006cd00 tx=0x7f67c801e850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d103e3efe8c71a43 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:28.554 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.545+0000 7f67ce7fc640 1 -- 172.21.15.39:0/1300545788 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c80a78e0 con 0x7f67d00cb2f0 2023-05-16T13:54:28.555 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.545+0000 7f67ce7fc640 1 -- 172.21.15.39:0/1300545788 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67c80a7a40 con 0x7f67d00cb2f0 2023-05-16T13:54:28.555 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.545+0000 7f67ce7fc640 1 -- 172.21.15.39:0/1300545788 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c80a7dd0 con 0x7f67d00cb2f0 2023-05-16T13:54:28.555 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.545+0000 7f67d54fc640 1 -- 172.21.15.39:0/1300545788 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f67d00cb2f0 msgr2=0x7f67d006bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:28.556 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.545+0000 7f67d54fc640 1 --2- 172.21.15.39:0/1300545788 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f67d00cb2f0 0x7f67d006bc00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f67d006cd00 tx=0x7f67c801e850 comp rx=0 tx=0).stop 2023-05-16T13:54:28.556 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.545+0000 7f67d54fc640 1 -- 172.21.15.39:0/1300545788 shutdown_connections 2023-05-16T13:54:28.556 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.545+0000 7f67d54fc640 1 --2- 172.21.15.39:0/1300545788 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f67d00cb2f0 0x7f67d006bc00 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:28.556 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.545+0000 7f67d54fc640 1 --2- 172.21.15.39:0/1300545788 >> v2:172.21.15.118:3300/0 conn(0x7f67d00703b0 0x7f67d00cadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:28.556 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.545+0000 7f67d54fc640 1 --2- 172.21.15.39:0/1300545788 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f67d0158bf0 0x7f67d015d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:28.556 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.545+0000 7f67d54fc640 1 -- 172.21.15.39:0/1300545788 >> 172.21.15.39:0/1300545788 conn(0x7f67d0069a50 msgr2=0x7f67d0069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:28.557 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.545+0000 7f67d54fc640 1 -- 172.21.15.39:0/1300545788 shutdown_connections 2023-05-16T13:54:28.557 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.545+0000 7f67d54fc640 1 -- 172.21.15.39:0/1300545788 wait complete. 2023-05-16T13:54:28.558 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.549+0000 7f67d54fc640 1 Processor -- start 2023-05-16T13:54:28.558 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.549+0000 7f67d54fc640 1 -- start start 2023-05-16T13:54:28.558 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.549+0000 7f67d54fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f67d00703b0 0x7f67d0159150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:28.558 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.549+0000 7f67d54fc640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f67d00cb2f0 0x7f67d015b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:28.558 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.549+0000 7f67d54fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f67d0158bf0 0x7f67d0069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:28.558 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.549+0000 7f67d54fc640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67d0159aa0 con 0x7f67d0158bf0 2023-05-16T13:54:28.559 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.549+0000 7f67d54fc640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67d00addb0 con 0x7f67d00703b0 2023-05-16T13:54:28.559 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.549+0000 7f67d54fc640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67d00ae090 con 0x7f67d00cb2f0 2023-05-16T13:54:28.559 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.549+0000 7f67cf7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f67d0158bf0 0x7f67d0069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:28.559 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.549+0000 7f67cf7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f67d0158bf0 0x7f67d0069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60340/0 (socket says 172.21.15.39:60340) 2023-05-16T13:54:28.559 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.549+0000 7f67cf7fe640 1 -- 172.21.15.39:0/2137562863 learned_addr learned my addr 172.21.15.39:0/2137562863 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:28.560 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.549+0000 7f67cf7fe640 1 -- 172.21.15.39:0/2137562863 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f67d00cb2f0 msgr2=0x7f67d015b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:28.560 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.549+0000 7f67cf7fe640 1 --2- 172.21.15.39:0/2137562863 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f67d00cb2f0 0x7f67d015b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:28.560 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.549+0000 7f67cf7fe640 1 -- 172.21.15.39:0/2137562863 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f67d00703b0 msgr2=0x7f67d0159150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:28.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.549+0000 7f67cf7fe640 1 --2- 172.21.15.39:0/2137562863 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f67d00703b0 0x7f67d0159150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:28.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.549+0000 7f67cf7fe640 1 -- 172.21.15.39:0/2137562863 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67c800b770 con 0x7f67d0158bf0 2023-05-16T13:54:28.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.549+0000 7f67cf7fe640 1 --2- 172.21.15.39:0/2137562863 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f67d0158bf0 0x7f67d0069e20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f67c800b2c0 tx=0x7f67c801d090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:28.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.549+0000 7f67c77fe640 1 -- 172.21.15.39:0/2137562863 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c80afb80 con 0x7f67d0158bf0 2023-05-16T13:54:28.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.549+0000 7f67c77fe640 1 -- 172.21.15.39:0/2137562863 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67c80afd00 con 0x7f67d0158bf0 2023-05-16T13:54:28.562 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.549+0000 7f67c77fe640 1 -- 172.21.15.39:0/2137562863 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c80ba690 con 0x7f67d0158bf0 2023-05-16T13:54:28.562 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.549+0000 7f67d54fc640 1 -- 172.21.15.39:0/2137562863 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67d0158fc0 con 0x7f67d0158bf0 2023-05-16T13:54:28.562 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.549+0000 7f67d54fc640 1 -- 172.21.15.39:0/2137562863 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67d00713f0 con 0x7f67d0158bf0 2023-05-16T13:54:28.562 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.553+0000 7f67d54fc640 1 -- 172.21.15.39:0/2137562863 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67d00ad950 con 0x7f67d0158bf0 2023-05-16T13:54:28.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.553+0000 7f67c77fe640 1 -- 172.21.15.39:0/2137562863 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f67c80b6070 con 0x7f67d0158bf0 2023-05-16T13:54:28.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.553+0000 7f67c77fe640 1 --2- 172.21.15.39:0/2137562863 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f67b0066280 0x7f67b0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:28.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.553+0000 7f67c77fe640 1 -- 172.21.15.39:0/2137562863 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f67c811efe0 con 0x7f67d0158bf0 2023-05-16T13:54:28.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.553+0000 7f67ceffd640 1 --2- 172.21.15.39:0/2137562863 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f67b0066280 0x7f67b0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:28.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.553+0000 7f67ceffd640 1 --2- 172.21.15.39:0/2137562863 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f67b0066280 0x7f67b0068730 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f67d00c5590 tx=0x7f67c0009250 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:28.566 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.557+0000 7f67c77fe640 1 -- 172.21.15.39:0/2137562863 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f67c80ec400 con 0x7f67d0158bf0 2023-05-16T13:54:28.722 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.713+0000 7f67d54fc640 1 -- 172.21.15.39:0/2137562863 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f67d0073c90 con 0x7f67d0158bf0 2023-05-16T13:54:28.723 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.713+0000 7f67c77fe640 1 -- 172.21.15.39:0/2137562863 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18279 (secure 0 0 0) 0x7f67c80be020 con 0x7f67d0158bf0 2023-05-16T13:54:28.724 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:54:28.724 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":24,"fsid":"9c1e210b-c515-4ea4-a065-397956895c68","created":"2023-05-16T13:53:48.955290+0000","modified":"2023-05-16T13:54:16.194544+0000","last_up_change":"2023-05-16T13:54:01.722051+0000","last_in_change":"2023-05-16T13:53:52.331336+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-16T13:54:00.885009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-16T13:54:08.327895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-16T13:54:12.864823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-16T13:54:14.180225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4ce0f0ba-c4bf-4405-8c95-d2e9a62878ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6809","nonce":3462013698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6811","nonce":3462013698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6815","nonce":3462013698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6813","nonce":3462013698}]},"public_addr":"172.21.15.39:6809/3462013698","cluster_addr":"172.21.15.39:6811/3462013698","heartbeat_back_addr":"172.21.15.39:6815/3462013698","heartbeat_front_addr":"172.21.15.39:6813/3462013698","state":["exists","up"]},{"osd":1,"uuid":"53fdc1ac-2473-472d-af32-2760fdf6e476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6801","nonce":2829970892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6803","nonce":2829970892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6807","nonce":2829970892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6805","nonce":2829970892}]},"public_addr":"172.21.15.39:6801/2829970892","cluster_addr":"172.21.15.39:6803/2829970892","heartbeat_back_addr":"172.21.15.39:6807/2829970892","heartbeat_front_addr":"172.21.15.39:6805/2829970892","state":["exists","up"]},{"osd":2,"uuid":"0b92d770-7030-42fa-a19f-4f7f1ac113c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6817","nonce":3888067413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6819","nonce":3888067413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6823","nonce":3888067413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6821","nonce":3888067413}]},"public_addr":"172.21.15.39:6817/3888067413","cluster_addr":"172.21.15.39:6819/3888067413","heartbeat_back_addr":"172.21.15.39:6823/3888067413","heartbeat_front_addr":"172.21.15.39:6821/3888067413","state":["exists","up"]},{"osd":3,"uuid":"000d9506-cbb2-4017-b875-deca579860ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6825","nonce":405003958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6827","nonce":405003958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6831","nonce":405003958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6829","nonce":405003958}]},"public_addr":"172.21.15.39:6825/405003958","cluster_addr":"172.21.15.39:6827/405003958","heartbeat_back_addr":"172.21.15.39:6831/405003958","heartbeat_front_addr":"172.21.15.39:6829/405003958","state":["exists","up"]},{"osd":4,"uuid":"70f0dacb-e960-40c5-bf6a-183e52bbe2ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6801","nonce":3895278838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6805","nonce":3895278838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6813","nonce":3895278838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6809","nonce":3895278838}]},"public_addr":"172.21.15.118:6801/3895278838","cluster_addr":"172.21.15.118:6805/3895278838","heartbeat_back_addr":"172.21.15.118:6813/3895278838","heartbeat_front_addr":"172.21.15.118:6809/3895278838","state":["exists","up"]},{"osd":5,"uuid":"756feb54-c3ae-4a2a-8f74-85c291ba707c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6804","nonce":3513592808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6808","nonce":3513592808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6815","nonce":3513592808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6812","nonce":3513592808}]},"public_addr":"172.21.15.118:6804/3513592808","cluster_addr":"172.21.15.118:6808/3513592808","heartbeat_back_addr":"172.21.15.118:6815/3513592808","heartbeat_front_addr":"172.21.15.118:6812/3513592808","state":["exists","up"]},{"osd":6,"uuid":"c4a982c1-f497-4b0f-8a23-c77372e4621e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6824","nonce":1863656053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6827","nonce":1863656053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6831","nonce":1863656053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6829","nonce":1863656053}]},"public_addr":"172.21.15.118:6824/1863656053","cluster_addr":"172.21.15.118:6827/1863656053","heartbeat_back_addr":"172.21.15.118:6831/1863656053","heartbeat_front_addr":"172.21.15.118:6829/1863656053","state":["exists","up"]},{"osd":7,"uuid":"6f2888aa-a7ac-4e26-9159-e31817934f44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6817","nonce":3636642904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6819","nonce":3636642904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6825","nonce":3636642904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6821","nonce":3636642904}]},"public_addr":"172.21.15.118:6817/3636642904","cluster_addr":"172.21.15.118:6819/3636642904","heartbeat_back_addr":"172.21.15.118:6825/3636642904","heartbeat_front_addr":"172.21.15.118:6821/3636642904","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.717636+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.724036+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.739144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:58.079275+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:58.073921+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.930466+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.987813+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.941098+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-16T13:54:28.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.717+0000 7f67d54fc640 1 -- 172.21.15.39:0/2137562863 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f67b0066280 msgr2=0x7f67b0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:28.726 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.717+0000 7f67d54fc640 1 --2- 172.21.15.39:0/2137562863 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f67b0066280 0x7f67b0068730 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f67d00c5590 tx=0x7f67c0009250 comp rx=0 tx=0).stop 2023-05-16T13:54:28.726 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.717+0000 7f67d54fc640 1 -- 172.21.15.39:0/2137562863 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f67d0158bf0 msgr2=0x7f67d0069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:28.726 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.717+0000 7f67d54fc640 1 --2- 172.21.15.39:0/2137562863 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f67d0158bf0 0x7f67d0069e20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f67c800b2c0 tx=0x7f67c801d090 comp rx=0 tx=0).stop 2023-05-16T13:54:28.726 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.717+0000 7f67d54fc640 1 -- 172.21.15.39:0/2137562863 shutdown_connections 2023-05-16T13:54:28.726 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.717+0000 7f67d54fc640 1 --2- 172.21.15.39:0/2137562863 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f67b0066280 0x7f67b0068730 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:28.726 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.717+0000 7f67d54fc640 1 --2- 172.21.15.39:0/2137562863 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f67d00cb2f0 0x7f67d015b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:28.727 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.717+0000 7f67d54fc640 1 --2- 172.21.15.39:0/2137562863 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f67d0158bf0 0x7f67d0069e20 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:28.727 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.717+0000 7f67d54fc640 1 --2- 172.21.15.39:0/2137562863 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f67d00703b0 0x7f67d0159150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:28.727 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.717+0000 7f67d54fc640 1 -- 172.21.15.39:0/2137562863 >> 172.21.15.39:0/2137562863 conn(0x7f67d0069a50 msgr2=0x7f67d01561f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:28.727 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.717+0000 7f67d54fc640 1 -- 172.21.15.39:0/2137562863 shutdown_connections 2023-05-16T13:54:28.727 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.717+0000 7f67d54fc640 1 -- 172.21.15.39:0/2137562863 wait complete. 2023-05-16T13:54:28.745 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-16T13:54:00.885009+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-16T13:54:08.327895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-16T13:54:12.864823+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-16T13:54:14.180225+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-16T13:54:28.745 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-16T13:54:28.887 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.877+0000 7f28514fc640 1 Processor -- start 2023-05-16T13:54:28.887 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.877+0000 7f28514fc640 1 -- start start 2023-05-16T13:54:28.889 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.877+0000 7f28514fc640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f284c06c690 0x7f284c0b0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:28.889 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.881+0000 7f28514fc640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f284c06b520 con 0x7f284c15c490 2023-05-16T13:54:28.889 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.881+0000 7f28514fc640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f284c06cb10 con 0x7f284c0b1a70 2023-05-16T13:54:28.889 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.881+0000 7f28514fc640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f284c0cee10 con 0x7f284c06c690 2023-05-16T13:54:28.890 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.881+0000 7f284affd640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f284c15c490 0x7f284c0ad300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:60886/0 (socket says 172.21.15.39:60886) 2023-05-16T13:54:28.890 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.881+0000 7f284affd640 1 -- 172.21.15.39:0/1630983902 learned_addr learned my addr 172.21.15.39:0/1630983902 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:28.890 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.881+0000 7f284b7fe640 1 --2- 172.21.15.39:0/1630983902 >> v2:172.21.15.118:3300/0 conn(0x7f284c06c690 0x7f284c0b0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:28.890 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.881+0000 7f284a7fc640 1 -- 172.21.15.39:0/1630983902 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3249043374 0 0) 0x7f284c06b520 con 0x7f284c15c490 2023-05-16T13:54:28.890 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.881+0000 7f284a7fc640 1 -- 172.21.15.39:0/1630983902 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2838003530 con 0x7f284c15c490 2023-05-16T13:54:28.890 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.881+0000 7f284a7fc640 1 -- 172.21.15.39:0/1630983902 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1003589593 0 0) 0x7f284c06cb10 con 0x7f284c0b1a70 2023-05-16T13:54:28.890 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.881+0000 7f284a7fc640 1 -- 172.21.15.39:0/1630983902 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f284c06b520 con 0x7f284c0b1a70 2023-05-16T13:54:28.890 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.881+0000 7f284b7fe640 1 -- 172.21.15.39:0/1630983902 >> v1:172.21.15.118:6789/0 conn(0x7f284c0b1a70 legacy=0x7f284c06bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:28.891 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.881+0000 7f284b7fe640 1 -- 172.21.15.39:0/1630983902 >> v1:172.21.15.39:6789/0 conn(0x7f284c15c490 legacy=0x7f284c0ad300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:28.891 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.881+0000 7f284b7fe640 1 -- 172.21.15.39:0/1630983902 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f284c0ce570 con 0x7f284c06c690 2023-05-16T13:54:28.891 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.881+0000 7f284b7fe640 1 --2- 172.21.15.39:0/1630983902 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f284c06c690 0x7f284c0b0ab0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f28440097c0 tx=0x7f284401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa23014f97cccb30 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:28.892 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.885+0000 7f284a7fc640 1 -- 172.21.15.39:0/1630983902 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28440ab670 con 0x7f284c06c690 2023-05-16T13:54:28.892 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.885+0000 7f284a7fc640 1 -- 172.21.15.39:0/1630983902 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28440ab7d0 con 0x7f284c06c690 2023-05-16T13:54:28.892 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.885+0000 7f284a7fc640 1 -- 172.21.15.39:0/1630983902 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28440abb60 con 0x7f284c06c690 2023-05-16T13:54:28.893 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.885+0000 7f28514fc640 1 -- 172.21.15.39:0/1630983902 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f284c06c690 msgr2=0x7f284c0b0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:28.893 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.885+0000 7f28514fc640 1 --2- 172.21.15.39:0/1630983902 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f284c06c690 0x7f284c0b0ab0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f28440097c0 tx=0x7f284401c450 comp rx=0 tx=0).stop 2023-05-16T13:54:28.893 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.885+0000 7f28514fc640 1 -- 172.21.15.39:0/1630983902 shutdown_connections 2023-05-16T13:54:28.893 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.885+0000 7f28514fc640 1 --2- 172.21.15.39:0/1630983902 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f284c06c690 0x7f284c0b0ab0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:28.893 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.885+0000 7f28514fc640 1 -- 172.21.15.39:0/1630983902 >> 172.21.15.39:0/1630983902 conn(0x7f284c0999a0 msgr2=0x7f284c0d0670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:28.893 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.885+0000 7f28514fc640 1 -- 172.21.15.39:0/1630983902 shutdown_connections 2023-05-16T13:54:28.893 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.885+0000 7f28514fc640 1 -- 172.21.15.39:0/1630983902 wait complete. 2023-05-16T13:54:28.894 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.885+0000 7f28514fc640 1 Processor -- start 2023-05-16T13:54:28.894 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.885+0000 7f28514fc640 1 -- start start 2023-05-16T13:54:28.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.885+0000 7f28514fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f284c06c690 0x7f284c15f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:28.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.885+0000 7f28514fc640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f284c0b1a70 0x7f284c1577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:28.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.885+0000 7f28514fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f284c15c490 0x7f284c0b34a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:28.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.885+0000 7f28514fc640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f284c0b5470 con 0x7f284c15c490 2023-05-16T13:54:28.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.885+0000 7f28514fc640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f284c0b5750 con 0x7f284c06c690 2023-05-16T13:54:28.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.885+0000 7f28514fc640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f284c0b5a30 con 0x7f284c0b1a70 2023-05-16T13:54:28.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.885+0000 7f284b7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f284c15c490 0x7f284c0b34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:28.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.885+0000 7f284b7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f284c15c490 0x7f284c0b34a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60346/0 (socket says 172.21.15.39:60346) 2023-05-16T13:54:28.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.885+0000 7f284b7fe640 1 -- 172.21.15.39:0/1071178872 learned_addr learned my addr 172.21.15.39:0/1071178872 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:28.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.885+0000 7f284affd640 1 --2- 172.21.15.39:0/1071178872 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f284c06c690 0x7f284c15f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:28.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.885+0000 7f2843fff640 1 --2- 172.21.15.39:0/1071178872 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f284c0b1a70 0x7f284c1577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:28.897 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.889+0000 7f284b7fe640 1 -- 172.21.15.39:0/1071178872 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f284c0b1a70 msgr2=0x7f284c1577f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:28.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.889+0000 7f284b7fe640 1 --2- 172.21.15.39:0/1071178872 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f284c0b1a70 0x7f284c1577f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:28.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.889+0000 7f284b7fe640 1 -- 172.21.15.39:0/1071178872 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f284c06c690 msgr2=0x7f284c15f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:28.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.889+0000 7f284b7fe640 1 --2- 172.21.15.39:0/1071178872 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f284c06c690 0x7f284c15f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:28.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.889+0000 7f284b7fe640 1 -- 172.21.15.39:0/1071178872 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2844009420 con 0x7f284c15c490 2023-05-16T13:54:28.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.889+0000 7f284affd640 1 --2- 172.21.15.39:0/1071178872 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f284c06c690 0x7f284c15f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:54:28.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.889+0000 7f284b7fe640 1 --2- 172.21.15.39:0/1071178872 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f284c15c490 0x7f284c0b34a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2844019060 tx=0x7f284401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:28.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.889+0000 7f28437fe640 1 -- 172.21.15.39:0/1071178872 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28440bf610 con 0x7f284c15c490 2023-05-16T13:54:28.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.889+0000 7f28437fe640 1 -- 172.21.15.39:0/1071178872 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28440bf770 con 0x7f284c15c490 2023-05-16T13:54:28.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.889+0000 7f28514fc640 1 -- 172.21.15.39:0/1071178872 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f284c06ba60 con 0x7f284c15c490 2023-05-16T13:54:28.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.889+0000 7f28437fe640 1 -- 172.21.15.39:0/1071178872 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28440bfae0 con 0x7f284c15c490 2023-05-16T13:54:28.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.889+0000 7f28514fc640 1 -- 172.21.15.39:0/1071178872 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f284c06b780 con 0x7f284c15c490 2023-05-16T13:54:28.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.889+0000 7f28514fc640 1 -- 172.21.15.39:0/1071178872 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f284c0d0410 con 0x7f284c15c490 2023-05-16T13:54:28.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.889+0000 7f28437fe640 1 -- 172.21.15.39:0/1071178872 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f28440bfc40 con 0x7f284c15c490 2023-05-16T13:54:28.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.889+0000 7f28437fe640 1 --2- 172.21.15.39:0/1071178872 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f282c066280 0x7f282c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:28.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.889+0000 7f28437fe640 1 -- 172.21.15.39:0/1071178872 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f284411e9e0 con 0x7f284c15c490 2023-05-16T13:54:28.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.889+0000 7f284affd640 1 --2- 172.21.15.39:0/1071178872 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f282c066280 0x7f282c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:28.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.893+0000 7f284affd640 1 --2- 172.21.15.39:0/1071178872 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f282c066280 0x7f282c068730 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f283c0012f0 tx=0x7f283c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:28.903 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:28.897+0000 7f28437fe640 1 -- 172.21.15.39:0/1071178872 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f28440ebdd0 con 0x7f284c15c490 2023-05-16T13:54:29.056 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.049+0000 7f28514fc640 1 -- 172.21.15.39:0/1071178872 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f284c066e50 con 0x7f284c15c490 2023-05-16T13:54:29.057 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.049+0000 7f28437fe640 1 -- 172.21.15.39:0/1071178872 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f28440ef3f0 con 0x7f284c15c490 2023-05-16T13:54:29.057 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2023-05-16T13:54:29.059 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.049+0000 7f28514fc640 1 -- 172.21.15.39:0/1071178872 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f282c066280 msgr2=0x7f282c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:29.059 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.049+0000 7f28514fc640 1 --2- 172.21.15.39:0/1071178872 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f282c066280 0x7f282c068730 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f283c0012f0 tx=0x7f283c009040 comp rx=0 tx=0).stop 2023-05-16T13:54:29.059 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.049+0000 7f28514fc640 1 -- 172.21.15.39:0/1071178872 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f284c15c490 msgr2=0x7f284c0b34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:29.059 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.049+0000 7f28514fc640 1 --2- 172.21.15.39:0/1071178872 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f284c15c490 0x7f284c0b34a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2844019060 tx=0x7f284401ac90 comp rx=0 tx=0).stop 2023-05-16T13:54:29.059 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.049+0000 7f28514fc640 1 -- 172.21.15.39:0/1071178872 shutdown_connections 2023-05-16T13:54:29.059 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.049+0000 7f28514fc640 1 --2- 172.21.15.39:0/1071178872 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f282c066280 0x7f282c068730 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:29.060 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.049+0000 7f28514fc640 1 --2- 172.21.15.39:0/1071178872 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f284c0b1a70 0x7f284c1577f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:29.060 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.049+0000 7f28514fc640 1 --2- 172.21.15.39:0/1071178872 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f284c15c490 0x7f284c0b34a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:29.060 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.049+0000 7f28514fc640 1 --2- 172.21.15.39:0/1071178872 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f284c06c690 0x7f284c15f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:29.060 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.049+0000 7f28514fc640 1 -- 172.21.15.39:0/1071178872 >> 172.21.15.39:0/1071178872 conn(0x7f284c0999a0 msgr2=0x7f284c152570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:29.060 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.049+0000 7f28514fc640 1 -- 172.21.15.39:0/1071178872 shutdown_connections 2023-05-16T13:54:29.060 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.049+0000 7f28514fc640 1 -- 172.21.15.39:0/1071178872 wait complete. 2023-05-16T13:54:29.077 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-16T13:54:29.217 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.209+0000 7f125c441640 1 Processor -- start 2023-05-16T13:54:29.218 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.209+0000 7f125c441640 1 -- start start 2023-05-16T13:54:29.219 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.209+0000 7f125c441640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f125415c490 0x7f12540ad300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:29.219 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.209+0000 7f125c441640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f125406c690 0x7f12540b0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:29.219 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.209+0000 7f125c441640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f125406b520 con 0x7f12540b1a70 2023-05-16T13:54:29.219 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.209+0000 7f125c441640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12540cee10 con 0x7f125415c490 2023-05-16T13:54:29.219 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.209+0000 7f125c441640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12540ad840 con 0x7f125406c690 2023-05-16T13:54:29.220 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.209+0000 7f12599dc640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f12540b1a70 0x7f125406bf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:60900/0 (socket says 172.21.15.39:60900) 2023-05-16T13:54:29.220 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.209+0000 7f12599dc640 1 -- 172.21.15.39:0/286694078 learned_addr learned my addr 172.21.15.39:0/286694078 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:29.221 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.209+0000 7f125a1dd640 1 --2- 172.21.15.39:0/286694078 >> v2:172.21.15.118:3300/0 conn(0x7f125415c490 0x7f12540ad300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:29.221 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.209+0000 7f125a9de640 1 --2- 172.21.15.39:0/286694078 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f125406c690 0x7f12540b0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:29.221 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.213+0000 7f12591db640 1 -- 172.21.15.39:0/286694078 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3730315923 0 0) 0x7f125406b520 con 0x7f12540b1a70 2023-05-16T13:54:29.221 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.213+0000 7f12591db640 1 -- 172.21.15.39:0/286694078 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1240003530 con 0x7f12540b1a70 2023-05-16T13:54:29.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.213+0000 7f12591db640 1 -- 172.21.15.39:0/286694078 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1977583189 0 0) 0x7f1240003530 con 0x7f12540b1a70 2023-05-16T13:54:29.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.213+0000 7f12591db640 1 -- 172.21.15.39:0/286694078 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f125406c690 msgr2=0x7f12540b0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:29.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.213+0000 7f12591db640 1 --2- 172.21.15.39:0/286694078 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f125406c690 0x7f12540b0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:29.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.213+0000 7f12591db640 1 -- 172.21.15.39:0/286694078 >> v2:172.21.15.118:3300/0 conn(0x7f125415c490 msgr2=0x7f12540ad300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:29.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.213+0000 7f12591db640 1 --2- 172.21.15.39:0/286694078 >> v2:172.21.15.118:3300/0 conn(0x7f125415c490 0x7f12540ad300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:29.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.213+0000 7f12591db640 1 -- 172.21.15.39:0/286694078 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f125406cb10 con 0x7f12540b1a70 2023-05-16T13:54:29.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.213+0000 7f12591db640 1 -- 172.21.15.39:0/286694078 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1738805496 0 0) 0x7f1244001680 con 0x7f12540b1a70 2023-05-16T13:54:29.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.213+0000 7f125a9de640 1 --2- 172.21.15.39:0/286694078 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f125406c690 0x7f12540b0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-16T13:54:29.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.213+0000 7f125a1dd640 1 --2- 172.21.15.39:0/286694078 >> v2:172.21.15.118:3300/0 conn(0x7f125415c490 0x7f12540ad300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-16T13:54:29.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.213+0000 7f12591db640 1 -- 172.21.15.39:0/286694078 >> v1:172.21.15.39:6789/0 conn(0x7f12540b1a70 legacy=0x7f125406bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:29.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.213+0000 7f12591db640 1 --2- 172.21.15.39:0/286694078 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f125406c690 0x7f1240003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:29.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.213+0000 7f12591db640 1 --2- 172.21.15.39:0/286694078 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1240003ec0 0x7f12400047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:29.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.213+0000 7f12591db640 1 --2- 172.21.15.39:0/286694078 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1240004d10 0x7f1240005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:29.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.213+0000 7f12591db640 1 -- 172.21.15.39:0/286694078 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12540ad840 con 0x7f1240003ec0 2023-05-16T13:54:29.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.213+0000 7f12591db640 1 -- 172.21.15.39:0/286694078 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1240004640 con 0x7f1240004d10 2023-05-16T13:54:29.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.213+0000 7f12591db640 1 -- 172.21.15.39:0/286694078 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f124000ba10 con 0x7f125406c690 2023-05-16T13:54:29.224 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.213+0000 7f12599dc640 1 --2- 172.21.15.39:0/286694078 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1240003ec0 0x7f12400047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:29.224 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.213+0000 7f125a1dd640 1 --2- 172.21.15.39:0/286694078 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f125406c690 0x7f1240003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:29.224 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.213+0000 7f125a9de640 1 --2- 172.21.15.39:0/286694078 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1240004d10 0x7f1240005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:29.224 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.213+0000 7f12599dc640 1 -- 172.21.15.39:0/286694078 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f125406c690 msgr2=0x7f1240003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:29.224 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.213+0000 7f12599dc640 1 --2- 172.21.15.39:0/286694078 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f125406c690 0x7f1240003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:29.224 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.213+0000 7f12599dc640 1 -- 172.21.15.39:0/286694078 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1240004d10 msgr2=0x7f1240005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:29.224 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.213+0000 7f12599dc640 1 --2- 172.21.15.39:0/286694078 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1240004d10 0x7f1240005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:29.224 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.213+0000 7f12599dc640 1 -- 172.21.15.39:0/286694078 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f124c009a70 con 0x7f1240003ec0 2023-05-16T13:54:29.225 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.213+0000 7f12599dc640 1 --2- 172.21.15.39:0/286694078 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1240003ec0 0x7f12400047d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f124400c240 tx=0x7f124401f3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eccbccd23cbc6fbb server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:29.226 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.217+0000 7f12591db640 1 -- 172.21.15.39:0/286694078 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1244005ae0 con 0x7f1240003ec0 2023-05-16T13:54:29.226 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.217+0000 7f12591db640 1 -- 172.21.15.39:0/286694078 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12440ab070 con 0x7f1240003ec0 2023-05-16T13:54:29.226 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.217+0000 7f12591db640 1 -- 172.21.15.39:0/286694078 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1244007070 con 0x7f1240003ec0 2023-05-16T13:54:29.226 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.217+0000 7f125c441640 1 -- 172.21.15.39:0/286694078 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1240003ec0 msgr2=0x7f12400047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:29.226 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.217+0000 7f125c441640 1 --2- 172.21.15.39:0/286694078 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1240003ec0 0x7f12400047d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f124400c240 tx=0x7f124401f3d0 comp rx=0 tx=0).stop 2023-05-16T13:54:29.226 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.217+0000 7f125a9de640 1 -- 172.21.15.39:0/286694078 reap_dead start 2023-05-16T13:54:29.226 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.217+0000 7f125c441640 1 -- 172.21.15.39:0/286694078 shutdown_connections 2023-05-16T13:54:29.226 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.217+0000 7f125c441640 1 -- 172.21.15.39:0/286694078 >> 172.21.15.39:0/286694078 conn(0x7f12540999a0 msgr2=0x7f12540d0670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:29.227 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.217+0000 7f125c441640 1 -- 172.21.15.39:0/286694078 shutdown_connections 2023-05-16T13:54:29.227 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.217+0000 7f125c441640 1 -- 172.21.15.39:0/286694078 wait complete. 2023-05-16T13:54:29.228 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.217+0000 7f125c441640 1 Processor -- start 2023-05-16T13:54:29.229 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.217+0000 7f125c441640 1 -- start start 2023-05-16T13:54:29.229 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.217+0000 7f125c441640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1240003ec0 0x7f125414ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:29.229 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.217+0000 7f125c441640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f12540c91e0 0x7f12540b4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:29.229 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.217+0000 7f125c441640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f125406e3b0 0x7f125406e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:29.229 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.217+0000 7f125c441640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12540b5fb0 con 0x7f1240003ec0 2023-05-16T13:54:29.229 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.217+0000 7f125c441640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12540b5100 con 0x7f125406e3b0 2023-05-16T13:54:29.229 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.217+0000 7f125c441640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f125406ed70 con 0x7f12540c91e0 2023-05-16T13:54:29.229 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.217+0000 7f125a1dd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1240003ec0 0x7f125414ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:29.230 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.217+0000 7f125a1dd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1240003ec0 0x7f125414ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60364/0 (socket says 172.21.15.39:60364) 2023-05-16T13:54:29.230 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.217+0000 7f125a1dd640 1 -- 172.21.15.39:0/2911405436 learned_addr learned my addr 172.21.15.39:0/2911405436 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:29.230 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.217+0000 7f12599dc640 1 --2- 172.21.15.39:0/2911405436 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f12540c91e0 0x7f12540b4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:29.230 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.221+0000 7f125a9de640 1 --2- 172.21.15.39:0/2911405436 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f125406e3b0 0x7f125406e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:29.230 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.221+0000 7f125a1dd640 1 -- 172.21.15.39:0/2911405436 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f12540c91e0 msgr2=0x7f12540b4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:29.230 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.221+0000 7f125a1dd640 1 --2- 172.21.15.39:0/2911405436 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f12540c91e0 0x7f12540b4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:29.230 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.221+0000 7f125a1dd640 1 -- 172.21.15.39:0/2911405436 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f125406e3b0 msgr2=0x7f125406e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:29.230 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.221+0000 7f125a1dd640 1 --2- 172.21.15.39:0/2911405436 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f125406e3b0 0x7f125406e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:29.231 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.221+0000 7f125a1dd640 1 -- 172.21.15.39:0/2911405436 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12540ce850 con 0x7f1240003ec0 2023-05-16T13:54:29.231 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.221+0000 7f125a9de640 1 --2- 172.21.15.39:0/2911405436 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f125406e3b0 0x7f125406e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:54:29.231 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.221+0000 7f12599dc640 1 --2- 172.21.15.39:0/2911405436 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f12540c91e0 0x7f12540b4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:54:29.231 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.221+0000 7f125a1dd640 1 --2- 172.21.15.39:0/2911405436 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1240003ec0 0x7f125414ee00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1250011930 tx=0x7f1250011df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:29.231 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.221+0000 7f124affd640 1 -- 172.21.15.39:0/2911405436 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125000fb70 con 0x7f1240003ec0 2023-05-16T13:54:29.231 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.221+0000 7f124affd640 1 -- 172.21.15.39:0/2911405436 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f125000fcd0 con 0x7f1240003ec0 2023-05-16T13:54:29.231 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.221+0000 7f125c441640 1 -- 172.21.15.39:0/2911405436 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12540ce570 con 0x7f1240003ec0 2023-05-16T13:54:29.231 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.221+0000 7f124affd640 1 -- 172.21.15.39:0/2911405436 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1250015460 con 0x7f1240003ec0 2023-05-16T13:54:29.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.221+0000 7f125c441640 1 -- 172.21.15.39:0/2911405436 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12540ceb30 con 0x7f1240003ec0 2023-05-16T13:54:29.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.221+0000 7f125c441640 1 -- 172.21.15.39:0/2911405436 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1254073c90 con 0x7f1240003ec0 2023-05-16T13:54:29.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.221+0000 7f124affd640 1 -- 172.21.15.39:0/2911405436 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f12500155c0 con 0x7f1240003ec0 2023-05-16T13:54:29.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.221+0000 7f124affd640 1 --2- 172.21.15.39:0/2911405436 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f1238066280 0x7f1238068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:29.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.221+0000 7f124affd640 1 -- 172.21.15.39:0/2911405436 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1250084800 con 0x7f1240003ec0 2023-05-16T13:54:29.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.221+0000 7f12599dc640 1 --2- 172.21.15.39:0/2911405436 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f1238066280 0x7f1238068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:29.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.225+0000 7f12599dc640 1 --2- 172.21.15.39:0/2911405436 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f1238066280 0x7f1238068730 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f12440ae000 tx=0x7f1244001a80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:29.235 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.225+0000 7f124affd640 1 -- 172.21.15.39:0/2911405436 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f1250051be0 con 0x7f1240003ec0 2023-05-16T13:54:29.391 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.381+0000 7f125c441640 1 -- 172.21.15.39:0/2911405436 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f12540b5330 con 0x7f1240003ec0 2023-05-16T13:54:29.392 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.385+0000 7f124affd640 1 -- 172.21.15.39:0/2911405436 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1250055200 con 0x7f1240003ec0 2023-05-16T13:54:29.392 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 8 2023-05-16T13:54:29.394 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.385+0000 7f125c441640 1 -- 172.21.15.39:0/2911405436 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f1238066280 msgr2=0x7f1238068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:29.394 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.385+0000 7f125c441640 1 --2- 172.21.15.39:0/2911405436 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f1238066280 0x7f1238068730 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f12440ae000 tx=0x7f1244001a80 comp rx=0 tx=0).stop 2023-05-16T13:54:29.394 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.385+0000 7f125c441640 1 -- 172.21.15.39:0/2911405436 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1240003ec0 msgr2=0x7f125414ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:29.394 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.385+0000 7f125c441640 1 --2- 172.21.15.39:0/2911405436 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1240003ec0 0x7f125414ee00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1250011930 tx=0x7f1250011df0 comp rx=0 tx=0).stop 2023-05-16T13:54:29.394 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.385+0000 7f125c441640 1 -- 172.21.15.39:0/2911405436 shutdown_connections 2023-05-16T13:54:29.395 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.385+0000 7f125c441640 1 --2- 172.21.15.39:0/2911405436 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f1238066280 0x7f1238068730 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:29.395 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.385+0000 7f125c441640 1 --2- 172.21.15.39:0/2911405436 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f12540c91e0 0x7f12540b4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:29.395 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.385+0000 7f125c441640 1 --2- 172.21.15.39:0/2911405436 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f125406e3b0 0x7f125406e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:29.395 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.385+0000 7f125c441640 1 --2- 172.21.15.39:0/2911405436 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1240003ec0 0x7f125414ee00 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:29.395 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.385+0000 7f125c441640 1 -- 172.21.15.39:0/2911405436 >> 172.21.15.39:0/2911405436 conn(0x7f12540999a0 msgr2=0x7f12541583f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:29.395 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.385+0000 7f125c441640 1 -- 172.21.15.39:0/2911405436 shutdown_connections 2023-05-16T13:54:29.395 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.385+0000 7f125c441640 1 -- 172.21.15.39:0/2911405436 wait complete. 2023-05-16T13:54:29.412 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-16T13:54:29.552 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.545+0000 7ff544918640 1 Processor -- start 2023-05-16T13:54:29.552 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.545+0000 7ff544918640 1 -- start start 2023-05-16T13:54:29.553 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.545+0000 7ff544918640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff5400cd930 0x7ff5400cddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:29.553 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.545+0000 7ff544918640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff540158dc0 con 0x7ff5400c92e0 2023-05-16T13:54:29.554 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.545+0000 7ff544918640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5401590a0 con 0x7ff5400ce440 2023-05-16T13:54:29.554 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.545+0000 7ff544918640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff540159380 con 0x7ff5400cd930 2023-05-16T13:54:29.554 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.545+0000 7ff53e59c640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7ff5400c92e0 0x7ff5400cacb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:60912/0 (socket says 172.21.15.39:60912) 2023-05-16T13:54:29.554 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.545+0000 7ff53e59c640 1 -- 172.21.15.39:0/988412970 learned_addr learned my addr 172.21.15.39:0/988412970 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:29.555 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.545+0000 7ff53dd9b640 1 --2- 172.21.15.39:0/988412970 >> v2:172.21.15.118:3300/0 conn(0x7ff5400cd930 0x7ff5400cddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:29.555 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.545+0000 7ff53d59a640 1 -- 172.21.15.39:0/988412970 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2228084477 0 0) 0x7ff540158dc0 con 0x7ff5400c92e0 2023-05-16T13:54:29.555 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.545+0000 7ff53d59a640 1 -- 172.21.15.39:0/988412970 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff528005740 con 0x7ff5400c92e0 2023-05-16T13:54:29.555 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.545+0000 7ff53d59a640 1 -- 172.21.15.39:0/988412970 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3787202014 0 0) 0x7ff5401590a0 con 0x7ff5400ce440 2023-05-16T13:54:29.555 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.545+0000 7ff53d59a640 1 -- 172.21.15.39:0/988412970 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff540158dc0 con 0x7ff5400ce440 2023-05-16T13:54:29.556 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.545+0000 7ff53dd9b640 1 -- 172.21.15.39:0/988412970 >> v1:172.21.15.118:6789/0 conn(0x7ff5400ce440 legacy=0x7ff5400ce860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:29.556 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.545+0000 7ff53dd9b640 1 -- 172.21.15.39:0/988412970 >> v1:172.21.15.39:6789/0 conn(0x7ff5400c92e0 legacy=0x7ff5400cacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:29.556 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.545+0000 7ff53dd9b640 1 -- 172.21.15.39:0/988412970 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff540159660 con 0x7ff5400cd930 2023-05-16T13:54:29.557 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.549+0000 7ff53dd9b640 1 --2- 172.21.15.39:0/988412970 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5400cd930 0x7ff5400cddb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff5340097c0 tx=0x7ff53401c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=509dcea78e5ecc35 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:29.558 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.549+0000 7ff53d59a640 1 -- 172.21.15.39:0/988412970 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5340ab600 con 0x7ff5400cd930 2023-05-16T13:54:29.558 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.549+0000 7ff53d59a640 1 -- 172.21.15.39:0/988412970 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5340a7050 con 0x7ff5400cd930 2023-05-16T13:54:29.558 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.549+0000 7ff53d59a640 1 -- 172.21.15.39:0/988412970 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5340ab980 con 0x7ff5400cd930 2023-05-16T13:54:29.559 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.549+0000 7ff544918640 1 -- 172.21.15.39:0/988412970 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5400cd930 msgr2=0x7ff5400cddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:29.559 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.549+0000 7ff544918640 1 --2- 172.21.15.39:0/988412970 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5400cd930 0x7ff5400cddb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff5340097c0 tx=0x7ff53401c3f0 comp rx=0 tx=0).stop 2023-05-16T13:54:29.559 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.549+0000 7ff544918640 1 -- 172.21.15.39:0/988412970 shutdown_connections 2023-05-16T13:54:29.559 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.549+0000 7ff544918640 1 --2- 172.21.15.39:0/988412970 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5400cd930 0x7ff5400cddb0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:29.559 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.549+0000 7ff544918640 1 -- 172.21.15.39:0/988412970 >> 172.21.15.39:0/988412970 conn(0x7ff540069a50 msgr2=0x7ff540069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:29.559 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.549+0000 7ff544918640 1 -- 172.21.15.39:0/988412970 shutdown_connections 2023-05-16T13:54:29.559 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.549+0000 7ff544918640 1 -- 172.21.15.39:0/988412970 wait complete. 2023-05-16T13:54:29.560 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.553+0000 7ff544918640 1 Processor -- start 2023-05-16T13:54:29.560 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.553+0000 7ff544918640 1 -- start start 2023-05-16T13:54:29.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.553+0000 7ff544918640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff5400c92e0 0x7ff5400b3380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:29.562 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.553+0000 7ff544918640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff5400cd930 0x7ff540152a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:29.562 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.553+0000 7ff544918640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5400ce440 0x7ff5400c80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:29.562 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.553+0000 7ff544918640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff540152fb0 con 0x7ff5400c92e0 2023-05-16T13:54:29.562 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.553+0000 7ff544918640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5400aea00 con 0x7ff5400ce440 2023-05-16T13:54:29.562 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.553+0000 7ff544918640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5400ae0d0 con 0x7ff5400cd930 2023-05-16T13:54:29.562 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.553+0000 7ff53e59c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff5400c92e0 0x7ff5400b3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:29.562 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.553+0000 7ff53e59c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff5400c92e0 0x7ff5400b3380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60372/0 (socket says 172.21.15.39:60372) 2023-05-16T13:54:29.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.553+0000 7ff53e59c640 1 -- 172.21.15.39:0/2892534140 learned_addr learned my addr 172.21.15.39:0/2892534140 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:29.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.553+0000 7ff53dd9b640 1 --2- 172.21.15.39:0/2892534140 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff5400cd930 0x7ff540152a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:29.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.553+0000 7ff53ed9d640 1 --2- 172.21.15.39:0/2892534140 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5400ce440 0x7ff5400c80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:29.564 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.553+0000 7ff53e59c640 1 -- 172.21.15.39:0/2892534140 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff5400cd930 msgr2=0x7ff540152a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:29.564 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.553+0000 7ff53e59c640 1 --2- 172.21.15.39:0/2892534140 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff5400cd930 0x7ff540152a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:29.564 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.553+0000 7ff53e59c640 1 -- 172.21.15.39:0/2892534140 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5400ce440 msgr2=0x7ff5400c80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:29.564 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.553+0000 7ff53e59c640 1 --2- 172.21.15.39:0/2892534140 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5400ce440 0x7ff5400c80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:29.564 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.553+0000 7ff53e59c640 1 -- 172.21.15.39:0/2892534140 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff534009420 con 0x7ff5400c92e0 2023-05-16T13:54:29.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.553+0000 7ff53e59c640 1 --2- 172.21.15.39:0/2892534140 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff5400c92e0 0x7ff5400b3380 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff53000c4d0 tx=0x7ff53000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:29.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.553+0000 7ff52effd640 1 -- 172.21.15.39:0/2892534140 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff530005cf0 con 0x7ff5400c92e0 2023-05-16T13:54:29.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.553+0000 7ff52effd640 1 -- 172.21.15.39:0/2892534140 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff530005e50 con 0x7ff5400c92e0 2023-05-16T13:54:29.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.553+0000 7ff52effd640 1 -- 172.21.15.39:0/2892534140 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5300072b0 con 0x7ff5400c92e0 2023-05-16T13:54:29.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.553+0000 7ff544918640 1 -- 172.21.15.39:0/2892534140 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5400ccab0 con 0x7ff5400c92e0 2023-05-16T13:54:29.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.553+0000 7ff544918640 1 -- 172.21.15.39:0/2892534140 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5400cc920 con 0x7ff5400c92e0 2023-05-16T13:54:29.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.557+0000 7ff544918640 1 -- 172.21.15.39:0/2892534140 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5400ccc40 con 0x7ff5400c92e0 2023-05-16T13:54:29.566 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.557+0000 7ff52effd640 1 -- 172.21.15.39:0/2892534140 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff530007410 con 0x7ff5400c92e0 2023-05-16T13:54:29.566 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.557+0000 7ff52effd640 1 --2- 172.21.15.39:0/2892534140 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ff5200662b0 0x7ff520068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:29.566 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.557+0000 7ff52effd640 1 -- 172.21.15.39:0/2892534140 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff530083320 con 0x7ff5400c92e0 2023-05-16T13:54:29.566 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.557+0000 7ff53dd9b640 1 --2- 172.21.15.39:0/2892534140 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ff5200662b0 0x7ff520068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:29.567 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.557+0000 7ff53dd9b640 1 --2- 172.21.15.39:0/2892534140 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ff5200662b0 0x7ff520068760 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff5340ad000 tx=0x7ff5340a6000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:29.569 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.561+0000 7ff52effd640 1 -- 172.21.15.39:0/2892534140 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ff5300507b0 con 0x7ff5400c92e0 2023-05-16T13:54:29.723 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.713+0000 7ff544918640 1 -- 172.21.15.39:0/2892534140 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff540073c90 con 0x7ff5400c92e0 2023-05-16T13:54:29.723 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.713+0000 7ff52effd640 1 -- 172.21.15.39:0/2892534140 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff530053dd0 con 0x7ff5400c92e0 2023-05-16T13:54:29.724 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2023-05-16T13:54:29.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.717+0000 7ff544918640 1 -- 172.21.15.39:0/2892534140 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ff5200662b0 msgr2=0x7ff520068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:29.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.717+0000 7ff544918640 1 --2- 172.21.15.39:0/2892534140 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ff5200662b0 0x7ff520068760 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff5340ad000 tx=0x7ff5340a6000 comp rx=0 tx=0).stop 2023-05-16T13:54:29.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.717+0000 7ff544918640 1 -- 172.21.15.39:0/2892534140 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff5400c92e0 msgr2=0x7ff5400b3380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:29.726 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.717+0000 7ff544918640 1 --2- 172.21.15.39:0/2892534140 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff5400c92e0 0x7ff5400b3380 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff53000c4d0 tx=0x7ff53000c990 comp rx=0 tx=0).stop 2023-05-16T13:54:29.726 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.717+0000 7ff544918640 1 -- 172.21.15.39:0/2892534140 shutdown_connections 2023-05-16T13:54:29.726 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.717+0000 7ff544918640 1 --2- 172.21.15.39:0/2892534140 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ff5200662b0 0x7ff520068760 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:29.726 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.717+0000 7ff544918640 1 --2- 172.21.15.39:0/2892534140 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff5400cd930 0x7ff540152a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:29.726 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.717+0000 7ff544918640 1 --2- 172.21.15.39:0/2892534140 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5400ce440 0x7ff5400c80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:29.726 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.717+0000 7ff544918640 1 --2- 172.21.15.39:0/2892534140 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff5400c92e0 0x7ff5400b3380 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:29.726 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.717+0000 7ff544918640 1 -- 172.21.15.39:0/2892534140 >> 172.21.15.39:0/2892534140 conn(0x7ff540069a50 msgr2=0x7ff540159bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:29.727 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.717+0000 7ff544918640 1 -- 172.21.15.39:0/2892534140 shutdown_connections 2023-05-16T13:54:29.727 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.717+0000 7ff544918640 1 -- 172.21.15.39:0/2892534140 wait complete. 2023-05-16T13:54:29.744 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-16T13:54:29.887 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.877+0000 7ffa7c466640 1 Processor -- start 2023-05-16T13:54:29.888 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.877+0000 7ffa7c466640 1 -- start start 2023-05-16T13:54:29.889 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.881+0000 7ffa7c466640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffa740cd930 0x7ffa740cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:29.889 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.881+0000 7ffa7c466640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7ffa740ce440 0x7ffa740ce880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:29.889 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.881+0000 7ffa7c466640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa740cedc0 con 0x7ffa740c92e0 2023-05-16T13:54:29.889 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.881+0000 7ffa7c466640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa74158dc0 con 0x7ffa740ce440 2023-05-16T13:54:29.889 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.881+0000 7ffa7c466640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa741590a0 con 0x7ffa740cd930 2023-05-16T13:54:29.890 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.881+0000 7ffa7aa03640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7ffa740ce440 0x7ffa740ce880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:29.890 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.881+0000 7ffa7a202640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7ffa740c92e0 0x7ffa740cacb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:60928/0 (socket says 172.21.15.39:60928) 2023-05-16T13:54:29.890 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.881+0000 7ffa7a202640 1 -- 172.21.15.39:0/1391569308 learned_addr learned my addr 172.21.15.39:0/1391569308 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:29.891 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.881+0000 7ffa79a01640 1 --2- 172.21.15.39:0/1391569308 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffa740cd930 0x7ffa740cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:29.891 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.881+0000 7ffa7aa03640 1 -- 172.21.15.39:0/1391569308 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffa740cd930 msgr2=0x7ffa740cdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:29.891 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.881+0000 7ffa7aa03640 1 --2- 172.21.15.39:0/1391569308 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffa740cd930 0x7ffa740cdd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:29.891 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.881+0000 7ffa7aa03640 1 -- 172.21.15.39:0/1391569308 >> v1:172.21.15.39:6789/0 conn(0x7ffa740c92e0 legacy=0x7ffa740cacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:29.891 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.881+0000 7ffa7aa03640 1 -- 172.21.15.39:0/1391569308 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa74159380 con 0x7ffa740ce440 2023-05-16T13:54:29.891 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.881+0000 7ffa79200640 1 -- 172.21.15.39:0/1391569308 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 147918343 0 0) 0x7ffa740cedc0 con 0x7ffa740c92e0 2023-05-16T13:54:29.892 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.885+0000 7ffa7aa03640 1 --2- 172.21.15.39:0/1391569308 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffa740ce440 0x7ffa740ce880 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c009d90 tx=0x7ffa6c01c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1f475fdc90e7d46 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:29.893 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.885+0000 7ffa79200640 1 -- 172.21.15.39:0/1391569308 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6c0a57a0 con 0x7ffa740ce440 2023-05-16T13:54:29.893 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.885+0000 7ffa79200640 1 -- 172.21.15.39:0/1391569308 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa6c0a5900 con 0x7ffa740ce440 2023-05-16T13:54:29.893 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.885+0000 7ffa79200640 1 -- 172.21.15.39:0/1391569308 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6c0a5c90 con 0x7ffa740ce440 2023-05-16T13:54:29.894 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.885+0000 7ffa7c466640 1 -- 172.21.15.39:0/1391569308 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffa740ce440 msgr2=0x7ffa740ce880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:29.894 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.885+0000 7ffa7c466640 1 --2- 172.21.15.39:0/1391569308 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffa740ce440 0x7ffa740ce880 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c009d90 tx=0x7ffa6c01c8c0 comp rx=0 tx=0).stop 2023-05-16T13:54:29.894 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.885+0000 7ffa7c466640 1 -- 172.21.15.39:0/1391569308 shutdown_connections 2023-05-16T13:54:29.894 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.885+0000 7ffa7c466640 1 --2- 172.21.15.39:0/1391569308 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffa740ce440 0x7ffa740ce880 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:29.894 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.885+0000 7ffa7c466640 1 --2- 172.21.15.39:0/1391569308 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffa740cd930 0x7ffa740cdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:29.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.885+0000 7ffa7c466640 1 -- 172.21.15.39:0/1391569308 >> 172.21.15.39:0/1391569308 conn(0x7ffa74069a50 msgr2=0x7ffa74069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:29.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.885+0000 7ffa7c466640 1 -- 172.21.15.39:0/1391569308 shutdown_connections 2023-05-16T13:54:29.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.885+0000 7ffa7c466640 1 -- 172.21.15.39:0/1391569308 wait complete. 2023-05-16T13:54:29.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.885+0000 7ffa7c466640 1 Processor -- start 2023-05-16T13:54:29.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.889+0000 7ffa7c466640 1 -- start start 2023-05-16T13:54:29.897 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.889+0000 7ffa7c466640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffa740c92e0 0x7ffa740b1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:29.897 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.889+0000 7ffa7c466640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffa740cd930 0x7ffa740c4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:29.897 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.889+0000 7ffa7c466640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa740ce440 0x7ffa74156660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:29.897 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.889+0000 7ffa7c466640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa741504f0 con 0x7ffa740cd930 2023-05-16T13:54:29.897 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.889+0000 7ffa7c466640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa741507d0 con 0x7ffa740ce440 2023-05-16T13:54:29.897 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.889+0000 7ffa7c466640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa74150ab0 con 0x7ffa740c92e0 2023-05-16T13:54:29.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.889+0000 7ffa79a01640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffa740cd930 0x7ffa740c4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:29.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.889+0000 7ffa79a01640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffa740cd930 0x7ffa740c4b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60392/0 (socket says 172.21.15.39:60392) 2023-05-16T13:54:29.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.889+0000 7ffa79a01640 1 -- 172.21.15.39:0/3853503711 learned_addr learned my addr 172.21.15.39:0/3853503711 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:29.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.889+0000 7ffa7a202640 1 --2- 172.21.15.39:0/3853503711 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffa740c92e0 0x7ffa740b1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:29.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.889+0000 7ffa7aa03640 1 --2- 172.21.15.39:0/3853503711 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa740ce440 0x7ffa74156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:29.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.889+0000 7ffa79a01640 1 -- 172.21.15.39:0/3853503711 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffa740c92e0 msgr2=0x7ffa740b1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:29.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.889+0000 7ffa79a01640 1 --2- 172.21.15.39:0/3853503711 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffa740c92e0 0x7ffa740b1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:29.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.889+0000 7ffa79a01640 1 -- 172.21.15.39:0/3853503711 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa740ce440 msgr2=0x7ffa74156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:29.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.889+0000 7ffa79a01640 1 --2- 172.21.15.39:0/3853503711 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa740ce440 0x7ffa74156660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:29.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.889+0000 7ffa79a01640 1 -- 172.21.15.39:0/3853503711 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa6c009a70 con 0x7ffa740cd930 2023-05-16T13:54:29.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.889+0000 7ffa7a202640 1 --2- 172.21.15.39:0/3853503711 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffa740c92e0 0x7ffa740b1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:54:29.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.889+0000 7ffa79a01640 1 --2- 172.21.15.39:0/3853503711 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffa740cd930 0x7ffa740c4b70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ffa6400e930 tx=0x7ffa6400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:29.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.889+0000 7ffa6affd640 1 -- 172.21.15.39:0/3853503711 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa64009690 con 0x7ffa740cd930 2023-05-16T13:54:29.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.889+0000 7ffa6affd640 1 -- 172.21.15.39:0/3853503711 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa6400ca00 con 0x7ffa740cd930 2023-05-16T13:54:29.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.889+0000 7ffa6affd640 1 -- 172.21.15.39:0/3853503711 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6400cd70 con 0x7ffa740cd930 2023-05-16T13:54:29.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.889+0000 7ffa7c466640 1 -- 172.21.15.39:0/3853503711 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa740c9840 con 0x7ffa740cd930 2023-05-16T13:54:29.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.889+0000 7ffa7c466640 1 -- 172.21.15.39:0/3853503711 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa740c96b0 con 0x7ffa740cd930 2023-05-16T13:54:29.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.889+0000 7ffa7c466640 1 -- 172.21.15.39:0/3853503711 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa740cd130 con 0x7ffa740cd930 2023-05-16T13:54:29.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.893+0000 7ffa6affd640 1 -- 172.21.15.39:0/3853503711 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ffa64013470 con 0x7ffa740cd930 2023-05-16T13:54:29.902 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.893+0000 7ffa6affd640 1 --2- 172.21.15.39:0/3853503711 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ffa580662b0 0x7ffa58068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:29.902 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.893+0000 7ffa6affd640 1 -- 172.21.15.39:0/3853503711 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ffa64083f30 con 0x7ffa740cd930 2023-05-16T13:54:29.902 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.893+0000 7ffa7a202640 1 --2- 172.21.15.39:0/3853503711 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ffa580662b0 0x7ffa58068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:29.902 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.893+0000 7ffa7a202640 1 --2- 172.21.15.39:0/3853503711 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ffa580662b0 0x7ffa58068760 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ffa70007fd0 tx=0x7ffa70007c20 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:29.904 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:29.897+0000 7ffa6affd640 1 -- 172.21.15.39:0/3853503711 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ffa64051450 con 0x7ffa740cd930 2023-05-16T13:54:30.058 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.049+0000 7ffa7c466640 1 -- 172.21.15.39:0/3853503711 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ffa74073c90 con 0x7ffa740cd930 2023-05-16T13:54:30.059 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.049+0000 7ffa6affd640 1 -- 172.21.15.39:0/3853503711 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7ffa640170a0 con 0x7ffa740cd930 2023-05-16T13:54:30.059 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 64 2023-05-16T13:54:30.060 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.053+0000 7ffa7c466640 1 -- 172.21.15.39:0/3853503711 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ffa580662b0 msgr2=0x7ffa58068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:30.060 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.053+0000 7ffa7c466640 1 --2- 172.21.15.39:0/3853503711 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ffa580662b0 0x7ffa58068760 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ffa70007fd0 tx=0x7ffa70007c20 comp rx=0 tx=0).stop 2023-05-16T13:54:30.061 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.053+0000 7ffa7c466640 1 -- 172.21.15.39:0/3853503711 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffa740cd930 msgr2=0x7ffa740c4b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:30.061 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.053+0000 7ffa7c466640 1 --2- 172.21.15.39:0/3853503711 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffa740cd930 0x7ffa740c4b70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ffa6400e930 tx=0x7ffa6400edf0 comp rx=0 tx=0).stop 2023-05-16T13:54:30.061 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.053+0000 7ffa7c466640 1 -- 172.21.15.39:0/3853503711 shutdown_connections 2023-05-16T13:54:30.061 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.053+0000 7ffa7c466640 1 --2- 172.21.15.39:0/3853503711 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa740ce440 0x7ffa74156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:30.061 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.053+0000 7ffa7c466640 1 --2- 172.21.15.39:0/3853503711 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffa740cd930 0x7ffa740c4b70 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:30.061 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.053+0000 7ffa7c466640 1 --2- 172.21.15.39:0/3853503711 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ffa580662b0 0x7ffa58068760 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:30.061 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.053+0000 7ffa7c466640 1 --2- 172.21.15.39:0/3853503711 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffa740c92e0 0x7ffa740b1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:30.062 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.053+0000 7ffa7c466640 1 -- 172.21.15.39:0/3853503711 >> 172.21.15.39:0/3853503711 conn(0x7ffa74069a50 msgr2=0x7ffa740714a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:30.062 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.053+0000 7ffa7c466640 1 -- 172.21.15.39:0/3853503711 shutdown_connections 2023-05-16T13:54:30.062 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.053+0000 7ffa7c466640 1 -- 172.21.15.39:0/3853503711 wait complete. 2023-05-16T13:54:30.079 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-16T13:54:30.216 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.209+0000 7efeecb98640 1 Processor -- start 2023-05-16T13:54:30.217 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.209+0000 7efeecb98640 1 -- start start 2023-05-16T13:54:30.217 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.209+0000 7efeecb98640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7efee80b5670 0x7efee80b42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:30.217 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.209+0000 7efeecb98640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efee80ce150 con 0x7efee815c470 2023-05-16T13:54:30.218 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.209+0000 7efeecb98640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efee80cd890 con 0x7efee80b5b10 2023-05-16T13:54:30.218 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.209+0000 7efeecb98640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efee80cdb00 con 0x7efee80b5670 2023-05-16T13:54:30.219 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.209+0000 7efee659c640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7efee815c470 0x7efee80d0720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:60938/0 (socket says 172.21.15.39:60938) 2023-05-16T13:54:30.220 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.209+0000 7efee659c640 1 -- 172.21.15.39:0/875873017 learned_addr learned my addr 172.21.15.39:0/875873017 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:30.220 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.209+0000 7efedffff640 1 --2- 172.21.15.39:0/875873017 >> v2:172.21.15.118:3300/0 conn(0x7efee80b5670 0x7efee80b42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:30.220 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.209+0000 7efee5d9b640 1 -- 172.21.15.39:0/875873017 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 539951260 0 0) 0x7efee80ce150 con 0x7efee815c470 2023-05-16T13:54:30.220 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.209+0000 7efee5d9b640 1 -- 172.21.15.39:0/875873017 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efed4003530 con 0x7efee815c470 2023-05-16T13:54:30.220 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.209+0000 7efee5d9b640 1 -- 172.21.15.39:0/875873017 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1841698553 0 0) 0x7efee80cd890 con 0x7efee80b5b10 2023-05-16T13:54:30.220 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.209+0000 7efee5d9b640 1 -- 172.21.15.39:0/875873017 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efee80ce150 con 0x7efee80b5b10 2023-05-16T13:54:30.220 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.209+0000 7efee5d9b640 1 -- 172.21.15.39:0/875873017 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 223425032 0 0) 0x7efed4003530 con 0x7efee815c470 2023-05-16T13:54:30.221 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.209+0000 7efee5d9b640 1 -- 172.21.15.39:0/875873017 >> v2:172.21.15.118:3300/0 conn(0x7efee80b5670 msgr2=0x7efee80b42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:30.221 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.209+0000 7efee5d9b640 1 --2- 172.21.15.39:0/875873017 >> v2:172.21.15.118:3300/0 conn(0x7efee80b5670 0x7efee80b42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:30.221 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.209+0000 7efee5d9b640 1 -- 172.21.15.39:0/875873017 >> v1:172.21.15.118:6789/0 conn(0x7efee80b5b10 legacy=0x7efee80ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:30.221 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.209+0000 7efee5d9b640 1 -- 172.21.15.39:0/875873017 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efee80cdde0 con 0x7efee815c470 2023-05-16T13:54:30.221 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.209+0000 7efee5d9b640 1 -- 172.21.15.39:0/875873017 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1738805496 0 0) 0x7efed8001800 con 0x7efee815c470 2023-05-16T13:54:30.221 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.209+0000 7efee5d9b640 1 -- 172.21.15.39:0/875873017 >> v1:172.21.15.39:6789/0 conn(0x7efee815c470 legacy=0x7efee80d0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:30.221 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.209+0000 7efee5d9b640 1 --2- 172.21.15.39:0/875873017 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efed4003b80 0x7efed4003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:30.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.209+0000 7efee5d9b640 1 --2- 172.21.15.39:0/875873017 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efed40047d0 0x7efed4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:30.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.209+0000 7efee5d9b640 1 --2- 172.21.15.39:0/875873017 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efed4005180 0x7efed400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:30.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.209+0000 7efee5d9b640 1 -- 172.21.15.39:0/875873017 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee80cdb00 con 0x7efed40047d0 2023-05-16T13:54:30.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.209+0000 7efee5d9b640 1 -- 172.21.15.39:0/875873017 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed400c060 con 0x7efed4003b80 2023-05-16T13:54:30.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.209+0000 7efee5d9b640 1 -- 172.21.15.39:0/875873017 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efed400c220 con 0x7efed4005180 2023-05-16T13:54:30.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.209+0000 7efedffff640 1 --2- 172.21.15.39:0/875873017 >> v2:172.21.15.118:3300/0 conn(0x7efee80b5670 0x7efee80b42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-16T13:54:30.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.209+0000 7efedffff640 1 --2- 172.21.15.39:0/875873017 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efed40047d0 0x7efed4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:30.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.209+0000 7efee659c640 1 --2- 172.21.15.39:0/875873017 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efed4003b80 0x7efed4003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:30.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.209+0000 7efee6d9d640 1 --2- 172.21.15.39:0/875873017 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efed4005180 0x7efed400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:30.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.209+0000 7efedffff640 1 -- 172.21.15.39:0/875873017 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efed4005180 msgr2=0x7efed400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:30.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.209+0000 7efedffff640 1 --2- 172.21.15.39:0/875873017 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efed4005180 0x7efed400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:30.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.209+0000 7efedffff640 1 -- 172.21.15.39:0/875873017 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efed4003b80 msgr2=0x7efed4003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:30.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.209+0000 7efedffff640 1 --2- 172.21.15.39:0/875873017 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efed4003b80 0x7efed4003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:30.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.209+0000 7efedffff640 1 -- 172.21.15.39:0/875873017 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed4003530 con 0x7efed40047d0 2023-05-16T13:54:30.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.209+0000 7efee6d9d640 1 -- 172.21.15.39:0/875873017 reap_dead start 2023-05-16T13:54:30.224 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.213+0000 7efedffff640 1 --2- 172.21.15.39:0/875873017 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efed40047d0 0x7efed4004c40 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7efed0009c60 tx=0x7efed001cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41715573697dd5f7 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:30.224 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.213+0000 7efee5d9b640 1 -- 172.21.15.39:0/875873017 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed0004020 con 0x7efed40047d0 2023-05-16T13:54:30.225 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.213+0000 7efee5d9b640 1 -- 172.21.15.39:0/875873017 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efed0004180 con 0x7efed40047d0 2023-05-16T13:54:30.225 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.213+0000 7efee5d9b640 1 -- 172.21.15.39:0/875873017 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed00a5720 con 0x7efed40047d0 2023-05-16T13:54:30.225 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.213+0000 7efeecb98640 1 -- 172.21.15.39:0/875873017 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efed40047d0 msgr2=0x7efed4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:30.225 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.213+0000 7efeecb98640 1 --2- 172.21.15.39:0/875873017 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efed40047d0 0x7efed4004c40 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7efed0009c60 tx=0x7efed001cb70 comp rx=0 tx=0).stop 2023-05-16T13:54:30.225 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.213+0000 7efeecb98640 1 -- 172.21.15.39:0/875873017 shutdown_connections 2023-05-16T13:54:30.225 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.213+0000 7efeecb98640 1 --2- 172.21.15.39:0/875873017 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efed40047d0 0x7efed4004c40 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:30.225 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.213+0000 7efeecb98640 1 -- 172.21.15.39:0/875873017 >> 172.21.15.39:0/875873017 conn(0x7efee809bae0 msgr2=0x7efee80d2820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:30.225 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.213+0000 7efeecb98640 1 -- 172.21.15.39:0/875873017 shutdown_connections 2023-05-16T13:54:30.226 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.213+0000 7efeecb98640 1 -- 172.21.15.39:0/875873017 wait complete. 2023-05-16T13:54:30.227 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.217+0000 7efeecb98640 1 Processor -- start 2023-05-16T13:54:30.227 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.217+0000 7efeecb98640 1 -- start start 2023-05-16T13:54:30.227 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.217+0000 7efeecb98640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efed40047d0 0x7efee815eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:30.227 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.217+0000 7efeecb98640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efee80afe70 0x7efee80b2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:30.227 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.217+0000 7efeecb98640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efee815b380 0x7efee806bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:30.227 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.217+0000 7efeecb98640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee80afa50 con 0x7efee80afe70 2023-05-16T13:54:30.228 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.217+0000 7efeecb98640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee80af3d0 con 0x7efee815b380 2023-05-16T13:54:30.228 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.217+0000 7efeecb98640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efee80b2c50 con 0x7efed40047d0 2023-05-16T13:54:30.228 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.217+0000 7efedffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efee80afe70 0x7efee80b2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:30.228 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.217+0000 7efedffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efee80afe70 0x7efee80b2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60412/0 (socket says 172.21.15.39:60412) 2023-05-16T13:54:30.228 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.217+0000 7efedffff640 1 -- 172.21.15.39:0/1933942756 learned_addr learned my addr 172.21.15.39:0/1933942756 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:30.228 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.217+0000 7efee659c640 1 --2- 172.21.15.39:0/1933942756 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efed40047d0 0x7efee815eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:30.228 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.217+0000 7efee6d9d640 1 --2- 172.21.15.39:0/1933942756 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efee815b380 0x7efee806bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:30.229 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.217+0000 7efedffff640 1 -- 172.21.15.39:0/1933942756 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efed40047d0 msgr2=0x7efee815eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:30.229 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.217+0000 7efedffff640 1 --2- 172.21.15.39:0/1933942756 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efed40047d0 0x7efee815eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:30.229 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.217+0000 7efedffff640 1 -- 172.21.15.39:0/1933942756 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efee815b380 msgr2=0x7efee806bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:30.229 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.217+0000 7efedffff640 1 --2- 172.21.15.39:0/1933942756 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efee815b380 0x7efee806bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:30.229 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.217+0000 7efedffff640 1 -- 172.21.15.39:0/1933942756 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efee809bf70 con 0x7efee80afe70 2023-05-16T13:54:30.229 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.217+0000 7efee659c640 1 --2- 172.21.15.39:0/1933942756 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efed40047d0 0x7efee815eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:54:30.229 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.217+0000 7efedffff640 1 --2- 172.21.15.39:0/1933942756 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efee80afe70 0x7efee80b2710 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7efed001c5e0 tx=0x7efed4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:30.230 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.217+0000 7efedeffd640 1 -- 172.21.15.39:0/1933942756 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed00a5920 con 0x7efee80afe70 2023-05-16T13:54:30.231 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.217+0000 7efedeffd640 1 -- 172.21.15.39:0/1933942756 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efed00a5a80 con 0x7efee80afe70 2023-05-16T13:54:30.231 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.217+0000 7efedeffd640 1 -- 172.21.15.39:0/1933942756 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed00a5e10 con 0x7efee80afe70 2023-05-16T13:54:30.231 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.217+0000 7efeecb98640 1 -- 172.21.15.39:0/1933942756 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efee815c840 con 0x7efee80afe70 2023-05-16T13:54:30.231 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.217+0000 7efeecb98640 1 -- 172.21.15.39:0/1933942756 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efee80d0ee0 con 0x7efee80afe70 2023-05-16T13:54:30.231 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.221+0000 7efeecb98640 1 -- 172.21.15.39:0/1933942756 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efee8073c90 con 0x7efee80afe70 2023-05-16T13:54:30.231 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.221+0000 7efedeffd640 1 -- 172.21.15.39:0/1933942756 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7efed0003620 con 0x7efee80afe70 2023-05-16T13:54:30.231 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.221+0000 7efedeffd640 1 --2- 172.21.15.39:0/1933942756 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7efec80662b0 0x7efec8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:30.231 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.221+0000 7efedeffd640 1 -- 172.21.15.39:0/1933942756 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efed011e7e0 con 0x7efee80afe70 2023-05-16T13:54:30.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.221+0000 7efee659c640 1 --2- 172.21.15.39:0/1933942756 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7efec80662b0 0x7efec8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:30.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.221+0000 7efee659c640 1 --2- 172.21.15.39:0/1933942756 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7efec80662b0 0x7efec8068760 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7efed80011c0 tx=0x7efed8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:30.234 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.225+0000 7efedeffd640 1 -- 172.21.15.39:0/1933942756 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7efed00ebc50 con 0x7efee80afe70 2023-05-16T13:54:30.419 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.409+0000 7efeecb98640 1 -- 172.21.15.39:0/1933942756 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efee806a6c0 con 0x7efee80afe70 2023-05-16T13:54:30.419 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.409+0000 7efedeffd640 1 -- 172.21.15.39:0/1933942756 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4668 (secure 0 0 0) 0x7efed00ef270 con 0x7efee80afe70 2023-05-16T13:54:30.420 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:54:30.420 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2374269620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":2374269620},{"type":"v1","addr":"172.21.15.118:6835","nonce":2374269620}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/3803055359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3803055359},{"type":"v1","addr":"172.21.15.118:6833","nonce":3803055359}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4308,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6836/3259535605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":3259535605},{"type":"v1","addr":"172.21.15.39:6836","nonce":3259535605}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-16T13:54:15.191894+0000","modified":"2023-05-16T13:54:18.210603+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4311},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4311":{"gid":4311,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.39:6837/616280162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6835","nonce":616280162},{"type":"v1","addr":"172.21.15.39:6837","nonce":616280162}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-16T13:54:30.420 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 8 2023-05-16T13:54:30.421 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.413+0000 7efeecb98640 1 -- 172.21.15.39:0/1933942756 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7efec80662b0 msgr2=0x7efec8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:30.421 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.413+0000 7efeecb98640 1 --2- 172.21.15.39:0/1933942756 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7efec80662b0 0x7efec8068760 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7efed80011c0 tx=0x7efed8009040 comp rx=0 tx=0).stop 2023-05-16T13:54:30.421 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.413+0000 7efeecb98640 1 -- 172.21.15.39:0/1933942756 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efee80afe70 msgr2=0x7efee80b2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:30.421 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.413+0000 7efeecb98640 1 --2- 172.21.15.39:0/1933942756 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efee80afe70 0x7efee80b2710 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7efed001c5e0 tx=0x7efed4005800 comp rx=0 tx=0).stop 2023-05-16T13:54:30.422 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.413+0000 7efeecb98640 1 -- 172.21.15.39:0/1933942756 shutdown_connections 2023-05-16T13:54:30.422 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.413+0000 7efeecb98640 1 --2- 172.21.15.39:0/1933942756 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efee815b380 0x7efee806bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:30.422 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.413+0000 7efeecb98640 1 --2- 172.21.15.39:0/1933942756 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efee80afe70 0x7efee80b2710 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:30.422 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.413+0000 7efeecb98640 1 --2- 172.21.15.39:0/1933942756 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7efec80662b0 0x7efec8068760 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:30.422 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.413+0000 7efeecb98640 1 --2- 172.21.15.39:0/1933942756 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efed40047d0 0x7efee815eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:30.422 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.413+0000 7efeecb98640 1 -- 172.21.15.39:0/1933942756 >> 172.21.15.39:0/1933942756 conn(0x7efee809bae0 msgr2=0x7efee815bd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:30.422 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.413+0000 7efeecb98640 1 -- 172.21.15.39:0/1933942756 shutdown_connections 2023-05-16T13:54:30.423 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.413+0000 7efeecb98640 1 -- 172.21.15.39:0/1933942756 wait complete. 2023-05-16T13:54:30.440 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-16T13:54:30.578 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.569+0000 7ff5562f9640 1 Processor -- start 2023-05-16T13:54:30.578 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.569+0000 7ff5562f9640 1 -- start start 2023-05-16T13:54:30.579 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.569+0000 7ff5562f9640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff55006d4d0 0x7ff55015cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:30.579 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.569+0000 7ff5562f9640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7ff55015faa0 0x7ff550069f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:30.580 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.569+0000 7ff5562f9640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff550145c30 con 0x7ff550145860 2023-05-16T13:54:30.580 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.569+0000 7ff5562f9640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff550160060 con 0x7ff55015faa0 2023-05-16T13:54:30.580 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.569+0000 7ff5562f9640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff550160340 con 0x7ff55006d4d0 2023-05-16T13:54:30.580 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.569+0000 7ff554896640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7ff55015faa0 0x7ff550069f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:30.580 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.569+0000 7ff54ffff640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7ff550145860 0x7ff55006cdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:60944/0 (socket says 172.21.15.39:60944) 2023-05-16T13:54:30.580 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.569+0000 7ff54ffff640 1 -- 172.21.15.39:0/2402623203 learned_addr learned my addr 172.21.15.39:0/2402623203 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:30.581 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.569+0000 7ff54f7fe640 1 --2- 172.21.15.39:0/2402623203 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff55006d4d0 0x7ff55015cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:30.581 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.573+0000 7ff554896640 1 -- 172.21.15.39:0/2402623203 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff55006d4d0 msgr2=0x7ff55015cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:30.581 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.573+0000 7ff554896640 1 --2- 172.21.15.39:0/2402623203 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff55006d4d0 0x7ff55015cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:30.581 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.573+0000 7ff554896640 1 -- 172.21.15.39:0/2402623203 >> v1:172.21.15.39:6789/0 conn(0x7ff550145860 legacy=0x7ff55006cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:30.582 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.573+0000 7ff554896640 1 -- 172.21.15.39:0/2402623203 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff550160620 con 0x7ff55015faa0 2023-05-16T13:54:30.582 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.573+0000 7ff54effd640 1 -- 172.21.15.39:0/2402623203 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4113957169 0 0) 0x7ff550145c30 con 0x7ff550145860 2023-05-16T13:54:30.582 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.573+0000 7ff554896640 1 --2- 172.21.15.39:0/2402623203 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff55015faa0 0x7ff550069f70 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff548009d90 tx=0x7ff54801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afc53ec33e24aeda server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:30.583 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.573+0000 7ff54effd640 1 -- 172.21.15.39:0/2402623203 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5480a5a10 con 0x7ff55015faa0 2023-05-16T13:54:30.583 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.573+0000 7ff54effd640 1 -- 172.21.15.39:0/2402623203 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5480a5b70 con 0x7ff55015faa0 2023-05-16T13:54:30.583 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.573+0000 7ff54effd640 1 -- 172.21.15.39:0/2402623203 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5480ad440 con 0x7ff55015faa0 2023-05-16T13:54:30.584 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.573+0000 7ff5562f9640 1 -- 172.21.15.39:0/2402623203 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff55015faa0 msgr2=0x7ff550069f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:30.584 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.573+0000 7ff5562f9640 1 --2- 172.21.15.39:0/2402623203 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff55015faa0 0x7ff550069f70 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff548009d90 tx=0x7ff54801c950 comp rx=0 tx=0).stop 2023-05-16T13:54:30.585 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.577+0000 7ff5562f9640 1 -- 172.21.15.39:0/2402623203 shutdown_connections 2023-05-16T13:54:30.585 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.577+0000 7ff5562f9640 1 --2- 172.21.15.39:0/2402623203 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff55015faa0 0x7ff550069f70 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:30.585 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.577+0000 7ff5562f9640 1 --2- 172.21.15.39:0/2402623203 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff55006d4d0 0x7ff55015cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:30.585 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.577+0000 7ff5562f9640 1 -- 172.21.15.39:0/2402623203 >> 172.21.15.39:0/2402623203 conn(0x7ff5500cb6d0 msgr2=0x7ff5500cbad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:30.585 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.577+0000 7ff5562f9640 1 -- 172.21.15.39:0/2402623203 shutdown_connections 2023-05-16T13:54:30.585 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.577+0000 7ff5562f9640 1 -- 172.21.15.39:0/2402623203 wait complete. 2023-05-16T13:54:30.586 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.577+0000 7ff5562f9640 1 Processor -- start 2023-05-16T13:54:30.586 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.577+0000 7ff5562f9640 1 -- start start 2023-05-16T13:54:30.587 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.577+0000 7ff5562f9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff55006d4d0 0x7ff550155970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:30.588 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.577+0000 7ff5562f9640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff550145860 0x7ff5501f8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:30.588 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.577+0000 7ff5562f9640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff55015faa0 0x7ff55015e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:30.588 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.577+0000 7ff5562f9640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5500ca900 con 0x7ff55006d4d0 2023-05-16T13:54:30.588 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.577+0000 7ff5562f9640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff550142060 con 0x7ff550145860 2023-05-16T13:54:30.588 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.577+0000 7ff5562f9640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5501f8850 con 0x7ff55015faa0 2023-05-16T13:54:30.588 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.577+0000 7ff54ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff55006d4d0 0x7ff550155970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:30.589 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.577+0000 7ff54ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff55006d4d0 0x7ff550155970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:39716/0 (socket says 172.21.15.39:39716) 2023-05-16T13:54:30.589 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.577+0000 7ff54ffff640 1 -- 172.21.15.39:0/320537195 learned_addr learned my addr 172.21.15.39:0/320537195 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:30.589 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.577+0000 7ff554896640 1 --2- 172.21.15.39:0/320537195 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff55015faa0 0x7ff55015e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:30.589 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.577+0000 7ff54f7fe640 1 --2- 172.21.15.39:0/320537195 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff550145860 0x7ff5501f8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:30.589 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.577+0000 7ff54ffff640 1 -- 172.21.15.39:0/320537195 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff55015faa0 msgr2=0x7ff55015e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:30.589 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.577+0000 7ff54ffff640 1 --2- 172.21.15.39:0/320537195 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff55015faa0 0x7ff55015e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:30.589 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.577+0000 7ff54ffff640 1 -- 172.21.15.39:0/320537195 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff550145860 msgr2=0x7ff5501f8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:30.589 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.577+0000 7ff54ffff640 1 --2- 172.21.15.39:0/320537195 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff550145860 0x7ff5501f8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:30.590 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.577+0000 7ff54ffff640 1 -- 172.21.15.39:0/320537195 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff548009a70 con 0x7ff55006d4d0 2023-05-16T13:54:30.590 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.577+0000 7ff54f7fe640 1 --2- 172.21.15.39:0/320537195 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff550145860 0x7ff5501f8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-16T13:54:30.590 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.577+0000 7ff54ffff640 1 --2- 172.21.15.39:0/320537195 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff55006d4d0 0x7ff550155970 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff54000c480 tx=0x7ff54000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:30.590 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.577+0000 7ff54cff9640 1 -- 172.21.15.39:0/320537195 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5400074e0 con 0x7ff55006d4d0 2023-05-16T13:54:30.590 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.581+0000 7ff54cff9640 1 -- 172.21.15.39:0/320537195 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff540007660 con 0x7ff55006d4d0 2023-05-16T13:54:30.590 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.581+0000 7ff54cff9640 1 -- 172.21.15.39:0/320537195 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff540004a30 con 0x7ff55006d4d0 2023-05-16T13:54:30.591 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.581+0000 7ff5562f9640 1 -- 172.21.15.39:0/320537195 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff55006ae50 con 0x7ff55006d4d0 2023-05-16T13:54:30.591 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.581+0000 7ff5562f9640 1 -- 172.21.15.39:0/320537195 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff55006acc0 con 0x7ff55006d4d0 2023-05-16T13:54:30.591 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.581+0000 7ff5562f9640 1 -- 172.21.15.39:0/320537195 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff55006afe0 con 0x7ff55006d4d0 2023-05-16T13:54:30.592 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.581+0000 7ff54cff9640 1 -- 172.21.15.39:0/320537195 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff540004b90 con 0x7ff55006d4d0 2023-05-16T13:54:30.592 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.581+0000 7ff54cff9640 1 --2- 172.21.15.39:0/320537195 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ff53c066280 0x7ff53c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:30.592 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.581+0000 7ff54cff9640 1 -- 172.21.15.39:0/320537195 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff540082eb0 con 0x7ff55006d4d0 2023-05-16T13:54:30.592 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.581+0000 7ff54f7fe640 1 --2- 172.21.15.39:0/320537195 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ff53c066280 0x7ff53c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:30.592 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.581+0000 7ff54f7fe640 1 --2- 172.21.15.39:0/320537195 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ff53c066280 0x7ff53c068730 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff5500b19e0 tx=0x7ff544008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:30.594 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.585+0000 7ff54cff9640 1 -- 172.21.15.39:0/320537195 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ff540053e50 con 0x7ff55006d4d0 2023-05-16T13:54:30.749 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.741+0000 7ff5562f9640 1 -- 172.21.15.39:0/320537195 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff550073c90 con 0x7ff55006d4d0 2023-05-16T13:54:30.751 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.741+0000 7ff54cff9640 1 -- 172.21.15.39:0/320537195 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18279 (secure 0 0 0) 0x7ff540018020 con 0x7ff55006d4d0 2023-05-16T13:54:30.751 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:54:30.751 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":24,"fsid":"9c1e210b-c515-4ea4-a065-397956895c68","created":"2023-05-16T13:53:48.955290+0000","modified":"2023-05-16T13:54:16.194544+0000","last_up_change":"2023-05-16T13:54:01.722051+0000","last_in_change":"2023-05-16T13:53:52.331336+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-16T13:54:00.885009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-16T13:54:08.327895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-16T13:54:12.864823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-16T13:54:14.180225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4ce0f0ba-c4bf-4405-8c95-d2e9a62878ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6809","nonce":3462013698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6811","nonce":3462013698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6815","nonce":3462013698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6813","nonce":3462013698}]},"public_addr":"172.21.15.39:6809/3462013698","cluster_addr":"172.21.15.39:6811/3462013698","heartbeat_back_addr":"172.21.15.39:6815/3462013698","heartbeat_front_addr":"172.21.15.39:6813/3462013698","state":["exists","up"]},{"osd":1,"uuid":"53fdc1ac-2473-472d-af32-2760fdf6e476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6801","nonce":2829970892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6803","nonce":2829970892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6807","nonce":2829970892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6805","nonce":2829970892}]},"public_addr":"172.21.15.39:6801/2829970892","cluster_addr":"172.21.15.39:6803/2829970892","heartbeat_back_addr":"172.21.15.39:6807/2829970892","heartbeat_front_addr":"172.21.15.39:6805/2829970892","state":["exists","up"]},{"osd":2,"uuid":"0b92d770-7030-42fa-a19f-4f7f1ac113c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6817","nonce":3888067413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6819","nonce":3888067413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6823","nonce":3888067413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6821","nonce":3888067413}]},"public_addr":"172.21.15.39:6817/3888067413","cluster_addr":"172.21.15.39:6819/3888067413","heartbeat_back_addr":"172.21.15.39:6823/3888067413","heartbeat_front_addr":"172.21.15.39:6821/3888067413","state":["exists","up"]},{"osd":3,"uuid":"000d9506-cbb2-4017-b875-deca579860ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6825","nonce":405003958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6827","nonce":405003958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6831","nonce":405003958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6829","nonce":405003958}]},"public_addr":"172.21.15.39:6825/405003958","cluster_addr":"172.21.15.39:6827/405003958","heartbeat_back_addr":"172.21.15.39:6831/405003958","heartbeat_front_addr":"172.21.15.39:6829/405003958","state":["exists","up"]},{"osd":4,"uuid":"70f0dacb-e960-40c5-bf6a-183e52bbe2ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6801","nonce":3895278838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6805","nonce":3895278838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6813","nonce":3895278838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6809","nonce":3895278838}]},"public_addr":"172.21.15.118:6801/3895278838","cluster_addr":"172.21.15.118:6805/3895278838","heartbeat_back_addr":"172.21.15.118:6813/3895278838","heartbeat_front_addr":"172.21.15.118:6809/3895278838","state":["exists","up"]},{"osd":5,"uuid":"756feb54-c3ae-4a2a-8f74-85c291ba707c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6804","nonce":3513592808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6808","nonce":3513592808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6815","nonce":3513592808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6812","nonce":3513592808}]},"public_addr":"172.21.15.118:6804/3513592808","cluster_addr":"172.21.15.118:6808/3513592808","heartbeat_back_addr":"172.21.15.118:6815/3513592808","heartbeat_front_addr":"172.21.15.118:6812/3513592808","state":["exists","up"]},{"osd":6,"uuid":"c4a982c1-f497-4b0f-8a23-c77372e4621e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6824","nonce":1863656053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6827","nonce":1863656053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6831","nonce":1863656053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6829","nonce":1863656053}]},"public_addr":"172.21.15.118:6824/1863656053","cluster_addr":"172.21.15.118:6827/1863656053","heartbeat_back_addr":"172.21.15.118:6831/1863656053","heartbeat_front_addr":"172.21.15.118:6829/1863656053","state":["exists","up"]},{"osd":7,"uuid":"6f2888aa-a7ac-4e26-9159-e31817934f44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6817","nonce":3636642904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6819","nonce":3636642904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6825","nonce":3636642904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6821","nonce":3636642904}]},"public_addr":"172.21.15.118:6817/3636642904","cluster_addr":"172.21.15.118:6819/3636642904","heartbeat_back_addr":"172.21.15.118:6825/3636642904","heartbeat_front_addr":"172.21.15.118:6821/3636642904","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.717636+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.724036+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.739144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:58.079275+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:58.073921+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.930466+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.987813+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.941098+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-16T13:54:30.753 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.745+0000 7ff5562f9640 1 -- 172.21.15.39:0/320537195 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ff53c066280 msgr2=0x7ff53c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:30.753 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.745+0000 7ff5562f9640 1 --2- 172.21.15.39:0/320537195 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ff53c066280 0x7ff53c068730 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff5500b19e0 tx=0x7ff544008040 comp rx=0 tx=0).stop 2023-05-16T13:54:30.753 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.745+0000 7ff5562f9640 1 -- 172.21.15.39:0/320537195 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff55006d4d0 msgr2=0x7ff550155970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:30.753 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.745+0000 7ff5562f9640 1 --2- 172.21.15.39:0/320537195 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff55006d4d0 0x7ff550155970 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff54000c480 tx=0x7ff54000c940 comp rx=0 tx=0).stop 2023-05-16T13:54:30.753 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.745+0000 7ff5562f9640 1 -- 172.21.15.39:0/320537195 shutdown_connections 2023-05-16T13:54:30.754 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.745+0000 7ff5562f9640 1 --2- 172.21.15.39:0/320537195 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ff53c066280 0x7ff53c068730 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:30.754 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.745+0000 7ff5562f9640 1 --2- 172.21.15.39:0/320537195 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff55015faa0 0x7ff55015e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:30.754 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.745+0000 7ff5562f9640 1 --2- 172.21.15.39:0/320537195 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff550145860 0x7ff5501f8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:30.754 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.745+0000 7ff5562f9640 1 --2- 172.21.15.39:0/320537195 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff55006d4d0 0x7ff550155970 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:30.754 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.745+0000 7ff5562f9640 1 -- 172.21.15.39:0/320537195 >> 172.21.15.39:0/320537195 conn(0x7ff5500cb6d0 msgr2=0x7ff5500ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:30.754 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.745+0000 7ff5562f9640 1 -- 172.21.15.39:0/320537195 shutdown_connections 2023-05-16T13:54:30.754 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.745+0000 7ff5562f9640 1 -- 172.21.15.39:0/320537195 wait complete. 2023-05-16T13:54:30.772 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-16T13:54:30.911 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.901+0000 7f3b72796640 1 Processor -- start 2023-05-16T13:54:30.912 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.901+0000 7f3b72796640 1 -- start start 2023-05-16T13:54:30.912 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.905+0000 7f3b72796640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3b6c0cb4c0 0x7f3b6c15d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:30.913 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.905+0000 7f3b72796640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f3b6c0703b0 0x7f3b6c0ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:30.913 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.905+0000 7f3b72796640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b6c15d6a0 con 0x7f3b6c158bf0 2023-05-16T13:54:30.913 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.905+0000 7f3b72796640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b6c070870 con 0x7f3b6c0703b0 2023-05-16T13:54:30.913 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.905+0000 7f3b72796640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b6c070b50 con 0x7f3b6c0cb4c0 2023-05-16T13:54:30.913 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.905+0000 7f3b70d33640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f3b6c0703b0 0x7f3b6c0ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:30.913 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.905+0000 7f3b70d33640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f3b6c0703b0 0x7f3b6c0ccda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:39718/0 (socket says 172.21.15.39:39718) 2023-05-16T13:54:30.913 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.905+0000 7f3b70d33640 1 -- 172.21.15.39:0/1147701059 learned_addr learned my addr 172.21.15.39:0/1147701059 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:30.914 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.905+0000 7f3b6b7fe640 1 --2- 172.21.15.39:0/1147701059 >> v2:172.21.15.118:3300/0 conn(0x7f3b6c0cb4c0 0x7f3b6c15d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:30.914 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.905+0000 7f3b70d33640 1 -- 172.21.15.39:0/1147701059 >> v2:172.21.15.118:3300/0 conn(0x7f3b6c0cb4c0 msgr2=0x7f3b6c15d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:30.914 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.905+0000 7f3b70d33640 1 --2- 172.21.15.39:0/1147701059 >> v2:172.21.15.118:3300/0 conn(0x7f3b6c0cb4c0 0x7f3b6c15d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:30.915 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.905+0000 7f3b70d33640 1 -- 172.21.15.39:0/1147701059 >> v1:172.21.15.118:6789/0 conn(0x7f3b6c158bf0 legacy=0x7f3b6c0cadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:30.915 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.905+0000 7f3b70d33640 1 -- 172.21.15.39:0/1147701059 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b6c070e30 con 0x7f3b6c0703b0 2023-05-16T13:54:30.916 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.909+0000 7f3b70d33640 1 --2- 172.21.15.39:0/1147701059 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3b6c0703b0 0x7f3b6c0ccda0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c06de10 tx=0x7f3b6401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3e3a413bcc7139e server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:30.916 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.909+0000 7f3b6affd640 1 -- 172.21.15.39:0/1147701059 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b640a57d0 con 0x7f3b6c0703b0 2023-05-16T13:54:30.916 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.909+0000 7f3b6affd640 1 -- 172.21.15.39:0/1147701059 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b640a5930 con 0x7f3b6c0703b0 2023-05-16T13:54:30.917 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.909+0000 7f3b6affd640 1 -- 172.21.15.39:0/1147701059 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b640a5cc0 con 0x7f3b6c0703b0 2023-05-16T13:54:30.917 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.909+0000 7f3b72796640 1 -- 172.21.15.39:0/1147701059 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3b6c0703b0 msgr2=0x7f3b6c0ccda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:30.917 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.909+0000 7f3b72796640 1 --2- 172.21.15.39:0/1147701059 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3b6c0703b0 0x7f3b6c0ccda0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c06de10 tx=0x7f3b6401c910 comp rx=0 tx=0).stop 2023-05-16T13:54:30.918 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.909+0000 7f3b72796640 1 -- 172.21.15.39:0/1147701059 shutdown_connections 2023-05-16T13:54:30.918 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.909+0000 7f3b72796640 1 --2- 172.21.15.39:0/1147701059 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3b6c0703b0 0x7f3b6c0ccda0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:30.918 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.909+0000 7f3b72796640 1 --2- 172.21.15.39:0/1147701059 >> v2:172.21.15.118:3300/0 conn(0x7f3b6c0cb4c0 0x7f3b6c15d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:30.918 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.909+0000 7f3b72796640 1 -- 172.21.15.39:0/1147701059 >> 172.21.15.39:0/1147701059 conn(0x7f3b6c069a50 msgr2=0x7f3b6c069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:30.918 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.909+0000 7f3b72796640 1 -- 172.21.15.39:0/1147701059 shutdown_connections 2023-05-16T13:54:30.918 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.909+0000 7f3b72796640 1 -- 172.21.15.39:0/1147701059 wait complete. 2023-05-16T13:54:30.919 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.909+0000 7f3b72796640 1 Processor -- start 2023-05-16T13:54:30.919 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.909+0000 7f3b72796640 1 -- start start 2023-05-16T13:54:30.920 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.909+0000 7f3b72796640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3b6c0703b0 0x7f3b6c1554d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:30.920 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.909+0000 7f3b72796640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b6c0cb4c0 0x7f3b6c0ce880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:30.920 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.913+0000 7f3b72796640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3b6c158bf0 0x7f3b6c14a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:30.920 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.913+0000 7f3b72796640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6c159150 con 0x7f3b6c0703b0 2023-05-16T13:54:30.920 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.913+0000 7f3b72796640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6c0c4e10 con 0x7f3b6c0cb4c0 2023-05-16T13:54:30.921 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.913+0000 7f3b72796640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6c159c60 con 0x7f3b6c158bf0 2023-05-16T13:54:30.921 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.913+0000 7f3b6bfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3b6c0703b0 0x7f3b6c1554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:30.921 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.913+0000 7f3b6bfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3b6c0703b0 0x7f3b6c1554d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:39720/0 (socket says 172.21.15.39:39720) 2023-05-16T13:54:30.921 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.913+0000 7f3b6bfff640 1 -- 172.21.15.39:0/2582262928 learned_addr learned my addr 172.21.15.39:0/2582262928 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:30.921 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.913+0000 7f3b6b7fe640 1 --2- 172.21.15.39:0/2582262928 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b6c0cb4c0 0x7f3b6c0ce880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:30.921 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.913+0000 7f3b70d33640 1 --2- 172.21.15.39:0/2582262928 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3b6c158bf0 0x7f3b6c14a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:30.922 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.913+0000 7f3b6bfff640 1 -- 172.21.15.39:0/2582262928 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3b6c158bf0 msgr2=0x7f3b6c14a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:30.922 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.913+0000 7f3b6bfff640 1 --2- 172.21.15.39:0/2582262928 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3b6c158bf0 0x7f3b6c14a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:30.923 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.913+0000 7f3b6bfff640 1 -- 172.21.15.39:0/2582262928 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b6c0cb4c0 msgr2=0x7f3b6c0ce880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:30.923 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.913+0000 7f3b6bfff640 1 --2- 172.21.15.39:0/2582262928 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b6c0cb4c0 0x7f3b6c0ce880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:30.923 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.913+0000 7f3b6bfff640 1 -- 172.21.15.39:0/2582262928 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b64009b30 con 0x7f3b6c0703b0 2023-05-16T13:54:30.923 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.913+0000 7f3b6bfff640 1 --2- 172.21.15.39:0/2582262928 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3b6c0703b0 0x7f3b6c1554d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c00c370 tx=0x7f3b5c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:30.923 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.913+0000 7f3b68ff9640 1 -- 172.21.15.39:0/2582262928 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5c0052d0 con 0x7f3b6c0703b0 2023-05-16T13:54:30.923 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.913+0000 7f3b68ff9640 1 -- 172.21.15.39:0/2582262928 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b5c005430 con 0x7f3b6c0703b0 2023-05-16T13:54:30.923 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.913+0000 7f3b68ff9640 1 -- 172.21.15.39:0/2582262928 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5c007260 con 0x7f3b6c0703b0 2023-05-16T13:54:30.924 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.913+0000 7f3b72796640 1 -- 172.21.15.39:0/2582262928 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b6c0ad950 con 0x7f3b6c0703b0 2023-05-16T13:54:30.924 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.913+0000 7f3b72796640 1 -- 172.21.15.39:0/2582262928 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b6c158fc0 con 0x7f3b6c0703b0 2023-05-16T13:54:30.924 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.913+0000 7f3b72796640 1 -- 172.21.15.39:0/2582262928 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b6c0cdaf0 con 0x7f3b6c0703b0 2023-05-16T13:54:30.925 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.913+0000 7f3b68ff9640 1 -- 172.21.15.39:0/2582262928 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3b5c0073c0 con 0x7f3b6c0703b0 2023-05-16T13:54:30.925 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.917+0000 7f3b68ff9640 1 --2- 172.21.15.39:0/2582262928 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f3b58066280 0x7f3b58068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:30.925 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.917+0000 7f3b68ff9640 1 -- 172.21.15.39:0/2582262928 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3b5c082e40 con 0x7f3b6c0703b0 2023-05-16T13:54:30.925 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.917+0000 7f3b6b7fe640 1 --2- 172.21.15.39:0/2582262928 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f3b58066280 0x7f3b58068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:30.925 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.917+0000 7f3b6b7fe640 1 --2- 172.21.15.39:0/2582262928 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f3b58066280 0x7f3b58068730 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c0c86a0 tx=0x7f3b60008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:30.928 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:30.921+0000 7f3b68ff9640 1 -- 172.21.15.39:0/2582262928 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f3b5c050370 con 0x7f3b6c0703b0 2023-05-16T13:54:31.115 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.105+0000 7f3b72796640 1 -- 172.21.15.39:0/2582262928 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3b6c15d6a0 con 0x7f3b6c0703b0 2023-05-16T13:54:31.116 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.109+0000 7f3b68ff9640 1 -- 172.21.15.39:0/2582262928 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4668 (secure 0 0 0) 0x7f3b6c15d6a0 con 0x7f3b6c0703b0 2023-05-16T13:54:31.116 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:54:31.116 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2374269620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":2374269620},{"type":"v1","addr":"172.21.15.118:6835","nonce":2374269620}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/3803055359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3803055359},{"type":"v1","addr":"172.21.15.118:6833","nonce":3803055359}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4308,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6836/3259535605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":3259535605},{"type":"v1","addr":"172.21.15.39:6836","nonce":3259535605}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-16T13:54:15.191894+0000","modified":"2023-05-16T13:54:18.210603+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4311},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4311":{"gid":4311,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.39:6837/616280162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6835","nonce":616280162},{"type":"v1","addr":"172.21.15.39:6837","nonce":616280162}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-16T13:54:31.117 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 8 2023-05-16T13:54:31.118 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.109+0000 7f3b72796640 1 -- 172.21.15.39:0/2582262928 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f3b58066280 msgr2=0x7f3b58068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:31.118 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.109+0000 7f3b72796640 1 --2- 172.21.15.39:0/2582262928 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f3b58066280 0x7f3b58068730 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c0c86a0 tx=0x7f3b60008040 comp rx=0 tx=0).stop 2023-05-16T13:54:31.118 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.109+0000 7f3b72796640 1 -- 172.21.15.39:0/2582262928 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3b6c0703b0 msgr2=0x7f3b6c1554d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:31.118 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.109+0000 7f3b72796640 1 --2- 172.21.15.39:0/2582262928 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3b6c0703b0 0x7f3b6c1554d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c00c370 tx=0x7f3b5c00c830 comp rx=0 tx=0).stop 2023-05-16T13:54:31.118 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.109+0000 7f3b72796640 1 -- 172.21.15.39:0/2582262928 shutdown_connections 2023-05-16T13:54:31.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.109+0000 7f3b72796640 1 --2- 172.21.15.39:0/2582262928 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f3b58066280 0x7f3b58068730 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:31.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.109+0000 7f3b72796640 1 --2- 172.21.15.39:0/2582262928 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3b6c158bf0 0x7f3b6c14a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:31.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.109+0000 7f3b72796640 1 --2- 172.21.15.39:0/2582262928 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b6c0cb4c0 0x7f3b6c0ce880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:31.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.109+0000 7f3b72796640 1 --2- 172.21.15.39:0/2582262928 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3b6c0703b0 0x7f3b6c1554d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:31.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.109+0000 7f3b72796640 1 -- 172.21.15.39:0/2582262928 >> 172.21.15.39:0/2582262928 conn(0x7f3b6c069a50 msgr2=0x7f3b6c0cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:31.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.109+0000 7f3b72796640 1 -- 172.21.15.39:0/2582262928 shutdown_connections 2023-05-16T13:54:31.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.109+0000 7f3b72796640 1 -- 172.21.15.39:0/2582262928 wait complete. 2023-05-16T13:54:31.539 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-05-16T13:54:15.191894+0000', 'modified': '2023-05-16T13:54:18.210603+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4311}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4311': {'gid': 4311, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.39:6837/616280162', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.39:6835', 'nonce': 616280162}, {'type': 'v1', 'addr': '172.21.15.39:6837', 'nonce': 616280162}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-05-16T13:54:31.540 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-05-16T13:54:31.541 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-05-16T13:54:31.682 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.673+0000 7f2ba9841640 1 Processor -- start 2023-05-16T13:54:31.682 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.673+0000 7f2ba9841640 1 -- start start 2023-05-16T13:54:31.683 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.673+0000 7f2ba9841640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f2ba406c870 0x7f2ba406fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:31.683 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.673+0000 7f2ba9841640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ba415ead0 con 0x7f2ba40b0610 2023-05-16T13:54:31.683 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.673+0000 7f2ba9841640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ba40701c0 con 0x7f2ba415e700 2023-05-16T13:54:31.683 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.673+0000 7f2ba9841640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ba406ccf0 con 0x7f2ba406c870 2023-05-16T13:54:31.683 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.673+0000 7f2b9bfff640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f2ba40b0610 0x7f2ba40cc380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:58144/0 (socket says 172.21.15.39:58144) 2023-05-16T13:54:31.683 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.673+0000 7f2b9bfff640 1 -- 172.21.15.39:0/117033782 learned_addr learned my addr 172.21.15.39:0/117033782 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:31.684 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.673+0000 7f2ba37fe640 1 --2- 172.21.15.39:0/117033782 >> v2:172.21.15.39:3300/0 conn(0x7f2ba406c870 0x7f2ba406fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:31.684 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.673+0000 7f2ba27fc640 1 -- 172.21.15.39:0/117033782 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3138807283 0 0) 0x7f2b8c001120 con 0x7f2ba40b0610 2023-05-16T13:54:31.684 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.673+0000 7f2ba27fc640 1 -- 172.21.15.39:0/117033782 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b90003530 con 0x7f2ba40b0610 2023-05-16T13:54:31.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.673+0000 7f2ba37fe640 1 -- 172.21.15.39:0/117033782 >> v1:172.21.15.118:6789/0 conn(0x7f2ba415e700 legacy=0x7f2ba40aff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:31.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.673+0000 7f2ba37fe640 1 -- 172.21.15.39:0/117033782 >> v1:172.21.15.39:6789/0 conn(0x7f2ba40b0610 legacy=0x7f2ba40cc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:31.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.673+0000 7f2ba37fe640 1 -- 172.21.15.39:0/117033782 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba4071ca0 con 0x7f2ba406c870 2023-05-16T13:54:31.686 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.677+0000 7f2ba37fe640 1 --2- 172.21.15.39:0/117033782 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2ba406c870 0x7f2ba406fc80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c009d90 tx=0x7f2b9c01c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=417bc8d5c58e97fb server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:31.686 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.677+0000 7f2ba27fc640 1 -- 172.21.15.39:0/117033782 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9c0a5870 con 0x7f2ba406c870 2023-05-16T13:54:31.687 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.677+0000 7f2ba27fc640 1 -- 172.21.15.39:0/117033782 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b9c0a59d0 con 0x7f2ba406c870 2023-05-16T13:54:31.687 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.677+0000 7f2ba27fc640 1 -- 172.21.15.39:0/117033782 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9c0a5d60 con 0x7f2ba406c870 2023-05-16T13:54:31.687 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.677+0000 7f2ba9841640 1 -- 172.21.15.39:0/117033782 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2ba406c870 msgr2=0x7f2ba406fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:31.688 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.677+0000 7f2ba9841640 1 --2- 172.21.15.39:0/117033782 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2ba406c870 0x7f2ba406fc80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c009d90 tx=0x7f2b9c01c8c0 comp rx=0 tx=0).stop 2023-05-16T13:54:31.688 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.677+0000 7f2ba9841640 1 -- 172.21.15.39:0/117033782 shutdown_connections 2023-05-16T13:54:31.688 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.677+0000 7f2ba9841640 1 --2- 172.21.15.39:0/117033782 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2ba406c870 0x7f2ba406fc80 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:31.688 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.677+0000 7f2ba9841640 1 -- 172.21.15.39:0/117033782 >> 172.21.15.39:0/117033782 conn(0x7f2ba4069a50 msgr2=0x7f2ba4069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:31.688 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.677+0000 7f2ba9841640 1 -- 172.21.15.39:0/117033782 shutdown_connections 2023-05-16T13:54:31.688 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.677+0000 7f2ba9841640 1 -- 172.21.15.39:0/117033782 wait complete. 2023-05-16T13:54:31.689 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.681+0000 7f2ba9841640 1 Processor -- start 2023-05-16T13:54:31.689 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.681+0000 7f2ba9841640 1 -- start start 2023-05-16T13:54:31.690 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.681+0000 7f2ba9841640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2ba406c870 0x7f2ba41f7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:31.690 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.681+0000 7f2ba9841640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ba40b0610 0x7f2ba4155740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:31.690 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.681+0000 7f2ba9841640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2ba415e700 0x7f2ba4155c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:31.690 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.681+0000 7f2ba9841640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba414a3b0 con 0x7f2ba415e700 2023-05-16T13:54:31.690 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.681+0000 7f2ba9841640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba41f7970 con 0x7f2ba40b0610 2023-05-16T13:54:31.690 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.681+0000 7f2ba9841640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba41f7bc0 con 0x7f2ba406c870 2023-05-16T13:54:31.691 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.681+0000 7f2ba37fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2ba415e700 0x7f2ba4155c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:31.692 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.681+0000 7f2ba37fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2ba415e700 0x7f2ba4155c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:39734/0 (socket says 172.21.15.39:39734) 2023-05-16T13:54:31.692 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.681+0000 7f2ba37fe640 1 -- 172.21.15.39:0/2146968379 learned_addr learned my addr 172.21.15.39:0/2146968379 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:31.692 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.681+0000 7f2ba37fe640 1 -- 172.21.15.39:0/2146968379 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2ba406c870 msgr2=0x7f2ba41f7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:31.692 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.681+0000 7f2b9bfff640 1 --2- 172.21.15.39:0/2146968379 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ba40b0610 0x7f2ba4155740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:31.692 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.681+0000 7f2ba2ffd640 1 --2- 172.21.15.39:0/2146968379 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2ba406c870 0x7f2ba41f7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:31.692 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.681+0000 7f2ba37fe640 1 --2- 172.21.15.39:0/2146968379 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2ba406c870 0x7f2ba41f7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:31.692 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.681+0000 7f2ba37fe640 1 -- 172.21.15.39:0/2146968379 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ba40b0610 msgr2=0x7f2ba4155740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:31.693 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.681+0000 7f2ba37fe640 1 --2- 172.21.15.39:0/2146968379 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ba40b0610 0x7f2ba4155740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:31.693 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.681+0000 7f2ba37fe640 1 -- 172.21.15.39:0/2146968379 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b9c009a70 con 0x7f2ba415e700 2023-05-16T13:54:31.693 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.681+0000 7f2ba2ffd640 1 --2- 172.21.15.39:0/2146968379 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2ba406c870 0x7f2ba41f7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-16T13:54:31.693 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.681+0000 7f2b9bfff640 1 --2- 172.21.15.39:0/2146968379 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ba40b0610 0x7f2ba4155740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-16T13:54:31.693 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.681+0000 7f2ba37fe640 1 --2- 172.21.15.39:0/2146968379 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2ba415e700 0x7f2ba4155c80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c0b0040 tx=0x7f2b9c019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:31.693 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.681+0000 7f2ba0ff9640 1 -- 172.21.15.39:0/2146968379 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9c0b9650 con 0x7f2ba415e700 2023-05-16T13:54:31.693 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.681+0000 7f2ba0ff9640 1 -- 172.21.15.39:0/2146968379 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b9c0b97b0 con 0x7f2ba415e700 2023-05-16T13:54:31.694 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.681+0000 7f2ba9841640 1 -- 172.21.15.39:0/2146968379 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ba40715e0 con 0x7f2ba415e700 2023-05-16T13:54:31.694 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.681+0000 7f2ba0ff9640 1 -- 172.21.15.39:0/2146968379 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9c0b9b40 con 0x7f2ba415e700 2023-05-16T13:54:31.694 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.681+0000 7f2ba9841640 1 -- 172.21.15.39:0/2146968379 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ba4071930 con 0x7f2ba415e700 2023-05-16T13:54:31.694 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.685+0000 7f2ba0ff9640 1 -- 172.21.15.39:0/2146968379 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2b9c0b9ca0 con 0x7f2ba415e700 2023-05-16T13:54:31.695 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.685+0000 7f2ba0ff9640 1 --2- 172.21.15.39:0/2146968379 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f2b840662b0 0x7f2b84068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:31.695 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.685+0000 7f2ba0ff9640 1 -- 172.21.15.39:0/2146968379 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2b9c11f120 con 0x7f2ba415e700 2023-05-16T13:54:31.695 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.685+0000 7f2ba2ffd640 1 --2- 172.21.15.39:0/2146968379 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f2b840662b0 0x7f2b84068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:31.695 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.685+0000 7f2bacba7000 1 Processor -- start 2023-05-16T13:54:31.696 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.685+0000 7f2bacba7000 1 -- start start 2023-05-16T13:54:31.696 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.685+0000 7f2ba2ffd640 1 --2- 172.21.15.39:0/2146968379 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f2b840662b0 0x7f2b84068760 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2b94000f70 tx=0x7f2b94009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:31.697 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.689+0000 7f2bacba7000 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555bb4292760 0x555bb4292b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:31.697 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.689+0000 7f2bacba7000 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555bb4293070 0x555bb4245ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:31.697 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.689+0000 7f2bacba7000 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555bb4246020 0x555bb42463f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:31.697 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.689+0000 7f2bacba7000 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x555bb4110310 con 0x555bb4246020 2023-05-16T13:54:31.698 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.689+0000 7f2bacba7000 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x555bb404a980 con 0x555bb4293070 2023-05-16T13:54:31.698 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.689+0000 7f2bacba7000 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x555bb409e040 con 0x555bb4292760 2023-05-16T13:54:31.698 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.689+0000 7f2ba37fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555bb4246020 0x555bb42463f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:31.698 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.689+0000 7f2ba37fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555bb4246020 0x555bb42463f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:39740/0 (socket says 172.21.15.39:39740) 2023-05-16T13:54:31.698 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.689+0000 7f2ba37fe640 1 -- 172.21.15.39:0/3337331054 learned_addr learned my addr 172.21.15.39:0/3337331054 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:31.698 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.689+0000 7f2ba2ffd640 1 --2- 172.21.15.39:0/3337331054 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555bb4292760 0x555bb4292b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:31.698 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.689+0000 7f2b9bfff640 1 --2- 172.21.15.39:0/3337331054 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555bb4293070 0x555bb4245ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:31.698 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.689+0000 7f2ba37fe640 1 -- 172.21.15.39:0/3337331054 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555bb4292760 msgr2=0x555bb4292b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:31.699 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.689+0000 7f2ba37fe640 1 --2- 172.21.15.39:0/3337331054 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555bb4292760 0x555bb4292b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:31.699 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.689+0000 7f2ba37fe640 1 -- 172.21.15.39:0/3337331054 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555bb4293070 msgr2=0x555bb4245ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:31.699 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.689+0000 7f2ba37fe640 1 --2- 172.21.15.39:0/3337331054 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555bb4293070 0x555bb4245ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:31.699 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.689+0000 7f2ba37fe640 1 -- 172.21.15.39:0/3337331054 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555bb405c0b0 con 0x555bb4246020 2023-05-16T13:54:31.699 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.689+0000 7f2b9bfff640 1 --2- 172.21.15.39:0/3337331054 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555bb4293070 0x555bb4245ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:54:31.699 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.689+0000 7f2ba37fe640 1 --2- 172.21.15.39:0/3337331054 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555bb4246020 0x555bb42463f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c0095c0 tx=0x7f2b9c0f43e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=534f35021d06b4a1 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:31.699 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.689+0000 7f2b997fa640 1 -- 172.21.15.39:0/3337331054 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9c0ee4e0 con 0x555bb4246020 2023-05-16T13:54:31.700 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.689+0000 7f2b997fa640 1 -- 172.21.15.39:0/3337331054 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b9c0ec9f0 con 0x555bb4246020 2023-05-16T13:54:31.700 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.689+0000 7f2b997fa640 1 -- 172.21.15.39:0/3337331054 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9c0ef9f0 con 0x555bb4246020 2023-05-16T13:54:31.702 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.689+0000 7f2bacba7000 1 -- 172.21.15.39:0/3337331054 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555bb4246020 msgr2=0x555bb42463f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:31.702 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.689+0000 7f2bacba7000 1 --2- 172.21.15.39:0/3337331054 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555bb4246020 0x555bb42463f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c0095c0 tx=0x7f2b9c0f43e0 comp rx=0 tx=0).stop 2023-05-16T13:54:31.702 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.689+0000 7f2bacba7000 1 -- 172.21.15.39:0/3337331054 shutdown_connections 2023-05-16T13:54:31.702 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.689+0000 7f2bacba7000 1 --2- 172.21.15.39:0/3337331054 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555bb4246020 0x555bb42463f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:31.703 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.689+0000 7f2bacba7000 1 --2- 172.21.15.39:0/3337331054 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555bb4293070 0x555bb4245ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:31.703 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.689+0000 7f2bacba7000 1 --2- 172.21.15.39:0/3337331054 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555bb4292760 0x555bb4292b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:31.703 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.689+0000 7f2bacba7000 1 -- 172.21.15.39:0/3337331054 >> 172.21.15.39:0/3337331054 conn(0x555bb4273710 msgr2=0x555bb4275af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:31.703 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.689+0000 7f2bacba7000 1 -- 172.21.15.39:0/3337331054 shutdown_connections 2023-05-16T13:54:31.703 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.689+0000 7f2bacba7000 1 -- 172.21.15.39:0/3337331054 wait complete. 2023-05-16T13:54:31.703 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.689+0000 7f2bacba7000 1 -- start start 2023-05-16T13:54:31.703 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.689+0000 7f2bacba7000 1 Processor -- start 2023-05-16T13:54:31.704 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.693+0000 7f2bacba7000 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555bb4246020 0x555bb424b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:31.704 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.693+0000 7f2bacba7000 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555bb4292760 0x555bb424bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:31.704 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.693+0000 7f2bacba7000 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555bb4293070 0x555bb424c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:31.704 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.693+0000 7f2bacba7000 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x555bb40970e0 con 0x555bb4292760 2023-05-16T13:54:31.704 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.693+0000 7f2bacba7000 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x555bb4053bd0 con 0x555bb4293070 2023-05-16T13:54:31.704 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.693+0000 7f2bacba7000 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x555bb4053870 con 0x555bb4246020 2023-05-16T13:54:31.704 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.693+0000 7f2bacba7000 10 client.0 _ll_register_callbacks cb 0x555bb4233c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-16T13:54:31.704 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.693+0000 7f2b9bfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555bb4292760 0x555bb424bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:31.705 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.693+0000 7f2b9bfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555bb4292760 0x555bb424bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:39744/0 (socket says 172.21.15.39:39744) 2023-05-16T13:54:31.705 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.693+0000 7f2b9bfff640 1 -- 172.21.15.39:0/3855866815 learned_addr learned my addr 172.21.15.39:0/3855866815 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:31.705 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.693+0000 7f2ba2ffd640 1 --2- 172.21.15.39:0/3855866815 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555bb4246020 0x555bb424b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:31.705 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.693+0000 7f2ba37fe640 1 --2- 172.21.15.39:0/3855866815 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555bb4293070 0x555bb424c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:31.705 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.693+0000 7f2b9bfff640 1 -- 172.21.15.39:0/3855866815 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555bb4246020 msgr2=0x555bb424b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:31.705 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.693+0000 7f2b9bfff640 1 --2- 172.21.15.39:0/3855866815 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555bb4246020 0x555bb424b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:31.705 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.693+0000 7f2b9bfff640 1 -- 172.21.15.39:0/3855866815 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555bb4293070 msgr2=0x555bb424c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:31.705 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.693+0000 7f2b9bfff640 1 --2- 172.21.15.39:0/3855866815 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555bb4293070 0x555bb424c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:31.706 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.693+0000 7f2b9bfff640 1 -- 172.21.15.39:0/3855866815 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ba4071930 con 0x555bb4292760 2023-05-16T13:54:31.706 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.693+0000 7f2b9bfff640 1 --2- 172.21.15.39:0/3855866815 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555bb4292760 0x555bb424bb30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c001e90 tx=0x7f2b8c00f660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bc16a9c1f785bde server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:31.706 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.693+0000 7f2b827fc640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-05-16T13:54:31.706 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.693+0000 7f2b827fc640 1 -- 172.21.15.39:0/3855866815 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c00fec0 con 0x555bb4292760 2023-05-16T13:54:31.706 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.693+0000 7f2b827fc640 1 -- 172.21.15.39:0/3855866815 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2b8c005a90 con 0x555bb4292760 2023-05-16T13:54:31.706 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.693+0000 7f2bacba7000 1 -- 172.21.15.39:0/3855866815 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555bb40928b0 con 0x555bb4292760 2023-05-16T13:54:31.706 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.693+0000 7f2b827fc640 1 -- 172.21.15.39:0/3855866815 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b8c005c50 con 0x555bb4292760 2023-05-16T13:54:31.707 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.693+0000 7f2bacba7000 10 client.4749 fetch_fsmap learned FSMap version 8 2023-05-16T13:54:31.707 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.693+0000 7f2bacba7000 1 -- 172.21.15.39:0/3855866815 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x555bb3d93890 con 0x555bb4292760 2023-05-16T13:54:31.707 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.693+0000 7f2b827fc640 1 -- 172.21.15.39:0/3855866815 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555bb40928b0 con 0x555bb4292760 2023-05-16T13:54:31.707 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.693+0000 7f2b827fc640 1 -- 172.21.15.39:0/3855866815 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 8) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f2b8c012070 con 0x555bb4292760 2023-05-16T13:54:31.707 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.693+0000 7f2bacba7000 10 client.4749 fetch_fsmap finished waiting for FSMap version 8 2023-05-16T13:54:31.707 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.693+0000 7f2bacba7000 10 client.4749 resolve_mds: resolved name 'c' to daemon mds.c 2023-05-16T13:54:31.707 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.693+0000 7f2bacba7000 20 client.4749 populate_metadata read hostname 'smithi039' 2023-05-16T13:54:31.707 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.693+0000 7f2bacba7000 1 --2- 172.21.15.39:0/3855866815 >> [v2:172.21.15.39:6835/616280162,v1:172.21.15.39:6837/616280162] conn(0x555bb424ca80 0x555bb42a39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:31.708 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.693+0000 7f2bacba7000 4 client.4749 mds_command: new command op to 4311 tid=0[{"prefix": "get_command_descriptions"}] 2023-05-16T13:54:31.708 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.693+0000 7f2bacba7000 1 -- 172.21.15.39:0/3855866815 --> [v2:172.21.15.39:6835/616280162,v1:172.21.15.39:6837/616280162] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555bb40c5f70 con 0x555bb424ca80 2023-05-16T13:54:31.708 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.693+0000 7f2ba2ffd640 1 --2- 172.21.15.39:0/3855866815 >> [v2:172.21.15.39:6835/616280162,v1:172.21.15.39:6837/616280162] conn(0x555bb424ca80 0x555bb42a39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:31.709 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.693+0000 7f2b827fc640 10 client.4749 ms_handle_connect on v2:172.21.15.39:6835/616280162 2023-05-16T13:54:31.709 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.693+0000 7f2ba2ffd640 1 --2- 172.21.15.39:0/3855866815 >> [v2:172.21.15.39:6835/616280162,v1:172.21.15.39:6837/616280162] conn(0x555bb424ca80 0x555bb42a39f0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59b1c8d1e728e54e server_cookie=2470c32abc77d276 in_seq=0 out_seq=0 2023-05-16T13:54:31.709 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.693+0000 7f2b827fc640 1 -- 172.21.15.39:0/3855866815 <== mds.0 v2:172.21.15.39:6835/616280162 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x555bb40c5f70 con 0x555bb424ca80 2023-05-16T13:54:31.709 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.693+0000 7f2b827fc640 10 client.4749 handle_command_reply: tid=0 2023-05-16T13:54:31.709 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.693+0000 7f2bacba7000 1 client.4749 shutdown 2023-05-16T13:54:31.710 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.693+0000 7f2bacba7000 1 -- 172.21.15.39:0/3855866815 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555bb4292760 msgr2=0x555bb424bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:31.710 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.693+0000 7f2bacba7000 1 --2- 172.21.15.39:0/3855866815 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555bb4292760 0x555bb424bb30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c001e90 tx=0x7f2b8c00f660 comp rx=0 tx=0).stop 2023-05-16T13:54:31.710 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.693+0000 7f2bacba7000 1 -- 172.21.15.39:0/3855866815 shutdown_connections 2023-05-16T13:54:31.710 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.693+0000 7f2bacba7000 1 --2- 172.21.15.39:0/3855866815 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555bb4293070 0x555bb424c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:31.710 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.693+0000 7f2bacba7000 1 --2- 172.21.15.39:0/3855866815 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555bb4292760 0x555bb424bb30 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:31.710 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.693+0000 7f2bacba7000 1 --2- 172.21.15.39:0/3855866815 >> [v2:172.21.15.39:6835/616280162,v1:172.21.15.39:6837/616280162] conn(0x555bb424ca80 0x555bb42a39f0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:31.710 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.693+0000 7f2bacba7000 1 --2- 172.21.15.39:0/3855866815 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555bb4246020 0x555bb424b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:31.710 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.693+0000 7f2bacba7000 1 -- 172.21.15.39:0/3855866815 >> 172.21.15.39:0/3855866815 conn(0x555bb4273710 msgr2=0x555bb4275af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:31.711 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.693+0000 7f2b827fc640 0 client.4749 ms_handle_reset on v2:172.21.15.39:6835/616280162 2023-05-16T13:54:31.711 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.697+0000 7f2bacba7000 1 -- 172.21.15.39:0/3855866815 shutdown_connections 2023-05-16T13:54:31.711 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.697+0000 7f2bacba7000 1 -- 172.21.15.39:0/3855866815 wait complete. 2023-05-16T13:54:31.711 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.697+0000 7f2bacba7000 20 client.4749 trim_cache size 0 max 16384 2023-05-16T13:54:31.719 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.709+0000 7f2bacba7000 1 Processor -- start 2023-05-16T13:54:31.719 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.709+0000 7f2bacba7000 1 -- start start 2023-05-16T13:54:31.720 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.713+0000 7f2bacba7000 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555bb4246020 0x555bb42919c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:31.720 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.713+0000 7f2bacba7000 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555bb4292760 0x555bb4291f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:31.721 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.713+0000 7f2bacba7000 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555bb4293070 0x555bb42a19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:31.721 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.713+0000 7f2bacba7000 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x555bb3d54940 con 0x555bb4293070 2023-05-16T13:54:31.721 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.713+0000 7f2bacba7000 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x555bb4275d20 con 0x555bb4246020 2023-05-16T13:54:31.721 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.713+0000 7f2bacba7000 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x555bb409b0e0 con 0x555bb4292760 2023-05-16T13:54:31.721 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.713+0000 7f2ba37fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555bb4293070 0x555bb42a19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:31.721 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.713+0000 7f2ba37fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555bb4293070 0x555bb42a19e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:39752/0 (socket says 172.21.15.39:39752) 2023-05-16T13:54:31.721 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.713+0000 7f2ba37fe640 1 -- 172.21.15.39:0/3817266077 learned_addr learned my addr 172.21.15.39:0/3817266077 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:31.723 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.713+0000 7f2ba37fe640 1 -- 172.21.15.39:0/3817266077 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555bb4292760 msgr2=0x555bb4291f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:31.723 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.713+0000 7f2ba37fe640 1 --2- 172.21.15.39:0/3817266077 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555bb4292760 0x555bb4291f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:31.723 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.713+0000 7f2ba2ffd640 1 --2- 172.21.15.39:0/3817266077 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555bb4246020 0x555bb42919c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:31.723 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.713+0000 7f2ba37fe640 1 -- 172.21.15.39:0/3817266077 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555bb4246020 msgr2=0x555bb42919c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:31.723 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.713+0000 7f2ba37fe640 1 --2- 172.21.15.39:0/3817266077 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555bb4246020 0x555bb42919c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:31.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.713+0000 7f2ba37fe640 1 -- 172.21.15.39:0/3817266077 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555bb405c360 con 0x555bb4293070 2023-05-16T13:54:31.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.713+0000 7f2ba37fe640 1 --2- 172.21.15.39:0/3817266077 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555bb4293070 0x555bb42a19e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c0effe0 tx=0x7f2b9c0b8000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae9607c7bd5c1670 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:31.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.713+0000 7f2b99ffb640 1 -- 172.21.15.39:0/3817266077 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9c0ee4e0 con 0x555bb4293070 2023-05-16T13:54:31.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.713+0000 7f2b99ffb640 1 -- 172.21.15.39:0/3817266077 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b9c0efe20 con 0x555bb4293070 2023-05-16T13:54:31.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.713+0000 7f2b99ffb640 1 -- 172.21.15.39:0/3817266077 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9c0ecb60 con 0x555bb4293070 2023-05-16T13:54:31.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.713+0000 7f2bacba7000 1 -- 172.21.15.39:0/3817266077 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555bb4293070 msgr2=0x555bb42a19e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:31.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.713+0000 7f2bacba7000 1 --2- 172.21.15.39:0/3817266077 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555bb4293070 0x555bb42a19e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c0effe0 tx=0x7f2b9c0b8000 comp rx=0 tx=0).stop 2023-05-16T13:54:31.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.713+0000 7f2bacba7000 1 -- 172.21.15.39:0/3817266077 shutdown_connections 2023-05-16T13:54:31.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.713+0000 7f2bacba7000 1 --2- 172.21.15.39:0/3817266077 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555bb4292760 0x555bb4291f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:31.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.713+0000 7f2bacba7000 1 --2- 172.21.15.39:0/3817266077 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555bb4293070 0x555bb42a19e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:31.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.713+0000 7f2bacba7000 1 --2- 172.21.15.39:0/3817266077 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555bb4246020 0x555bb42919c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:31.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.713+0000 7f2bacba7000 1 -- 172.21.15.39:0/3817266077 >> 172.21.15.39:0/3817266077 conn(0x555bb4273710 msgr2=0x555bb42912b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:31.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.713+0000 7f2bacba7000 1 -- 172.21.15.39:0/3817266077 shutdown_connections 2023-05-16T13:54:31.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.713+0000 7f2bacba7000 1 -- 172.21.15.39:0/3817266077 wait complete. 2023-05-16T13:54:31.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.713+0000 7f2bacba7000 1 -- start start 2023-05-16T13:54:31.726 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.713+0000 7f2bacba7000 1 Processor -- start 2023-05-16T13:54:31.729 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.717+0000 7f2bacba7000 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555bb4246020 0x555bb42a4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:31.729 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.717+0000 7f2bacba7000 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555bb4292760 0x555bb42f1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:31.730 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.717+0000 7f2bacba7000 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555bb4293070 0x555bb42f17d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:31.730 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.717+0000 7f2bacba7000 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x555bb4092a50 con 0x555bb4292760 2023-05-16T13:54:31.730 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.717+0000 7f2bacba7000 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x555bb42a83d0 con 0x555bb4293070 2023-05-16T13:54:31.730 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.717+0000 7f2bacba7000 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x555bb403f710 con 0x555bb4246020 2023-05-16T13:54:31.730 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.717+0000 7f2bacba7000 10 client.0 _ll_register_callbacks cb 0x555bb40623e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-16T13:54:31.730 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.717+0000 7f2b9bfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555bb4292760 0x555bb42f1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:31.730 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.717+0000 7f2b9bfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555bb4292760 0x555bb42f1290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:39768/0 (socket says 172.21.15.39:39768) 2023-05-16T13:54:31.731 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.717+0000 7f2b9bfff640 1 -- 172.21.15.39:0/4280652663 learned_addr learned my addr 172.21.15.39:0/4280652663 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:31.731 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.717+0000 7f2ba2ffd640 1 --2- 172.21.15.39:0/4280652663 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555bb4246020 0x555bb42a4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:31.731 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.717+0000 7f2ba37fe640 1 --2- 172.21.15.39:0/4280652663 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555bb4293070 0x555bb42f17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:31.731 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.717+0000 7f2b9bfff640 1 -- 172.21.15.39:0/4280652663 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555bb4246020 msgr2=0x555bb42a4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:31.731 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.717+0000 7f2b9bfff640 1 --2- 172.21.15.39:0/4280652663 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555bb4246020 0x555bb42a4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:31.731 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.717+0000 7f2b9bfff640 1 -- 172.21.15.39:0/4280652663 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555bb4293070 msgr2=0x555bb42f17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:31.731 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.717+0000 7f2b9bfff640 1 --2- 172.21.15.39:0/4280652663 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555bb4293070 0x555bb42f17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:31.731 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.717+0000 7f2b9bfff640 1 -- 172.21.15.39:0/4280652663 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555bb405c0b0 con 0x555bb4292760 2023-05-16T13:54:31.732 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.717+0000 7f2b9bfff640 1 --2- 172.21.15.39:0/4280652663 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555bb4292760 0x555bb42f1290 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c00f6a0 tx=0x7f2b8c0012f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e969fd76b55dbd2 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:31.732 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.717+0000 7f2b827fc640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-05-16T13:54:31.732 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.717+0000 7f2b827fc640 1 -- 172.21.15.39:0/4280652663 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c005a90 con 0x555bb4292760 2023-05-16T13:54:31.732 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.717+0000 7f2b827fc640 1 -- 172.21.15.39:0/4280652663 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2b8c005bf0 con 0x555bb4292760 2023-05-16T13:54:31.732 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.717+0000 7f2bacba7000 1 -- 172.21.15.39:0/4280652663 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2b9c0ec9f0 con 0x555bb4292760 2023-05-16T13:54:31.732 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.717+0000 7f2b827fc640 1 -- 172.21.15.39:0/4280652663 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b8c0070d0 con 0x555bb4292760 2023-05-16T13:54:31.732 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.717+0000 7f2bacba7000 10 client.4755 fetch_fsmap learned FSMap version 8 2023-05-16T13:54:31.733 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.717+0000 7f2bacba7000 1 -- 172.21.15.39:0/4280652663 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x555bb4041be0 con 0x555bb4292760 2023-05-16T13:54:31.733 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.717+0000 7f2b827fc640 1 -- 172.21.15.39:0/4280652663 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b9c0ec9f0 con 0x555bb4292760 2023-05-16T13:54:31.733 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.717+0000 7f2b827fc640 1 -- 172.21.15.39:0/4280652663 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 8) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f2b8c007230 con 0x555bb4292760 2023-05-16T13:54:31.733 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.717+0000 7f2bacba7000 10 client.4755 fetch_fsmap finished waiting for FSMap version 8 2023-05-16T13:54:31.733 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.717+0000 7f2bacba7000 10 client.4755 resolve_mds: resolved name 'c' to daemon mds.c 2023-05-16T13:54:31.733 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.717+0000 7f2bacba7000 20 client.4755 populate_metadata read hostname 'smithi039' 2023-05-16T13:54:31.733 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.717+0000 7f2bacba7000 1 --2- 172.21.15.39:0/4280652663 >> [v2:172.21.15.39:6835/616280162,v1:172.21.15.39:6837/616280162] conn(0x555bb42edbf0 0x555bb42edfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:31.733 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.717+0000 7f2bacba7000 4 client.4755 mds_command: new command op to 4311 tid=0[{"prefix": "status"}] 2023-05-16T13:54:31.734 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.717+0000 7f2bacba7000 1 -- 172.21.15.39:0/4280652663 --> [v2:172.21.15.39:6835/616280162,v1:172.21.15.39:6837/616280162] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555bb40900c0 con 0x555bb42edbf0 2023-05-16T13:54:31.734 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.717+0000 7f2ba2ffd640 1 --2- 172.21.15.39:0/4280652663 >> [v2:172.21.15.39:6835/616280162,v1:172.21.15.39:6837/616280162] conn(0x555bb42edbf0 0x555bb42edfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:31.734 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.717+0000 7f2ba2ffd640 1 --2- 172.21.15.39:0/4280652663 >> [v2:172.21.15.39:6835/616280162,v1:172.21.15.39:6837/616280162] conn(0x555bb42edbf0 0x555bb42edfc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70851f2fa5720de4 server_cookie=d984c3a8508337d1 in_seq=0 out_seq=0 2023-05-16T13:54:31.734 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.717+0000 7f2b827fc640 10 client.4755 ms_handle_connect on v2:172.21.15.39:6835/616280162 2023-05-16T13:54:31.734 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.717+0000 7f2b827fc640 1 -- 172.21.15.39:0/4280652663 <== mds.0 v2:172.21.15.39:6835/616280162 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x555bb40900c0 con 0x555bb42edbf0 2023-05-16T13:54:31.734 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.717+0000 7f2b827fc640 10 client.4755 handle_command_reply: tid=0 2023-05-16T13:54:31.734 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.717+0000 7f2bacba7000 1 client.4755 shutdown 2023-05-16T13:54:31.734 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.717+0000 7f2bacba7000 1 -- 172.21.15.39:0/4280652663 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555bb4292760 msgr2=0x555bb42f1290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:31.735 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.717+0000 7f2bacba7000 1 --2- 172.21.15.39:0/4280652663 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555bb4292760 0x555bb42f1290 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c00f6a0 tx=0x7f2b8c0012f0 comp rx=0 tx=0).stop 2023-05-16T13:54:31.735 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.717+0000 7f2bacba7000 1 -- 172.21.15.39:0/4280652663 shutdown_connections 2023-05-16T13:54:31.735 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.717+0000 7f2bacba7000 1 --2- 172.21.15.39:0/4280652663 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555bb4293070 0x555bb42f17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:31.735 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.717+0000 7f2bacba7000 1 --2- 172.21.15.39:0/4280652663 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555bb4292760 0x555bb42f1290 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:31.735 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.717+0000 7f2bacba7000 1 --2- 172.21.15.39:0/4280652663 >> [v2:172.21.15.39:6835/616280162,v1:172.21.15.39:6837/616280162] conn(0x555bb42edbf0 0x555bb42edfc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:31.735 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.717+0000 7f2bacba7000 1 --2- 172.21.15.39:0/4280652663 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x555bb4246020 0x555bb42a4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:31.735 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.717+0000 7f2bacba7000 1 -- 172.21.15.39:0/4280652663 >> 172.21.15.39:0/4280652663 conn(0x555bb4273710 msgr2=0x555bb42912b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:31.735 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.717+0000 7f2b827fc640 0 client.4755 ms_handle_reset on v2:172.21.15.39:6835/616280162 2023-05-16T13:54:31.736 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.717+0000 7f2bacba7000 1 -- 172.21.15.39:0/4280652663 shutdown_connections 2023-05-16T13:54:31.736 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.717+0000 7f2bacba7000 1 -- 172.21.15.39:0/4280652663 wait complete. 2023-05-16T13:54:31.736 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.721+0000 7f2bacba7000 20 client.4755 trim_cache size 0 max 16384 2023-05-16T13:54:31.736 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2023-05-16T13:54:31.736 INFO:teuthology.orchestra.run.smithi039.stdout: "cluster_fsid": "9c1e210b-c515-4ea4-a065-397956895c68", 2023-05-16T13:54:31.737 INFO:teuthology.orchestra.run.smithi039.stdout: "whoami": 0, 2023-05-16T13:54:31.737 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 4311, 2023-05-16T13:54:31.737 INFO:teuthology.orchestra.run.smithi039.stdout: "want_state": "up:active", 2023-05-16T13:54:31.737 INFO:teuthology.orchestra.run.smithi039.stdout: "state": "up:active", 2023-05-16T13:54:31.737 INFO:teuthology.orchestra.run.smithi039.stdout: "fs_name": "cephfs", 2023-05-16T13:54:31.737 INFO:teuthology.orchestra.run.smithi039.stdout: "rank_uptime": 16.529523884, 2023-05-16T13:54:31.737 INFO:teuthology.orchestra.run.smithi039.stdout: "mdsmap_epoch": 8, 2023-05-16T13:54:31.738 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch": 24, 2023-05-16T13:54:31.738 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch_barrier": 24, 2023-05-16T13:54:31.738 INFO:teuthology.orchestra.run.smithi039.stdout: "uptime": 21.808628681999998 2023-05-16T13:54:31.738 INFO:teuthology.orchestra.run.smithi039.stdout:} 2023-05-16T13:54:31.739 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.721+0000 7f2ba9841640 1 -- 172.21.15.39:0/2146968379 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f2b840662b0 msgr2=0x7f2b84068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:31.739 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.721+0000 7f2ba9841640 1 --2- 172.21.15.39:0/2146968379 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f2b840662b0 0x7f2b84068760 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2b94000f70 tx=0x7f2b94009040 comp rx=0 tx=0).stop 2023-05-16T13:54:31.739 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.721+0000 7f2ba9841640 1 -- 172.21.15.39:0/2146968379 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2ba415e700 msgr2=0x7f2ba4155c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:31.739 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.721+0000 7f2ba9841640 1 --2- 172.21.15.39:0/2146968379 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2ba415e700 0x7f2ba4155c80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c0b0040 tx=0x7f2b9c019660 comp rx=0 tx=0).stop 2023-05-16T13:54:31.739 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.721+0000 7f2ba9841640 1 -- 172.21.15.39:0/2146968379 shutdown_connections 2023-05-16T13:54:31.739 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.721+0000 7f2ba9841640 1 --2- 172.21.15.39:0/2146968379 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2ba415e700 0x7f2ba4155c80 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:31.739 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.721+0000 7f2ba9841640 1 --2- 172.21.15.39:0/2146968379 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ba40b0610 0x7f2ba4155740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:31.740 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.721+0000 7f2ba9841640 1 --2- 172.21.15.39:0/2146968379 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f2b840662b0 0x7f2b84068760 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:31.740 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.721+0000 7f2ba9841640 1 --2- 172.21.15.39:0/2146968379 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2ba406c870 0x7f2ba41f7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:31.740 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.721+0000 7f2ba9841640 1 -- 172.21.15.39:0/2146968379 >> 172.21.15.39:0/2146968379 conn(0x7f2ba4069a50 msgr2=0x7f2ba40aee10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:31.740 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.721+0000 7f2ba9841640 1 -- 172.21.15.39:0/2146968379 shutdown_connections 2023-05-16T13:54:31.740 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:31.721+0000 7f2ba9841640 1 -- 172.21.15.39:0/2146968379 wait complete. 2023-05-16T13:54:31.747 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-05-16T13:54:31.772 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-05-16T13:54:31.772 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-05-16T13:54:31.773 INFO:tasks.ceph_fuse:client.0 config is {} 2023-05-16T13:54:31.773 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-05-16T13:54:31.774 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-05-16T13:54:31.774 INFO:tasks.ceph_fuse:client.2 config is {} 2023-05-16T13:54:31.774 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-05-16T13:54:31.774 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-05-16T13:54:31.774 INFO:tasks.ceph_fuse:client.1 config is {} 2023-05-16T13:54:31.775 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-05-16T13:54:31.775 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-05-16T13:54:31.775 INFO:tasks.ceph_fuse:client.3 config is {} 2023-05-16T13:54:31.775 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-05-16T13:54:31.775 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-05-16T13:54:31.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:31.776 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list 2023-05-16T13:54:31.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:31.787 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link delete ceph-brx 2023-05-16T13:54:31.850 INFO:teuthology.orchestra.run.smithi118.stderr:Cannot find device "ceph-brx" 2023-05-16T13:54:31.852 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-16T13:54:31.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:31.853 DEBUG:teuthology.orchestra.run.smithi039:> ip netns list 2023-05-16T13:54:31.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:31.861 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link delete ceph-brx 2023-05-16T13:54:31.924 INFO:teuthology.orchestra.run.smithi039.stderr:Cannot find device "ceph-brx" 2023-05-16T13:54:31.926 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-16T13:54:31.926 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-05-16T13:54:31.926 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-05-16T13:54:32.104 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.093+0000 7fd041998640 1 Processor -- start 2023-05-16T13:54:32.104 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.097+0000 7fd041998640 1 -- start start 2023-05-16T13:54:32.105 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.097+0000 7fd041998640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd03c0ced10 0x7fd03c06fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:32.105 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.097+0000 7fd041998640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd03c0c9cb0 0x7fd03c0713f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:32.105 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.097+0000 7fd041998640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd03c071930 0x7fd03c15d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:32.106 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.097+0000 7fd041998640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd03c0cf0e0 con 0x7fd03c071930 2023-05-16T13:54:32.106 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.097+0000 7fd041998640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd03c0c89f0 con 0x7fd03c0c9cb0 2023-05-16T13:54:32.106 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.097+0000 7fd041998640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd03c0c8c40 con 0x7fd03c0ced10 2023-05-16T13:54:32.106 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.097+0000 7fd03b7fe640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd03c071930 0x7fd03c15d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:32.106 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.097+0000 7fd03b7fe640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd03c071930 0x7fd03c15d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:39776/0 (socket says 172.21.15.39:39776) 2023-05-16T13:54:32.107 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.097+0000 7fd03b7fe640 1 -- 172.21.15.39:0/603740164 learned_addr learned my addr 172.21.15.39:0/603740164 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:32.107 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.097+0000 7fd033fff640 1 --2- 172.21.15.39:0/603740164 >> v2:172.21.15.118:3300/0 conn(0x7fd03c0c9cb0 0x7fd03c0713f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:32.107 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.097+0000 7fd03affd640 1 --2- 172.21.15.39:0/603740164 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd03c0ced10 0x7fd03c06fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:32.107 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.097+0000 7fd03b7fe640 1 -- 172.21.15.39:0/603740164 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd03c0ced10 msgr2=0x7fd03c06fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:32.108 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.097+0000 7fd03b7fe640 1 --2- 172.21.15.39:0/603740164 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd03c0ced10 0x7fd03c06fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:32.108 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.097+0000 7fd03b7fe640 1 -- 172.21.15.39:0/603740164 >> v2:172.21.15.118:3300/0 conn(0x7fd03c0c9cb0 msgr2=0x7fd03c0713f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:32.108 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.097+0000 7fd03b7fe640 1 --2- 172.21.15.39:0/603740164 >> v2:172.21.15.118:3300/0 conn(0x7fd03c0c9cb0 0x7fd03c0713f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:32.108 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.097+0000 7fd03b7fe640 1 -- 172.21.15.39:0/603740164 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd03c0c8f20 con 0x7fd03c071930 2023-05-16T13:54:32.110 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.101+0000 7fd03b7fe640 1 --2- 172.21.15.39:0/603740164 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd03c071930 0x7fd03c15d9a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd03c0cbf20 tx=0x7fd03401c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=675c0e13fbd2000c server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:32.111 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.101+0000 7fd03a7fc640 1 -- 172.21.15.39:0/603740164 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0340a64e0 con 0x7fd03c071930 2023-05-16T13:54:32.111 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.101+0000 7fd03a7fc640 1 -- 172.21.15.39:0/603740164 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0340a6640 con 0x7fd03c071930 2023-05-16T13:54:32.111 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.101+0000 7fd03a7fc640 1 -- 172.21.15.39:0/603740164 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0340a69d0 con 0x7fd03c071930 2023-05-16T13:54:32.111 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.101+0000 7fd041998640 1 -- 172.21.15.39:0/603740164 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd03c071930 msgr2=0x7fd03c15d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:32.111 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.101+0000 7fd041998640 1 --2- 172.21.15.39:0/603740164 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd03c071930 0x7fd03c15d9a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd03c0cbf20 tx=0x7fd03401c650 comp rx=0 tx=0).stop 2023-05-16T13:54:32.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.101+0000 7fd041998640 1 -- 172.21.15.39:0/603740164 shutdown_connections 2023-05-16T13:54:32.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.101+0000 7fd041998640 1 --2- 172.21.15.39:0/603740164 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd03c071930 0x7fd03c15d9a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:32.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.101+0000 7fd041998640 1 --2- 172.21.15.39:0/603740164 >> v2:172.21.15.118:3300/0 conn(0x7fd03c0c9cb0 0x7fd03c0713f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:32.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.101+0000 7fd041998640 1 --2- 172.21.15.39:0/603740164 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd03c0ced10 0x7fd03c06fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:32.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.101+0000 7fd041998640 1 -- 172.21.15.39:0/603740164 >> 172.21.15.39:0/603740164 conn(0x7fd03c069a50 msgr2=0x7fd03c069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:32.113 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.101+0000 7fd041998640 1 -- 172.21.15.39:0/603740164 shutdown_connections 2023-05-16T13:54:32.113 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.101+0000 7fd041998640 1 -- 172.21.15.39:0/603740164 wait complete. 2023-05-16T13:54:32.115 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.101+0000 7fd041998640 1 Processor -- start 2023-05-16T13:54:32.115 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.101+0000 7fd041998640 1 -- start start 2023-05-16T13:54:32.115 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.105+0000 7fd041998640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd03c071930 0x7fd03c145e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:32.116 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.105+0000 7fd041998640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd03c0c9cb0 0x7fd03c1f5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:32.116 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.105+0000 7fd041998640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd03c0ced10 0x7fd03c1f3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:32.116 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.105+0000 7fd041998640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd03c0c49e0 con 0x7fd03c071930 2023-05-16T13:54:32.116 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.105+0000 7fd041998640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd03c1f5690 con 0x7fd03c0ced10 2023-05-16T13:54:32.116 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.105+0000 7fd041998640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd03c1f7db0 con 0x7fd03c0c9cb0 2023-05-16T13:54:32.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.105+0000 7fd03affd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd03c071930 0x7fd03c145e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:32.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.105+0000 7fd03affd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd03c071930 0x7fd03c145e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:39786/0 (socket says 172.21.15.39:39786) 2023-05-16T13:54:32.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.105+0000 7fd03affd640 1 -- 172.21.15.39:0/683829687 learned_addr learned my addr 172.21.15.39:0/683829687 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:32.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.105+0000 7fd03b7fe640 1 --2- 172.21.15.39:0/683829687 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd03c0ced10 0x7fd03c1f3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:32.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.105+0000 7fd033fff640 1 --2- 172.21.15.39:0/683829687 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd03c0c9cb0 0x7fd03c1f5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:32.118 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.105+0000 7fd03affd640 1 -- 172.21.15.39:0/683829687 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd03c0c9cb0 msgr2=0x7fd03c1f5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:32.118 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.105+0000 7fd03affd640 1 --2- 172.21.15.39:0/683829687 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd03c0c9cb0 0x7fd03c1f5150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:32.118 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.105+0000 7fd03affd640 1 -- 172.21.15.39:0/683829687 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd03c0ced10 msgr2=0x7fd03c1f3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:32.118 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.105+0000 7fd03affd640 1 --2- 172.21.15.39:0/683829687 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd03c0ced10 0x7fd03c1f3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:32.118 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.105+0000 7fd03affd640 1 -- 172.21.15.39:0/683829687 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd034009b30 con 0x7fd03c071930 2023-05-16T13:54:32.118 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.105+0000 7fd03b7fe640 1 --2- 172.21.15.39:0/683829687 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd03c0ced10 0x7fd03c1f3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-16T13:54:32.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.105+0000 7fd03affd640 1 --2- 172.21.15.39:0/683829687 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd03c071930 0x7fd03c145e40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd02c00e8a0 tx=0x7fd02c00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:32.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.105+0000 7fd038ff9640 1 -- 172.21.15.39:0/683829687 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd02c009510 con 0x7fd03c071930 2023-05-16T13:54:32.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.105+0000 7fd038ff9640 1 -- 172.21.15.39:0/683829687 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd02c00c8e0 con 0x7fd03c071930 2023-05-16T13:54:32.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.105+0000 7fd038ff9640 1 -- 172.21.15.39:0/683829687 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd02c00cc50 con 0x7fd03c071930 2023-05-16T13:54:32.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.105+0000 7fd041998640 1 -- 172.21.15.39:0/683829687 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd03c0b42f0 con 0x7fd03c071930 2023-05-16T13:54:32.120 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.105+0000 7fd041998640 1 -- 172.21.15.39:0/683829687 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd03c0c97c0 con 0x7fd03c071930 2023-05-16T13:54:32.120 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.105+0000 7fd041998640 1 -- 172.21.15.39:0/683829687 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd03c071db0 con 0x7fd03c071930 2023-05-16T13:54:32.121 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.105+0000 7fd038ff9640 1 -- 172.21.15.39:0/683829687 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd02c013470 con 0x7fd03c071930 2023-05-16T13:54:32.121 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.109+0000 7fd038ff9640 1 --2- 172.21.15.39:0/683829687 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd01c066280 0x7fd01c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:32.122 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.109+0000 7fd038ff9640 1 -- 172.21.15.39:0/683829687 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd02c083e30 con 0x7fd03c071930 2023-05-16T13:54:32.122 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.109+0000 7fd033fff640 1 --2- 172.21.15.39:0/683829687 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd01c066280 0x7fd01c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:32.122 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.109+0000 7fd033fff640 1 --2- 172.21.15.39:0/683829687 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd01c066280 0x7fd01c068730 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd03c0b3b60 tx=0x7fd024008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:32.123 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.113+0000 7fd038ff9640 1 -- 172.21.15.39:0/683829687 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fd02c0512a0 con 0x7fd03c071930 2023-05-16T13:54:32.310 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.301+0000 7fd041998640 1 -- 172.21.15.39:0/683829687 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd03c073c90 con 0x7fd03c071930 2023-05-16T13:54:32.311 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.301+0000 7fd038ff9640 1 -- 172.21.15.39:0/683829687 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd02c017070 con 0x7fd03c071930 2023-05-16T13:54:32.311 INFO:teuthology.orchestra.run.smithi039.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-05-16T13:54:32.312 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.305+0000 7fd041998640 1 -- 172.21.15.39:0/683829687 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd01c066280 msgr2=0x7fd01c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:32.313 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.305+0000 7fd041998640 1 --2- 172.21.15.39:0/683829687 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd01c066280 0x7fd01c068730 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd03c0b3b60 tx=0x7fd024008040 comp rx=0 tx=0).stop 2023-05-16T13:54:32.313 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.305+0000 7fd041998640 1 -- 172.21.15.39:0/683829687 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd03c071930 msgr2=0x7fd03c145e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:32.313 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.305+0000 7fd041998640 1 --2- 172.21.15.39:0/683829687 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd03c071930 0x7fd03c145e40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd02c00e8a0 tx=0x7fd02c00eca0 comp rx=0 tx=0).stop 2023-05-16T13:54:32.313 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.305+0000 7fd041998640 1 -- 172.21.15.39:0/683829687 shutdown_connections 2023-05-16T13:54:32.313 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.305+0000 7fd041998640 1 --2- 172.21.15.39:0/683829687 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd01c066280 0x7fd01c068730 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:32.314 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.305+0000 7fd041998640 1 --2- 172.21.15.39:0/683829687 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd03c0c9cb0 0x7fd03c1f5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:32.314 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.305+0000 7fd041998640 1 --2- 172.21.15.39:0/683829687 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd03c0ced10 0x7fd03c1f3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:32.314 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.305+0000 7fd041998640 1 --2- 172.21.15.39:0/683829687 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd03c071930 0x7fd03c145e40 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:32.314 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.305+0000 7fd041998640 1 -- 172.21.15.39:0/683829687 >> 172.21.15.39:0/683829687 conn(0x7fd03c069a50 msgr2=0x7fd03c0cbf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:32.314 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.305+0000 7fd041998640 1 -- 172.21.15.39:0/683829687 shutdown_connections 2023-05-16T13:54:32.314 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:32.305+0000 7fd041998640 1 -- 172.21.15.39:0/683829687 wait complete. 2023-05-16T13:54:32.331 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-16T13:54:32.331 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-16T13:54:32.331 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi039.front.sepia.ceph.com 2023-05-16T13:54:32.332 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-05-16T13:54:32.332 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-05-16T13:54:32.332 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-16T13:54:32.332 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-05-16T13:54:32.332 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-16T13:54:32.333 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-05-16T13:54:32.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:32.333 DEBUG:teuthology.orchestra.run.smithi039:> ip addr 2023-05-16T13:54:32.342 INFO:teuthology.orchestra.run.smithi039.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-16T13:54:32.342 INFO:teuthology.orchestra.run.smithi039.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-16T13:54:32.342 INFO:teuthology.orchestra.run.smithi039.stdout: inet 127.0.0.1/8 scope host lo 2023-05-16T13:54:32.342 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-05-16T13:54:32.342 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 ::1/128 scope host 2023-05-16T13:54:32.342 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-05-16T13:54:32.343 INFO:teuthology.orchestra.run.smithi039.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-05-16T13:54:32.343 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:6b:fe:c6 brd ff:ff:ff:ff:ff:ff 2023-05-16T13:54:32.343 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp7s0f0 2023-05-16T13:54:32.343 INFO:teuthology.orchestra.run.smithi039.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-05-16T13:54:32.343 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:6b:fe:c7 brd ff:ff:ff:ff:ff:ff 2023-05-16T13:54:32.343 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp7s0f1 2023-05-16T13:54:32.343 INFO:teuthology.orchestra.run.smithi039.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-16T13:54:32.344 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:bd:13:70 brd ff:ff:ff:ff:ff:ff 2023-05-16T13:54:32.344 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp1s0f0 2023-05-16T13:54:32.344 INFO:teuthology.orchestra.run.smithi039.stdout: inet 172.21.15.39/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-05-16T13:54:32.344 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft 42328sec preferred_lft 42328sec 2023-05-16T13:54:32.344 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 fe80::ec4:7aff:febd:1370/64 scope link 2023-05-16T13:54:32.344 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-05-16T13:54:32.344 INFO:teuthology.orchestra.run.smithi039.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-05-16T13:54:32.345 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:bd:13:71 brd ff:ff:ff:ff:ff:ff 2023-05-16T13:54:32.345 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp1s0f1 2023-05-16T13:54:32.345 INFO:teuthology.orchestra.run.smithi039.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-05-16T13:54:32.345 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 02:42:f1:77:1b:cd brd ff:ff:ff:ff:ff:ff 2023-05-16T13:54:32.345 INFO:teuthology.orchestra.run.smithi039.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-05-16T13:54:32.345 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-05-16T13:54:32.346 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-05-16T13:54:32.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:32.347 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec bash -c ' 2023-05-16T13:54:32.347 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2023-05-16T13:54:32.347 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link add name ceph-brx type bridge 2023-05-16T13:54:32.347 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip addr flush dev ceph-brx 2023-05-16T13:54:32.348 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link set ceph-brx up 2023-05-16T13:54:32.348 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-05-16T13:54:32.348 DEBUG:teuthology.orchestra.run.smithi039:> ') 2023-05-16T13:54:32.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:32.452 DEBUG:teuthology.orchestra.run.smithi039:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-16T13:54:32.469 INFO:teuthology.orchestra.run.smithi039.stdout:1 2023-05-16T13:54:32.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:32.473 DEBUG:teuthology.orchestra.run.smithi039:> route 2023-05-16T13:54:32.540 INFO:teuthology.orchestra.run.smithi039.stdout:Kernel IP routing table 2023-05-16T13:54:32.540 INFO:teuthology.orchestra.run.smithi039.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-16T13:54:32.540 INFO:teuthology.orchestra.run.smithi039.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-05-16T13:54:32.540 INFO:teuthology.orchestra.run.smithi039.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-05-16T13:54:32.541 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-05-16T13:54:32.541 INFO:teuthology.orchestra.run.smithi039.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-16T13:54:32.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:32.541 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec bash -c ' 2023-05-16T13:54:32.542 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2023-05-16T13:54:32.542 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-05-16T13:54:32.542 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-05-16T13:54:32.542 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-05-16T13:54:32.543 DEBUG:teuthology.orchestra.run.smithi039:> ') 2023-05-16T13:54:32.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:32.635 DEBUG:teuthology.orchestra.run.smithi039:> ip netns list 2023-05-16T13:54:32.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:32.684 DEBUG:teuthology.orchestra.run.smithi039:> ip netns list-id 2023-05-16T13:54:32.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:32.735 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec bash -c ' 2023-05-16T13:54:32.735 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2023-05-16T13:54:32.736 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-05-16T13:54:32.736 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-05-16T13:54:32.736 DEBUG:teuthology.orchestra.run.smithi039:> ') 2023-05-16T13:54:32.812 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-05-16T13:54:32.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:32.813 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec bash -c ' 2023-05-16T13:54:32.813 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2023-05-16T13:54:32.813 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-05-16T13:54:32.814 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-05-16T13:54:32.814 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-05-16T13:54:32.814 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-05-16T13:54:32.814 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-05-16T13:54:32.815 DEBUG:teuthology.orchestra.run.smithi039:> ') 2023-05-16T13:54:32.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:32.979 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec bash -c ' 2023-05-16T13:54:32.979 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2023-05-16T13:54:32.979 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link set brx.0 up 2023-05-16T13:54:32.980 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link set dev brx.0 master ceph-brx 2023-05-16T13:54:32.980 DEBUG:teuthology.orchestra.run.smithi039:> ') 2023-05-16T13:54:33.019 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-05-16T13:54:33.020 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-16T13:54:33.020 DEBUG:teuthology.orchestra.run.smithi039:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-05-16T13:54:33.075 INFO:teuthology.orchestra.run.smithi039.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-05-16T13:54:33.075 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-16T13:54:33.075 DEBUG:teuthology.orchestra.run.smithi039:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-05-16T13:54:33.126 DEBUG:teuthology.orchestra.run.smithi039:> sudo modprobe fuse 2023-05-16T13:54:33.186 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-16T13:54:33.187 DEBUG:teuthology.orchestra.run.smithi039:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-16T13:54:33.245 INFO:teuthology.orchestra.run.smithi039.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-16T13:54:33.246 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-16T13:54:33.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:33.247 DEBUG:teuthology.orchestra.run.smithi039:> ls /sys/fs/fuse/connections 2023-05-16T13:54:33.298 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-05-16T13:54:33.299 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-05-16T13:54:33.342 DEBUG:teuthology.orchestra.run.smithi039:> sudo modprobe fuse 2023-05-16T13:54:33.361 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-16T13:54:33.362 DEBUG:teuthology.orchestra.run.smithi039:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-16T13:54:33.425 INFO:teuthology.orchestra.run.smithi039.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-16T13:54:33.426 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-16T13:54:33.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:33.427 DEBUG:teuthology.orchestra.run.smithi039:> ls /sys/fs/fuse/connections 2023-05-16T13:54:33.456 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi039.stderr:2023-05-16T13:54:33.449+0000 7fb84e173580 -1 init, newargv = 0x55776257e730 newargc=15 2023-05-16T13:54:33.457 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi039.stderr:ceph-fuse[43845]: starting ceph client 2023-05-16T13:54:33.465 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi039.stderr:ceph-fuse[43845]: starting fuse 2023-05-16T13:54:34.565 DEBUG:teuthology.orchestra.run.smithi039:> sudo modprobe fuse 2023-05-16T13:54:34.588 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-16T13:54:34.588 DEBUG:teuthology.orchestra.run.smithi039:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-16T13:54:34.650 INFO:teuthology.orchestra.run.smithi039.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-16T13:54:34.651 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-16T13:54:34.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:34.652 DEBUG:teuthology.orchestra.run.smithi039:> ls /sys/fs/fuse/connections 2023-05-16T13:54:34.707 INFO:teuthology.orchestra.run.smithi039.stdout:42 2023-05-16T13:54:34.707 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2023-05-16T13:54:34.707 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-05-16T13:54:34.708 DEBUG:teuthology.orchestra.run.smithi039:> import glob 2023-05-16T13:54:34.708 DEBUG:teuthology.orchestra.run.smithi039:> import re 2023-05-16T13:54:34.708 DEBUG:teuthology.orchestra.run.smithi039:> import os 2023-05-16T13:54:34.708 DEBUG:teuthology.orchestra.run.smithi039:> import subprocess 2023-05-16T13:54:34.709 DEBUG:teuthology.orchestra.run.smithi039:> 2023-05-16T13:54:34.709 DEBUG:teuthology.orchestra.run.smithi039:> def _find_admin_socket(client_name): 2023-05-16T13:54:34.709 DEBUG:teuthology.orchestra.run.smithi039:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-05-16T13:54:34.709 DEBUG:teuthology.orchestra.run.smithi039:> files = glob.glob(asok_path) 2023-05-16T13:54:34.710 DEBUG:teuthology.orchestra.run.smithi039:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-05-16T13:54:34.710 DEBUG:teuthology.orchestra.run.smithi039:> 2023-05-16T13:54:34.710 DEBUG:teuthology.orchestra.run.smithi039:> # Given a non-glob path, it better be there 2023-05-16T13:54:34.710 DEBUG:teuthology.orchestra.run.smithi039:> if "*" not in asok_path: 2023-05-16T13:54:34.710 DEBUG:teuthology.orchestra.run.smithi039:> assert(len(files) == 1) 2023-05-16T13:54:34.711 DEBUG:teuthology.orchestra.run.smithi039:> return files[0] 2023-05-16T13:54:34.711 DEBUG:teuthology.orchestra.run.smithi039:> 2023-05-16T13:54:34.711 DEBUG:teuthology.orchestra.run.smithi039:> for f in files: 2023-05-16T13:54:34.711 DEBUG:teuthology.orchestra.run.smithi039:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-05-16T13:54:34.712 DEBUG:teuthology.orchestra.run.smithi039:> if os.path.exists("/proc/{0}".format(pid)): 2023-05-16T13:54:34.712 DEBUG:teuthology.orchestra.run.smithi039:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-05-16T13:54:34.712 DEBUG:teuthology.orchestra.run.smithi039:> contents = proc_f.read() 2023-05-16T13:54:34.712 DEBUG:teuthology.orchestra.run.smithi039:> if mountpoint in contents: 2023-05-16T13:54:34.712 DEBUG:teuthology.orchestra.run.smithi039:> return f 2023-05-16T13:54:34.713 DEBUG:teuthology.orchestra.run.smithi039:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-05-16T13:54:34.713 DEBUG:teuthology.orchestra.run.smithi039:> 2023-05-16T13:54:34.713 DEBUG:teuthology.orchestra.run.smithi039:> print(_find_admin_socket("client.0")) 2023-05-16T13:54:34.713 DEBUG:teuthology.orchestra.run.smithi039:> ' 2023-05-16T13:54:34.835 INFO:teuthology.orchestra.run.smithi039.stdout:/var/run/ceph/ceph-client.0.43845.asok 2023-05-16T13:54:35.018 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.43845.asok 2023-05-16T13:54:35.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:35.019 DEBUG:teuthology.orchestra.run.smithi039:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.43845.asok status 2023-05-16T13:54:35.189 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2023-05-16T13:54:35.190 INFO:teuthology.orchestra.run.smithi039.stdout: "metadata": { 2023-05-16T13:54:35.190 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_sha1": "27be51263d3d0c721b6d1ca9f42550bf0ab3c97b", 2023-05-16T13:54:35.190 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_version": "ceph version 18.0.0-3926-g27be5126 (27be51263d3d0c721b6d1ca9f42550bf0ab3c97b) reef (dev)", 2023-05-16T13:54:35.190 INFO:teuthology.orchestra.run.smithi039.stdout: "entity_id": "0", 2023-05-16T13:54:35.190 INFO:teuthology.orchestra.run.smithi039.stdout: "hostname": "smithi039", 2023-05-16T13:54:35.190 INFO:teuthology.orchestra.run.smithi039.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-05-16T13:54:35.191 INFO:teuthology.orchestra.run.smithi039.stdout: "pid": "43845", 2023-05-16T13:54:35.191 INFO:teuthology.orchestra.run.smithi039.stdout: "root": "/" 2023-05-16T13:54:35.191 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-05-16T13:54:35.191 INFO:teuthology.orchestra.run.smithi039.stdout: "dentry_count": 0, 2023-05-16T13:54:35.191 INFO:teuthology.orchestra.run.smithi039.stdout: "dentry_pinned_count": 0, 2023-05-16T13:54:35.191 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 4767, 2023-05-16T13:54:35.191 INFO:teuthology.orchestra.run.smithi039.stdout: "inst": { 2023-05-16T13:54:35.192 INFO:teuthology.orchestra.run.smithi039.stdout: "name": { 2023-05-16T13:54:35.192 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "client", 2023-05-16T13:54:35.192 INFO:teuthology.orchestra.run.smithi039.stdout: "num": 4767 2023-05-16T13:54:35.192 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-05-16T13:54:35.192 INFO:teuthology.orchestra.run.smithi039.stdout: "addr": { 2023-05-16T13:54:35.192 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "v1", 2023-05-16T13:54:35.192 INFO:teuthology.orchestra.run.smithi039.stdout: "addr": "192.168.0.1:0", 2023-05-16T13:54:35.192 INFO:teuthology.orchestra.run.smithi039.stdout: "nonce": 3531389286 2023-05-16T13:54:35.193 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-05-16T13:54:35.193 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-05-16T13:54:35.193 INFO:teuthology.orchestra.run.smithi039.stdout: "addr": { 2023-05-16T13:54:35.193 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "v1", 2023-05-16T13:54:35.193 INFO:teuthology.orchestra.run.smithi039.stdout: "addr": "192.168.0.1:0", 2023-05-16T13:54:35.193 INFO:teuthology.orchestra.run.smithi039.stdout: "nonce": 3531389286 2023-05-16T13:54:35.193 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-05-16T13:54:35.193 INFO:teuthology.orchestra.run.smithi039.stdout: "inst_str": "client.4767 192.168.0.1:0/3531389286", 2023-05-16T13:54:35.194 INFO:teuthology.orchestra.run.smithi039.stdout: "addr_str": "192.168.0.1:0/3531389286", 2023-05-16T13:54:35.194 INFO:teuthology.orchestra.run.smithi039.stdout: "inode_count": 1, 2023-05-16T13:54:35.194 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_epoch": 8, 2023-05-16T13:54:35.194 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_epoch": 24, 2023-05-16T13:54:35.194 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_epoch_barrier": 0, 2023-05-16T13:54:35.194 INFO:teuthology.orchestra.run.smithi039.stdout: "blocklisted": false, 2023-05-16T13:54:35.194 INFO:teuthology.orchestra.run.smithi039.stdout: "fs_name": "cephfs" 2023-05-16T13:54:35.194 INFO:teuthology.orchestra.run.smithi039.stdout:} 2023-05-16T13:54:35.204 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-05-16T13:54:35.341 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.337+0000 7f99ba3a2640 1 Processor -- start 2023-05-16T13:54:35.342 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.337+0000 7f99ba3a2640 1 -- start start 2023-05-16T13:54:35.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.337+0000 7f99ba3a2640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f99b40ccdc0 0x7f99b406a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:35.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.337+0000 7f99ba3a2640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f99b406a8a0 0x7f99b40c4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:35.344 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.337+0000 7f99ba3a2640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99b40c3f90 con 0x7f99b4145110 2023-05-16T13:54:35.344 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.337+0000 7f99ba3a2640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99b41454e0 con 0x7f99b40ccdc0 2023-05-16T13:54:35.344 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.337+0000 7f99ba3a2640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99b406ad00 con 0x7f99b406a8a0 2023-05-16T13:54:35.344 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.337+0000 7f99b93a0640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f99b4145110 0x7f99b40cc6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:58152/0 (socket says 172.21.15.39:58152) 2023-05-16T13:54:35.344 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.337+0000 7f99b93a0640 1 -- 172.21.15.39:0/953952103 learned_addr learned my addr 172.21.15.39:0/953952103 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:35.344 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.337+0000 7f99b8b9f640 1 --2- 172.21.15.39:0/953952103 >> v2:172.21.15.118:3300/0 conn(0x7f99b40ccdc0 0x7f99b406a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:35.344 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.337+0000 7f99b9ba1640 1 --2- 172.21.15.39:0/953952103 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f99b406a8a0 0x7f99b40c4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:35.345 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.337+0000 7f99abfff640 1 -- 172.21.15.39:0/953952103 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2608479366 0 0) 0x7f99b40c3f90 con 0x7f99b4145110 2023-05-16T13:54:35.345 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.341+0000 7f99abfff640 1 -- 172.21.15.39:0/953952103 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99a0003530 con 0x7f99b4145110 2023-05-16T13:54:35.345 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.341+0000 7f99b8b9f640 1 -- 172.21.15.39:0/953952103 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f99b406a8a0 msgr2=0x7f99b40c4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:35.345 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.341+0000 7f99b8b9f640 1 --2- 172.21.15.39:0/953952103 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f99b406a8a0 0x7f99b40c4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:35.346 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.341+0000 7f99b8b9f640 1 -- 172.21.15.39:0/953952103 >> v1:172.21.15.39:6789/0 conn(0x7f99b4145110 legacy=0x7f99b40cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:35.346 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.341+0000 7f99b8b9f640 1 -- 172.21.15.39:0/953952103 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b40c3980 con 0x7f99b40ccdc0 2023-05-16T13:54:35.346 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.341+0000 7f99b9ba1640 1 --2- 172.21.15.39:0/953952103 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f99b406a8a0 0x7f99b40c4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-16T13:54:35.347 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.341+0000 7f99b8b9f640 1 --2- 172.21.15.39:0/953952103 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99b40ccdc0 0x7f99b406a360 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f99a40097a0 tx=0x7f99a401c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bde9733bdb75d356 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:35.347 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.341+0000 7f99abfff640 1 -- 172.21.15.39:0/953952103 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a40a7070 con 0x7f99b40ccdc0 2023-05-16T13:54:35.347 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.341+0000 7f99abfff640 1 -- 172.21.15.39:0/953952103 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99a40ab430 con 0x7f99b40ccdc0 2023-05-16T13:54:35.347 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.341+0000 7f99abfff640 1 -- 172.21.15.39:0/953952103 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a40ab7c0 con 0x7f99b40ccdc0 2023-05-16T13:54:35.348 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.341+0000 7f99ba3a2640 1 -- 172.21.15.39:0/953952103 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99b40ccdc0 msgr2=0x7f99b406a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:35.348 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.341+0000 7f99ba3a2640 1 --2- 172.21.15.39:0/953952103 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99b40ccdc0 0x7f99b406a360 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f99a40097a0 tx=0x7f99a401c430 comp rx=0 tx=0).stop 2023-05-16T13:54:35.348 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.345+0000 7f99ba3a2640 1 -- 172.21.15.39:0/953952103 shutdown_connections 2023-05-16T13:54:35.349 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.345+0000 7f99ba3a2640 1 --2- 172.21.15.39:0/953952103 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f99b406a8a0 0x7f99b40c4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:35.349 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.345+0000 7f99ba3a2640 1 --2- 172.21.15.39:0/953952103 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99b40ccdc0 0x7f99b406a360 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:35.349 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.345+0000 7f99ba3a2640 1 -- 172.21.15.39:0/953952103 >> 172.21.15.39:0/953952103 conn(0x7f99b40cf770 msgr2=0x7f99b40cb560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:35.349 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.345+0000 7f99ba3a2640 1 -- 172.21.15.39:0/953952103 shutdown_connections 2023-05-16T13:54:35.349 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.345+0000 7f99ba3a2640 1 -- 172.21.15.39:0/953952103 wait complete. 2023-05-16T13:54:35.350 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.345+0000 7f99ba3a2640 1 Processor -- start 2023-05-16T13:54:35.350 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.345+0000 7f99ba3a2640 1 -- start start 2023-05-16T13:54:35.350 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.345+0000 7f99ba3a2640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99b406a8a0 0x7f99b412e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:35.351 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.345+0000 7f99ba3a2640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f99b40ccdc0 0x7f99b40af6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:35.351 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.345+0000 7f99ba3a2640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99b4145110 0x7f99b40afc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:35.351 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.345+0000 7f99ba3a2640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b40b2730 con 0x7f99b406a8a0 2023-05-16T13:54:35.351 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.345+0000 7f99ba3a2640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b40b1ab0 con 0x7f99b4145110 2023-05-16T13:54:35.351 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.345+0000 7f99ba3a2640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99b40b1d90 con 0x7f99b40ccdc0 2023-05-16T13:54:35.352 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.345+0000 7f99b93a0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99b406a8a0 0x7f99b412e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:35.352 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.345+0000 7f99b93a0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99b406a8a0 0x7f99b412e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:39798/0 (socket says 172.21.15.39:39798) 2023-05-16T13:54:35.353 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.345+0000 7f99b93a0640 1 -- 172.21.15.39:0/1743466159 learned_addr learned my addr 172.21.15.39:0/1743466159 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:35.353 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.345+0000 7f99b8b9f640 1 --2- 172.21.15.39:0/1743466159 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f99b40ccdc0 0x7f99b40af6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:35.353 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.345+0000 7f99b9ba1640 1 --2- 172.21.15.39:0/1743466159 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99b4145110 0x7f99b40afc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:35.353 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.345+0000 7f99b93a0640 1 -- 172.21.15.39:0/1743466159 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f99b40ccdc0 msgr2=0x7f99b40af6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:35.353 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.345+0000 7f99b93a0640 1 --2- 172.21.15.39:0/1743466159 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f99b40ccdc0 0x7f99b40af6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:35.354 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.345+0000 7f99b93a0640 1 -- 172.21.15.39:0/1743466159 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99b4145110 msgr2=0x7f99b40afc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:35.354 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.345+0000 7f99b93a0640 1 --2- 172.21.15.39:0/1743466159 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99b4145110 0x7f99b40afc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:35.354 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.345+0000 7f99b93a0640 1 -- 172.21.15.39:0/1743466159 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99ac009a70 con 0x7f99b406a8a0 2023-05-16T13:54:35.354 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.345+0000 7f99b93a0640 1 --2- 172.21.15.39:0/1743466159 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99b406a8a0 0x7f99b412e2c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f99b000c420 tx=0x7f99b000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:35.354 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.345+0000 7f99a9ffb640 1 -- 172.21.15.39:0/1743466159 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b0005cf0 con 0x7f99b406a8a0 2023-05-16T13:54:35.354 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.349+0000 7f99a9ffb640 1 -- 172.21.15.39:0/1743466159 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b0005e50 con 0x7f99b406a8a0 2023-05-16T13:54:35.354 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.349+0000 7f99ba3a2640 1 -- 172.21.15.39:0/1743466159 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99a40093b0 con 0x7f99b406a8a0 2023-05-16T13:54:35.354 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.349+0000 7f99a9ffb640 1 -- 172.21.15.39:0/1743466159 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b00072d0 con 0x7f99b406a8a0 2023-05-16T13:54:35.355 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.349+0000 7f99ba3a2640 1 -- 172.21.15.39:0/1743466159 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99b40c3c20 con 0x7f99b406a8a0 2023-05-16T13:54:35.355 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.349+0000 7f99ba3a2640 1 -- 172.21.15.39:0/1743466159 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99b406b270 con 0x7f99b406a8a0 2023-05-16T13:54:35.355 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.349+0000 7f99a9ffb640 1 -- 172.21.15.39:0/1743466159 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f99b0007430 con 0x7f99b406a8a0 2023-05-16T13:54:35.356 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.349+0000 7f99a9ffb640 1 --2- 172.21.15.39:0/1743466159 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f9998066280 0x7f9998068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:35.356 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.349+0000 7f99a9ffb640 1 -- 172.21.15.39:0/1743466159 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f99b0083330 con 0x7f99b406a8a0 2023-05-16T13:54:35.356 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.349+0000 7f99b8b9f640 1 --2- 172.21.15.39:0/1743466159 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f9998066280 0x7f9998068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:35.356 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.353+0000 7f99b8b9f640 1 --2- 172.21.15.39:0/1743466159 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f9998066280 0x7f9998068730 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f99a40af000 tx=0x7f99a4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:35.359 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.353+0000 7f99a9ffb640 1 -- 172.21.15.39:0/1743466159 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f99b00507c0 con 0x7f99b406a8a0 2023-05-16T13:54:35.547 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.541+0000 7f99ba3a2640 1 -- 172.21.15.39:0/1743466159 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f99b40c5170 con 0x7f99b406a8a0 2023-05-16T13:54:35.548 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.545+0000 7f99a9ffb640 1 -- 172.21.15.39:0/1743466159 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f99b0053de0 con 0x7f99b406a8a0 2023-05-16T13:54:35.548 INFO:teuthology.orchestra.run.smithi039.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-05-16T13:54:35.550 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.545+0000 7f99ba3a2640 1 -- 172.21.15.39:0/1743466159 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f9998066280 msgr2=0x7f9998068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:35.550 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.545+0000 7f99ba3a2640 1 --2- 172.21.15.39:0/1743466159 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f9998066280 0x7f9998068730 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f99a40af000 tx=0x7f99a4008040 comp rx=0 tx=0).stop 2023-05-16T13:54:35.551 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.545+0000 7f99ba3a2640 1 -- 172.21.15.39:0/1743466159 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99b406a8a0 msgr2=0x7f99b412e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:35.551 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.545+0000 7f99ba3a2640 1 --2- 172.21.15.39:0/1743466159 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99b406a8a0 0x7f99b412e2c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f99b000c420 tx=0x7f99b000c8e0 comp rx=0 tx=0).stop 2023-05-16T13:54:35.551 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.545+0000 7f99ba3a2640 1 -- 172.21.15.39:0/1743466159 shutdown_connections 2023-05-16T13:54:35.551 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.545+0000 7f99ba3a2640 1 --2- 172.21.15.39:0/1743466159 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f9998066280 0x7f9998068730 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:35.551 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.545+0000 7f99ba3a2640 1 --2- 172.21.15.39:0/1743466159 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f99b40ccdc0 0x7f99b40af6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:35.551 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.545+0000 7f99ba3a2640 1 --2- 172.21.15.39:0/1743466159 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99b4145110 0x7f99b40afc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:35.551 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.545+0000 7f99ba3a2640 1 --2- 172.21.15.39:0/1743466159 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99b406a8a0 0x7f99b412e2c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:35.551 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.545+0000 7f99ba3a2640 1 -- 172.21.15.39:0/1743466159 >> 172.21.15.39:0/1743466159 conn(0x7f99b40cf770 msgr2=0x7f99b40cc360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:35.552 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.545+0000 7f99ba3a2640 1 -- 172.21.15.39:0/1743466159 shutdown_connections 2023-05-16T13:54:35.552 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:35.545+0000 7f99ba3a2640 1 -- 172.21.15.39:0/1743466159 wait complete. 2023-05-16T13:54:35.568 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-16T13:54:35.568 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-16T13:54:35.569 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi039.front.sepia.ceph.com 2023-05-16T13:54:35.569 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-05-16T13:54:35.571 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-05-16T13:54:35.572 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-16T13:54:35.572 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-05-16T13:54:35.572 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-16T13:54:35.572 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-05-16T13:54:35.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:35.573 DEBUG:teuthology.orchestra.run.smithi039:> ip addr 2023-05-16T13:54:35.581 INFO:teuthology.orchestra.run.smithi039.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-16T13:54:35.582 INFO:teuthology.orchestra.run.smithi039.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-16T13:54:35.582 INFO:teuthology.orchestra.run.smithi039.stdout: inet 127.0.0.1/8 scope host lo 2023-05-16T13:54:35.582 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-05-16T13:54:35.582 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 ::1/128 scope host 2023-05-16T13:54:35.582 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-05-16T13:54:35.583 INFO:teuthology.orchestra.run.smithi039.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-05-16T13:54:35.583 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:6b:fe:c6 brd ff:ff:ff:ff:ff:ff 2023-05-16T13:54:35.583 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp7s0f0 2023-05-16T13:54:35.583 INFO:teuthology.orchestra.run.smithi039.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-05-16T13:54:35.583 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:6b:fe:c7 brd ff:ff:ff:ff:ff:ff 2023-05-16T13:54:35.583 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp7s0f1 2023-05-16T13:54:35.583 INFO:teuthology.orchestra.run.smithi039.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-16T13:54:35.583 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:bd:13:70 brd ff:ff:ff:ff:ff:ff 2023-05-16T13:54:35.584 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp1s0f0 2023-05-16T13:54:35.584 INFO:teuthology.orchestra.run.smithi039.stdout: inet 172.21.15.39/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-05-16T13:54:35.584 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft 42325sec preferred_lft 42325sec 2023-05-16T13:54:35.584 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 fe80::ec4:7aff:febd:1370/64 scope link 2023-05-16T13:54:35.584 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-05-16T13:54:35.584 INFO:teuthology.orchestra.run.smithi039.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-05-16T13:54:35.584 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:bd:13:71 brd ff:ff:ff:ff:ff:ff 2023-05-16T13:54:35.584 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp1s0f1 2023-05-16T13:54:35.585 INFO:teuthology.orchestra.run.smithi039.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-05-16T13:54:35.585 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 02:42:f1:77:1b:cd brd ff:ff:ff:ff:ff:ff 2023-05-16T13:54:35.585 INFO:teuthology.orchestra.run.smithi039.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-05-16T13:54:35.585 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-05-16T13:54:35.585 INFO:teuthology.orchestra.run.smithi039.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-16T13:54:35.585 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-05-16T13:54:35.585 INFO:teuthology.orchestra.run.smithi039.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-05-16T13:54:35.586 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-05-16T13:54:35.586 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-05-16T13:54:35.586 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-05-16T13:54:35.586 INFO:teuthology.orchestra.run.smithi039.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-16T13:54:35.586 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-05-16T13:54:35.586 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-05-16T13:54:35.586 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-05-16T13:54:35.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:35.587 DEBUG:teuthology.orchestra.run.smithi039:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-16T13:54:35.641 INFO:teuthology.orchestra.run.smithi039.stdout:1 2023-05-16T13:54:35.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:35.643 DEBUG:teuthology.orchestra.run.smithi039:> route 2023-05-16T13:54:35.692 INFO:teuthology.orchestra.run.smithi039.stdout:Kernel IP routing table 2023-05-16T13:54:35.692 INFO:teuthology.orchestra.run.smithi039.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-16T13:54:35.692 INFO:teuthology.orchestra.run.smithi039.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-05-16T13:54:35.692 INFO:teuthology.orchestra.run.smithi039.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-05-16T13:54:35.692 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-05-16T13:54:35.692 INFO:teuthology.orchestra.run.smithi039.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-16T13:54:35.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:35.693 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec bash -c ' 2023-05-16T13:54:35.693 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2023-05-16T13:54:35.694 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-05-16T13:54:35.694 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-05-16T13:54:35.694 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-05-16T13:54:35.694 DEBUG:teuthology.orchestra.run.smithi039:> ') 2023-05-16T13:54:35.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:35.783 DEBUG:teuthology.orchestra.run.smithi039:> ip netns list 2023-05-16T13:54:35.830 INFO:teuthology.orchestra.run.smithi039.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-05-16T13:54:35.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:35.832 DEBUG:teuthology.orchestra.run.smithi039:> ip netns list-id 2023-05-16T13:54:35.886 INFO:teuthology.orchestra.run.smithi039.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-05-16T13:54:35.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:35.888 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec bash -c ' 2023-05-16T13:54:35.888 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2023-05-16T13:54:35.888 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-05-16T13:54:35.888 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-05-16T13:54:35.889 DEBUG:teuthology.orchestra.run.smithi039:> ') 2023-05-16T13:54:35.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:35.964 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-05-16T13:54:36.023 INFO:teuthology.orchestra.run.smithi039.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-16T13:54:36.023 INFO:teuthology.orchestra.run.smithi039.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-16T13:54:36.023 INFO:teuthology.orchestra.run.smithi039.stdout: inet 127.0.0.1/8 scope host lo 2023-05-16T13:54:36.023 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-05-16T13:54:36.023 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 ::1/128 scope host 2023-05-16T13:54:36.023 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-05-16T13:54:36.024 INFO:teuthology.orchestra.run.smithi039.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-16T13:54:36.024 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether f6:49:0c:1f:f2:4f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-05-16T13:54:36.024 INFO:teuthology.orchestra.run.smithi039.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-05-16T13:54:36.024 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-05-16T13:54:36.024 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 fe80::f449:cff:fe1f:f24f/64 scope link 2023-05-16T13:54:36.024 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-05-16T13:54:36.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:36.026 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-05-16T13:54:36.070 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T13:54:36.087 INFO:teuthology.orchestra.run.smithi039.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-16T13:54:36.087 INFO:teuthology.orchestra.run.smithi039.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-16T13:54:36.087 INFO:teuthology.orchestra.run.smithi039.stdout: inet 127.0.0.1/8 scope host lo 2023-05-16T13:54:36.087 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-05-16T13:54:36.087 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 ::1/128 scope host 2023-05-16T13:54:36.087 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-05-16T13:54:36.088 INFO:teuthology.orchestra.run.smithi039.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-16T13:54:36.088 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether f6:49:0c:1f:f2:4f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-05-16T13:54:36.088 INFO:teuthology.orchestra.run.smithi039.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-05-16T13:54:36.088 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-05-16T13:54:36.088 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 fe80::f449:cff:fe1f:f24f/64 scope link 2023-05-16T13:54:36.088 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-05-16T13:54:36.089 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-05-16T13:54:36.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:36.090 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec bash -c ' 2023-05-16T13:54:36.090 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2023-05-16T13:54:36.090 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-05-16T13:54:36.091 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-05-16T13:54:36.091 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-05-16T13:54:36.091 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-05-16T13:54:36.091 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-05-16T13:54:36.092 DEBUG:teuthology.orchestra.run.smithi039:> ') 2023-05-16T13:54:36.092 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T13:54:36.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:36.268 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec bash -c ' 2023-05-16T13:54:36.268 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2023-05-16T13:54:36.268 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link set brx.1 up 2023-05-16T13:54:36.268 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link set dev brx.1 master ceph-brx 2023-05-16T13:54:36.269 DEBUG:teuthology.orchestra.run.smithi039:> ') 2023-05-16T13:54:36.306 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-05-16T13:54:36.306 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-16T13:54:36.306 DEBUG:teuthology.orchestra.run.smithi039:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-05-16T13:54:36.359 INFO:teuthology.orchestra.run.smithi039.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-05-16T13:54:36.359 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-16T13:54:36.359 DEBUG:teuthology.orchestra.run.smithi039:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-05-16T13:54:36.410 DEBUG:teuthology.orchestra.run.smithi039:> sudo modprobe fuse 2023-05-16T13:54:36.475 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-16T13:54:36.475 DEBUG:teuthology.orchestra.run.smithi039:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-16T13:54:36.533 INFO:teuthology.orchestra.run.smithi039.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-16T13:54:36.534 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-16T13:54:36.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:36.535 DEBUG:teuthology.orchestra.run.smithi039:> ls /sys/fs/fuse/connections 2023-05-16T13:54:36.583 INFO:teuthology.orchestra.run.smithi039.stdout:42 2023-05-16T13:54:36.583 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [42] 2023-05-16T13:54:36.583 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-05-16T13:54:36.630 DEBUG:teuthology.orchestra.run.smithi039:> sudo modprobe fuse 2023-05-16T13:54:36.651 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-16T13:54:36.651 DEBUG:teuthology.orchestra.run.smithi039:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-16T13:54:36.709 INFO:teuthology.orchestra.run.smithi039.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-16T13:54:36.710 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-16T13:54:36.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:36.711 DEBUG:teuthology.orchestra.run.smithi039:> ls /sys/fs/fuse/connections 2023-05-16T13:54:36.722 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi039.stderr:2023-05-16T13:54:36.717+0000 7fd041443580 -1 init, newargv = 0x55aebaac23a0 newargc=15 2023-05-16T13:54:36.723 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi039.stderr:ceph-fuse[43984]: starting ceph client 2023-05-16T13:54:36.729 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi039.stderr:ceph-fuse[43984]: starting fuse 2023-05-16T13:54:36.730 INFO:teuthology.orchestra.run.smithi039.stdout:42 2023-05-16T13:54:36.730 INFO:teuthology.orchestra.run.smithi039.stdout:43 2023-05-16T13:54:36.730 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42, 43] 2023-05-16T13:54:36.731 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-05-16T13:54:36.731 DEBUG:teuthology.orchestra.run.smithi039:> import glob 2023-05-16T13:54:36.731 DEBUG:teuthology.orchestra.run.smithi039:> import re 2023-05-16T13:54:36.732 DEBUG:teuthology.orchestra.run.smithi039:> import os 2023-05-16T13:54:36.732 DEBUG:teuthology.orchestra.run.smithi039:> import subprocess 2023-05-16T13:54:36.732 DEBUG:teuthology.orchestra.run.smithi039:> 2023-05-16T13:54:36.732 DEBUG:teuthology.orchestra.run.smithi039:> def _find_admin_socket(client_name): 2023-05-16T13:54:36.732 DEBUG:teuthology.orchestra.run.smithi039:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-05-16T13:54:36.733 DEBUG:teuthology.orchestra.run.smithi039:> files = glob.glob(asok_path) 2023-05-16T13:54:36.733 DEBUG:teuthology.orchestra.run.smithi039:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-05-16T13:54:36.733 DEBUG:teuthology.orchestra.run.smithi039:> 2023-05-16T13:54:36.733 DEBUG:teuthology.orchestra.run.smithi039:> # Given a non-glob path, it better be there 2023-05-16T13:54:36.734 DEBUG:teuthology.orchestra.run.smithi039:> if "*" not in asok_path: 2023-05-16T13:54:36.734 DEBUG:teuthology.orchestra.run.smithi039:> assert(len(files) == 1) 2023-05-16T13:54:36.734 DEBUG:teuthology.orchestra.run.smithi039:> return files[0] 2023-05-16T13:54:36.734 DEBUG:teuthology.orchestra.run.smithi039:> 2023-05-16T13:54:36.734 DEBUG:teuthology.orchestra.run.smithi039:> for f in files: 2023-05-16T13:54:36.735 DEBUG:teuthology.orchestra.run.smithi039:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-05-16T13:54:36.735 DEBUG:teuthology.orchestra.run.smithi039:> if os.path.exists("/proc/{0}".format(pid)): 2023-05-16T13:54:36.735 DEBUG:teuthology.orchestra.run.smithi039:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-05-16T13:54:36.735 DEBUG:teuthology.orchestra.run.smithi039:> contents = proc_f.read() 2023-05-16T13:54:36.736 DEBUG:teuthology.orchestra.run.smithi039:> if mountpoint in contents: 2023-05-16T13:54:36.736 DEBUG:teuthology.orchestra.run.smithi039:> return f 2023-05-16T13:54:36.736 DEBUG:teuthology.orchestra.run.smithi039:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-05-16T13:54:36.736 DEBUG:teuthology.orchestra.run.smithi039:> 2023-05-16T13:54:36.736 DEBUG:teuthology.orchestra.run.smithi039:> print(_find_admin_socket("client.2")) 2023-05-16T13:54:36.737 DEBUG:teuthology.orchestra.run.smithi039:> ' 2023-05-16T13:54:36.855 INFO:teuthology.orchestra.run.smithi039.stdout:/var/run/ceph/ceph-client.2.43984.asok 2023-05-16T13:54:37.039 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.43984.asok 2023-05-16T13:54:37.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:37.039 DEBUG:teuthology.orchestra.run.smithi039:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.43984.asok status 2023-05-16T13:54:37.209 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2023-05-16T13:54:37.210 INFO:teuthology.orchestra.run.smithi039.stdout: "metadata": { 2023-05-16T13:54:37.210 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_sha1": "27be51263d3d0c721b6d1ca9f42550bf0ab3c97b", 2023-05-16T13:54:37.210 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_version": "ceph version 18.0.0-3926-g27be5126 (27be51263d3d0c721b6d1ca9f42550bf0ab3c97b) reef (dev)", 2023-05-16T13:54:37.210 INFO:teuthology.orchestra.run.smithi039.stdout: "entity_id": "2", 2023-05-16T13:54:37.210 INFO:teuthology.orchestra.run.smithi039.stdout: "hostname": "smithi039", 2023-05-16T13:54:37.210 INFO:teuthology.orchestra.run.smithi039.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-05-16T13:54:37.210 INFO:teuthology.orchestra.run.smithi039.stdout: "pid": "43984", 2023-05-16T13:54:37.211 INFO:teuthology.orchestra.run.smithi039.stdout: "root": "/" 2023-05-16T13:54:37.211 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-05-16T13:54:37.211 INFO:teuthology.orchestra.run.smithi039.stdout: "dentry_count": 0, 2023-05-16T13:54:37.211 INFO:teuthology.orchestra.run.smithi039.stdout: "dentry_pinned_count": 0, 2023-05-16T13:54:37.211 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 4782, 2023-05-16T13:54:37.211 INFO:teuthology.orchestra.run.smithi039.stdout: "inst": { 2023-05-16T13:54:37.211 INFO:teuthology.orchestra.run.smithi039.stdout: "name": { 2023-05-16T13:54:37.211 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "client", 2023-05-16T13:54:37.212 INFO:teuthology.orchestra.run.smithi039.stdout: "num": 4782 2023-05-16T13:54:37.212 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-05-16T13:54:37.212 INFO:teuthology.orchestra.run.smithi039.stdout: "addr": { 2023-05-16T13:54:37.212 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "v1", 2023-05-16T13:54:37.212 INFO:teuthology.orchestra.run.smithi039.stdout: "addr": "192.168.0.2:0", 2023-05-16T13:54:37.212 INFO:teuthology.orchestra.run.smithi039.stdout: "nonce": 4167866391 2023-05-16T13:54:37.212 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-05-16T13:54:37.212 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-05-16T13:54:37.213 INFO:teuthology.orchestra.run.smithi039.stdout: "addr": { 2023-05-16T13:54:37.213 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "v1", 2023-05-16T13:54:37.213 INFO:teuthology.orchestra.run.smithi039.stdout: "addr": "192.168.0.2:0", 2023-05-16T13:54:37.213 INFO:teuthology.orchestra.run.smithi039.stdout: "nonce": 4167866391 2023-05-16T13:54:37.213 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-05-16T13:54:37.213 INFO:teuthology.orchestra.run.smithi039.stdout: "inst_str": "client.4782 192.168.0.2:0/4167866391", 2023-05-16T13:54:37.213 INFO:teuthology.orchestra.run.smithi039.stdout: "addr_str": "192.168.0.2:0/4167866391", 2023-05-16T13:54:37.214 INFO:teuthology.orchestra.run.smithi039.stdout: "inode_count": 1, 2023-05-16T13:54:37.214 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_epoch": 8, 2023-05-16T13:54:37.214 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_epoch": 24, 2023-05-16T13:54:37.214 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_epoch_barrier": 0, 2023-05-16T13:54:37.214 INFO:teuthology.orchestra.run.smithi039.stdout: "blocklisted": false, 2023-05-16T13:54:37.214 INFO:teuthology.orchestra.run.smithi039.stdout: "fs_name": "cephfs" 2023-05-16T13:54:37.214 INFO:teuthology.orchestra.run.smithi039.stdout:} 2023-05-16T13:54:37.224 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-05-16T13:54:37.362 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.357+0000 7fe9d5f6d640 1 Processor -- start 2023-05-16T13:54:37.362 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.357+0000 7fe9d5f6d640 1 -- start start 2023-05-16T13:54:37.363 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.357+0000 7fe9d5f6d640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe9d00cb4c0 0x7fe9d015d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:37.363 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.357+0000 7fe9d5f6d640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fe9d00703b0 0x7fe9d00ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:37.364 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.357+0000 7fe9d5f6d640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9d015d6a0 con 0x7fe9d0158bf0 2023-05-16T13:54:37.364 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.357+0000 7fe9d5f6d640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9d0070870 con 0x7fe9d00703b0 2023-05-16T13:54:37.364 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.357+0000 7fe9d5f6d640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d0070b50 con 0x7fe9d00cb4c0 2023-05-16T13:54:37.365 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.357+0000 7fe9cf7fe640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fe9d0158bf0 0x7fe9d00cadb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.39:44948/0 (socket says 172.21.15.39:44948) 2023-05-16T13:54:37.365 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.357+0000 7fe9cf7fe640 1 -- 172.21.15.39:0/37625517 learned_addr learned my addr 172.21.15.39:0/37625517 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:37.365 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.357+0000 7fe9cffff640 1 --2- 172.21.15.39:0/37625517 >> v2:172.21.15.39:3300/0 conn(0x7fe9d00703b0 0x7fe9d00ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:37.365 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.357+0000 7fe9ceffd640 1 --2- 172.21.15.39:0/37625517 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe9d00cb4c0 0x7fe9d015d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:37.365 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.361+0000 7fe9cffff640 1 -- 172.21.15.39:0/37625517 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe9d00cb4c0 msgr2=0x7fe9d015d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:37.365 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.361+0000 7fe9cffff640 1 --2- 172.21.15.39:0/37625517 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe9d00cb4c0 0x7fe9d015d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:37.365 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.361+0000 7fe9cffff640 1 -- 172.21.15.39:0/37625517 >> v1:172.21.15.118:6789/0 conn(0x7fe9d0158bf0 legacy=0x7fe9d00cadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:37.366 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.361+0000 7fe9cffff640 1 -- 172.21.15.39:0/37625517 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9d0070e30 con 0x7fe9d00703b0 2023-05-16T13:54:37.366 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.361+0000 7fe9ce7fc640 1 -- 172.21.15.39:0/37625517 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3737321769 0 0) 0x7fe9c0001120 con 0x7fe9d0158bf0 2023-05-16T13:54:37.366 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.361+0000 7fe9cffff640 1 --2- 172.21.15.39:0/37625517 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe9d00703b0 0x7fe9d00ccda0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe9c8009d90 tx=0x7fe9c801c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24ab42b8bca65bbe server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:37.367 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.361+0000 7fe9ce7fc640 1 -- 172.21.15.39:0/37625517 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c80a5950 con 0x7fe9d00703b0 2023-05-16T13:54:37.367 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.361+0000 7fe9ce7fc640 1 -- 172.21.15.39:0/37625517 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9c80a5ab0 con 0x7fe9d00703b0 2023-05-16T13:54:37.367 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.361+0000 7fe9ce7fc640 1 -- 172.21.15.39:0/37625517 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c80a5e40 con 0x7fe9d00703b0 2023-05-16T13:54:37.368 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.361+0000 7fe9d5f6d640 1 -- 172.21.15.39:0/37625517 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe9d00703b0 msgr2=0x7fe9d00ccda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:37.368 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.361+0000 7fe9d5f6d640 1 --2- 172.21.15.39:0/37625517 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe9d00703b0 0x7fe9d00ccda0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe9c8009d90 tx=0x7fe9c801c890 comp rx=0 tx=0).stop 2023-05-16T13:54:37.369 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.361+0000 7fe9d5f6d640 1 -- 172.21.15.39:0/37625517 shutdown_connections 2023-05-16T13:54:37.369 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.361+0000 7fe9d5f6d640 1 --2- 172.21.15.39:0/37625517 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe9d00703b0 0x7fe9d00ccda0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:37.369 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.361+0000 7fe9d5f6d640 1 --2- 172.21.15.39:0/37625517 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe9d00cb4c0 0x7fe9d015d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:37.369 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.361+0000 7fe9d5f6d640 1 -- 172.21.15.39:0/37625517 >> 172.21.15.39:0/37625517 conn(0x7fe9d0069a50 msgr2=0x7fe9d0069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:37.369 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.361+0000 7fe9d5f6d640 1 -- 172.21.15.39:0/37625517 shutdown_connections 2023-05-16T13:54:37.369 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.361+0000 7fe9d5f6d640 1 -- 172.21.15.39:0/37625517 wait complete. 2023-05-16T13:54:37.370 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.365+0000 7fe9d5f6d640 1 Processor -- start 2023-05-16T13:54:37.370 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.365+0000 7fe9d5f6d640 1 -- start start 2023-05-16T13:54:37.371 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.365+0000 7fe9d5f6d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9d00703b0 0x7fe9d00b1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:37.372 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.365+0000 7fe9d5f6d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe9d00cb4c0 0x7fe9d014c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:37.372 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.365+0000 7fe9d5f6d640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe9d0158bf0 0x7fe9d00ac3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:37.372 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.365+0000 7fe9d5f6d640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d014d3d0 con 0x7fe9d00cb4c0 2023-05-16T13:54:37.372 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.365+0000 7fe9d5f6d640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d01578d0 con 0x7fe9d00703b0 2023-05-16T13:54:37.372 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.365+0000 7fe9d5f6d640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d0157b90 con 0x7fe9d0158bf0 2023-05-16T13:54:37.372 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.365+0000 7fe9ceffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe9d00cb4c0 0x7fe9d014c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:37.372 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.365+0000 7fe9ceffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe9d00cb4c0 0x7fe9d014c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:39816/0 (socket says 172.21.15.39:39816) 2023-05-16T13:54:37.373 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.365+0000 7fe9ceffd640 1 -- 172.21.15.39:0/204208092 learned_addr learned my addr 172.21.15.39:0/204208092 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:37.373 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.365+0000 7fe9cf7fe640 1 --2- 172.21.15.39:0/204208092 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9d00703b0 0x7fe9d00b1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:37.373 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.365+0000 7fe9cffff640 1 --2- 172.21.15.39:0/204208092 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe9d0158bf0 0x7fe9d00ac3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:37.373 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.365+0000 7fe9ceffd640 1 -- 172.21.15.39:0/204208092 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe9d0158bf0 msgr2=0x7fe9d00ac3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:37.373 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.365+0000 7fe9ceffd640 1 --2- 172.21.15.39:0/204208092 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe9d0158bf0 0x7fe9d00ac3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:37.373 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.365+0000 7fe9ceffd640 1 -- 172.21.15.39:0/204208092 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9d00703b0 msgr2=0x7fe9d00b1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:37.373 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.365+0000 7fe9ceffd640 1 --2- 172.21.15.39:0/204208092 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9d00703b0 0x7fe9d00b1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:37.373 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.365+0000 7fe9ceffd640 1 -- 172.21.15.39:0/204208092 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c8009a70 con 0x7fe9d00cb4c0 2023-05-16T13:54:37.374 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.365+0000 7fe9cffff640 1 --2- 172.21.15.39:0/204208092 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe9d0158bf0 0x7fe9d00ac3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:54:37.374 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.365+0000 7fe9ceffd640 1 --2- 172.21.15.39:0/204208092 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe9d00cb4c0 0x7fe9d014c380 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe9c400e900 tx=0x7fe9c400edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:37.374 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.365+0000 7fe9b7fff640 1 -- 172.21.15.39:0/204208092 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c4009690 con 0x7fe9d00cb4c0 2023-05-16T13:54:37.375 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.369+0000 7fe9b7fff640 1 -- 172.21.15.39:0/204208092 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9c400ca00 con 0x7fe9d00cb4c0 2023-05-16T13:54:37.375 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.369+0000 7fe9b7fff640 1 -- 172.21.15.39:0/204208092 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c400cdb0 con 0x7fe9d00cb4c0 2023-05-16T13:54:37.375 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.369+0000 7fe9d5f6d640 1 -- 172.21.15.39:0/204208092 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9d00ad950 con 0x7fe9d00cb4c0 2023-05-16T13:54:37.375 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.369+0000 7fe9d5f6d640 1 -- 172.21.15.39:0/204208092 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9d0158fc0 con 0x7fe9d00cb4c0 2023-05-16T13:54:37.375 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.369+0000 7fe9d5f6d640 1 -- 172.21.15.39:0/204208092 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9d00cdaf0 con 0x7fe9d00cb4c0 2023-05-16T13:54:37.375 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.369+0000 7fe9b7fff640 1 -- 172.21.15.39:0/204208092 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe9c4013470 con 0x7fe9d00cb4c0 2023-05-16T13:54:37.376 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.369+0000 7fe9b7fff640 1 --2- 172.21.15.39:0/204208092 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fe9bc066280 0x7fe9bc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:37.376 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.369+0000 7fe9b7fff640 1 -- 172.21.15.39:0/204208092 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe9c4083e70 con 0x7fe9d00cb4c0 2023-05-16T13:54:37.376 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.369+0000 7fe9cf7fe640 1 --2- 172.21.15.39:0/204208092 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fe9bc066280 0x7fe9bc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:37.376 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.373+0000 7fe9cf7fe640 1 --2- 172.21.15.39:0/204208092 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fe9bc066280 0x7fe9bc068730 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0000f70 tx=0x7fe9c0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:37.379 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.373+0000 7fe9b7fff640 1 -- 172.21.15.39:0/204208092 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fe9c4051430 con 0x7fe9d00cb4c0 2023-05-16T13:54:37.568 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.561+0000 7fe9d5f6d640 1 -- 172.21.15.39:0/204208092 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe9d0073c90 con 0x7fe9d00cb4c0 2023-05-16T13:54:37.568 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.565+0000 7fe9b7fff640 1 -- 172.21.15.39:0/204208092 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe9c4017070 con 0x7fe9d00cb4c0 2023-05-16T13:54:37.569 INFO:teuthology.orchestra.run.smithi039.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-05-16T13:54:37.570 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.565+0000 7fe9d5f6d640 1 -- 172.21.15.39:0/204208092 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fe9bc066280 msgr2=0x7fe9bc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:37.571 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.565+0000 7fe9d5f6d640 1 --2- 172.21.15.39:0/204208092 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fe9bc066280 0x7fe9bc068730 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0000f70 tx=0x7fe9c0009040 comp rx=0 tx=0).stop 2023-05-16T13:54:37.571 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.565+0000 7fe9d5f6d640 1 -- 172.21.15.39:0/204208092 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe9d00cb4c0 msgr2=0x7fe9d014c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:37.571 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.565+0000 7fe9d5f6d640 1 --2- 172.21.15.39:0/204208092 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe9d00cb4c0 0x7fe9d014c380 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe9c400e900 tx=0x7fe9c400edc0 comp rx=0 tx=0).stop 2023-05-16T13:54:37.571 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.565+0000 7fe9d5f6d640 1 -- 172.21.15.39:0/204208092 shutdown_connections 2023-05-16T13:54:37.571 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.565+0000 7fe9d5f6d640 1 --2- 172.21.15.39:0/204208092 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fe9bc066280 0x7fe9bc068730 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:37.571 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.565+0000 7fe9d5f6d640 1 --2- 172.21.15.39:0/204208092 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe9d0158bf0 0x7fe9d00ac3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:37.571 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.565+0000 7fe9d5f6d640 1 --2- 172.21.15.39:0/204208092 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe9d00cb4c0 0x7fe9d014c380 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:37.572 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.565+0000 7fe9d5f6d640 1 --2- 172.21.15.39:0/204208092 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9d00703b0 0x7fe9d00b1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:37.572 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.565+0000 7fe9d5f6d640 1 -- 172.21.15.39:0/204208092 >> 172.21.15.39:0/204208092 conn(0x7fe9d0069a50 msgr2=0x7fe9d0069e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:37.572 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.565+0000 7fe9d5f6d640 1 -- 172.21.15.39:0/204208092 shutdown_connections 2023-05-16T13:54:37.572 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:37.565+0000 7fe9d5f6d640 1 -- 172.21.15.39:0/204208092 wait complete. 2023-05-16T13:54:37.589 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-16T13:54:37.589 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-16T13:54:37.589 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi118.front.sepia.ceph.com 2023-05-16T13:54:37.589 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-05-16T13:54:37.590 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-05-16T13:54:37.590 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-16T13:54:37.590 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-05-16T13:54:37.590 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-16T13:54:37.590 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-05-16T13:54:37.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:37.591 DEBUG:teuthology.orchestra.run.smithi118:> ip addr 2023-05-16T13:54:37.600 INFO:teuthology.orchestra.run.smithi118.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-16T13:54:37.600 INFO:teuthology.orchestra.run.smithi118.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-16T13:54:37.600 INFO:teuthology.orchestra.run.smithi118.stdout: inet 127.0.0.1/8 scope host lo 2023-05-16T13:54:37.600 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-05-16T13:54:37.600 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 ::1/128 scope host 2023-05-16T13:54:37.600 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-05-16T13:54:37.601 INFO:teuthology.orchestra.run.smithi118.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-05-16T13:54:37.601 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cc brd ff:ff:ff:ff:ff:ff 2023-05-16T13:54:37.601 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f0 2023-05-16T13:54:37.601 INFO:teuthology.orchestra.run.smithi118.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-05-16T13:54:37.601 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cd brd ff:ff:ff:ff:ff:ff 2023-05-16T13:54:37.601 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f1 2023-05-16T13:54:37.601 INFO:teuthology.orchestra.run.smithi118.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-05-16T13:54:37.601 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:24 brd ff:ff:ff:ff:ff:ff 2023-05-16T13:54:37.602 INFO:teuthology.orchestra.run.smithi118.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-16T13:54:37.602 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:25 brd ff:ff:ff:ff:ff:ff 2023-05-16T13:54:37.602 INFO:teuthology.orchestra.run.smithi118.stdout: inet 172.21.15.118/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-05-16T13:54:37.602 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft 42302sec preferred_lft 42302sec 2023-05-16T13:54:37.602 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::ec4:7aff:fe8f:d725/64 scope link 2023-05-16T13:54:37.602 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-05-16T13:54:37.602 INFO:teuthology.orchestra.run.smithi118.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-05-16T13:54:37.603 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 02:42:e0:5d:93:d2 brd ff:ff:ff:ff:ff:ff 2023-05-16T13:54:37.603 INFO:teuthology.orchestra.run.smithi118.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-05-16T13:54:37.603 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-05-16T13:54:37.603 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-05-16T13:54:37.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:37.604 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2023-05-16T13:54:37.604 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2023-05-16T13:54:37.605 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link add name ceph-brx type bridge 2023-05-16T13:54:37.605 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip addr flush dev ceph-brx 2023-05-16T13:54:37.605 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set ceph-brx up 2023-05-16T13:54:37.605 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-05-16T13:54:37.605 DEBUG:teuthology.orchestra.run.smithi118:> ') 2023-05-16T13:54:37.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:37.721 DEBUG:teuthology.orchestra.run.smithi118:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-16T13:54:37.739 INFO:teuthology.orchestra.run.smithi118.stdout:1 2023-05-16T13:54:37.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:37.741 DEBUG:teuthology.orchestra.run.smithi118:> route 2023-05-16T13:54:37.816 INFO:teuthology.orchestra.run.smithi118.stdout:Kernel IP routing table 2023-05-16T13:54:37.816 INFO:teuthology.orchestra.run.smithi118.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-16T13:54:37.816 INFO:teuthology.orchestra.run.smithi118.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-05-16T13:54:37.816 INFO:teuthology.orchestra.run.smithi118.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-05-16T13:54:37.816 INFO:teuthology.orchestra.run.smithi118.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-05-16T13:54:37.816 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-05-16T13:54:37.817 INFO:teuthology.orchestra.run.smithi118.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-05-16T13:54:37.817 INFO:teuthology.orchestra.run.smithi118.stdout:ns2.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-05-16T13:54:37.817 INFO:teuthology.orchestra.run.smithi118.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-05-16T13:54:37.817 INFO:teuthology.orchestra.run.smithi118.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-16T13:54:37.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:37.818 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2023-05-16T13:54:37.818 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2023-05-16T13:54:37.818 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-05-16T13:54:37.818 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-05-16T13:54:37.818 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-05-16T13:54:37.819 DEBUG:teuthology.orchestra.run.smithi118:> ') 2023-05-16T13:54:37.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:37.906 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list 2023-05-16T13:54:37.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:37.915 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list-id 2023-05-16T13:54:37.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:37.963 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2023-05-16T13:54:37.964 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2023-05-16T13:54:37.964 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-05-16T13:54:37.964 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-05-16T13:54:37.964 DEBUG:teuthology.orchestra.run.smithi118:> ') 2023-05-16T13:54:38.041 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-05-16T13:54:38.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:38.042 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2023-05-16T13:54:38.042 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2023-05-16T13:54:38.042 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-05-16T13:54:38.042 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-05-16T13:54:38.043 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-05-16T13:54:38.043 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-05-16T13:54:38.043 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-05-16T13:54:38.043 DEBUG:teuthology.orchestra.run.smithi118:> ') 2023-05-16T13:54:38.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:38.200 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2023-05-16T13:54:38.200 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2023-05-16T13:54:38.200 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set brx.0 up 2023-05-16T13:54:38.200 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set dev brx.0 master ceph-brx 2023-05-16T13:54:38.201 DEBUG:teuthology.orchestra.run.smithi118:> ') 2023-05-16T13:54:38.238 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-05-16T13:54:38.238 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-16T13:54:38.239 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-05-16T13:54:38.287 INFO:teuthology.orchestra.run.smithi118.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-05-16T13:54:38.287 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-16T13:54:38.287 DEBUG:teuthology.orchestra.run.smithi118:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-05-16T13:54:38.338 DEBUG:teuthology.orchestra.run.smithi118:> sudo modprobe fuse 2023-05-16T13:54:38.402 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-16T13:54:38.402 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-16T13:54:38.460 INFO:teuthology.orchestra.run.smithi118.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-16T13:54:38.462 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-16T13:54:38.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:38.462 DEBUG:teuthology.orchestra.run.smithi118:> ls /sys/fs/fuse/connections 2023-05-16T13:54:38.515 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-05-16T13:54:38.516 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-05-16T13:54:38.562 DEBUG:teuthology.orchestra.run.smithi118:> sudo modprobe fuse 2023-05-16T13:54:38.581 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-16T13:54:38.582 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-16T13:54:38.641 INFO:teuthology.orchestra.run.smithi118.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-16T13:54:38.642 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-16T13:54:38.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:38.643 DEBUG:teuthology.orchestra.run.smithi118:> ls /sys/fs/fuse/connections 2023-05-16T13:54:38.655 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi118.stderr:2023-05-16T13:54:38.649+0000 7ff9d9803580 -1 init, newargv = 0x55f36ab4a7c0 newargc=15 2023-05-16T13:54:38.656 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi118.stderr:ceph-fuse[41311]: starting ceph client 2023-05-16T13:54:38.664 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi118.stderr:ceph-fuse[41311]: starting fuse 2023-05-16T13:54:39.766 DEBUG:teuthology.orchestra.run.smithi118:> sudo modprobe fuse 2023-05-16T13:54:39.788 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-16T13:54:39.788 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-16T13:54:39.854 INFO:teuthology.orchestra.run.smithi118.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-16T13:54:39.855 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-16T13:54:39.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:39.856 DEBUG:teuthology.orchestra.run.smithi118:> ls /sys/fs/fuse/connections 2023-05-16T13:54:39.911 INFO:teuthology.orchestra.run.smithi118.stdout:42 2023-05-16T13:54:39.911 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2023-05-16T13:54:39.911 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-05-16T13:54:39.912 DEBUG:teuthology.orchestra.run.smithi118:> import glob 2023-05-16T13:54:39.912 DEBUG:teuthology.orchestra.run.smithi118:> import re 2023-05-16T13:54:39.912 DEBUG:teuthology.orchestra.run.smithi118:> import os 2023-05-16T13:54:39.912 DEBUG:teuthology.orchestra.run.smithi118:> import subprocess 2023-05-16T13:54:39.913 DEBUG:teuthology.orchestra.run.smithi118:> 2023-05-16T13:54:39.913 DEBUG:teuthology.orchestra.run.smithi118:> def _find_admin_socket(client_name): 2023-05-16T13:54:39.913 DEBUG:teuthology.orchestra.run.smithi118:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-05-16T13:54:39.913 DEBUG:teuthology.orchestra.run.smithi118:> files = glob.glob(asok_path) 2023-05-16T13:54:39.914 DEBUG:teuthology.orchestra.run.smithi118:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-05-16T13:54:39.914 DEBUG:teuthology.orchestra.run.smithi118:> 2023-05-16T13:54:39.914 DEBUG:teuthology.orchestra.run.smithi118:> # Given a non-glob path, it better be there 2023-05-16T13:54:39.914 DEBUG:teuthology.orchestra.run.smithi118:> if "*" not in asok_path: 2023-05-16T13:54:39.914 DEBUG:teuthology.orchestra.run.smithi118:> assert(len(files) == 1) 2023-05-16T13:54:39.915 DEBUG:teuthology.orchestra.run.smithi118:> return files[0] 2023-05-16T13:54:39.915 DEBUG:teuthology.orchestra.run.smithi118:> 2023-05-16T13:54:39.915 DEBUG:teuthology.orchestra.run.smithi118:> for f in files: 2023-05-16T13:54:39.915 DEBUG:teuthology.orchestra.run.smithi118:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-05-16T13:54:39.916 DEBUG:teuthology.orchestra.run.smithi118:> if os.path.exists("/proc/{0}".format(pid)): 2023-05-16T13:54:39.916 DEBUG:teuthology.orchestra.run.smithi118:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-05-16T13:54:39.916 DEBUG:teuthology.orchestra.run.smithi118:> contents = proc_f.read() 2023-05-16T13:54:39.916 DEBUG:teuthology.orchestra.run.smithi118:> if mountpoint in contents: 2023-05-16T13:54:39.916 DEBUG:teuthology.orchestra.run.smithi118:> return f 2023-05-16T13:54:39.917 DEBUG:teuthology.orchestra.run.smithi118:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-05-16T13:54:39.917 DEBUG:teuthology.orchestra.run.smithi118:> 2023-05-16T13:54:39.917 DEBUG:teuthology.orchestra.run.smithi118:> print(_find_admin_socket("client.1")) 2023-05-16T13:54:39.917 DEBUG:teuthology.orchestra.run.smithi118:> ' 2023-05-16T13:54:40.034 INFO:teuthology.orchestra.run.smithi118.stdout:/var/run/ceph/ceph-client.1.41311.asok 2023-05-16T13:54:40.218 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.41311.asok 2023-05-16T13:54:40.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:40.219 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.41311.asok status 2023-05-16T13:54:40.388 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2023-05-16T13:54:40.420 INFO:teuthology.orchestra.run.smithi118.stdout: "metadata": { 2023-05-16T13:54:40.420 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_sha1": "27be51263d3d0c721b6d1ca9f42550bf0ab3c97b", 2023-05-16T13:54:40.420 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_version": "ceph version 18.0.0-3926-g27be5126 (27be51263d3d0c721b6d1ca9f42550bf0ab3c97b) reef (dev)", 2023-05-16T13:54:40.420 INFO:teuthology.orchestra.run.smithi118.stdout: "entity_id": "1", 2023-05-16T13:54:40.421 INFO:teuthology.orchestra.run.smithi118.stdout: "hostname": "smithi118", 2023-05-16T13:54:40.421 INFO:teuthology.orchestra.run.smithi118.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-05-16T13:54:40.421 INFO:teuthology.orchestra.run.smithi118.stdout: "pid": "41311", 2023-05-16T13:54:40.421 INFO:teuthology.orchestra.run.smithi118.stdout: "root": "/" 2023-05-16T13:54:40.421 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-05-16T13:54:40.421 INFO:teuthology.orchestra.run.smithi118.stdout: "dentry_count": 0, 2023-05-16T13:54:40.421 INFO:teuthology.orchestra.run.smithi118.stdout: "dentry_pinned_count": 0, 2023-05-16T13:54:40.422 INFO:teuthology.orchestra.run.smithi118.stdout: "id": 4708, 2023-05-16T13:54:40.422 INFO:teuthology.orchestra.run.smithi118.stdout: "inst": { 2023-05-16T13:54:40.422 INFO:teuthology.orchestra.run.smithi118.stdout: "name": { 2023-05-16T13:54:40.422 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "client", 2023-05-16T13:54:40.422 INFO:teuthology.orchestra.run.smithi118.stdout: "num": 4708 2023-05-16T13:54:40.422 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-05-16T13:54:40.422 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": { 2023-05-16T13:54:40.423 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2023-05-16T13:54:40.423 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "192.168.0.1:0", 2023-05-16T13:54:40.423 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1675638925 2023-05-16T13:54:40.423 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-05-16T13:54:40.423 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-05-16T13:54:40.423 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": { 2023-05-16T13:54:40.423 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2023-05-16T13:54:40.423 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "192.168.0.1:0", 2023-05-16T13:54:40.424 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1675638925 2023-05-16T13:54:40.424 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-05-16T13:54:40.424 INFO:teuthology.orchestra.run.smithi118.stdout: "inst_str": "client.4708 192.168.0.1:0/1675638925", 2023-05-16T13:54:40.424 INFO:teuthology.orchestra.run.smithi118.stdout: "addr_str": "192.168.0.1:0/1675638925", 2023-05-16T13:54:40.424 INFO:teuthology.orchestra.run.smithi118.stdout: "inode_count": 1, 2023-05-16T13:54:40.424 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_epoch": 8, 2023-05-16T13:54:40.424 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_epoch": 24, 2023-05-16T13:54:40.425 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_epoch_barrier": 0, 2023-05-16T13:54:40.425 INFO:teuthology.orchestra.run.smithi118.stdout: "blocklisted": false, 2023-05-16T13:54:40.425 INFO:teuthology.orchestra.run.smithi118.stdout: "fs_name": "cephfs" 2023-05-16T13:54:40.425 INFO:teuthology.orchestra.run.smithi118.stdout:} 2023-05-16T13:54:40.426 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-05-16T13:54:40.574 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.569+0000 7fbb973f3640 1 Processor -- start 2023-05-16T13:54:40.575 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.569+0000 7fbb973f3640 1 -- start start 2023-05-16T13:54:40.576 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.569+0000 7fbb973f3640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbb9006c770 0x7fbb900cadc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:40.576 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.569+0000 7fbb973f3640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb900c8f20 0x7fbb900cb300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:40.576 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.569+0000 7fbb973f3640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb900b1320 con 0x7fbb900b0f50 2023-05-16T13:54:40.576 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.569+0000 7fbb973f3640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb9006d060 con 0x7fbb9006c770 2023-05-16T13:54:40.576 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.569+0000 7fbb973f3640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9015e910 con 0x7fbb900c8f20 2023-05-16T13:54:40.577 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.573+0000 7fbb9518f640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fbb900b0f50 0x7fbb9006c060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:58154/0 (socket says 172.21.15.39:58154) 2023-05-16T13:54:40.577 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.573+0000 7fbb9518f640 1 -- 172.21.15.39:0/3055744514 learned_addr learned my addr 172.21.15.39:0/3055744514 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:40.577 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.573+0000 7fbb95990640 1 --2- 172.21.15.39:0/3055744514 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb900c8f20 0x7fbb900cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:40.578 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.573+0000 7fbb9498e640 1 --2- 172.21.15.39:0/3055744514 >> v2:172.21.15.118:3300/0 conn(0x7fbb9006c770 0x7fbb900cadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:40.578 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.573+0000 7fbb87fff640 1 -- 172.21.15.39:0/3055744514 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1318229103 0 0) 0x7fbb900b1320 con 0x7fbb900b0f50 2023-05-16T13:54:40.578 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.573+0000 7fbb87fff640 1 -- 172.21.15.39:0/3055744514 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb7c003530 con 0x7fbb900b0f50 2023-05-16T13:54:40.578 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.573+0000 7fbb95990640 1 -- 172.21.15.39:0/3055744514 >> v2:172.21.15.118:3300/0 conn(0x7fbb9006c770 msgr2=0x7fbb900cadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:40.578 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.573+0000 7fbb95990640 1 --2- 172.21.15.39:0/3055744514 >> v2:172.21.15.118:3300/0 conn(0x7fbb9006c770 0x7fbb900cadc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:40.578 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.573+0000 7fbb95990640 1 -- 172.21.15.39:0/3055744514 >> v1:172.21.15.39:6789/0 conn(0x7fbb900b0f50 legacy=0x7fbb9006c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:40.578 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.573+0000 7fbb95990640 1 -- 172.21.15.39:0/3055744514 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb9006d320 con 0x7fbb900c8f20 2023-05-16T13:54:40.579 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.573+0000 7fbb9498e640 1 --2- 172.21.15.39:0/3055744514 >> v2:172.21.15.118:3300/0 conn(0x7fbb9006c770 0x7fbb900cadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-16T13:54:40.579 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.573+0000 7fbb95990640 1 --2- 172.21.15.39:0/3055744514 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb900c8f20 0x7fbb900cb300 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbb88009d90 tx=0x7fbb8801c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7f0a6f2d101651c server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:40.580 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.573+0000 7fbb87fff640 1 -- 172.21.15.39:0/3055744514 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb880a5850 con 0x7fbb900c8f20 2023-05-16T13:54:40.580 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.573+0000 7fbb87fff640 1 -- 172.21.15.39:0/3055744514 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb880a59b0 con 0x7fbb900c8f20 2023-05-16T13:54:40.580 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.573+0000 7fbb87fff640 1 -- 172.21.15.39:0/3055744514 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb880a5d20 con 0x7fbb900c8f20 2023-05-16T13:54:40.581 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.577+0000 7fbb973f3640 1 -- 172.21.15.39:0/3055744514 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb900c8f20 msgr2=0x7fbb900cb300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:40.581 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.577+0000 7fbb973f3640 1 --2- 172.21.15.39:0/3055744514 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb900c8f20 0x7fbb900cb300 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbb88009d90 tx=0x7fbb8801c800 comp rx=0 tx=0).stop 2023-05-16T13:54:40.581 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.577+0000 7fbb973f3640 1 -- 172.21.15.39:0/3055744514 shutdown_connections 2023-05-16T13:54:40.581 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.577+0000 7fbb973f3640 1 --2- 172.21.15.39:0/3055744514 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb900c8f20 0x7fbb900cb300 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:40.582 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.577+0000 7fbb973f3640 1 --2- 172.21.15.39:0/3055744514 >> v2:172.21.15.118:3300/0 conn(0x7fbb9006c770 0x7fbb900cadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:40.582 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.577+0000 7fbb973f3640 1 -- 172.21.15.39:0/3055744514 >> 172.21.15.39:0/3055744514 conn(0x7fbb900b1850 msgr2=0x7fbb900b1c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:40.582 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.577+0000 7fbb973f3640 1 -- 172.21.15.39:0/3055744514 shutdown_connections 2023-05-16T13:54:40.582 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.577+0000 7fbb973f3640 1 -- 172.21.15.39:0/3055744514 wait complete. 2023-05-16T13:54:40.582 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.577+0000 7fbb973f3640 1 Processor -- start 2023-05-16T13:54:40.583 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.577+0000 7fbb973f3640 1 -- start start 2023-05-16T13:54:40.583 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.577+0000 7fbb973f3640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb9006c770 0x7fbb90144d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:40.584 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.577+0000 7fbb973f3640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb900b0f50 0x7fbb90155200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:40.584 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.577+0000 7fbb973f3640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb900c8f20 0x7fbb900c8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:40.584 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.577+0000 7fbb973f3640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb90154160 con 0x7fbb9006c770 2023-05-16T13:54:40.584 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.577+0000 7fbb973f3640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb90154440 con 0x7fbb900c8f20 2023-05-16T13:54:40.584 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.577+0000 7fbb973f3640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb90154720 con 0x7fbb900b0f50 2023-05-16T13:54:40.584 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.577+0000 7fbb9518f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb9006c770 0x7fbb90144d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:40.585 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.577+0000 7fbb9518f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb9006c770 0x7fbb90144d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34840/0 (socket says 172.21.15.39:34840) 2023-05-16T13:54:40.585 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.577+0000 7fbb9518f640 1 -- 172.21.15.39:0/1578436302 learned_addr learned my addr 172.21.15.39:0/1578436302 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:40.585 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.577+0000 7fbb9498e640 1 --2- 172.21.15.39:0/1578436302 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb900b0f50 0x7fbb90155200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:40.585 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.577+0000 7fbb95990640 1 --2- 172.21.15.39:0/1578436302 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb900c8f20 0x7fbb900c8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:40.586 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.581+0000 7fbb9518f640 1 -- 172.21.15.39:0/1578436302 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb900b0f50 msgr2=0x7fbb90155200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:40.586 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.581+0000 7fbb9518f640 1 --2- 172.21.15.39:0/1578436302 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb900b0f50 0x7fbb90155200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:40.586 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.581+0000 7fbb9518f640 1 -- 172.21.15.39:0/1578436302 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb900c8f20 msgr2=0x7fbb900c8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:40.586 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.581+0000 7fbb9518f640 1 --2- 172.21.15.39:0/1578436302 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb900c8f20 0x7fbb900c8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:40.587 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.581+0000 7fbb9518f640 1 -- 172.21.15.39:0/1578436302 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb80009420 con 0x7fbb9006c770 2023-05-16T13:54:40.587 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.581+0000 7fbb9518f640 1 --2- 172.21.15.39:0/1578436302 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb9006c770 0x7fbb90144d30 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c0010f0 tx=0x7fbb8c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:40.587 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.581+0000 7fbb85ffb640 1 -- 172.21.15.39:0/1578436302 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb8c005cf0 con 0x7fbb9006c770 2023-05-16T13:54:40.587 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.581+0000 7fbb85ffb640 1 -- 172.21.15.39:0/1578436302 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb8c005e70 con 0x7fbb9006c770 2023-05-16T13:54:40.587 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.581+0000 7fbb85ffb640 1 -- 172.21.15.39:0/1578436302 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb8c0072d0 con 0x7fbb9006c770 2023-05-16T13:54:40.587 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.581+0000 7fbb973f3640 1 -- 172.21.15.39:0/1578436302 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb88009a70 con 0x7fbb9006c770 2023-05-16T13:54:40.587 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.581+0000 7fbb973f3640 1 -- 172.21.15.39:0/1578436302 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb900cbc50 con 0x7fbb9006c770 2023-05-16T13:54:40.588 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.581+0000 7fbb973f3640 1 -- 172.21.15.39:0/1578436302 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb9006d600 con 0x7fbb9006c770 2023-05-16T13:54:40.588 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.581+0000 7fbb85ffb640 1 -- 172.21.15.39:0/1578436302 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbb8c007430 con 0x7fbb9006c770 2023-05-16T13:54:40.588 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.581+0000 7fbb85ffb640 1 --2- 172.21.15.39:0/1578436302 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fbb74066280 0x7fbb74068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:40.589 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.581+0000 7fbb85ffb640 1 -- 172.21.15.39:0/1578436302 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbb8c083320 con 0x7fbb9006c770 2023-05-16T13:54:40.589 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.581+0000 7fbb9498e640 1 --2- 172.21.15.39:0/1578436302 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fbb74066280 0x7fbb74068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:40.589 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.585+0000 7fbb9498e640 1 --2- 172.21.15.39:0/1578436302 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fbb74066280 0x7fbb74068730 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbb900c5310 tx=0x7fbb80009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:40.592 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.585+0000 7fbb85ffb640 1 -- 172.21.15.39:0/1578436302 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fbb8c0507b0 con 0x7fbb9006c770 2023-05-16T13:54:40.778 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.773+0000 7fbb973f3640 1 -- 172.21.15.39:0/1578436302 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fbb9015e530 con 0x7fbb9006c770 2023-05-16T13:54:40.778 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.773+0000 7fbb85ffb640 1 -- 172.21.15.39:0/1578436302 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fbb8c053dd0 con 0x7fbb9006c770 2023-05-16T13:54:40.778 INFO:teuthology.orchestra.run.smithi039.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-05-16T13:54:40.780 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.773+0000 7fbb973f3640 1 -- 172.21.15.39:0/1578436302 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fbb74066280 msgr2=0x7fbb74068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:40.780 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.773+0000 7fbb973f3640 1 --2- 172.21.15.39:0/1578436302 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fbb74066280 0x7fbb74068730 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbb900c5310 tx=0x7fbb80009190 comp rx=0 tx=0).stop 2023-05-16T13:54:40.780 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.773+0000 7fbb973f3640 1 -- 172.21.15.39:0/1578436302 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb9006c770 msgr2=0x7fbb90144d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:40.780 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.773+0000 7fbb973f3640 1 --2- 172.21.15.39:0/1578436302 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb9006c770 0x7fbb90144d30 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c0010f0 tx=0x7fbb8c00c890 comp rx=0 tx=0).stop 2023-05-16T13:54:40.781 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.773+0000 7fbb973f3640 1 -- 172.21.15.39:0/1578436302 shutdown_connections 2023-05-16T13:54:40.781 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.773+0000 7fbb973f3640 1 --2- 172.21.15.39:0/1578436302 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fbb74066280 0x7fbb74068730 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:40.781 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.773+0000 7fbb973f3640 1 --2- 172.21.15.39:0/1578436302 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb900b0f50 0x7fbb90155200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:40.781 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.773+0000 7fbb973f3640 1 --2- 172.21.15.39:0/1578436302 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb900c8f20 0x7fbb900c8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:40.781 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.773+0000 7fbb973f3640 1 --2- 172.21.15.39:0/1578436302 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb9006c770 0x7fbb90144d30 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:40.781 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.773+0000 7fbb973f3640 1 -- 172.21.15.39:0/1578436302 >> 172.21.15.39:0/1578436302 conn(0x7fbb900b1850 msgr2=0x7fbb90155d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:40.781 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.777+0000 7fbb973f3640 1 -- 172.21.15.39:0/1578436302 shutdown_connections 2023-05-16T13:54:40.782 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:40.777+0000 7fbb973f3640 1 -- 172.21.15.39:0/1578436302 wait complete. 2023-05-16T13:54:40.798 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-16T13:54:40.798 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-16T13:54:40.799 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi118.front.sepia.ceph.com 2023-05-16T13:54:40.799 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-05-16T13:54:40.799 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-05-16T13:54:40.799 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-16T13:54:40.799 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-05-16T13:54:40.799 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-16T13:54:40.800 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-05-16T13:54:40.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:40.800 DEBUG:teuthology.orchestra.run.smithi118:> ip addr 2023-05-16T13:54:40.808 INFO:teuthology.orchestra.run.smithi118.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-16T13:54:40.809 INFO:teuthology.orchestra.run.smithi118.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-16T13:54:40.809 INFO:teuthology.orchestra.run.smithi118.stdout: inet 127.0.0.1/8 scope host lo 2023-05-16T13:54:40.809 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-05-16T13:54:40.809 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 ::1/128 scope host 2023-05-16T13:54:40.809 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-05-16T13:54:40.809 INFO:teuthology.orchestra.run.smithi118.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-05-16T13:54:40.809 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cc brd ff:ff:ff:ff:ff:ff 2023-05-16T13:54:40.810 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f0 2023-05-16T13:54:40.810 INFO:teuthology.orchestra.run.smithi118.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-05-16T13:54:40.810 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cd brd ff:ff:ff:ff:ff:ff 2023-05-16T13:54:40.810 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f1 2023-05-16T13:54:40.810 INFO:teuthology.orchestra.run.smithi118.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-05-16T13:54:40.810 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:24 brd ff:ff:ff:ff:ff:ff 2023-05-16T13:54:40.811 INFO:teuthology.orchestra.run.smithi118.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-16T13:54:40.811 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:25 brd ff:ff:ff:ff:ff:ff 2023-05-16T13:54:40.811 INFO:teuthology.orchestra.run.smithi118.stdout: inet 172.21.15.118/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-05-16T13:54:40.811 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft 42299sec preferred_lft 42299sec 2023-05-16T13:54:40.811 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::ec4:7aff:fe8f:d725/64 scope link 2023-05-16T13:54:40.811 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-05-16T13:54:40.811 INFO:teuthology.orchestra.run.smithi118.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-05-16T13:54:40.811 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 02:42:e0:5d:93:d2 brd ff:ff:ff:ff:ff:ff 2023-05-16T13:54:40.812 INFO:teuthology.orchestra.run.smithi118.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-05-16T13:54:40.812 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-05-16T13:54:40.812 INFO:teuthology.orchestra.run.smithi118.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-16T13:54:40.812 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-05-16T13:54:40.812 INFO:teuthology.orchestra.run.smithi118.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-05-16T13:54:40.812 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-05-16T13:54:40.812 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-05-16T13:54:40.812 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-05-16T13:54:40.813 INFO:teuthology.orchestra.run.smithi118.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-16T13:54:40.813 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-05-16T13:54:40.813 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-05-16T13:54:40.813 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-05-16T13:54:40.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:40.814 DEBUG:teuthology.orchestra.run.smithi118:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-16T13:54:40.872 INFO:teuthology.orchestra.run.smithi118.stdout:1 2023-05-16T13:54:40.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:40.875 DEBUG:teuthology.orchestra.run.smithi118:> route 2023-05-16T13:54:40.929 INFO:teuthology.orchestra.run.smithi118.stdout:Kernel IP routing table 2023-05-16T13:54:40.929 INFO:teuthology.orchestra.run.smithi118.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-16T13:54:40.929 INFO:teuthology.orchestra.run.smithi118.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-05-16T13:54:40.929 INFO:teuthology.orchestra.run.smithi118.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-05-16T13:54:40.929 INFO:teuthology.orchestra.run.smithi118.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-05-16T13:54:40.929 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-05-16T13:54:40.930 INFO:teuthology.orchestra.run.smithi118.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-05-16T13:54:40.930 INFO:teuthology.orchestra.run.smithi118.stdout:ns2.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-05-16T13:54:40.930 INFO:teuthology.orchestra.run.smithi118.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-05-16T13:54:40.930 INFO:teuthology.orchestra.run.smithi118.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-16T13:54:40.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:40.931 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2023-05-16T13:54:40.931 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2023-05-16T13:54:40.931 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-05-16T13:54:40.931 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-05-16T13:54:40.931 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-05-16T13:54:40.932 DEBUG:teuthology.orchestra.run.smithi118:> ') 2023-05-16T13:54:41.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:41.018 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list 2023-05-16T13:54:41.026 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-05-16T13:54:41.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:41.027 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list-id 2023-05-16T13:54:41.075 INFO:teuthology.orchestra.run.smithi118.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-05-16T13:54:41.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:41.076 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2023-05-16T13:54:41.076 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2023-05-16T13:54:41.076 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-05-16T13:54:41.076 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-05-16T13:54:41.077 DEBUG:teuthology.orchestra.run.smithi118:> ') 2023-05-16T13:54:41.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:41.153 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-05-16T13:54:41.214 INFO:teuthology.orchestra.run.smithi118.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-16T13:54:41.214 INFO:teuthology.orchestra.run.smithi118.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-16T13:54:41.215 INFO:teuthology.orchestra.run.smithi118.stdout: inet 127.0.0.1/8 scope host lo 2023-05-16T13:54:41.215 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-05-16T13:54:41.215 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 ::1/128 scope host 2023-05-16T13:54:41.215 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-05-16T13:54:41.215 INFO:teuthology.orchestra.run.smithi118.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-16T13:54:41.215 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 6e:d3:83:cc:25:b2 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-05-16T13:54:41.215 INFO:teuthology.orchestra.run.smithi118.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-05-16T13:54:41.215 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-05-16T13:54:41.216 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::6cd3:83ff:fecc:25b2/64 scope link 2023-05-16T13:54:41.216 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-05-16T13:54:41.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:41.217 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-05-16T13:54:41.282 INFO:teuthology.orchestra.run.smithi118.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-16T13:54:41.282 INFO:teuthology.orchestra.run.smithi118.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-16T13:54:41.283 INFO:teuthology.orchestra.run.smithi118.stdout: inet 127.0.0.1/8 scope host lo 2023-05-16T13:54:41.283 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-05-16T13:54:41.283 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 ::1/128 scope host 2023-05-16T13:54:41.283 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-05-16T13:54:41.283 INFO:teuthology.orchestra.run.smithi118.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-16T13:54:41.283 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 6e:d3:83:cc:25:b2 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-05-16T13:54:41.283 INFO:teuthology.orchestra.run.smithi118.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-05-16T13:54:41.284 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-05-16T13:54:41.284 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::6cd3:83ff:fecc:25b2/64 scope link 2023-05-16T13:54:41.284 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-05-16T13:54:41.285 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-05-16T13:54:41.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:41.285 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2023-05-16T13:54:41.286 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2023-05-16T13:54:41.286 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-05-16T13:54:41.286 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-05-16T13:54:41.286 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-05-16T13:54:41.286 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-05-16T13:54:41.287 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-05-16T13:54:41.287 DEBUG:teuthology.orchestra.run.smithi118:> ') 2023-05-16T13:54:41.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:41.415 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2023-05-16T13:54:41.415 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2023-05-16T13:54:41.415 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set brx.1 up 2023-05-16T13:54:41.416 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set dev brx.1 master ceph-brx 2023-05-16T13:54:41.416 DEBUG:teuthology.orchestra.run.smithi118:> ') 2023-05-16T13:54:41.453 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-05-16T13:54:41.453 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-16T13:54:41.453 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-05-16T13:54:41.503 INFO:teuthology.orchestra.run.smithi118.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-05-16T13:54:41.503 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-16T13:54:41.504 DEBUG:teuthology.orchestra.run.smithi118:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-05-16T13:54:41.550 DEBUG:teuthology.orchestra.run.smithi118:> sudo modprobe fuse 2023-05-16T13:54:41.610 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-16T13:54:41.611 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-16T13:54:41.669 INFO:teuthology.orchestra.run.smithi118.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-16T13:54:41.670 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-16T13:54:41.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:41.672 DEBUG:teuthology.orchestra.run.smithi118:> ls /sys/fs/fuse/connections 2023-05-16T13:54:41.722 INFO:teuthology.orchestra.run.smithi118.stdout:42 2023-05-16T13:54:41.723 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [42] 2023-05-16T13:54:41.723 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2023-05-16T13:54:41.770 DEBUG:teuthology.orchestra.run.smithi118:> sudo modprobe fuse 2023-05-16T13:54:41.790 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-16T13:54:41.790 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-16T13:54:41.849 INFO:teuthology.orchestra.run.smithi118.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-16T13:54:41.850 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-16T13:54:41.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:41.851 DEBUG:teuthology.orchestra.run.smithi118:> ls /sys/fs/fuse/connections 2023-05-16T13:54:41.862 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi118.stderr:2023-05-16T13:54:41.856+0000 7f911fe9b580 -1 init, newargv = 0x55d812219dc0 newargc=15 2023-05-16T13:54:41.863 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi118.stderr:ceph-fuse[41424]: starting ceph client 2023-05-16T13:54:41.869 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi118.stderr:ceph-fuse[41424]: starting fuse 2023-05-16T13:54:41.871 INFO:teuthology.orchestra.run.smithi118.stdout:42 2023-05-16T13:54:41.871 INFO:teuthology.orchestra.run.smithi118.stdout:43 2023-05-16T13:54:41.871 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42, 43] 2023-05-16T13:54:41.872 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-05-16T13:54:41.872 DEBUG:teuthology.orchestra.run.smithi118:> import glob 2023-05-16T13:54:41.873 DEBUG:teuthology.orchestra.run.smithi118:> import re 2023-05-16T13:54:41.873 DEBUG:teuthology.orchestra.run.smithi118:> import os 2023-05-16T13:54:41.874 DEBUG:teuthology.orchestra.run.smithi118:> import subprocess 2023-05-16T13:54:41.874 DEBUG:teuthology.orchestra.run.smithi118:> 2023-05-16T13:54:41.874 DEBUG:teuthology.orchestra.run.smithi118:> def _find_admin_socket(client_name): 2023-05-16T13:54:41.875 DEBUG:teuthology.orchestra.run.smithi118:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-05-16T13:54:41.875 DEBUG:teuthology.orchestra.run.smithi118:> files = glob.glob(asok_path) 2023-05-16T13:54:41.876 DEBUG:teuthology.orchestra.run.smithi118:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-05-16T13:54:41.876 DEBUG:teuthology.orchestra.run.smithi118:> 2023-05-16T13:54:41.876 DEBUG:teuthology.orchestra.run.smithi118:> # Given a non-glob path, it better be there 2023-05-16T13:54:41.877 DEBUG:teuthology.orchestra.run.smithi118:> if "*" not in asok_path: 2023-05-16T13:54:41.877 DEBUG:teuthology.orchestra.run.smithi118:> assert(len(files) == 1) 2023-05-16T13:54:41.878 DEBUG:teuthology.orchestra.run.smithi118:> return files[0] 2023-05-16T13:54:41.878 DEBUG:teuthology.orchestra.run.smithi118:> 2023-05-16T13:54:41.878 DEBUG:teuthology.orchestra.run.smithi118:> for f in files: 2023-05-16T13:54:41.879 DEBUG:teuthology.orchestra.run.smithi118:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-05-16T13:54:41.879 DEBUG:teuthology.orchestra.run.smithi118:> if os.path.exists("/proc/{0}".format(pid)): 2023-05-16T13:54:41.880 DEBUG:teuthology.orchestra.run.smithi118:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-05-16T13:54:41.880 DEBUG:teuthology.orchestra.run.smithi118:> contents = proc_f.read() 2023-05-16T13:54:41.881 DEBUG:teuthology.orchestra.run.smithi118:> if mountpoint in contents: 2023-05-16T13:54:41.881 DEBUG:teuthology.orchestra.run.smithi118:> return f 2023-05-16T13:54:41.881 DEBUG:teuthology.orchestra.run.smithi118:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-05-16T13:54:41.882 DEBUG:teuthology.orchestra.run.smithi118:> 2023-05-16T13:54:41.882 DEBUG:teuthology.orchestra.run.smithi118:> print(_find_admin_socket("client.3")) 2023-05-16T13:54:41.882 DEBUG:teuthology.orchestra.run.smithi118:> ' 2023-05-16T13:54:41.988 INFO:teuthology.orchestra.run.smithi118.stdout:/var/run/ceph/ceph-client.3.41424.asok 2023-05-16T13:54:42.173 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.41424.asok 2023-05-16T13:54:42.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:42.174 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.41424.asok status 2023-05-16T13:54:42.339 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2023-05-16T13:54:42.339 INFO:teuthology.orchestra.run.smithi118.stdout: "metadata": { 2023-05-16T13:54:42.339 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_sha1": "27be51263d3d0c721b6d1ca9f42550bf0ab3c97b", 2023-05-16T13:54:42.339 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_version": "ceph version 18.0.0-3926-g27be5126 (27be51263d3d0c721b6d1ca9f42550bf0ab3c97b) reef (dev)", 2023-05-16T13:54:42.339 INFO:teuthology.orchestra.run.smithi118.stdout: "entity_id": "3", 2023-05-16T13:54:42.340 INFO:teuthology.orchestra.run.smithi118.stdout: "hostname": "smithi118", 2023-05-16T13:54:42.340 INFO:teuthology.orchestra.run.smithi118.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-05-16T13:54:42.340 INFO:teuthology.orchestra.run.smithi118.stdout: "pid": "41424", 2023-05-16T13:54:42.340 INFO:teuthology.orchestra.run.smithi118.stdout: "root": "/" 2023-05-16T13:54:42.340 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-05-16T13:54:42.340 INFO:teuthology.orchestra.run.smithi118.stdout: "dentry_count": 0, 2023-05-16T13:54:42.340 INFO:teuthology.orchestra.run.smithi118.stdout: "dentry_pinned_count": 0, 2023-05-16T13:54:42.341 INFO:teuthology.orchestra.run.smithi118.stdout: "id": 4720, 2023-05-16T13:54:42.341 INFO:teuthology.orchestra.run.smithi118.stdout: "inst": { 2023-05-16T13:54:42.341 INFO:teuthology.orchestra.run.smithi118.stdout: "name": { 2023-05-16T13:54:42.341 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "client", 2023-05-16T13:54:42.341 INFO:teuthology.orchestra.run.smithi118.stdout: "num": 4720 2023-05-16T13:54:42.341 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-05-16T13:54:42.341 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": { 2023-05-16T13:54:42.341 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2023-05-16T13:54:42.342 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "192.168.0.2:0", 2023-05-16T13:54:42.342 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 477927102 2023-05-16T13:54:42.342 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-05-16T13:54:42.342 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-05-16T13:54:42.342 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": { 2023-05-16T13:54:42.342 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2023-05-16T13:54:42.342 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "192.168.0.2:0", 2023-05-16T13:54:42.342 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 477927102 2023-05-16T13:54:42.343 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-05-16T13:54:42.343 INFO:teuthology.orchestra.run.smithi118.stdout: "inst_str": "client.4720 192.168.0.2:0/477927102", 2023-05-16T13:54:42.343 INFO:teuthology.orchestra.run.smithi118.stdout: "addr_str": "192.168.0.2:0/477927102", 2023-05-16T13:54:42.343 INFO:teuthology.orchestra.run.smithi118.stdout: "inode_count": 1, 2023-05-16T13:54:42.343 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_epoch": 8, 2023-05-16T13:54:42.343 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_epoch": 24, 2023-05-16T13:54:42.343 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_epoch_barrier": 0, 2023-05-16T13:54:42.344 INFO:teuthology.orchestra.run.smithi118.stdout: "blocklisted": false, 2023-05-16T13:54:42.344 INFO:teuthology.orchestra.run.smithi118.stdout: "fs_name": "cephfs" 2023-05-16T13:54:42.344 INFO:teuthology.orchestra.run.smithi118.stdout:} 2023-05-16T13:54:42.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:42.353 DEBUG:teuthology.orchestra.run.smithi039:> stat --file-system '--printf=%T 2023-05-16T13:54:42.353 DEBUG:teuthology.orchestra.run.smithi039:> ' -- /home/ubuntu/cephtest/mnt.0 2023-05-16T13:54:42.363 INFO:teuthology.orchestra.run.smithi039.stdout:fuseblk 2023-05-16T13:54:42.364 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-05-16T13:54:42.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:42.364 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-05-16T13:54:42.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:42.432 DEBUG:teuthology.orchestra.run.smithi039:> stat --file-system '--printf=%T 2023-05-16T13:54:42.432 DEBUG:teuthology.orchestra.run.smithi039:> ' -- /home/ubuntu/cephtest/mnt.2 2023-05-16T13:54:42.485 INFO:teuthology.orchestra.run.smithi039.stdout:fuseblk 2023-05-16T13:54:42.485 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-05-16T13:54:42.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:42.486 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-05-16T13:54:42.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:42.552 DEBUG:teuthology.orchestra.run.smithi118:> stat --file-system '--printf=%T 2023-05-16T13:54:42.553 DEBUG:teuthology.orchestra.run.smithi118:> ' -- /home/ubuntu/cephtest/mnt.1 2023-05-16T13:54:42.561 INFO:teuthology.orchestra.run.smithi118.stdout:fuseblk 2023-05-16T13:54:42.561 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-05-16T13:54:42.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:42.562 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-05-16T13:54:42.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:42.622 DEBUG:teuthology.orchestra.run.smithi118:> stat --file-system '--printf=%T 2023-05-16T13:54:42.623 DEBUG:teuthology.orchestra.run.smithi118:> ' -- /home/ubuntu/cephtest/mnt.3 2023-05-16T13:54:42.671 INFO:teuthology.orchestra.run.smithi118.stdout:fuseblk 2023-05-16T13:54:42.672 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-05-16T13:54:42.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:42.672 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-05-16T13:54:42.730 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-05-16T13:54:42.748 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-16T13:54:42.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:42.892+0000 7f1138ef2640 1 Processor -- start 2023-05-16T13:54:42.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:42.892+0000 7f1138ef2640 1 -- start start 2023-05-16T13:54:42.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:42.896+0000 7f1138ef2640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1134145860 0x7f113415cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:42.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:42.896+0000 7f1138ef2640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f113415faa0 0x7f113406cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:42.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:42.896+0000 7f1138ef2640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1134145c30 con 0x7f113406d300 2023-05-16T13:54:42.902 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:42.896+0000 7f1138ef2640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f113406d700 con 0x7f113415faa0 2023-05-16T13:54:42.902 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:42.896+0000 7f1138ef2640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1134160060 con 0x7f1134145860 2023-05-16T13:54:42.902 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:42.896+0000 7f1132d9d640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f113406d300 0x7f11340703b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:41206/0 (socket says 172.21.15.39:41206) 2023-05-16T13:54:42.902 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:42.896+0000 7f112bfff640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f113415faa0 0x7f113406cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:42.902 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:42.896+0000 7f1132d9d640 1 -- 172.21.15.39:0/3983823914 learned_addr learned my addr 172.21.15.39:0/3983823914 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:42.903 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:42.896+0000 7f113259c640 1 --2- 172.21.15.39:0/3983823914 >> v2:172.21.15.118:3300/0 conn(0x7f1134145860 0x7f113415cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:42.903 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:42.896+0000 7f1131d9b640 1 -- 172.21.15.39:0/3983823914 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1493042233 0 0) 0x7f1134145c30 con 0x7f113406d300 2023-05-16T13:54:42.903 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:42.896+0000 7f112bfff640 1 -- 172.21.15.39:0/3983823914 >> v2:172.21.15.118:3300/0 conn(0x7f1134145860 msgr2=0x7f113415cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:42.903 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:42.896+0000 7f112bfff640 1 --2- 172.21.15.39:0/3983823914 >> v2:172.21.15.118:3300/0 conn(0x7f1134145860 0x7f113415cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:42.903 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:42.896+0000 7f112bfff640 1 -- 172.21.15.39:0/3983823914 >> v1:172.21.15.39:6789/0 conn(0x7f113406d300 legacy=0x7f11340703b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:42.904 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:42.896+0000 7f112bfff640 1 -- 172.21.15.39:0/3983823914 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1134160340 con 0x7f113415faa0 2023-05-16T13:54:42.904 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:42.900+0000 7f112bfff640 1 --2- 172.21.15.39:0/3983823914 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f113415faa0 0x7f113406cdc0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1134071950 tx=0x7f111c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1acd9708f3b7a0bf server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:42.905 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:42.900+0000 7f1131d9b640 1 -- 172.21.15.39:0/3983823914 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f111c0ab660 con 0x7f113415faa0 2023-05-16T13:54:42.906 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:42.900+0000 7f1131d9b640 1 -- 172.21.15.39:0/3983823914 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f111c0ab7c0 con 0x7f113415faa0 2023-05-16T13:54:42.906 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:42.900+0000 7f1131d9b640 1 -- 172.21.15.39:0/3983823914 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f111c0abb50 con 0x7f113415faa0 2023-05-16T13:54:42.906 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:42.900+0000 7f1138ef2640 1 -- 172.21.15.39:0/3983823914 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f113415faa0 msgr2=0x7f113406cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:42.906 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:42.900+0000 7f1138ef2640 1 --2- 172.21.15.39:0/3983823914 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f113415faa0 0x7f113406cdc0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1134071950 tx=0x7f111c01c460 comp rx=0 tx=0).stop 2023-05-16T13:54:42.907 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:42.900+0000 7f1138ef2640 1 -- 172.21.15.39:0/3983823914 shutdown_connections 2023-05-16T13:54:42.907 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:42.900+0000 7f1138ef2640 1 --2- 172.21.15.39:0/3983823914 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f113415faa0 0x7f113406cdc0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:42.907 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:42.900+0000 7f1138ef2640 1 --2- 172.21.15.39:0/3983823914 >> v2:172.21.15.118:3300/0 conn(0x7f1134145860 0x7f113415cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:42.907 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:42.900+0000 7f1138ef2640 1 -- 172.21.15.39:0/3983823914 >> 172.21.15.39:0/3983823914 conn(0x7f11340cb6d0 msgr2=0x7f11340cbad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:42.907 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:42.900+0000 7f1138ef2640 1 -- 172.21.15.39:0/3983823914 shutdown_connections 2023-05-16T13:54:42.908 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:42.900+0000 7f1138ef2640 1 -- 172.21.15.39:0/3983823914 wait complete. 2023-05-16T13:54:42.908 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:42.900+0000 7f1138ef2640 1 Processor -- start 2023-05-16T13:54:42.908 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:42.900+0000 7f1138ef2640 1 -- start start 2023-05-16T13:54:42.909 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:42.904+0000 7f1138ef2640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f113406d300 0x7f113413c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:42.909 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:42.904+0000 7f1138ef2640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1134145860 0x7f1134143e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:42.909 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:42.904+0000 7f1138ef2640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f113415faa0 0x7f11340c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:42.909 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:42.904+0000 7f1138ef2640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1134158100 con 0x7f1134145860 2023-05-16T13:54:42.909 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:42.904+0000 7f1138ef2640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1134144350 con 0x7f113415faa0 2023-05-16T13:54:42.909 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:42.904+0000 7f1138ef2640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1134140410 con 0x7f113406d300 2023-05-16T13:54:42.910 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:42.904+0000 7f112bfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1134145860 0x7f1134143e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:42.911 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:42.904+0000 7f112bfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1134145860 0x7f1134143e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34858/0 (socket says 172.21.15.39:34858) 2023-05-16T13:54:42.911 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:42.904+0000 7f112bfff640 1 -- 172.21.15.39:0/131867877 learned_addr learned my addr 172.21.15.39:0/131867877 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:42.911 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:42.904+0000 7f113259c640 1 --2- 172.21.15.39:0/131867877 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f113406d300 0x7f113413c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:42.911 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:42.904+0000 7f1132d9d640 1 --2- 172.21.15.39:0/131867877 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f113415faa0 0x7f11340c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:42.911 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:42.904+0000 7f112bfff640 1 -- 172.21.15.39:0/131867877 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f113406d300 msgr2=0x7f113413c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:42.911 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:42.904+0000 7f112bfff640 1 --2- 172.21.15.39:0/131867877 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f113406d300 0x7f113413c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:42.912 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:42.904+0000 7f112bfff640 1 -- 172.21.15.39:0/131867877 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f113415faa0 msgr2=0x7f11340c93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:42.912 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:42.904+0000 7f112bfff640 1 --2- 172.21.15.39:0/131867877 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f113415faa0 0x7f11340c93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:42.912 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:42.904+0000 7f112bfff640 1 -- 172.21.15.39:0/131867877 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f111c009420 con 0x7f1134145860 2023-05-16T13:54:42.912 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:42.904+0000 7f112bfff640 1 --2- 172.21.15.39:0/131867877 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1134145860 0x7f1134143e10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f111c019070 tx=0x7f111c01aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:42.912 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:42.904+0000 7f112affd640 1 -- 172.21.15.39:0/131867877 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f111c0b5810 con 0x7f1134145860 2023-05-16T13:54:42.912 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:42.904+0000 7f112affd640 1 -- 172.21.15.39:0/131867877 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f111c0b5990 con 0x7f1134145860 2023-05-16T13:54:42.912 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:42.904+0000 7f1138ef2640 1 -- 172.21.15.39:0/131867877 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1134168e40 con 0x7f1134145860 2023-05-16T13:54:42.913 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:42.904+0000 7f112affd640 1 -- 172.21.15.39:0/131867877 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f111c0b5d40 con 0x7f1134145860 2023-05-16T13:54:42.913 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:42.904+0000 7f1138ef2640 1 -- 172.21.15.39:0/131867877 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1134069a50 con 0x7f1134145860 2023-05-16T13:54:42.914 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:42.904+0000 7f1138ef2640 1 -- 172.21.15.39:0/131867877 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1134168fd0 con 0x7f1134145860 2023-05-16T13:54:42.914 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:42.904+0000 7f112affd640 1 -- 172.21.15.39:0/131867877 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f111c0a9070 con 0x7f1134145860 2023-05-16T13:54:42.914 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:42.908+0000 7f112affd640 1 --2- 172.21.15.39:0/131867877 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f1114066280 0x7f1114068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:42.914 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:42.908+0000 7f112affd640 1 -- 172.21.15.39:0/131867877 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f111c11e330 con 0x7f1134145860 2023-05-16T13:54:42.914 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:42.908+0000 7f113259c640 1 --2- 172.21.15.39:0/131867877 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f1114066280 0x7f1114068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:42.914 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:42.908+0000 7f113259c640 1 --2- 172.21.15.39:0/131867877 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f1114066280 0x7f1114068730 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1134142e10 tx=0x7f1124008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:42.916 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:42.912+0000 7f112affd640 1 -- 172.21.15.39:0/131867877 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f111c0eb8e0 con 0x7f1134145860 2023-05-16T13:54:43.073 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.068+0000 7f1138ef2640 1 -- 172.21.15.39:0/131867877 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1134073c90 con 0x7f1134145860 2023-05-16T13:54:43.074 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.068+0000 7f112affd640 1 -- 172.21.15.39:0/131867877 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18279 (secure 0 0 0) 0x7f111c0ab620 con 0x7f1134145860 2023-05-16T13:54:43.074 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:54:43.074 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":24,"fsid":"9c1e210b-c515-4ea4-a065-397956895c68","created":"2023-05-16T13:53:48.955290+0000","modified":"2023-05-16T13:54:16.194544+0000","last_up_change":"2023-05-16T13:54:01.722051+0000","last_in_change":"2023-05-16T13:53:52.331336+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-16T13:54:00.885009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-16T13:54:08.327895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-16T13:54:12.864823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-16T13:54:14.180225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4ce0f0ba-c4bf-4405-8c95-d2e9a62878ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6809","nonce":3462013698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6811","nonce":3462013698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6815","nonce":3462013698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6813","nonce":3462013698}]},"public_addr":"172.21.15.39:6809/3462013698","cluster_addr":"172.21.15.39:6811/3462013698","heartbeat_back_addr":"172.21.15.39:6815/3462013698","heartbeat_front_addr":"172.21.15.39:6813/3462013698","state":["exists","up"]},{"osd":1,"uuid":"53fdc1ac-2473-472d-af32-2760fdf6e476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6801","nonce":2829970892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6803","nonce":2829970892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6807","nonce":2829970892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6805","nonce":2829970892}]},"public_addr":"172.21.15.39:6801/2829970892","cluster_addr":"172.21.15.39:6803/2829970892","heartbeat_back_addr":"172.21.15.39:6807/2829970892","heartbeat_front_addr":"172.21.15.39:6805/2829970892","state":["exists","up"]},{"osd":2,"uuid":"0b92d770-7030-42fa-a19f-4f7f1ac113c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6817","nonce":3888067413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6819","nonce":3888067413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6823","nonce":3888067413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6821","nonce":3888067413}]},"public_addr":"172.21.15.39:6817/3888067413","cluster_addr":"172.21.15.39:6819/3888067413","heartbeat_back_addr":"172.21.15.39:6823/3888067413","heartbeat_front_addr":"172.21.15.39:6821/3888067413","state":["exists","up"]},{"osd":3,"uuid":"000d9506-cbb2-4017-b875-deca579860ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6825","nonce":405003958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6827","nonce":405003958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6831","nonce":405003958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6829","nonce":405003958}]},"public_addr":"172.21.15.39:6825/405003958","cluster_addr":"172.21.15.39:6827/405003958","heartbeat_back_addr":"172.21.15.39:6831/405003958","heartbeat_front_addr":"172.21.15.39:6829/405003958","state":["exists","up"]},{"osd":4,"uuid":"70f0dacb-e960-40c5-bf6a-183e52bbe2ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6801","nonce":3895278838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6805","nonce":3895278838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6813","nonce":3895278838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6809","nonce":3895278838}]},"public_addr":"172.21.15.118:6801/3895278838","cluster_addr":"172.21.15.118:6805/3895278838","heartbeat_back_addr":"172.21.15.118:6813/3895278838","heartbeat_front_addr":"172.21.15.118:6809/3895278838","state":["exists","up"]},{"osd":5,"uuid":"756feb54-c3ae-4a2a-8f74-85c291ba707c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6804","nonce":3513592808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6808","nonce":3513592808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6815","nonce":3513592808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6812","nonce":3513592808}]},"public_addr":"172.21.15.118:6804/3513592808","cluster_addr":"172.21.15.118:6808/3513592808","heartbeat_back_addr":"172.21.15.118:6815/3513592808","heartbeat_front_addr":"172.21.15.118:6812/3513592808","state":["exists","up"]},{"osd":6,"uuid":"c4a982c1-f497-4b0f-8a23-c77372e4621e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6824","nonce":1863656053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6827","nonce":1863656053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6831","nonce":1863656053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6829","nonce":1863656053}]},"public_addr":"172.21.15.118:6824/1863656053","cluster_addr":"172.21.15.118:6827/1863656053","heartbeat_back_addr":"172.21.15.118:6831/1863656053","heartbeat_front_addr":"172.21.15.118:6829/1863656053","state":["exists","up"]},{"osd":7,"uuid":"6f2888aa-a7ac-4e26-9159-e31817934f44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6817","nonce":3636642904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6819","nonce":3636642904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6825","nonce":3636642904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6821","nonce":3636642904}]},"public_addr":"172.21.15.118:6817/3636642904","cluster_addr":"172.21.15.118:6819/3636642904","heartbeat_back_addr":"172.21.15.118:6825/3636642904","heartbeat_front_addr":"172.21.15.118:6821/3636642904","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.717636+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.724036+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.739144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:58.079275+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:58.073921+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.930466+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.987813+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.941098+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-16T13:54:43.076 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.068+0000 7f1138ef2640 1 -- 172.21.15.39:0/131867877 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f1114066280 msgr2=0x7f1114068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:43.076 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.068+0000 7f1138ef2640 1 --2- 172.21.15.39:0/131867877 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f1114066280 0x7f1114068730 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1134142e10 tx=0x7f1124008040 comp rx=0 tx=0).stop 2023-05-16T13:54:43.076 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.068+0000 7f1138ef2640 1 -- 172.21.15.39:0/131867877 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1134145860 msgr2=0x7f1134143e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:43.077 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.068+0000 7f1138ef2640 1 --2- 172.21.15.39:0/131867877 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1134145860 0x7f1134143e10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f111c019070 tx=0x7f111c01aca0 comp rx=0 tx=0).stop 2023-05-16T13:54:43.077 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.068+0000 7f1138ef2640 1 -- 172.21.15.39:0/131867877 shutdown_connections 2023-05-16T13:54:43.077 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.068+0000 7f1138ef2640 1 --2- 172.21.15.39:0/131867877 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f113415faa0 0x7f11340c93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:43.077 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.068+0000 7f1138ef2640 1 --2- 172.21.15.39:0/131867877 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1134145860 0x7f1134143e10 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:43.077 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.068+0000 7f1138ef2640 1 --2- 172.21.15.39:0/131867877 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f1114066280 0x7f1114068730 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:43.077 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.068+0000 7f1138ef2640 1 --2- 172.21.15.39:0/131867877 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f113406d300 0x7f113413c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:43.077 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.068+0000 7f1138ef2640 1 -- 172.21.15.39:0/131867877 >> 172.21.15.39:0/131867877 conn(0x7f11340cb6d0 msgr2=0x7f11340c81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:43.078 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.072+0000 7f1138ef2640 1 -- 172.21.15.39:0/131867877 shutdown_connections 2023-05-16T13:54:43.078 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.072+0000 7f1138ef2640 1 -- 172.21.15.39:0/131867877 wait complete. 2023-05-16T13:54:43.095 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-16T13:54:00.885009+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-16T13:54:08.327895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-16T13:54:12.864823+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-16T13:54:14.180225+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-16T13:54:43.096 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-16T13:54:43.236 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.232+0000 7fd76d5cb640 1 Processor -- start 2023-05-16T13:54:43.237 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.232+0000 7fd76d5cb640 1 -- start start 2023-05-16T13:54:43.238 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.232+0000 7fd76d5cb640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd7680ceb50 0x7fd7680cddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:43.238 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.232+0000 7fd76d5cb640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd768158dc0 con 0x7fd7680cd930 2023-05-16T13:54:43.238 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.232+0000 7fd76d5cb640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7681590a0 con 0x7fd7680c92e0 2023-05-16T13:54:43.238 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.232+0000 7fd76d5cb640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd768159380 con 0x7fd7680ceb50 2023-05-16T13:54:43.238 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.232+0000 7fd75ffff640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fd7680cd930 0x7fd7680ce440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:41216/0 (socket says 172.21.15.39:41216) 2023-05-16T13:54:43.238 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.232+0000 7fd75ffff640 1 -- 172.21.15.39:0/3416683573 learned_addr learned my addr 172.21.15.39:0/3416683573 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:43.239 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.232+0000 7fd7677fe640 1 --2- 172.21.15.39:0/3416683573 >> v2:172.21.15.118:3300/0 conn(0x7fd7680ceb50 0x7fd7680cddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:43.239 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.232+0000 7fd7667fc640 1 -- 172.21.15.39:0/3416683573 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1925811277 0 0) 0x7fd768158dc0 con 0x7fd7680cd930 2023-05-16T13:54:43.239 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.232+0000 7fd7667fc640 1 -- 172.21.15.39:0/3416683573 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd754003530 con 0x7fd7680cd930 2023-05-16T13:54:43.240 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.232+0000 7fd7667fc640 1 -- 172.21.15.39:0/3416683573 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 918515251 0 0) 0x7fd7681590a0 con 0x7fd7680c92e0 2023-05-16T13:54:43.240 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.232+0000 7fd7667fc640 1 -- 172.21.15.39:0/3416683573 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd768158dc0 con 0x7fd7680c92e0 2023-05-16T13:54:43.240 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.232+0000 7fd7677fe640 1 -- 172.21.15.39:0/3416683573 >> v1:172.21.15.118:6789/0 conn(0x7fd7680c92e0 legacy=0x7fd7680cacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:43.240 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.232+0000 7fd7677fe640 1 -- 172.21.15.39:0/3416683573 >> v1:172.21.15.39:6789/0 conn(0x7fd7680cd930 legacy=0x7fd7680ce440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:43.240 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.232+0000 7fd7667fc640 1 -- 172.21.15.39:0/3416683573 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3167466792 0 0) 0x7fd754003530 con 0x7fd7680cd930 2023-05-16T13:54:43.240 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.232+0000 7fd7677fe640 1 -- 172.21.15.39:0/3416683573 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd768159660 con 0x7fd7680ceb50 2023-05-16T13:54:43.241 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.236+0000 7fd7677fe640 1 --2- 172.21.15.39:0/3416683573 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7680ceb50 0x7fd7680cddb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd760009d90 tx=0x7fd76001c7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=267d1545220b1fb9 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:43.242 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.236+0000 7fd7667fc640 1 -- 172.21.15.39:0/3416683573 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd750001680 con 0x7fd7680ceb50 2023-05-16T13:54:43.242 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.236+0000 7fd7667fc640 1 -- 172.21.15.39:0/3416683573 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7680c98c0 con 0x7fd7680ceb50 2023-05-16T13:54:43.242 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.236+0000 7fd7667fc640 1 -- 172.21.15.39:0/3416683573 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7600a5750 con 0x7fd7680ceb50 2023-05-16T13:54:43.243 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.236+0000 7fd76d5cb640 1 -- 172.21.15.39:0/3416683573 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7680ceb50 msgr2=0x7fd7680cddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:43.243 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.236+0000 7fd76d5cb640 1 --2- 172.21.15.39:0/3416683573 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7680ceb50 0x7fd7680cddb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd760009d90 tx=0x7fd76001c7e0 comp rx=0 tx=0).stop 2023-05-16T13:54:43.243 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.236+0000 7fd76d5cb640 1 -- 172.21.15.39:0/3416683573 shutdown_connections 2023-05-16T13:54:43.243 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.236+0000 7fd76d5cb640 1 --2- 172.21.15.39:0/3416683573 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7680ceb50 0x7fd7680cddb0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:43.243 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.236+0000 7fd76d5cb640 1 -- 172.21.15.39:0/3416683573 >> 172.21.15.39:0/3416683573 conn(0x7fd768069a50 msgr2=0x7fd768069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:43.244 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.236+0000 7fd76d5cb640 1 -- 172.21.15.39:0/3416683573 shutdown_connections 2023-05-16T13:54:43.244 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.236+0000 7fd76d5cb640 1 -- 172.21.15.39:0/3416683573 wait complete. 2023-05-16T13:54:43.244 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.240+0000 7fd76d5cb640 1 Processor -- start 2023-05-16T13:54:43.244 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.240+0000 7fd76d5cb640 1 -- start start 2023-05-16T13:54:43.245 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.240+0000 7fd76d5cb640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7680c92e0 0x7fd76815c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:43.245 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.240+0000 7fd76d5cb640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7680cd930 0x7fd7681512c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:43.246 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.240+0000 7fd76d5cb640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd7680ceb50 0x7fd768151800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:43.246 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.240+0000 7fd76d5cb640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd768156e20 con 0x7fd7680c92e0 2023-05-16T13:54:43.246 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.240+0000 7fd76d5cb640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7681564f0 con 0x7fd7680cd930 2023-05-16T13:54:43.246 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.240+0000 7fd76d5cb640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7681567d0 con 0x7fd7680ceb50 2023-05-16T13:54:43.246 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.240+0000 7fd766ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7680c92e0 0x7fd76815c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:43.246 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.240+0000 7fd766ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7680c92e0 0x7fd76815c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34872/0 (socket says 172.21.15.39:34872) 2023-05-16T13:54:43.246 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.240+0000 7fd766ffd640 1 -- 172.21.15.39:0/2807278771 learned_addr learned my addr 172.21.15.39:0/2807278771 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:43.247 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.240+0000 7fd7677fe640 1 --2- 172.21.15.39:0/2807278771 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd7680ceb50 0x7fd768151800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:43.248 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.240+0000 7fd75ffff640 1 --2- 172.21.15.39:0/2807278771 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7680cd930 0x7fd7681512c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:43.248 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.240+0000 7fd766ffd640 1 -- 172.21.15.39:0/2807278771 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd7680ceb50 msgr2=0x7fd768151800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:43.248 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.240+0000 7fd766ffd640 1 --2- 172.21.15.39:0/2807278771 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd7680ceb50 0x7fd768151800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:43.248 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.240+0000 7fd766ffd640 1 -- 172.21.15.39:0/2807278771 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7680cd930 msgr2=0x7fd7681512c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:43.248 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.240+0000 7fd766ffd640 1 --2- 172.21.15.39:0/2807278771 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7680cd930 0x7fd7681512c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:43.248 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.240+0000 7fd766ffd640 1 -- 172.21.15.39:0/2807278771 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd760009a70 con 0x7fd7680c92e0 2023-05-16T13:54:43.249 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.240+0000 7fd75ffff640 1 --2- 172.21.15.39:0/2807278771 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7680cd930 0x7fd7681512c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-16T13:54:43.249 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.240+0000 7fd766ffd640 1 --2- 172.21.15.39:0/2807278771 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7680c92e0 0x7fd76815c240 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd75800c430 tx=0x7fd75800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:43.249 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.240+0000 7fd75f7fe640 1 -- 172.21.15.39:0/2807278771 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7580052d0 con 0x7fd7680c92e0 2023-05-16T13:54:43.249 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.240+0000 7fd75f7fe640 1 -- 172.21.15.39:0/2807278771 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd758005450 con 0x7fd7680c92e0 2023-05-16T13:54:43.249 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.240+0000 7fd75f7fe640 1 -- 172.21.15.39:0/2807278771 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd758003840 con 0x7fd7680c92e0 2023-05-16T13:54:43.249 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.240+0000 7fd76d5cb640 1 -- 172.21.15.39:0/2807278771 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7680cd2c0 con 0x7fd7680c92e0 2023-05-16T13:54:43.249 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.240+0000 7fd76d5cb640 1 -- 172.21.15.39:0/2807278771 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7680cd130 con 0x7fd7680c92e0 2023-05-16T13:54:43.249 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.240+0000 7fd76d5cb640 1 -- 172.21.15.39:0/2807278771 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7680cd450 con 0x7fd7680c92e0 2023-05-16T13:54:43.250 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.244+0000 7fd75f7fe640 1 -- 172.21.15.39:0/2807278771 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd7580039a0 con 0x7fd7680c92e0 2023-05-16T13:54:43.250 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.244+0000 7fd75f7fe640 1 --2- 172.21.15.39:0/2807278771 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd748066280 0x7fd748068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:43.250 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.244+0000 7fd75f7fe640 1 -- 172.21.15.39:0/2807278771 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd7580833b0 con 0x7fd7680c92e0 2023-05-16T13:54:43.251 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.244+0000 7fd75ffff640 1 --2- 172.21.15.39:0/2807278771 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd748066280 0x7fd748068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:43.251 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.244+0000 7fd75ffff640 1 --2- 172.21.15.39:0/2807278771 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd748066280 0x7fd748068730 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd7500011f0 tx=0x7fd750009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:43.253 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.248+0000 7fd75f7fe640 1 -- 172.21.15.39:0/2807278771 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fd758050790 con 0x7fd7680c92e0 2023-05-16T13:54:43.406 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.400+0000 7fd76d5cb640 1 -- 172.21.15.39:0/2807278771 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd768073c90 con 0x7fd7680c92e0 2023-05-16T13:54:43.406 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.400+0000 7fd75f7fe640 1 -- 172.21.15.39:0/2807278771 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd758053db0 con 0x7fd7680c92e0 2023-05-16T13:54:43.407 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2023-05-16T13:54:43.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.400+0000 7fd76d5cb640 1 -- 172.21.15.39:0/2807278771 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd748066280 msgr2=0x7fd748068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:43.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.400+0000 7fd76d5cb640 1 --2- 172.21.15.39:0/2807278771 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd748066280 0x7fd748068730 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd7500011f0 tx=0x7fd750009040 comp rx=0 tx=0).stop 2023-05-16T13:54:43.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.400+0000 7fd76d5cb640 1 -- 172.21.15.39:0/2807278771 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7680c92e0 msgr2=0x7fd76815c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:43.409 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.400+0000 7fd76d5cb640 1 --2- 172.21.15.39:0/2807278771 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7680c92e0 0x7fd76815c240 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd75800c430 tx=0x7fd75800c8f0 comp rx=0 tx=0).stop 2023-05-16T13:54:43.409 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.404+0000 7fd76d5cb640 1 -- 172.21.15.39:0/2807278771 shutdown_connections 2023-05-16T13:54:43.409 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.404+0000 7fd76d5cb640 1 --2- 172.21.15.39:0/2807278771 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd748066280 0x7fd748068730 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:43.409 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.404+0000 7fd76d5cb640 1 --2- 172.21.15.39:0/2807278771 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd7680ceb50 0x7fd768151800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:43.409 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.404+0000 7fd76d5cb640 1 --2- 172.21.15.39:0/2807278771 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7680cd930 0x7fd7681512c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:43.409 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.404+0000 7fd76d5cb640 1 --2- 172.21.15.39:0/2807278771 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7680c92e0 0x7fd76815c240 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:43.409 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.404+0000 7fd76d5cb640 1 -- 172.21.15.39:0/2807278771 >> 172.21.15.39:0/2807278771 conn(0x7fd768069a50 msgr2=0x7fd76806fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:43.410 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.404+0000 7fd76d5cb640 1 -- 172.21.15.39:0/2807278771 shutdown_connections 2023-05-16T13:54:43.410 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.404+0000 7fd76d5cb640 1 -- 172.21.15.39:0/2807278771 wait complete. 2023-05-16T13:54:43.427 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-16T13:54:43.567 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.560+0000 7f9050074640 1 Processor -- start 2023-05-16T13:54:43.567 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.560+0000 7f9050074640 1 -- start start 2023-05-16T13:54:43.568 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.564+0000 7f9050074640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f90480cb0f0 0x7f9048160430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:43.568 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.564+0000 7f9050074640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9048160970 0x7f90480718a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:43.568 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.564+0000 7f9050074640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90480cee40 con 0x7f9048071de0 2023-05-16T13:54:43.569 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.564+0000 7f9050074640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90480cd490 con 0x7f90480cb0f0 2023-05-16T13:54:43.569 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.564+0000 7f9050074640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90480cf120 con 0x7f9048160970 2023-05-16T13:54:43.569 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.564+0000 7f904de10640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f90480cb0f0 0x7f9048160430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:43.570 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.564+0000 7f904e611640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f9048071de0 0x7f9048069a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:41220/0 (socket says 172.21.15.39:41220) 2023-05-16T13:54:43.570 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.564+0000 7f904e611640 1 -- 172.21.15.39:0/1421365592 learned_addr learned my addr 172.21.15.39:0/1421365592 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:43.570 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.564+0000 7f904d60f640 1 --2- 172.21.15.39:0/1421365592 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9048160970 0x7f90480718a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:43.570 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.564+0000 7f904de10640 1 -- 172.21.15.39:0/1421365592 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9048160970 msgr2=0x7f90480718a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:43.570 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.564+0000 7f904de10640 1 --2- 172.21.15.39:0/1421365592 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9048160970 0x7f90480718a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:43.570 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.564+0000 7f904de10640 1 -- 172.21.15.39:0/1421365592 >> v1:172.21.15.39:6789/0 conn(0x7f9048071de0 legacy=0x7f9048069a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:43.570 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.564+0000 7f904de10640 1 -- 172.21.15.39:0/1421365592 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90480cf400 con 0x7f90480cb0f0 2023-05-16T13:54:43.571 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.564+0000 7f904ce0e640 1 -- 172.21.15.39:0/1421365592 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3170535178 0 0) 0x7f90480cee40 con 0x7f9048071de0 2023-05-16T13:54:43.571 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.564+0000 7f904d60f640 1 --2- 172.21.15.39:0/1421365592 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9048160970 0x7f90480718a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:54:43.572 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.564+0000 7f904de10640 1 --2- 172.21.15.39:0/1421365592 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f90480cb0f0 0x7f9048160430 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f90440097c0 tx=0x7f904401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78f40dc0d997811a server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:43.572 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.564+0000 7f904ce0e640 1 -- 172.21.15.39:0/1421365592 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90440ab680 con 0x7f90480cb0f0 2023-05-16T13:54:43.572 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.564+0000 7f904ce0e640 1 -- 172.21.15.39:0/1421365592 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90440ab7e0 con 0x7f90480cb0f0 2023-05-16T13:54:43.572 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.564+0000 7f904ce0e640 1 -- 172.21.15.39:0/1421365592 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90440abb70 con 0x7f90480cb0f0 2023-05-16T13:54:43.573 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.568+0000 7f9050074640 1 -- 172.21.15.39:0/1421365592 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f90480cb0f0 msgr2=0x7f9048160430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:43.573 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.568+0000 7f9050074640 1 --2- 172.21.15.39:0/1421365592 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f90480cb0f0 0x7f9048160430 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f90440097c0 tx=0x7f904401c480 comp rx=0 tx=0).stop 2023-05-16T13:54:43.573 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.568+0000 7f9050074640 1 -- 172.21.15.39:0/1421365592 shutdown_connections 2023-05-16T13:54:43.574 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.568+0000 7f9050074640 1 --2- 172.21.15.39:0/1421365592 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9048160970 0x7f90480718a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:43.574 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.568+0000 7f9050074640 1 --2- 172.21.15.39:0/1421365592 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f90480cb0f0 0x7f9048160430 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:43.574 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.568+0000 7f9050074640 1 -- 172.21.15.39:0/1421365592 >> 172.21.15.39:0/1421365592 conn(0x7f904806ce40 msgr2=0x7f904806d240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:43.574 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.568+0000 7f9050074640 1 -- 172.21.15.39:0/1421365592 shutdown_connections 2023-05-16T13:54:43.574 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.568+0000 7f9050074640 1 -- 172.21.15.39:0/1421365592 wait complete. 2023-05-16T13:54:43.575 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.568+0000 7f9050074640 1 Processor -- start 2023-05-16T13:54:43.575 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.568+0000 7f9050074640 1 -- start start 2023-05-16T13:54:43.576 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.568+0000 7f9050074640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9048071de0 0x7f9048148a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:43.576 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.568+0000 7f9050074640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f90480cb0f0 0x7f90480c7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:43.577 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.568+0000 7f9050074640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9048160970 0x7f90480c87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:43.577 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.568+0000 7f9050074640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90480c56a0 con 0x7f9048071de0 2023-05-16T13:54:43.577 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.568+0000 7f9050074640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9048148f40 con 0x7f9048160970 2023-05-16T13:54:43.577 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.568+0000 7f9050074640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90480c4a20 con 0x7f90480cb0f0 2023-05-16T13:54:43.577 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.568+0000 7f904de10640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9048071de0 0x7f9048148a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:43.578 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.568+0000 7f904de10640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9048071de0 0x7f9048148a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34888/0 (socket says 172.21.15.39:34888) 2023-05-16T13:54:43.578 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.568+0000 7f904de10640 1 -- 172.21.15.39:0/1741703499 learned_addr learned my addr 172.21.15.39:0/1741703499 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:43.578 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.568+0000 7f904d60f640 1 --2- 172.21.15.39:0/1741703499 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f90480cb0f0 0x7f90480c7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:43.578 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.568+0000 7f904e611640 1 --2- 172.21.15.39:0/1741703499 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9048160970 0x7f90480c87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:43.578 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.568+0000 7f904de10640 1 -- 172.21.15.39:0/1741703499 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f90480cb0f0 msgr2=0x7f90480c7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:43.578 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.568+0000 7f904de10640 1 --2- 172.21.15.39:0/1741703499 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f90480cb0f0 0x7f90480c7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:43.578 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.568+0000 7f904de10640 1 -- 172.21.15.39:0/1741703499 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9048160970 msgr2=0x7f90480c87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:43.579 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.568+0000 7f904de10640 1 --2- 172.21.15.39:0/1741703499 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9048160970 0x7f90480c87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:43.579 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.568+0000 7f904de10640 1 -- 172.21.15.39:0/1741703499 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9044009420 con 0x7f9048071de0 2023-05-16T13:54:43.579 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.568+0000 7f904e611640 1 --2- 172.21.15.39:0/1741703499 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9048160970 0x7f90480c87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:54:43.579 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.572+0000 7f904de10640 1 --2- 172.21.15.39:0/1741703499 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9048071de0 0x7f9048148a00 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f90440ad040 tx=0x7f904401acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:43.580 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.572+0000 7f903e7fc640 1 -- 172.21.15.39:0/1741703499 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90440b5810 con 0x7f9048071de0 2023-05-16T13:54:43.580 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.572+0000 7f903e7fc640 1 -- 172.21.15.39:0/1741703499 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90440b59b0 con 0x7f9048071de0 2023-05-16T13:54:43.581 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.572+0000 7f903e7fc640 1 -- 172.21.15.39:0/1741703499 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90440b5d60 con 0x7f9048071de0 2023-05-16T13:54:43.581 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.572+0000 7f9050074640 1 -- 172.21.15.39:0/1741703499 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90480ceaa0 con 0x7f9048071de0 2023-05-16T13:54:43.581 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.572+0000 7f9050074640 1 -- 172.21.15.39:0/1741703499 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90480cb4c0 con 0x7f9048071de0 2023-05-16T13:54:43.581 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.572+0000 7f9050074640 1 -- 172.21.15.39:0/1741703499 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90480cc670 con 0x7f9048071de0 2023-05-16T13:54:43.581 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.572+0000 7f903e7fc640 1 -- 172.21.15.39:0/1741703499 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f90440b4390 con 0x7f9048071de0 2023-05-16T13:54:43.581 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.572+0000 7f903e7fc640 1 --2- 172.21.15.39:0/1741703499 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f902c066280 0x7f902c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:43.582 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.572+0000 7f903e7fc640 1 -- 172.21.15.39:0/1741703499 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f904411e910 con 0x7f9048071de0 2023-05-16T13:54:43.582 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.572+0000 7f904d60f640 1 --2- 172.21.15.39:0/1741703499 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f902c066280 0x7f902c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:43.582 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.576+0000 7f904d60f640 1 --2- 172.21.15.39:0/1741703499 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f902c066280 0x7f902c068730 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f904815efb0 tx=0x7f9038008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:43.583 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.576+0000 7f903e7fc640 1 -- 172.21.15.39:0/1741703499 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f90440ebd10 con 0x7f9048071de0 2023-05-16T13:54:43.738 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.732+0000 7f9050074640 1 -- 172.21.15.39:0/1741703499 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9048073c90 con 0x7f9048071de0 2023-05-16T13:54:43.739 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.732+0000 7f903e7fc640 1 -- 172.21.15.39:0/1741703499 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f90440ef330 con 0x7f9048071de0 2023-05-16T13:54:43.739 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 8 2023-05-16T13:54:43.740 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.736+0000 7f9050074640 1 -- 172.21.15.39:0/1741703499 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f902c066280 msgr2=0x7f902c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:43.741 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.736+0000 7f9050074640 1 --2- 172.21.15.39:0/1741703499 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f902c066280 0x7f902c068730 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f904815efb0 tx=0x7f9038008040 comp rx=0 tx=0).stop 2023-05-16T13:54:43.741 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.736+0000 7f9050074640 1 -- 172.21.15.39:0/1741703499 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9048071de0 msgr2=0x7f9048148a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:43.741 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.736+0000 7f9050074640 1 --2- 172.21.15.39:0/1741703499 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9048071de0 0x7f9048148a00 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f90440ad040 tx=0x7f904401acc0 comp rx=0 tx=0).stop 2023-05-16T13:54:43.741 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.736+0000 7f9050074640 1 -- 172.21.15.39:0/1741703499 shutdown_connections 2023-05-16T13:54:43.741 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.736+0000 7f9050074640 1 --2- 172.21.15.39:0/1741703499 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f902c066280 0x7f902c068730 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:43.741 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.736+0000 7f9050074640 1 --2- 172.21.15.39:0/1741703499 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f90480cb0f0 0x7f90480c7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:43.741 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.736+0000 7f9050074640 1 --2- 172.21.15.39:0/1741703499 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9048160970 0x7f90480c87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:43.742 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.736+0000 7f9050074640 1 --2- 172.21.15.39:0/1741703499 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9048071de0 0x7f9048148a00 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:43.742 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.736+0000 7f9050074640 1 -- 172.21.15.39:0/1741703499 >> 172.21.15.39:0/1741703499 conn(0x7f904806ce40 msgr2=0x7f90480b45e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:43.742 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.736+0000 7f9050074640 1 -- 172.21.15.39:0/1741703499 shutdown_connections 2023-05-16T13:54:43.742 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.736+0000 7f9050074640 1 -- 172.21.15.39:0/1741703499 wait complete. 2023-05-16T13:54:43.759 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-16T13:54:43.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.892+0000 7f2319191640 1 Processor -- start 2023-05-16T13:54:43.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.892+0000 7f2319191640 1 -- start start 2023-05-16T13:54:43.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.896+0000 7f2319191640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f231406c5a0 0x7f23140d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:43.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.896+0000 7f2319191640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f231415fd60 con 0x7f23140d2c20 2023-05-16T13:54:43.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.896+0000 7f2319191640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f231415cc20 con 0x7f23140d2ff0 2023-05-16T13:54:43.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.896+0000 7f2319191640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f231415cf00 con 0x7f231406c5a0 2023-05-16T13:54:43.902 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.896+0000 7f2318990640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f231406c5a0 0x7f23140d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:43.902 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.896+0000 7f2313fff640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f23140d2c20 0x7f23141601f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:41228/0 (socket says 172.21.15.39:41228) 2023-05-16T13:54:43.902 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.896+0000 7f2313fff640 1 -- 172.21.15.39:0/2813640489 learned_addr learned my addr 172.21.15.39:0/2813640489 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:43.902 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.896+0000 7f2312ffd640 1 -- 172.21.15.39:0/2813640489 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1100341438 0 0) 0x7f231415fd60 con 0x7f23140d2c20 2023-05-16T13:54:43.902 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.896+0000 7f2318990640 1 -- 172.21.15.39:0/2813640489 >> v1:172.21.15.118:6789/0 conn(0x7f23140d2ff0 legacy=0x7f231415c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:43.902 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.896+0000 7f2318990640 1 -- 172.21.15.39:0/2813640489 >> v1:172.21.15.39:6789/0 conn(0x7f23140d2c20 legacy=0x7f23141601f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:43.903 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.896+0000 7f2318990640 1 -- 172.21.15.39:0/2813640489 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f231415f9f0 con 0x7f231406c5a0 2023-05-16T13:54:43.904 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.900+0000 7f2318990640 1 --2- 172.21.15.39:0/2813640489 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f231406c5a0 0x7f23140d02a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f230c009d90 tx=0x7f230c01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cb847d51a08aba server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:43.905 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.900+0000 7f2312ffd640 1 -- 172.21.15.39:0/2813640489 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230c0a8660 con 0x7f231406c5a0 2023-05-16T13:54:43.905 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.900+0000 7f2312ffd640 1 -- 172.21.15.39:0/2813640489 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f230c0a87c0 con 0x7f231406c5a0 2023-05-16T13:54:43.905 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.900+0000 7f2312ffd640 1 -- 172.21.15.39:0/2813640489 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230c0a8b50 con 0x7f231406c5a0 2023-05-16T13:54:43.906 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.900+0000 7f2319191640 1 -- 172.21.15.39:0/2813640489 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f231406c5a0 msgr2=0x7f23140d02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:43.906 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.900+0000 7f2319191640 1 --2- 172.21.15.39:0/2813640489 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f231406c5a0 0x7f23140d02a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f230c009d90 tx=0x7f230c01c950 comp rx=0 tx=0).stop 2023-05-16T13:54:43.906 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.900+0000 7f2319191640 1 -- 172.21.15.39:0/2813640489 shutdown_connections 2023-05-16T13:54:43.906 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.900+0000 7f2319191640 1 --2- 172.21.15.39:0/2813640489 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f231406c5a0 0x7f23140d02a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:43.907 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.900+0000 7f2319191640 1 -- 172.21.15.39:0/2813640489 >> 172.21.15.39:0/2813640489 conn(0x7f2314089fe0 msgr2=0x7f231409ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:43.907 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.900+0000 7f2319191640 1 -- 172.21.15.39:0/2813640489 shutdown_connections 2023-05-16T13:54:43.907 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.900+0000 7f2319191640 1 -- 172.21.15.39:0/2813640489 wait complete. 2023-05-16T13:54:43.907 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.900+0000 7f2319191640 1 Processor -- start 2023-05-16T13:54:43.908 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.900+0000 7f2319191640 1 -- start start 2023-05-16T13:54:43.909 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.900+0000 7f2319191640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f231406c5a0 0x7f23140c8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:43.909 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.900+0000 7f2319191640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f23140d2c20 0x7f2314148820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:43.909 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.900+0000 7f2319191640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f23140d2ff0 0x7f23141526e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:43.909 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.900+0000 7f2319191640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23141539f0 con 0x7f23140d2c20 2023-05-16T13:54:43.909 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.900+0000 7f2319191640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23140c64d0 con 0x7f231406c5a0 2023-05-16T13:54:43.909 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.900+0000 7f2319191640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23141533a0 con 0x7f23140d2ff0 2023-05-16T13:54:43.909 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.904+0000 7f23137fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f23140d2c20 0x7f2314148820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:43.910 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.904+0000 7f23137fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f23140d2c20 0x7f2314148820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34906/0 (socket says 172.21.15.39:34906) 2023-05-16T13:54:43.910 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.904+0000 7f23137fe640 1 -- 172.21.15.39:0/3598715785 learned_addr learned my addr 172.21.15.39:0/3598715785 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:43.910 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.904+0000 7f2318990640 1 --2- 172.21.15.39:0/3598715785 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f23140d2ff0 0x7f23141526e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:43.910 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.904+0000 7f2313fff640 1 --2- 172.21.15.39:0/3598715785 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f231406c5a0 0x7f23140c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:43.910 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.904+0000 7f23137fe640 1 -- 172.21.15.39:0/3598715785 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f23140d2ff0 msgr2=0x7f23141526e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:43.910 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.904+0000 7f23137fe640 1 --2- 172.21.15.39:0/3598715785 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f23140d2ff0 0x7f23141526e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:43.910 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.904+0000 7f23137fe640 1 -- 172.21.15.39:0/3598715785 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f231406c5a0 msgr2=0x7f23140c8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:43.911 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.904+0000 7f23137fe640 1 --2- 172.21.15.39:0/3598715785 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f231406c5a0 0x7f23140c8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:43.911 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.904+0000 7f23137fe640 1 -- 172.21.15.39:0/3598715785 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f230c009a70 con 0x7f23140d2c20 2023-05-16T13:54:43.911 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.904+0000 7f23137fe640 1 --2- 172.21.15.39:0/3598715785 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f23140d2c20 0x7f2314148820 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f230800c3c0 tx=0x7f230800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:43.912 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.904+0000 7f2310ff9640 1 -- 172.21.15.39:0/3598715785 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23080052d0 con 0x7f23140d2c20 2023-05-16T13:54:43.912 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.904+0000 7f2310ff9640 1 -- 172.21.15.39:0/3598715785 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2308005430 con 0x7f23140d2c20 2023-05-16T13:54:43.912 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.904+0000 7f2319191640 1 -- 172.21.15.39:0/3598715785 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f231406b4b0 con 0x7f23140d2c20 2023-05-16T13:54:43.912 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.904+0000 7f2310ff9640 1 -- 172.21.15.39:0/3598715785 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2308003840 con 0x7f23140d2c20 2023-05-16T13:54:43.912 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.904+0000 7f2319191640 1 -- 172.21.15.39:0/3598715785 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f231406b320 con 0x7f23140d2c20 2023-05-16T13:54:43.912 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.904+0000 7f2319191640 1 -- 172.21.15.39:0/3598715785 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23140b12c0 con 0x7f23140d2c20 2023-05-16T13:54:43.912 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.904+0000 7f2310ff9640 1 -- 172.21.15.39:0/3598715785 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f23080039a0 con 0x7f23140d2c20 2023-05-16T13:54:43.913 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.908+0000 7f2310ff9640 1 --2- 172.21.15.39:0/3598715785 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f2300066280 0x7f2300068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:43.913 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.908+0000 7f2310ff9640 1 -- 172.21.15.39:0/3598715785 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f23080831c0 con 0x7f23140d2c20 2023-05-16T13:54:43.913 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.908+0000 7f2313fff640 1 --2- 172.21.15.39:0/3598715785 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f2300066280 0x7f2300068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:43.913 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.908+0000 7f2313fff640 1 --2- 172.21.15.39:0/3598715785 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f2300066280 0x7f2300068730 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2304000f70 tx=0x7f2304007240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:43.916 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:43.912+0000 7f2310ff9640 1 -- 172.21.15.39:0/3598715785 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f23080506f0 con 0x7f23140d2c20 2023-05-16T13:54:44.069 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.064+0000 7f2319191640 1 -- 172.21.15.39:0/3598715785 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f23140cef50 con 0x7f23140d2c20 2023-05-16T13:54:44.070 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.064+0000 7f2310ff9640 1 -- 172.21.15.39:0/3598715785 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2308053d10 con 0x7f23140d2c20 2023-05-16T13:54:44.070 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2023-05-16T13:54:44.071 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.064+0000 7f2319191640 1 -- 172.21.15.39:0/3598715785 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f2300066280 msgr2=0x7f2300068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:44.072 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.064+0000 7f2319191640 1 --2- 172.21.15.39:0/3598715785 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f2300066280 0x7f2300068730 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2304000f70 tx=0x7f2304007240 comp rx=0 tx=0).stop 2023-05-16T13:54:44.072 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.064+0000 7f2319191640 1 -- 172.21.15.39:0/3598715785 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f23140d2c20 msgr2=0x7f2314148820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:44.072 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.064+0000 7f2319191640 1 --2- 172.21.15.39:0/3598715785 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f23140d2c20 0x7f2314148820 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f230800c3c0 tx=0x7f230800c880 comp rx=0 tx=0).stop 2023-05-16T13:54:44.072 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.064+0000 7f2319191640 1 -- 172.21.15.39:0/3598715785 shutdown_connections 2023-05-16T13:54:44.072 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.064+0000 7f2319191640 1 --2- 172.21.15.39:0/3598715785 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f2300066280 0x7f2300068730 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:44.072 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.064+0000 7f2319191640 1 --2- 172.21.15.39:0/3598715785 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f23140d2ff0 0x7f23141526e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:44.072 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.064+0000 7f2319191640 1 --2- 172.21.15.39:0/3598715785 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f23140d2c20 0x7f2314148820 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:44.073 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.064+0000 7f2319191640 1 --2- 172.21.15.39:0/3598715785 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f231406c5a0 0x7f23140c8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:44.073 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.064+0000 7f2319191640 1 -- 172.21.15.39:0/3598715785 >> 172.21.15.39:0/3598715785 conn(0x7f2314089fe0 msgr2=0x7f23140b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:44.073 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.064+0000 7f2319191640 1 -- 172.21.15.39:0/3598715785 shutdown_connections 2023-05-16T13:54:44.073 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.064+0000 7f2319191640 1 -- 172.21.15.39:0/3598715785 wait complete. 2023-05-16T13:54:44.091 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-16T13:54:44.230 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.224+0000 7f300fac3640 1 Processor -- start 2023-05-16T13:54:44.230 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.224+0000 7f300fac3640 1 -- start start 2023-05-16T13:54:44.231 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.224+0000 7f300fac3640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3008158e00 0x7f30080c9530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:44.231 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.224+0000 7f300fac3640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f30080c9a70 0x7f30080aff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:44.231 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.224+0000 7f300fac3640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30080ca030 con 0x7f30080b0490 2023-05-16T13:54:44.231 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.224+0000 7f300fac3640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30080b0910 con 0x7f3008158e00 2023-05-16T13:54:44.231 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.224+0000 7f300fac3640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f300815c890 con 0x7f30080c9a70 2023-05-16T13:54:44.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.224+0000 7f300d05e640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f30080c9a70 0x7f30080aff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:44.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.224+0000 7f300d05e640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f30080c9a70 0x7f30080aff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.39:46504/0 (socket says 172.21.15.39:46504) 2023-05-16T13:54:44.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.224+0000 7f300d05e640 1 -- 172.21.15.39:0/2626774917 learned_addr learned my addr 172.21.15.39:0/2626774917 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:44.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.224+0000 7f300e060640 1 --1- 172.21.15.39:0/2626774917 >> v1:172.21.15.118:6789/0 conn(0x7f30080b0490 0x7f30080caec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.39:38838/0 (socket says 172.21.15.39:38838) 2023-05-16T13:54:44.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.224+0000 7f300d85f640 1 --2- 172.21.15.39:0/2626774917 >> v2:172.21.15.118:3300/0 conn(0x7f3008158e00 0x7f30080c9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:44.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.224+0000 7f300d05e640 1 -- 172.21.15.39:0/2626774917 >> v2:172.21.15.118:3300/0 conn(0x7f3008158e00 msgr2=0x7f30080c9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:44.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.224+0000 7f300d05e640 1 --2- 172.21.15.39:0/2626774917 >> v2:172.21.15.118:3300/0 conn(0x7f3008158e00 0x7f30080c9530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:44.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.224+0000 7f300c85d640 1 -- 172.21.15.39:0/2626774917 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4055769063 0 0) 0x7f30080ca030 con 0x7f30080b0490 2023-05-16T13:54:44.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.224+0000 7f300d05e640 1 -- 172.21.15.39:0/2626774917 >> v1:172.21.15.118:6789/0 conn(0x7f30080b0490 legacy=0x7f30080caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:44.234 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.224+0000 7f300d05e640 1 -- 172.21.15.39:0/2626774917 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f300815cb70 con 0x7f30080c9a70 2023-05-16T13:54:44.234 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.228+0000 7f300d05e640 1 --2- 172.21.15.39:0/2626774917 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f30080c9a70 0x7f30080aff50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2ff8009870 tx=0x7f2ff801ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e136c1421ec1bee server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:44.235 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.228+0000 7f300c85d640 1 -- 172.21.15.39:0/2626774917 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff80a8a30 con 0x7f30080c9a70 2023-05-16T13:54:44.235 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.228+0000 7f300c85d640 1 -- 172.21.15.39:0/2626774917 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ff80a8b90 con 0x7f30080c9a70 2023-05-16T13:54:44.235 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.228+0000 7f300c85d640 1 -- 172.21.15.39:0/2626774917 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff80b0440 con 0x7f30080c9a70 2023-05-16T13:54:44.236 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.228+0000 7f300fac3640 1 -- 172.21.15.39:0/2626774917 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f30080c9a70 msgr2=0x7f30080aff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:44.236 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.228+0000 7f300fac3640 1 --2- 172.21.15.39:0/2626774917 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f30080c9a70 0x7f30080aff50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2ff8009870 tx=0x7f2ff801ed30 comp rx=0 tx=0).stop 2023-05-16T13:54:44.237 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.228+0000 7f300fac3640 1 -- 172.21.15.39:0/2626774917 shutdown_connections 2023-05-16T13:54:44.237 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.228+0000 7f300fac3640 1 --2- 172.21.15.39:0/2626774917 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f30080c9a70 0x7f30080aff50 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:44.237 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.228+0000 7f300fac3640 1 --2- 172.21.15.39:0/2626774917 >> v2:172.21.15.118:3300/0 conn(0x7f3008158e00 0x7f30080c9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:44.237 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.228+0000 7f300fac3640 1 -- 172.21.15.39:0/2626774917 >> 172.21.15.39:0/2626774917 conn(0x7f3008069a50 msgr2=0x7f3008069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:44.237 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.228+0000 7f300fac3640 1 -- 172.21.15.39:0/2626774917 shutdown_connections 2023-05-16T13:54:44.237 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.228+0000 7f300fac3640 1 -- 172.21.15.39:0/2626774917 wait complete. 2023-05-16T13:54:44.238 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.232+0000 7f300fac3640 1 Processor -- start 2023-05-16T13:54:44.238 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.232+0000 7f300fac3640 1 -- start start 2023-05-16T13:54:44.239 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.232+0000 7f300fac3640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f30080b0490 0x7f30080c6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:44.239 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.232+0000 7f300fac3640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30080c9a70 0x7f300815b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:44.240 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.232+0000 7f300fac3640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3008158e00 0x7f30081f4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:44.240 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.232+0000 7f300fac3640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f300815a910 con 0x7f30080c9a70 2023-05-16T13:54:44.240 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.232+0000 7f300fac3640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f300815abb0 con 0x7f30080b0490 2023-05-16T13:54:44.240 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.232+0000 7f300fac3640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f300815ae90 con 0x7f3008158e00 2023-05-16T13:54:44.241 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.232+0000 7f300d05e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30080c9a70 0x7f300815b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:44.241 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.232+0000 7f300d05e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30080c9a70 0x7f300815b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34918/0 (socket says 172.21.15.39:34918) 2023-05-16T13:54:44.241 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.232+0000 7f300d05e640 1 -- 172.21.15.39:0/487050796 learned_addr learned my addr 172.21.15.39:0/487050796 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:44.241 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.232+0000 7f300d85f640 1 --2- 172.21.15.39:0/487050796 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f30080b0490 0x7f30080c6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:44.241 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.232+0000 7f300e060640 1 --2- 172.21.15.39:0/487050796 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3008158e00 0x7f30081f4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:44.241 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.232+0000 7f300d05e640 1 -- 172.21.15.39:0/487050796 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3008158e00 msgr2=0x7f30081f4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:44.242 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.232+0000 7f300d05e640 1 --2- 172.21.15.39:0/487050796 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3008158e00 0x7f30081f4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:44.242 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.232+0000 7f300d05e640 1 -- 172.21.15.39:0/487050796 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f30080b0490 msgr2=0x7f30080c6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:44.242 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.232+0000 7f300d05e640 1 --2- 172.21.15.39:0/487050796 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f30080b0490 0x7f30080c6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:44.242 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.232+0000 7f300d05e640 1 -- 172.21.15.39:0/487050796 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ff80094d0 con 0x7f30080c9a70 2023-05-16T13:54:44.242 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.232+0000 7f300d05e640 1 --2- 172.21.15.39:0/487050796 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30080c9a70 0x7f300815b970 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2ff801c960 tx=0x7f2ff801d570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:44.243 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.232+0000 7f2ffe7fc640 1 -- 172.21.15.39:0/487050796 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff80b1de0 con 0x7f30080c9a70 2023-05-16T13:54:44.244 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.232+0000 7f2ffe7fc640 1 -- 172.21.15.39:0/487050796 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ff8004020 con 0x7f30080c9a70 2023-05-16T13:54:44.244 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.232+0000 7f2ffe7fc640 1 -- 172.21.15.39:0/487050796 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff80043d0 con 0x7f30080c9a70 2023-05-16T13:54:44.244 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.232+0000 7f300fac3640 1 -- 172.21.15.39:0/487050796 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f300815d130 con 0x7f30080c9a70 2023-05-16T13:54:44.244 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.232+0000 7f300fac3640 1 -- 172.21.15.39:0/487050796 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f300815ce50 con 0x7f30080c9a70 2023-05-16T13:54:44.244 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.236+0000 7f300fac3640 1 -- 172.21.15.39:0/487050796 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30080cc730 con 0x7f30080c9a70 2023-05-16T13:54:44.244 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.236+0000 7f2ffe7fc640 1 -- 172.21.15.39:0/487050796 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2ff80b7040 con 0x7f30080c9a70 2023-05-16T13:54:44.245 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.236+0000 7f2ffe7fc640 1 --2- 172.21.15.39:0/487050796 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f2fec066280 0x7f2fec068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:44.245 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.236+0000 7f2ffe7fc640 1 -- 172.21.15.39:0/487050796 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2ff8120fb0 con 0x7f30080c9a70 2023-05-16T13:54:44.245 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.236+0000 7f300d85f640 1 --2- 172.21.15.39:0/487050796 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f2fec066280 0x7f2fec068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:44.245 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.236+0000 7f300d85f640 1 --2- 172.21.15.39:0/487050796 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f2fec066280 0x7f2fec068730 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3004009b60 tx=0x7f3004009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:44.246 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.240+0000 7f2ffe7fc640 1 -- 172.21.15.39:0/487050796 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f2ff80ee440 con 0x7f30080c9a70 2023-05-16T13:54:44.401 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.396+0000 7f300fac3640 1 -- 172.21.15.39:0/487050796 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3008073c90 con 0x7f30080c9a70 2023-05-16T13:54:44.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.396+0000 7f2ffe7fc640 1 -- 172.21.15.39:0/487050796 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2ff80b50a0 con 0x7f30080c9a70 2023-05-16T13:54:44.402 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 64 2023-05-16T13:54:44.404 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.396+0000 7f300fac3640 1 -- 172.21.15.39:0/487050796 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f2fec066280 msgr2=0x7f2fec068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:44.404 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.396+0000 7f300fac3640 1 --2- 172.21.15.39:0/487050796 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f2fec066280 0x7f2fec068730 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3004009b60 tx=0x7f3004009190 comp rx=0 tx=0).stop 2023-05-16T13:54:44.404 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.396+0000 7f300fac3640 1 -- 172.21.15.39:0/487050796 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30080c9a70 msgr2=0x7f300815b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:44.404 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.396+0000 7f300fac3640 1 --2- 172.21.15.39:0/487050796 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30080c9a70 0x7f300815b970 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2ff801c960 tx=0x7f2ff801d570 comp rx=0 tx=0).stop 2023-05-16T13:54:44.405 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.396+0000 7f300fac3640 1 -- 172.21.15.39:0/487050796 shutdown_connections 2023-05-16T13:54:44.405 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.396+0000 7f300fac3640 1 --2- 172.21.15.39:0/487050796 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f2fec066280 0x7f2fec068730 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:44.405 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.396+0000 7f300fac3640 1 --2- 172.21.15.39:0/487050796 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3008158e00 0x7f30081f4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:44.405 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.396+0000 7f300fac3640 1 --2- 172.21.15.39:0/487050796 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30080c9a70 0x7f300815b970 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:44.405 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.396+0000 7f300fac3640 1 --2- 172.21.15.39:0/487050796 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f30080b0490 0x7f30080c6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:44.405 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.396+0000 7f300fac3640 1 -- 172.21.15.39:0/487050796 >> 172.21.15.39:0/487050796 conn(0x7f3008069a50 msgr2=0x7f3008070e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:44.405 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.396+0000 7f300fac3640 1 -- 172.21.15.39:0/487050796 shutdown_connections 2023-05-16T13:54:44.406 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.396+0000 7f300fac3640 1 -- 172.21.15.39:0/487050796 wait complete. 2023-05-16T13:54:44.422 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-16T13:54:44.559 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.552+0000 7fd095ff3640 1 Processor -- start 2023-05-16T13:54:44.560 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.552+0000 7fd095ff3640 1 -- start start 2023-05-16T13:54:44.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.556+0000 7fd095ff3640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd0900ced10 0x7fd09006fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:44.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.556+0000 7fd095ff3640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd0900c9cb0 0x7fd0900713f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:44.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.556+0000 7fd095ff3640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0900cf0e0 con 0x7fd090071930 2023-05-16T13:54:44.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.556+0000 7fd095ff3640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0900c89f0 con 0x7fd0900c9cb0 2023-05-16T13:54:44.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.556+0000 7fd095ff3640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0900c8c40 con 0x7fd0900ced10 2023-05-16T13:54:44.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.556+0000 7fd08ffff640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fd090071930 0x7fd09015d9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:41238/0 (socket says 172.21.15.39:41238) 2023-05-16T13:54:44.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.556+0000 7fd08ffff640 1 -- 172.21.15.39:0/1800651685 learned_addr learned my addr 172.21.15.39:0/1800651685 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:44.562 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.556+0000 7fd08effd640 1 --2- 172.21.15.39:0/1800651685 >> v2:172.21.15.118:3300/0 conn(0x7fd0900c9cb0 0x7fd0900713f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:44.562 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.556+0000 7fd08f7fe640 1 --2- 172.21.15.39:0/1800651685 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd0900ced10 0x7fd09006fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:44.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.556+0000 7fd08e7fc640 1 -- 172.21.15.39:0/1800651685 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 179171473 0 0) 0x7fd0880014a0 con 0x7fd090071930 2023-05-16T13:54:44.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.556+0000 7fd08e7fc640 1 -- 172.21.15.39:0/1800651685 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd078003530 con 0x7fd090071930 2023-05-16T13:54:44.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.556+0000 7fd08e7fc640 1 -- 172.21.15.39:0/1800651685 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1444611587 0 0) 0x7fd078003530 con 0x7fd090071930 2023-05-16T13:54:44.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.556+0000 7fd08f7fe640 1 -- 172.21.15.39:0/1800651685 >> v2:172.21.15.118:3300/0 conn(0x7fd0900c9cb0 msgr2=0x7fd0900713f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:44.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.556+0000 7fd08f7fe640 1 --2- 172.21.15.39:0/1800651685 >> v2:172.21.15.118:3300/0 conn(0x7fd0900c9cb0 0x7fd0900713f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:44.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.556+0000 7fd08f7fe640 1 -- 172.21.15.39:0/1800651685 >> v1:172.21.15.39:6789/0 conn(0x7fd090071930 legacy=0x7fd09015d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:44.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.556+0000 7fd08f7fe640 1 -- 172.21.15.39:0/1800651685 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0900c8f20 con 0x7fd0900ced10 2023-05-16T13:54:44.564 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.560+0000 7fd08f7fe640 1 --2- 172.21.15.39:0/1800651685 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd0900ced10 0x7fd09006fc10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd0800097c0 tx=0x7fd08001c2e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=abfbd45c947975d7 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:44.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.560+0000 7fd08e7fc640 1 -- 172.21.15.39:0/1800651685 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd088001b90 con 0x7fd0900ced10 2023-05-16T13:54:44.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.560+0000 7fd08e7fc640 1 -- 172.21.15.39:0/1800651685 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0800a7050 con 0x7fd0900ced10 2023-05-16T13:54:44.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.560+0000 7fd08e7fc640 1 -- 172.21.15.39:0/1800651685 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0800ab620 con 0x7fd0900ced10 2023-05-16T13:54:44.566 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.560+0000 7fd095ff3640 1 -- 172.21.15.39:0/1800651685 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd0900ced10 msgr2=0x7fd09006fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:44.566 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.560+0000 7fd095ff3640 1 --2- 172.21.15.39:0/1800651685 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd0900ced10 0x7fd09006fc10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd0800097c0 tx=0x7fd08001c2e0 comp rx=0 tx=0).stop 2023-05-16T13:54:44.566 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.560+0000 7fd095ff3640 1 -- 172.21.15.39:0/1800651685 shutdown_connections 2023-05-16T13:54:44.567 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.560+0000 7fd095ff3640 1 --2- 172.21.15.39:0/1800651685 >> v2:172.21.15.118:3300/0 conn(0x7fd0900c9cb0 0x7fd0900713f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:44.567 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.560+0000 7fd095ff3640 1 --2- 172.21.15.39:0/1800651685 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd0900ced10 0x7fd09006fc10 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:44.567 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.560+0000 7fd095ff3640 1 -- 172.21.15.39:0/1800651685 >> 172.21.15.39:0/1800651685 conn(0x7fd090069a50 msgr2=0x7fd090069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:44.567 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.560+0000 7fd095ff3640 1 -- 172.21.15.39:0/1800651685 shutdown_connections 2023-05-16T13:54:44.567 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.560+0000 7fd095ff3640 1 -- 172.21.15.39:0/1800651685 wait complete. 2023-05-16T13:54:44.568 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.560+0000 7fd095ff3640 1 Processor -- start 2023-05-16T13:54:44.568 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.560+0000 7fd095ff3640 1 -- start start 2023-05-16T13:54:44.569 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.564+0000 7fd095ff3640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd090071930 0x7fd0900c6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:44.569 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.564+0000 7fd095ff3640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd0900c9cb0 0x7fd090153070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:44.569 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.564+0000 7fd095ff3640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0900ced10 0x7fd09015ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:44.569 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.564+0000 7fd095ff3640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0900c5470 con 0x7fd090071930 2023-05-16T13:54:44.569 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.564+0000 7fd095ff3640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0900c56c0 con 0x7fd0900ced10 2023-05-16T13:54:44.570 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.564+0000 7fd095ff3640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0900c59a0 con 0x7fd0900c9cb0 2023-05-16T13:54:44.570 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.564+0000 7fd08f7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd090071930 0x7fd0900c6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:44.570 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.564+0000 7fd08f7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd090071930 0x7fd0900c6760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34930/0 (socket says 172.21.15.39:34930) 2023-05-16T13:54:44.570 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.564+0000 7fd08f7fe640 1 -- 172.21.15.39:0/154237752 learned_addr learned my addr 172.21.15.39:0/154237752 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:44.571 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.564+0000 7fd08ffff640 1 --2- 172.21.15.39:0/154237752 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0900ced10 0x7fd09015ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:44.571 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.564+0000 7fd08f7fe640 1 -- 172.21.15.39:0/154237752 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd0900c9cb0 msgr2=0x7fd090153070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:44.571 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.564+0000 7fd08f7fe640 1 --2- 172.21.15.39:0/154237752 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd0900c9cb0 0x7fd090153070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:44.572 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.564+0000 7fd08f7fe640 1 -- 172.21.15.39:0/154237752 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0900ced10 msgr2=0x7fd09015ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:44.572 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.564+0000 7fd08f7fe640 1 --2- 172.21.15.39:0/154237752 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0900ced10 0x7fd09015ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:44.572 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.564+0000 7fd08f7fe640 1 -- 172.21.15.39:0/154237752 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd080009420 con 0x7fd090071930 2023-05-16T13:54:44.572 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.564+0000 7fd08ffff640 1 --2- 172.21.15.39:0/154237752 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0900ced10 0x7fd09015ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-16T13:54:44.572 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.564+0000 7fd08f7fe640 1 --2- 172.21.15.39:0/154237752 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd090071930 0x7fd0900c6760 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd0800ae040 tx=0x7fd08001ab20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:44.572 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.564+0000 7fd077fff640 1 -- 172.21.15.39:0/154237752 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0800b7450 con 0x7fd090071930 2023-05-16T13:54:44.572 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.564+0000 7fd077fff640 1 -- 172.21.15.39:0/154237752 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0800b75d0 con 0x7fd090071930 2023-05-16T13:54:44.573 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.564+0000 7fd077fff640 1 -- 172.21.15.39:0/154237752 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0800b7980 con 0x7fd090071930 2023-05-16T13:54:44.573 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.564+0000 7fd095ff3640 1 -- 172.21.15.39:0/154237752 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0900b42f0 con 0x7fd090071930 2023-05-16T13:54:44.573 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.564+0000 7fd095ff3640 1 -- 172.21.15.39:0/154237752 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0900c97c0 con 0x7fd090071930 2023-05-16T13:54:44.573 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.564+0000 7fd095ff3640 1 -- 172.21.15.39:0/154237752 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd090071db0 con 0x7fd090071930 2023-05-16T13:54:44.574 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.564+0000 7fd077fff640 1 -- 172.21.15.39:0/154237752 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd0800b7ae0 con 0x7fd090071930 2023-05-16T13:54:44.574 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.568+0000 7fd077fff640 1 --2- 172.21.15.39:0/154237752 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd07c066280 0x7fd07c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:44.574 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.568+0000 7fd077fff640 1 -- 172.21.15.39:0/154237752 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd08011e4c0 con 0x7fd090071930 2023-05-16T13:54:44.574 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.568+0000 7fd08effd640 1 --2- 172.21.15.39:0/154237752 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd07c066280 0x7fd07c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:44.574 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.568+0000 7fd08effd640 1 --2- 172.21.15.39:0/154237752 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd07c066280 0x7fd07c068730 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd084006aa0 tx=0x7fd084006a30 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:44.576 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.572+0000 7fd077fff640 1 -- 172.21.15.39:0/154237752 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fd0800eba60 con 0x7fd090071930 2023-05-16T13:54:44.731 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.724+0000 7fd095ff3640 1 -- 172.21.15.39:0/154237752 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd090073c90 con 0x7fd090071930 2023-05-16T13:54:44.732 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.724+0000 7fd077fff640 1 -- 172.21.15.39:0/154237752 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18279 (secure 0 0 0) 0x7fd0800ef080 con 0x7fd090071930 2023-05-16T13:54:44.732 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:54:44.733 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":24,"fsid":"9c1e210b-c515-4ea4-a065-397956895c68","created":"2023-05-16T13:53:48.955290+0000","modified":"2023-05-16T13:54:16.194544+0000","last_up_change":"2023-05-16T13:54:01.722051+0000","last_in_change":"2023-05-16T13:53:52.331336+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-16T13:54:00.885009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-16T13:54:08.327895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-16T13:54:12.864823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-16T13:54:14.180225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4ce0f0ba-c4bf-4405-8c95-d2e9a62878ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6809","nonce":3462013698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6811","nonce":3462013698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6815","nonce":3462013698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6813","nonce":3462013698}]},"public_addr":"172.21.15.39:6809/3462013698","cluster_addr":"172.21.15.39:6811/3462013698","heartbeat_back_addr":"172.21.15.39:6815/3462013698","heartbeat_front_addr":"172.21.15.39:6813/3462013698","state":["exists","up"]},{"osd":1,"uuid":"53fdc1ac-2473-472d-af32-2760fdf6e476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6801","nonce":2829970892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6803","nonce":2829970892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6807","nonce":2829970892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6805","nonce":2829970892}]},"public_addr":"172.21.15.39:6801/2829970892","cluster_addr":"172.21.15.39:6803/2829970892","heartbeat_back_addr":"172.21.15.39:6807/2829970892","heartbeat_front_addr":"172.21.15.39:6805/2829970892","state":["exists","up"]},{"osd":2,"uuid":"0b92d770-7030-42fa-a19f-4f7f1ac113c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6817","nonce":3888067413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6819","nonce":3888067413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6823","nonce":3888067413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6821","nonce":3888067413}]},"public_addr":"172.21.15.39:6817/3888067413","cluster_addr":"172.21.15.39:6819/3888067413","heartbeat_back_addr":"172.21.15.39:6823/3888067413","heartbeat_front_addr":"172.21.15.39:6821/3888067413","state":["exists","up"]},{"osd":3,"uuid":"000d9506-cbb2-4017-b875-deca579860ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6825","nonce":405003958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6827","nonce":405003958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6831","nonce":405003958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6829","nonce":405003958}]},"public_addr":"172.21.15.39:6825/405003958","cluster_addr":"172.21.15.39:6827/405003958","heartbeat_back_addr":"172.21.15.39:6831/405003958","heartbeat_front_addr":"172.21.15.39:6829/405003958","state":["exists","up"]},{"osd":4,"uuid":"70f0dacb-e960-40c5-bf6a-183e52bbe2ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6801","nonce":3895278838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6805","nonce":3895278838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6813","nonce":3895278838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6809","nonce":3895278838}]},"public_addr":"172.21.15.118:6801/3895278838","cluster_addr":"172.21.15.118:6805/3895278838","heartbeat_back_addr":"172.21.15.118:6813/3895278838","heartbeat_front_addr":"172.21.15.118:6809/3895278838","state":["exists","up"]},{"osd":5,"uuid":"756feb54-c3ae-4a2a-8f74-85c291ba707c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6804","nonce":3513592808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6808","nonce":3513592808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6815","nonce":3513592808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6812","nonce":3513592808}]},"public_addr":"172.21.15.118:6804/3513592808","cluster_addr":"172.21.15.118:6808/3513592808","heartbeat_back_addr":"172.21.15.118:6815/3513592808","heartbeat_front_addr":"172.21.15.118:6812/3513592808","state":["exists","up"]},{"osd":6,"uuid":"c4a982c1-f497-4b0f-8a23-c77372e4621e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6824","nonce":1863656053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6827","nonce":1863656053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6831","nonce":1863656053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6829","nonce":1863656053}]},"public_addr":"172.21.15.118:6824/1863656053","cluster_addr":"172.21.15.118:6827/1863656053","heartbeat_back_addr":"172.21.15.118:6831/1863656053","heartbeat_front_addr":"172.21.15.118:6829/1863656053","state":["exists","up"]},{"osd":7,"uuid":"6f2888aa-a7ac-4e26-9159-e31817934f44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6817","nonce":3636642904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6819","nonce":3636642904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6825","nonce":3636642904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6821","nonce":3636642904}]},"public_addr":"172.21.15.118:6817/3636642904","cluster_addr":"172.21.15.118:6819/3636642904","heartbeat_back_addr":"172.21.15.118:6825/3636642904","heartbeat_front_addr":"172.21.15.118:6821/3636642904","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.717636+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.724036+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.739144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:58.079275+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:58.073921+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.930466+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.987813+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.941098+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-16T13:54:44.734 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.728+0000 7fd095ff3640 1 -- 172.21.15.39:0/154237752 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd07c066280 msgr2=0x7fd07c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:44.734 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.728+0000 7fd095ff3640 1 --2- 172.21.15.39:0/154237752 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd07c066280 0x7fd07c068730 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd084006aa0 tx=0x7fd084006a30 comp rx=0 tx=0).stop 2023-05-16T13:54:44.734 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.728+0000 7fd095ff3640 1 -- 172.21.15.39:0/154237752 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd090071930 msgr2=0x7fd0900c6760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:44.735 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.728+0000 7fd095ff3640 1 --2- 172.21.15.39:0/154237752 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd090071930 0x7fd0900c6760 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd0800ae040 tx=0x7fd08001ab20 comp rx=0 tx=0).stop 2023-05-16T13:54:44.735 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.728+0000 7fd095ff3640 1 -- 172.21.15.39:0/154237752 shutdown_connections 2023-05-16T13:54:44.735 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.728+0000 7fd095ff3640 1 --2- 172.21.15.39:0/154237752 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd07c066280 0x7fd07c068730 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:44.735 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.728+0000 7fd095ff3640 1 --2- 172.21.15.39:0/154237752 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd0900c9cb0 0x7fd090153070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:44.735 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.728+0000 7fd095ff3640 1 --2- 172.21.15.39:0/154237752 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0900ced10 0x7fd09015ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:44.736 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.728+0000 7fd095ff3640 1 --2- 172.21.15.39:0/154237752 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd090071930 0x7fd0900c6760 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:44.736 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.728+0000 7fd095ff3640 1 -- 172.21.15.39:0/154237752 >> 172.21.15.39:0/154237752 conn(0x7fd090069a50 msgr2=0x7fd0900cd0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:44.736 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.728+0000 7fd095ff3640 1 -- 172.21.15.39:0/154237752 shutdown_connections 2023-05-16T13:54:44.736 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.728+0000 7fd095ff3640 1 -- 172.21.15.39:0/154237752 wait complete. 2023-05-16T13:54:44.753 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-16T13:54:00.885009+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-16T13:54:08.327895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-16T13:54:12.864823+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-16T13:54:14.180225+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-16T13:54:44.753 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-16T13:54:44.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.888+0000 7fdc59083640 1 Processor -- start 2023-05-16T13:54:44.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.888+0000 7fdc59083640 1 -- start start 2023-05-16T13:54:44.897 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.892+0000 7fdc59083640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fdc540cf080 0x7fdc5415d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:44.897 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.892+0000 7fdc59083640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fdc540d0570 0x7fdc540cd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:44.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.892+0000 7fdc59083640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc540cd3b0 con 0x7fdc5415c360 2023-05-16T13:54:44.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.892+0000 7fdc59083640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc5415d6e0 con 0x7fdc540d0570 2023-05-16T13:54:44.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.892+0000 7fdc59083640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc540d0aa0 con 0x7fdc540cf080 2023-05-16T13:54:44.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.892+0000 7fdc58882640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fdc540d0570 0x7fdc540cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:44.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.892+0000 7fdc537fe640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fdc5415c360 0x7fdc540cf450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:41250/0 (socket says 172.21.15.39:41250) 2023-05-16T13:54:44.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.892+0000 7fdc537fe640 1 -- 172.21.15.39:0/684820561 learned_addr learned my addr 172.21.15.39:0/684820561 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:44.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.892+0000 7fdc53fff640 1 --2- 172.21.15.39:0/684820561 >> v2:172.21.15.118:3300/0 conn(0x7fdc540cf080 0x7fdc5415d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:44.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.892+0000 7fdc58882640 1 -- 172.21.15.39:0/684820561 >> v2:172.21.15.118:3300/0 conn(0x7fdc540cf080 msgr2=0x7fdc5415d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:44.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.892+0000 7fdc58882640 1 --2- 172.21.15.39:0/684820561 >> v2:172.21.15.118:3300/0 conn(0x7fdc540cf080 0x7fdc5415d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:44.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.892+0000 7fdc58882640 1 -- 172.21.15.39:0/684820561 >> v1:172.21.15.39:6789/0 conn(0x7fdc5415c360 legacy=0x7fdc540cf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:44.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.892+0000 7fdc52ffd640 1 -- 172.21.15.39:0/684820561 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2947067272 0 0) 0x7fdc540cd3b0 con 0x7fdc5415c360 2023-05-16T13:54:44.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.892+0000 7fdc58882640 1 -- 172.21.15.39:0/684820561 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc540ccd60 con 0x7fdc540d0570 2023-05-16T13:54:44.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.892+0000 7fdc58882640 1 --2- 172.21.15.39:0/684820561 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdc540d0570 0x7fdc540cd840 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fdc540d2550 tx=0x7fdc4c01c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43c55e9d1678fc7f server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:44.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.896+0000 7fdc52ffd640 1 -- 172.21.15.39:0/684820561 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c0a5890 con 0x7fdc540d0570 2023-05-16T13:54:44.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.896+0000 7fdc52ffd640 1 -- 172.21.15.39:0/684820561 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc4c0a59f0 con 0x7fdc540d0570 2023-05-16T13:54:44.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.896+0000 7fdc52ffd640 1 -- 172.21.15.39:0/684820561 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c0a5d80 con 0x7fdc540d0570 2023-05-16T13:54:44.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.896+0000 7fdc59083640 1 -- 172.21.15.39:0/684820561 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdc540d0570 msgr2=0x7fdc540cd840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:44.902 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.896+0000 7fdc59083640 1 --2- 172.21.15.39:0/684820561 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdc540d0570 0x7fdc540cd840 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fdc540d2550 tx=0x7fdc4c01c7f0 comp rx=0 tx=0).stop 2023-05-16T13:54:44.902 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.896+0000 7fdc59083640 1 -- 172.21.15.39:0/684820561 shutdown_connections 2023-05-16T13:54:44.902 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.896+0000 7fdc59083640 1 --2- 172.21.15.39:0/684820561 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdc540d0570 0x7fdc540cd840 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:44.902 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.896+0000 7fdc59083640 1 --2- 172.21.15.39:0/684820561 >> v2:172.21.15.118:3300/0 conn(0x7fdc540cf080 0x7fdc5415d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:44.902 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.896+0000 7fdc59083640 1 -- 172.21.15.39:0/684820561 >> 172.21.15.39:0/684820561 conn(0x7fdc54071aa0 msgr2=0x7fdc5409b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:44.902 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.896+0000 7fdc59083640 1 -- 172.21.15.39:0/684820561 shutdown_connections 2023-05-16T13:54:44.903 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.896+0000 7fdc59083640 1 -- 172.21.15.39:0/684820561 wait complete. 2023-05-16T13:54:44.903 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.896+0000 7fdc59083640 1 Processor -- start 2023-05-16T13:54:44.903 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.896+0000 7fdc59083640 1 -- start start 2023-05-16T13:54:44.905 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.896+0000 7fdc59083640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdc540cf080 0x7fdc540b55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:44.905 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.896+0000 7fdc59083640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdc540d0570 0x7fdc54144850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:44.905 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.896+0000 7fdc59083640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdc5415c360 0x7fdc54144d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:44.905 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.896+0000 7fdc59083640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc54156780 con 0x7fdc540cf080 2023-05-16T13:54:44.905 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.896+0000 7fdc59083640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5406c4c0 con 0x7fdc5415c360 2023-05-16T13:54:44.905 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.896+0000 7fdc59083640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc54142a40 con 0x7fdc540d0570 2023-05-16T13:54:44.906 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.896+0000 7fdc53fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdc540cf080 0x7fdc540b55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:44.906 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.900+0000 7fdc53fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdc540cf080 0x7fdc540b55f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34960/0 (socket says 172.21.15.39:34960) 2023-05-16T13:54:44.906 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.900+0000 7fdc53fff640 1 -- 172.21.15.39:0/2804846804 learned_addr learned my addr 172.21.15.39:0/2804846804 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:44.906 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.900+0000 7fdc537fe640 1 --2- 172.21.15.39:0/2804846804 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdc540d0570 0x7fdc54144850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:44.906 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.900+0000 7fdc58882640 1 --2- 172.21.15.39:0/2804846804 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdc5415c360 0x7fdc54144d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:44.906 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.900+0000 7fdc53fff640 1 -- 172.21.15.39:0/2804846804 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdc540d0570 msgr2=0x7fdc54144850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:44.906 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.900+0000 7fdc53fff640 1 --2- 172.21.15.39:0/2804846804 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdc540d0570 0x7fdc54144850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:44.907 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.900+0000 7fdc53fff640 1 -- 172.21.15.39:0/2804846804 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdc5415c360 msgr2=0x7fdc54144d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:44.907 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.900+0000 7fdc53fff640 1 --2- 172.21.15.39:0/2804846804 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdc5415c360 0x7fdc54144d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:44.907 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.900+0000 7fdc53fff640 1 -- 172.21.15.39:0/2804846804 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc4c009a70 con 0x7fdc540cf080 2023-05-16T13:54:44.907 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.900+0000 7fdc58882640 1 --2- 172.21.15.39:0/2804846804 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdc5415c360 0x7fdc54144d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:54:44.907 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.900+0000 7fdc53fff640 1 --2- 172.21.15.39:0/2804846804 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdc540cf080 0x7fdc540b55f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fdc4400d800 tx=0x7fdc4400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:44.908 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.900+0000 7fdc50ff9640 1 -- 172.21.15.39:0/2804846804 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4400b6c0 con 0x7fdc540cf080 2023-05-16T13:54:44.908 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.900+0000 7fdc50ff9640 1 -- 172.21.15.39:0/2804846804 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc4400b820 con 0x7fdc540cf080 2023-05-16T13:54:44.908 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.900+0000 7fdc59083640 1 -- 172.21.15.39:0/2804846804 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc540ce720 con 0x7fdc540cf080 2023-05-16T13:54:44.909 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.900+0000 7fdc50ff9640 1 -- 172.21.15.39:0/2804846804 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4400bbd0 con 0x7fdc540cf080 2023-05-16T13:54:44.909 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.900+0000 7fdc59083640 1 -- 172.21.15.39:0/2804846804 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc540ce590 con 0x7fdc540cf080 2023-05-16T13:54:44.909 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.900+0000 7fdc59083640 1 -- 172.21.15.39:0/2804846804 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc540ce8b0 con 0x7fdc540cf080 2023-05-16T13:54:44.909 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.900+0000 7fdc50ff9640 1 -- 172.21.15.39:0/2804846804 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdc4400bd30 con 0x7fdc540cf080 2023-05-16T13:54:44.909 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.900+0000 7fdc50ff9640 1 --2- 172.21.15.39:0/2804846804 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fdc40066280 0x7fdc40068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:44.909 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.900+0000 7fdc50ff9640 1 -- 172.21.15.39:0/2804846804 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdc44084300 con 0x7fdc540cf080 2023-05-16T13:54:44.910 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.904+0000 7fdc537fe640 1 --2- 172.21.15.39:0/2804846804 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fdc40066280 0x7fdc40068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:44.910 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.904+0000 7fdc537fe640 1 --2- 172.21.15.39:0/2804846804 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fdc40066280 0x7fdc40068730 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdc540b8610 tx=0x7fdc48007b60 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:44.911 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:44.904+0000 7fdc50ff9640 1 -- 172.21.15.39:0/2804846804 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fdc440550e0 con 0x7fdc540cf080 2023-05-16T13:54:45.065 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.060+0000 7fdc59083640 1 -- 172.21.15.39:0/2804846804 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdc5404ed20 con 0x7fdc540cf080 2023-05-16T13:54:45.066 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.060+0000 7fdc50ff9640 1 -- 172.21.15.39:0/2804846804 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdc44054c70 con 0x7fdc540cf080 2023-05-16T13:54:45.066 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2023-05-16T13:54:45.067 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.060+0000 7fdc59083640 1 -- 172.21.15.39:0/2804846804 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fdc40066280 msgr2=0x7fdc40068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:45.067 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.060+0000 7fdc59083640 1 --2- 172.21.15.39:0/2804846804 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fdc40066280 0x7fdc40068730 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdc540b8610 tx=0x7fdc48007b60 comp rx=0 tx=0).stop 2023-05-16T13:54:45.068 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.060+0000 7fdc59083640 1 -- 172.21.15.39:0/2804846804 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdc540cf080 msgr2=0x7fdc540b55f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:45.068 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.060+0000 7fdc59083640 1 --2- 172.21.15.39:0/2804846804 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdc540cf080 0x7fdc540b55f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fdc4400d800 tx=0x7fdc4400dcc0 comp rx=0 tx=0).stop 2023-05-16T13:54:45.068 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.060+0000 7fdc59083640 1 -- 172.21.15.39:0/2804846804 shutdown_connections 2023-05-16T13:54:45.068 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.060+0000 7fdc59083640 1 --2- 172.21.15.39:0/2804846804 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fdc40066280 0x7fdc40068730 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:45.068 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.060+0000 7fdc59083640 1 --2- 172.21.15.39:0/2804846804 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdc540d0570 0x7fdc54144850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:45.068 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.060+0000 7fdc59083640 1 --2- 172.21.15.39:0/2804846804 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdc5415c360 0x7fdc54144d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:45.069 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.060+0000 7fdc59083640 1 --2- 172.21.15.39:0/2804846804 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdc540cf080 0x7fdc540b55f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:45.069 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.060+0000 7fdc59083640 1 -- 172.21.15.39:0/2804846804 >> 172.21.15.39:0/2804846804 conn(0x7fdc54071aa0 msgr2=0x7fdc5415c960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:45.069 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.060+0000 7fdc59083640 1 -- 172.21.15.39:0/2804846804 shutdown_connections 2023-05-16T13:54:45.069 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.060+0000 7fdc59083640 1 -- 172.21.15.39:0/2804846804 wait complete. 2023-05-16T13:54:45.087 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-16T13:54:45.228 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.220+0000 7f28d736d640 1 Processor -- start 2023-05-16T13:54:45.228 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.220+0000 7f28d736d640 1 -- start start 2023-05-16T13:54:45.229 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.224+0000 7f28d736d640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f28d015c490 0x7f28d00ad300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:45.229 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.224+0000 7f28d736d640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f28d00b1a70 0x7f28d006bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:45.229 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.224+0000 7f28d736d640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28d006b520 con 0x7f28d006c4c0 2023-05-16T13:54:45.230 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.224+0000 7f28d736d640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28d00cee10 con 0x7f28d015c490 2023-05-16T13:54:45.230 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.224+0000 7f28d736d640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28d00ad840 con 0x7f28d00b1a70 2023-05-16T13:54:45.230 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.224+0000 7f28d590a640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f28d006c4c0 0x7f28d00afaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:41264/0 (socket says 172.21.15.39:41264) 2023-05-16T13:54:45.231 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.224+0000 7f28d590a640 1 -- 172.21.15.39:0/1835529024 learned_addr learned my addr 172.21.15.39:0/1835529024 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:45.231 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.224+0000 7f28d5109640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f28d015c490 0x7f28d00ad300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:45.231 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.224+0000 7f28d4908640 1 --2- 172.21.15.39:0/1835529024 >> v2:172.21.15.118:3300/0 conn(0x7f28d00b1a70 0x7f28d006bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:45.231 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.224+0000 7f28d5109640 1 -- 172.21.15.39:0/1835529024 >> v2:172.21.15.118:3300/0 conn(0x7f28d00b1a70 msgr2=0x7f28d006bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:45.231 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.224+0000 7f28d5109640 1 --2- 172.21.15.39:0/1835529024 >> v2:172.21.15.118:3300/0 conn(0x7f28d00b1a70 0x7f28d006bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:45.231 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.224+0000 7f28d5109640 1 -- 172.21.15.39:0/1835529024 >> v1:172.21.15.39:6789/0 conn(0x7f28d006c4c0 legacy=0x7f28d00afaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:45.231 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.224+0000 7f28c7fff640 1 -- 172.21.15.39:0/1835529024 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4134384984 0 0) 0x7f28d006b520 con 0x7f28d006c4c0 2023-05-16T13:54:45.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.224+0000 7f28d5109640 1 -- 172.21.15.39:0/1835529024 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d00ce570 con 0x7f28d015c490 2023-05-16T13:54:45.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.224+0000 7f28d4908640 1 --2- 172.21.15.39:0/1835529024 >> v2:172.21.15.118:3300/0 conn(0x7f28d00b1a70 0x7f28d006bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-16T13:54:45.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.228+0000 7f28d5109640 1 --2- 172.21.15.39:0/1835529024 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f28d015c490 0x7f28d00ad300 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f28d00b3220 tx=0x7f28cc01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d328e0f674f293d7 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:45.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.228+0000 7f28c7fff640 1 -- 172.21.15.39:0/1835529024 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28cc0ab600 con 0x7f28d015c490 2023-05-16T13:54:45.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.228+0000 7f28c7fff640 1 -- 172.21.15.39:0/1835529024 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28cc0a7050 con 0x7f28d015c490 2023-05-16T13:54:45.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.228+0000 7f28c7fff640 1 -- 172.21.15.39:0/1835529024 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28cc0ab980 con 0x7f28d015c490 2023-05-16T13:54:45.234 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.228+0000 7f28d736d640 1 -- 172.21.15.39:0/1835529024 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f28d015c490 msgr2=0x7f28d00ad300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:45.234 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.228+0000 7f28d736d640 1 --2- 172.21.15.39:0/1835529024 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f28d015c490 0x7f28d00ad300 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f28d00b3220 tx=0x7f28cc01c430 comp rx=0 tx=0).stop 2023-05-16T13:54:45.234 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.228+0000 7f28d736d640 1 -- 172.21.15.39:0/1835529024 shutdown_connections 2023-05-16T13:54:45.234 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.228+0000 7f28d736d640 1 --2- 172.21.15.39:0/1835529024 >> v2:172.21.15.118:3300/0 conn(0x7f28d00b1a70 0x7f28d006bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:45.235 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.228+0000 7f28d736d640 1 --2- 172.21.15.39:0/1835529024 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f28d015c490 0x7f28d00ad300 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:45.235 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.228+0000 7f28d736d640 1 -- 172.21.15.39:0/1835529024 >> 172.21.15.39:0/1835529024 conn(0x7f28d00999a0 msgr2=0x7f28d00d0670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:45.235 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.228+0000 7f28d736d640 1 -- 172.21.15.39:0/1835529024 shutdown_connections 2023-05-16T13:54:45.235 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.228+0000 7f28d736d640 1 -- 172.21.15.39:0/1835529024 wait complete. 2023-05-16T13:54:45.235 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.228+0000 7f28d736d640 1 Processor -- start 2023-05-16T13:54:45.236 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.228+0000 7f28d736d640 1 -- start start 2023-05-16T13:54:45.237 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.232+0000 7f28d736d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f28d006c4c0 0x7f28d0157500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:45.237 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.232+0000 7f28d736d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28d00b1a70 0x7f28d01551f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:45.237 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.232+0000 7f28d736d640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f28d015c490 0x7f28d00b5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:45.237 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.232+0000 7f28d736d640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d01457d0 con 0x7f28d006c4c0 2023-05-16T13:54:45.237 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.232+0000 7f28d736d640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d0155730 con 0x7f28d00b1a70 2023-05-16T13:54:45.238 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.232+0000 7f28d736d640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28d0144f30 con 0x7f28d015c490 2023-05-16T13:54:45.238 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.232+0000 7f28d5109640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f28d006c4c0 0x7f28d0157500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:45.238 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.232+0000 7f28d5109640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f28d006c4c0 0x7f28d0157500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34982/0 (socket says 172.21.15.39:34982) 2023-05-16T13:54:45.238 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.232+0000 7f28d5109640 1 -- 172.21.15.39:0/143117413 learned_addr learned my addr 172.21.15.39:0/143117413 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:45.238 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.232+0000 7f28d4908640 1 --2- 172.21.15.39:0/143117413 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28d00b1a70 0x7f28d01551f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:45.238 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.232+0000 7f28d590a640 1 --2- 172.21.15.39:0/143117413 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f28d015c490 0x7f28d00b5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:45.238 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.232+0000 7f28d5109640 1 -- 172.21.15.39:0/143117413 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f28d015c490 msgr2=0x7f28d00b5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:45.238 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.232+0000 7f28d5109640 1 --2- 172.21.15.39:0/143117413 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f28d015c490 0x7f28d00b5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:45.239 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.232+0000 7f28d5109640 1 -- 172.21.15.39:0/143117413 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28d00b1a70 msgr2=0x7f28d01551f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:45.239 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.232+0000 7f28d5109640 1 --2- 172.21.15.39:0/143117413 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28d00b1a70 0x7f28d01551f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:45.239 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.232+0000 7f28d5109640 1 -- 172.21.15.39:0/143117413 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28cc009420 con 0x7f28d006c4c0 2023-05-16T13:54:45.239 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.232+0000 7f28d4908640 1 --2- 172.21.15.39:0/143117413 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28d00b1a70 0x7f28d01551f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:54:45.240 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.232+0000 7f28d5109640 1 --2- 172.21.15.39:0/143117413 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f28d006c4c0 0x7f28d0157500 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f28cc01a060 tx=0x7f28cc01ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:45.240 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.232+0000 7f28c5ffb640 1 -- 172.21.15.39:0/143117413 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28cc0b7450 con 0x7f28d006c4c0 2023-05-16T13:54:45.240 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.232+0000 7f28c5ffb640 1 -- 172.21.15.39:0/143117413 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28cc0b75d0 con 0x7f28d006c4c0 2023-05-16T13:54:45.240 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.232+0000 7f28c5ffb640 1 -- 172.21.15.39:0/143117413 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28cc0b7980 con 0x7f28d006c4c0 2023-05-16T13:54:45.240 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.232+0000 7f28d736d640 1 -- 172.21.15.39:0/143117413 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28d006ba60 con 0x7f28d006c4c0 2023-05-16T13:54:45.241 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.232+0000 7f28d736d640 1 -- 172.21.15.39:0/143117413 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28d006b780 con 0x7f28d006c4c0 2023-05-16T13:54:45.241 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.232+0000 7f28d736d640 1 -- 172.21.15.39:0/143117413 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28d00d0410 con 0x7f28d006c4c0 2023-05-16T13:54:45.241 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.232+0000 7f28c5ffb640 1 -- 172.21.15.39:0/143117413 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f28cc0b7ae0 con 0x7f28d006c4c0 2023-05-16T13:54:45.241 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.236+0000 7f28c5ffb640 1 --2- 172.21.15.39:0/143117413 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f28b40662b0 0x7f28b4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:45.242 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.236+0000 7f28c5ffb640 1 -- 172.21.15.39:0/143117413 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f28cc11e6e0 con 0x7f28d006c4c0 2023-05-16T13:54:45.242 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.236+0000 7f28d4908640 1 --2- 172.21.15.39:0/143117413 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f28b40662b0 0x7f28b4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:45.242 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.236+0000 7f28d4908640 1 --2- 172.21.15.39:0/143117413 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f28b40662b0 0x7f28b4068760 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f28c0006fd0 tx=0x7f28c0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:45.244 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.240+0000 7f28c5ffb640 1 -- 172.21.15.39:0/143117413 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f28cc0ebc70 con 0x7f28d006c4c0 2023-05-16T13:54:45.397 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.392+0000 7f28d736d640 1 -- 172.21.15.39:0/143117413 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f28d0066e50 con 0x7f28d006c4c0 2023-05-16T13:54:45.398 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.392+0000 7f28c5ffb640 1 -- 172.21.15.39:0/143117413 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f28cc0ef290 con 0x7f28d006c4c0 2023-05-16T13:54:45.398 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 8 2023-05-16T13:54:45.400 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.392+0000 7f28d736d640 1 -- 172.21.15.39:0/143117413 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f28b40662b0 msgr2=0x7f28b4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:45.400 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.392+0000 7f28d736d640 1 --2- 172.21.15.39:0/143117413 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f28b40662b0 0x7f28b4068760 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f28c0006fd0 tx=0x7f28c0008040 comp rx=0 tx=0).stop 2023-05-16T13:54:45.400 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.392+0000 7f28d736d640 1 -- 172.21.15.39:0/143117413 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f28d006c4c0 msgr2=0x7f28d0157500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:45.400 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.392+0000 7f28d736d640 1 --2- 172.21.15.39:0/143117413 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f28d006c4c0 0x7f28d0157500 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f28cc01a060 tx=0x7f28cc01ac70 comp rx=0 tx=0).stop 2023-05-16T13:54:45.400 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.392+0000 7f28d736d640 1 -- 172.21.15.39:0/143117413 shutdown_connections 2023-05-16T13:54:45.401 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.392+0000 7f28d736d640 1 --2- 172.21.15.39:0/143117413 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f28b40662b0 0x7f28b4068760 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:45.401 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.392+0000 7f28d736d640 1 --2- 172.21.15.39:0/143117413 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f28d015c490 0x7f28d00b5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:45.401 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.392+0000 7f28d736d640 1 --2- 172.21.15.39:0/143117413 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28d00b1a70 0x7f28d01551f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:45.401 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.392+0000 7f28d736d640 1 --2- 172.21.15.39:0/143117413 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f28d006c4c0 0x7f28d0157500 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:45.401 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.392+0000 7f28d736d640 1 -- 172.21.15.39:0/143117413 >> 172.21.15.39:0/143117413 conn(0x7f28d00999a0 msgr2=0x7f28d006f740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:45.401 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.392+0000 7f28d736d640 1 -- 172.21.15.39:0/143117413 shutdown_connections 2023-05-16T13:54:45.401 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.392+0000 7f28d736d640 1 -- 172.21.15.39:0/143117413 wait complete. 2023-05-16T13:54:45.419 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-16T13:54:45.558 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.552+0000 7f830b4fc640 1 Processor -- start 2023-05-16T13:54:45.559 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.552+0000 7f830b4fc640 1 -- start start 2023-05-16T13:54:45.560 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.552+0000 7f830b4fc640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f83040b0710 0x7f830415d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:45.560 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.552+0000 7f830b4fc640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f8304071b70 0x7f83040c91c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:45.560 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.552+0000 7f830b4fc640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f830415de40 con 0x7f83040b4030 2023-05-16T13:54:45.560 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.552+0000 7f830b4fc640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f830415e910 con 0x7f8304071b70 2023-05-16T13:54:45.560 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.552+0000 7f830b4fc640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83040b0ae0 con 0x7f83040b0710 2023-05-16T13:54:45.560 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.552+0000 7f8309a99640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f8304071b70 0x7f83040c91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:45.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.552+0000 7f8309a99640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f8304071b70 0x7f83040c91c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34994/0 (socket says 172.21.15.39:34994) 2023-05-16T13:54:45.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.552+0000 7f8309a99640 1 -- 172.21.15.39:0/2341912148 learned_addr learned my addr 172.21.15.39:0/2341912148 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:45.562 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.556+0000 7f8309298640 1 --2- 172.21.15.39:0/2341912148 >> v2:172.21.15.118:3300/0 conn(0x7f83040b0710 0x7f830415d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:45.562 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.556+0000 7f8309a99640 1 -- 172.21.15.39:0/2341912148 >> v2:172.21.15.118:3300/0 conn(0x7f83040b0710 msgr2=0x7f830415d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:45.562 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.556+0000 7f8309a99640 1 --2- 172.21.15.39:0/2341912148 >> v2:172.21.15.118:3300/0 conn(0x7f83040b0710 0x7f830415d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:45.562 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.556+0000 7f8309a99640 1 -- 172.21.15.39:0/2341912148 >> v1:172.21.15.118:6789/0 conn(0x7f83040b4030 legacy=0x7f8304071460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:45.562 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.556+0000 7f8309a99640 1 -- 172.21.15.39:0/2341912148 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f830415e070 con 0x7f8304071b70 2023-05-16T13:54:45.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.556+0000 7f8309a99640 1 --2- 172.21.15.39:0/2341912148 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8304071b70 0x7f83040c91c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f83040b1080 tx=0x7f82fc01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d71154b7095f8efe server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:45.564 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.556+0000 7f82fbfff640 1 -- 172.21.15.39:0/2341912148 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82fc0a57a0 con 0x7f8304071b70 2023-05-16T13:54:45.564 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.556+0000 7f82fbfff640 1 -- 172.21.15.39:0/2341912148 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82fc0a5900 con 0x7f8304071b70 2023-05-16T13:54:45.564 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.556+0000 7f82fbfff640 1 -- 172.21.15.39:0/2341912148 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82fc0a5c90 con 0x7f8304071b70 2023-05-16T13:54:45.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.556+0000 7f830b4fc640 1 -- 172.21.15.39:0/2341912148 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8304071b70 msgr2=0x7f83040c91c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:45.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.556+0000 7f830b4fc640 1 --2- 172.21.15.39:0/2341912148 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8304071b70 0x7f83040c91c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f83040b1080 tx=0x7f82fc01c9d0 comp rx=0 tx=0).stop 2023-05-16T13:54:45.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.560+0000 7f830b4fc640 1 -- 172.21.15.39:0/2341912148 shutdown_connections 2023-05-16T13:54:45.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.560+0000 7f830b4fc640 1 --2- 172.21.15.39:0/2341912148 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8304071b70 0x7f83040c91c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:45.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.560+0000 7f830b4fc640 1 --2- 172.21.15.39:0/2341912148 >> v2:172.21.15.118:3300/0 conn(0x7f83040b0710 0x7f830415d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:45.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.560+0000 7f830b4fc640 1 -- 172.21.15.39:0/2341912148 >> 172.21.15.39:0/2341912148 conn(0x7f8304069a50 msgr2=0x7f8304069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:45.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.560+0000 7f830b4fc640 1 -- 172.21.15.39:0/2341912148 shutdown_connections 2023-05-16T13:54:45.566 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.560+0000 7f830b4fc640 1 -- 172.21.15.39:0/2341912148 wait complete. 2023-05-16T13:54:45.566 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.560+0000 7f830b4fc640 1 Processor -- start 2023-05-16T13:54:45.566 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.560+0000 7f830b4fc640 1 -- start start 2023-05-16T13:54:45.567 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.560+0000 7f830b4fc640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8304071b70 0x7f83041f3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:45.567 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.560+0000 7f830b4fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83040b0710 0x7f83040ae7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:45.567 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.560+0000 7f830b4fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f83040b4030 0x7f83040c5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:45.568 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.560+0000 7f830b4fc640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83040afe70 con 0x7f83040b4030 2023-05-16T13:54:45.568 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.560+0000 7f830b4fc640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83040af260 con 0x7f83040b0710 2023-05-16T13:54:45.568 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.560+0000 7f830b4fc640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83040af540 con 0x7f8304071b70 2023-05-16T13:54:45.568 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.560+0000 7f8309a99640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f83040b4030 0x7f83040c5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:45.568 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.560+0000 7f8309a99640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f83040b4030 0x7f83040c5580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35004/0 (socket says 172.21.15.39:35004) 2023-05-16T13:54:45.568 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.560+0000 7f8309a99640 1 -- 172.21.15.39:0/4026932086 learned_addr learned my addr 172.21.15.39:0/4026932086 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:45.568 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.560+0000 7f8309298640 1 --2- 172.21.15.39:0/4026932086 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8304071b70 0x7f83041f3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:45.569 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.560+0000 7f8308a97640 1 --2- 172.21.15.39:0/4026932086 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83040b0710 0x7f83040ae7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:45.569 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.560+0000 7f8309a99640 1 -- 172.21.15.39:0/4026932086 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8304071b70 msgr2=0x7f83041f3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:45.570 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.560+0000 7f8309a99640 1 --2- 172.21.15.39:0/4026932086 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8304071b70 0x7f83041f3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:45.570 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.560+0000 7f8309a99640 1 -- 172.21.15.39:0/4026932086 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83040b0710 msgr2=0x7f83040ae7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:45.570 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.560+0000 7f8309a99640 1 --2- 172.21.15.39:0/4026932086 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83040b0710 0x7f83040ae7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:45.570 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.560+0000 7f8309a99640 1 -- 172.21.15.39:0/4026932086 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82fc009b30 con 0x7f83040b4030 2023-05-16T13:54:45.570 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.560+0000 7f8309a99640 1 --2- 172.21.15.39:0/4026932086 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f83040b4030 0x7f83040c5580 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f82fc0af040 tx=0x7f82fc019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:45.570 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.564+0000 7f82f9ffb640 1 -- 172.21.15.39:0/4026932086 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82fc0b8670 con 0x7f83040b4030 2023-05-16T13:54:45.570 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.564+0000 7f82f9ffb640 1 -- 172.21.15.39:0/4026932086 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82fc0b87f0 con 0x7f83040b4030 2023-05-16T13:54:45.571 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.564+0000 7f830b4fc640 1 -- 172.21.15.39:0/4026932086 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83040c9f10 con 0x7f83040b4030 2023-05-16T13:54:45.571 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.564+0000 7f82f9ffb640 1 -- 172.21.15.39:0/4026932086 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82fc0b8ba0 con 0x7f83040b4030 2023-05-16T13:54:45.571 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.564+0000 7f830b4fc640 1 -- 172.21.15.39:0/4026932086 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83040c8ca0 con 0x7f83040b4030 2023-05-16T13:54:45.571 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.564+0000 7f830b4fc640 1 -- 172.21.15.39:0/4026932086 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83040ca0a0 con 0x7f83040b4030 2023-05-16T13:54:45.572 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.564+0000 7f82f9ffb640 1 -- 172.21.15.39:0/4026932086 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f82fc0b8d00 con 0x7f83040b4030 2023-05-16T13:54:45.572 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.564+0000 7f82f9ffb640 1 --2- 172.21.15.39:0/4026932086 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f82e80662b0 0x7f82e8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:45.572 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.564+0000 7f82f9ffb640 1 -- 172.21.15.39:0/4026932086 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f82fc11f140 con 0x7f83040b4030 2023-05-16T13:54:45.572 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.564+0000 7f8309298640 1 --2- 172.21.15.39:0/4026932086 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f82e80662b0 0x7f82e8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:45.572 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.568+0000 7f8309298640 1 --2- 172.21.15.39:0/4026932086 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f82e80662b0 0x7f82e8068760 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8300007a60 tx=0x7f8300008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:45.575 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.568+0000 7f82f9ffb640 1 -- 172.21.15.39:0/4026932086 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f82fc0ec6a0 con 0x7f83040b4030 2023-05-16T13:54:45.727 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.720+0000 7f830b4fc640 1 -- 172.21.15.39:0/4026932086 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8304073c90 con 0x7f83040b4030 2023-05-16T13:54:45.728 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.720+0000 7f82f9ffb640 1 -- 172.21.15.39:0/4026932086 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f82fc0efcc0 con 0x7f83040b4030 2023-05-16T13:54:45.728 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2023-05-16T13:54:45.730 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.724+0000 7f830b4fc640 1 -- 172.21.15.39:0/4026932086 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f82e80662b0 msgr2=0x7f82e8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:45.730 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.724+0000 7f830b4fc640 1 --2- 172.21.15.39:0/4026932086 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f82e80662b0 0x7f82e8068760 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8300007a60 tx=0x7f8300008040 comp rx=0 tx=0).stop 2023-05-16T13:54:45.730 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.724+0000 7f830b4fc640 1 -- 172.21.15.39:0/4026932086 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f83040b4030 msgr2=0x7f83040c5580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:45.730 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.724+0000 7f830b4fc640 1 --2- 172.21.15.39:0/4026932086 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f83040b4030 0x7f83040c5580 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f82fc0af040 tx=0x7f82fc019770 comp rx=0 tx=0).stop 2023-05-16T13:54:45.730 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.724+0000 7f830b4fc640 1 -- 172.21.15.39:0/4026932086 shutdown_connections 2023-05-16T13:54:45.730 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.724+0000 7f830b4fc640 1 --2- 172.21.15.39:0/4026932086 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f83040b4030 0x7f83040c5580 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:45.730 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.724+0000 7f830b4fc640 1 --2- 172.21.15.39:0/4026932086 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f83040b0710 0x7f83040ae7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:45.731 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.724+0000 7f830b4fc640 1 --2- 172.21.15.39:0/4026932086 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f82e80662b0 0x7f82e8068760 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:45.731 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.724+0000 7f830b4fc640 1 --2- 172.21.15.39:0/4026932086 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8304071b70 0x7f83041f3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:45.731 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.724+0000 7f830b4fc640 1 -- 172.21.15.39:0/4026932086 >> 172.21.15.39:0/4026932086 conn(0x7f8304069a50 msgr2=0x7f83040acda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:45.731 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.724+0000 7f830b4fc640 1 -- 172.21.15.39:0/4026932086 shutdown_connections 2023-05-16T13:54:45.731 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.724+0000 7f830b4fc640 1 -- 172.21.15.39:0/4026932086 wait complete. 2023-05-16T13:54:45.748 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-16T13:54:45.889 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.884+0000 7f9bb4066640 1 Processor -- start 2023-05-16T13:54:45.889 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.884+0000 7f9bb4066640 1 -- start start 2023-05-16T13:54:45.890 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.884+0000 7f9bb4066640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9bac1603e0 0x7f9bac0c8b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:45.890 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.884+0000 7f9bb4066640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9bac0ca8e0 0x7f9bac0c10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:45.890 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.884+0000 7f9bb4066640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bac0ce940 con 0x7f9bac0ca460 2023-05-16T13:54:45.890 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.884+0000 7f9bb4066640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bac0cec20 con 0x7f9bac1603e0 2023-05-16T13:54:45.891 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.884+0000 7f9bb4066640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bac0cef00 con 0x7f9bac0ca8e0 2023-05-16T13:54:45.891 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.884+0000 7f9bb1e02640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9bac1603e0 0x7f9bac0c8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:45.892 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.884+0000 7f9bb1601640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f9bac0ca460 0x7f9bac0aff50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.39:38870/0 (socket says 172.21.15.39:38870) 2023-05-16T13:54:45.892 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.884+0000 7f9bb1e02640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9bac1603e0 0x7f9bac0c8b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35010/0 (socket says 172.21.15.39:35010) 2023-05-16T13:54:45.892 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.884+0000 7f9bb1601640 1 -- 172.21.15.39:0/1112868889 learned_addr learned my addr 172.21.15.39:0/1112868889 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:45.892 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.884+0000 7f9bb2603640 1 --2- 172.21.15.39:0/1112868889 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9bac0ca8e0 0x7f9bac0c10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:45.892 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.884+0000 7f9bb1e02640 1 -- 172.21.15.39:0/1112868889 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9bac0ca8e0 msgr2=0x7f9bac0c10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:45.892 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.884+0000 7f9bb1e02640 1 --2- 172.21.15.39:0/1112868889 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9bac0ca8e0 0x7f9bac0c10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:45.892 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.884+0000 7f9bb1e02640 1 -- 172.21.15.39:0/1112868889 >> v1:172.21.15.118:6789/0 conn(0x7f9bac0ca460 legacy=0x7f9bac0aff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:45.893 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.884+0000 7f9bb0e00640 1 -- 172.21.15.39:0/1112868889 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3625762971 0 0) 0x7f9bac0ce940 con 0x7f9bac0ca460 2023-05-16T13:54:45.893 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.884+0000 7f9bb1e02640 1 -- 172.21.15.39:0/1112868889 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bac0cf1e0 con 0x7f9bac1603e0 2023-05-16T13:54:45.894 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.888+0000 7f9bb1e02640 1 --2- 172.21.15.39:0/1112868889 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9bac1603e0 0x7f9bac0c8b90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9ba80097c0 tx=0x7f9ba801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=971fc45c70ac7ecc server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:45.894 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.888+0000 7f9bb0e00640 1 -- 172.21.15.39:0/1112868889 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba80ab600 con 0x7f9bac1603e0 2023-05-16T13:54:45.894 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.888+0000 7f9bb0e00640 1 -- 172.21.15.39:0/1112868889 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba80a7050 con 0x7f9bac1603e0 2023-05-16T13:54:45.894 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.888+0000 7f9bb0e00640 1 -- 172.21.15.39:0/1112868889 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba80ab980 con 0x7f9bac1603e0 2023-05-16T13:54:45.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.888+0000 7f9bb4066640 1 -- 172.21.15.39:0/1112868889 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9bac1603e0 msgr2=0x7f9bac0c8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:45.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.888+0000 7f9bb4066640 1 --2- 172.21.15.39:0/1112868889 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9bac1603e0 0x7f9bac0c8b90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9ba80097c0 tx=0x7f9ba801c480 comp rx=0 tx=0).stop 2023-05-16T13:54:45.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.888+0000 7f9bb4066640 1 -- 172.21.15.39:0/1112868889 shutdown_connections 2023-05-16T13:54:45.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.888+0000 7f9bb4066640 1 --2- 172.21.15.39:0/1112868889 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9bac0ca8e0 0x7f9bac0c10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:45.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.888+0000 7f9bb4066640 1 --2- 172.21.15.39:0/1112868889 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9bac1603e0 0x7f9bac0c8b90 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:45.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.888+0000 7f9bb4066640 1 -- 172.21.15.39:0/1112868889 >> 172.21.15.39:0/1112868889 conn(0x7f9bac069a50 msgr2=0x7f9bac069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:45.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.888+0000 7f9bb4066640 1 -- 172.21.15.39:0/1112868889 shutdown_connections 2023-05-16T13:54:45.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.888+0000 7f9bb4066640 1 -- 172.21.15.39:0/1112868889 wait complete. 2023-05-16T13:54:45.897 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.892+0000 7f9bb4066640 1 Processor -- start 2023-05-16T13:54:45.897 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.892+0000 7f9bb4066640 1 -- start start 2023-05-16T13:54:45.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.892+0000 7f9bb4066640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9bac0ca460 0x7f9bac161060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:45.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.892+0000 7f9bb4066640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9bac0ca8e0 0x7f9bac0b2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:45.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.892+0000 7f9bb4066640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9bac1603e0 0x7f9bac151bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:45.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.892+0000 7f9bb4066640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bac162300 con 0x7f9bac0ca460 2023-05-16T13:54:45.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.892+0000 7f9bb4066640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bac0b2c90 con 0x7f9bac0ca8e0 2023-05-16T13:54:45.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.892+0000 7f9bb4066640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bac1616f0 con 0x7f9bac1603e0 2023-05-16T13:54:45.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.892+0000 7f9bb1e02640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9bac0ca460 0x7f9bac161060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:45.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.892+0000 7f9bb1e02640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9bac0ca460 0x7f9bac161060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35024/0 (socket says 172.21.15.39:35024) 2023-05-16T13:54:45.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.892+0000 7f9bb1e02640 1 -- 172.21.15.39:0/3590849612 learned_addr learned my addr 172.21.15.39:0/3590849612 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:45.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.892+0000 7f9bb1601640 1 --2- 172.21.15.39:0/3590849612 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9bac0ca8e0 0x7f9bac0b2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:45.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.892+0000 7f9bb2603640 1 --2- 172.21.15.39:0/3590849612 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9bac1603e0 0x7f9bac151bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:45.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.892+0000 7f9bb1e02640 1 -- 172.21.15.39:0/3590849612 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9bac1603e0 msgr2=0x7f9bac151bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:45.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.892+0000 7f9bb1e02640 1 --2- 172.21.15.39:0/3590849612 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9bac1603e0 0x7f9bac151bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:45.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.892+0000 7f9bb1e02640 1 -- 172.21.15.39:0/3590849612 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9bac0ca8e0 msgr2=0x7f9bac0b2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:45.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.892+0000 7f9bb1e02640 1 --2- 172.21.15.39:0/3590849612 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9bac0ca8e0 0x7f9bac0b2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:45.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.892+0000 7f9bb1e02640 1 -- 172.21.15.39:0/3590849612 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ba8009420 con 0x7f9bac0ca460 2023-05-16T13:54:45.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.892+0000 7f9bb2603640 1 --2- 172.21.15.39:0/3590849612 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9bac1603e0 0x7f9bac151bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:54:45.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.892+0000 7f9bb1e02640 1 --2- 172.21.15.39:0/3590849612 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9bac0ca460 0x7f9bac161060 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9ba801ab30 tx=0x7f9ba8019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:45.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.892+0000 7f9ba27fc640 1 -- 172.21.15.39:0/3590849612 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba8004220 con 0x7f9bac0ca460 2023-05-16T13:54:45.902 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.892+0000 7f9ba27fc640 1 -- 172.21.15.39:0/3590849612 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba8004380 con 0x7f9bac0ca460 2023-05-16T13:54:45.902 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.892+0000 7f9bb4066640 1 -- 172.21.15.39:0/3590849612 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bac0b07f0 con 0x7f9bac0ca460 2023-05-16T13:54:45.902 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.892+0000 7f9ba27fc640 1 -- 172.21.15.39:0/3590849612 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba8003820 con 0x7f9bac0ca460 2023-05-16T13:54:45.902 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.892+0000 7f9bb4066640 1 -- 172.21.15.39:0/3590849612 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bac0b0660 con 0x7f9bac0ca460 2023-05-16T13:54:45.902 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.892+0000 7f9bb4066640 1 -- 172.21.15.39:0/3590849612 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bac06fec0 con 0x7f9bac0ca460 2023-05-16T13:54:45.903 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.896+0000 7f9ba27fc640 1 -- 172.21.15.39:0/3590849612 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9ba80b2040 con 0x7f9bac0ca460 2023-05-16T13:54:45.903 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.896+0000 7f9ba27fc640 1 --2- 172.21.15.39:0/3590849612 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f9b90066280 0x7f9b90068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:45.903 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.896+0000 7f9ba27fc640 1 -- 172.21.15.39:0/3590849612 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9ba811d100 con 0x7f9bac0ca460 2023-05-16T13:54:45.903 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.896+0000 7f9bb1601640 1 --2- 172.21.15.39:0/3590849612 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f9b90066280 0x7f9b90068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:45.903 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.896+0000 7f9bb1601640 1 --2- 172.21.15.39:0/3590849612 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f9b90066280 0x7f9b90068730 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9bac15c3d0 tx=0x7f9b9c007d60 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:45.906 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:45.900+0000 7f9ba27fc640 1 -- 172.21.15.39:0/3590849612 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f9ba80ea4e0 con 0x7f9bac0ca460 2023-05-16T13:54:46.059 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.052+0000 7f9bb4066640 1 -- 172.21.15.39:0/3590849612 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9bac073c90 con 0x7f9bac0ca460 2023-05-16T13:54:46.059 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.052+0000 7f9ba27fc640 1 -- 172.21.15.39:0/3590849612 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9ba80b00a0 con 0x7f9bac0ca460 2023-05-16T13:54:46.060 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 64 2023-05-16T13:54:46.061 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.056+0000 7f9bb4066640 1 -- 172.21.15.39:0/3590849612 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f9b90066280 msgr2=0x7f9b90068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:46.061 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.056+0000 7f9bb4066640 1 --2- 172.21.15.39:0/3590849612 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f9b90066280 0x7f9b90068730 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9bac15c3d0 tx=0x7f9b9c007d60 comp rx=0 tx=0).stop 2023-05-16T13:54:46.061 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.056+0000 7f9bb4066640 1 -- 172.21.15.39:0/3590849612 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9bac0ca460 msgr2=0x7f9bac161060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:46.062 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.056+0000 7f9bb4066640 1 --2- 172.21.15.39:0/3590849612 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9bac0ca460 0x7f9bac161060 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9ba801ab30 tx=0x7f9ba8019220 comp rx=0 tx=0).stop 2023-05-16T13:54:46.062 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.056+0000 7f9bb4066640 1 -- 172.21.15.39:0/3590849612 shutdown_connections 2023-05-16T13:54:46.062 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.056+0000 7f9bb4066640 1 --2- 172.21.15.39:0/3590849612 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f9b90066280 0x7f9b90068730 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:46.062 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.056+0000 7f9bb4066640 1 --2- 172.21.15.39:0/3590849612 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9bac1603e0 0x7f9bac151bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:46.062 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.056+0000 7f9bb4066640 1 --2- 172.21.15.39:0/3590849612 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9bac0ca8e0 0x7f9bac0b2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:46.062 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.056+0000 7f9bb4066640 1 --2- 172.21.15.39:0/3590849612 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9bac0ca460 0x7f9bac161060 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:46.062 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.056+0000 7f9bb4066640 1 -- 172.21.15.39:0/3590849612 >> 172.21.15.39:0/3590849612 conn(0x7f9bac069a50 msgr2=0x7f9bac157d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:46.063 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.056+0000 7f9bb4066640 1 -- 172.21.15.39:0/3590849612 shutdown_connections 2023-05-16T13:54:46.063 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.056+0000 7f9bb4066640 1 -- 172.21.15.39:0/3590849612 wait complete. 2023-05-16T13:54:46.080 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-16T13:54:46.217 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.212+0000 7f12455c0640 1 Processor -- start 2023-05-16T13:54:46.217 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.212+0000 7f12455c0640 1 -- start start 2023-05-16T13:54:46.218 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.212+0000 7f12455c0640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f12400cd0c0 0x7f12400cd490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:46.218 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.212+0000 7f12455c0640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f124008a3e0 0x7f1240160670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:46.218 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.212+0000 7f12455c0640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12400ced80 con 0x7f1240160bb0 2023-05-16T13:54:46.218 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.212+0000 7f12455c0640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12400cd9d0 con 0x7f124008a3e0 2023-05-16T13:54:46.218 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.212+0000 7f12455c0640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12400cdbe0 con 0x7f12400cd0c0 2023-05-16T13:54:46.219 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.212+0000 7f123e7fc640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f124008a3e0 0x7f1240160670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:46.219 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.212+0000 7f123f7fe640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f1240160bb0 0x7f124006ab60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:41274/0 (socket says 172.21.15.39:41274) 2023-05-16T13:54:46.219 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.212+0000 7f123f7fe640 1 -- 172.21.15.39:0/3435992138 learned_addr learned my addr 172.21.15.39:0/3435992138 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:46.219 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.212+0000 7f123effd640 1 --2- 172.21.15.39:0/3435992138 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f12400cd0c0 0x7f12400cd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:46.220 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.212+0000 7f123e7fc640 1 -- 172.21.15.39:0/3435992138 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f12400cd0c0 msgr2=0x7f12400cd490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:46.220 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.212+0000 7f123e7fc640 1 --2- 172.21.15.39:0/3435992138 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f12400cd0c0 0x7f12400cd490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:46.220 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.212+0000 7f123e7fc640 1 -- 172.21.15.39:0/3435992138 >> v1:172.21.15.39:6789/0 conn(0x7f1240160bb0 legacy=0x7f124006ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:46.220 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.212+0000 7f123e7fc640 1 -- 172.21.15.39:0/3435992138 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12400ce580 con 0x7f124008a3e0 2023-05-16T13:54:46.220 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.212+0000 7f123dffb640 1 -- 172.21.15.39:0/3435992138 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3878610900 0 0) 0x7f12380014a0 con 0x7f1240160bb0 2023-05-16T13:54:46.221 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.216+0000 7f123e7fc640 1 --2- 172.21.15.39:0/3435992138 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f124008a3e0 0x7f1240160670 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f12340097c0 tx=0x7f123401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dad90394cf93b90b server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:46.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.216+0000 7f123dffb640 1 -- 172.21.15.39:0/3435992138 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12340ab670 con 0x7f124008a3e0 2023-05-16T13:54:46.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.216+0000 7f123dffb640 1 -- 172.21.15.39:0/3435992138 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12340ab7d0 con 0x7f124008a3e0 2023-05-16T13:54:46.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.216+0000 7f123dffb640 1 -- 172.21.15.39:0/3435992138 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12340abb60 con 0x7f124008a3e0 2023-05-16T13:54:46.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.216+0000 7f12455c0640 1 -- 172.21.15.39:0/3435992138 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f124008a3e0 msgr2=0x7f1240160670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:46.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.216+0000 7f12455c0640 1 --2- 172.21.15.39:0/3435992138 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f124008a3e0 0x7f1240160670 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f12340097c0 tx=0x7f123401c450 comp rx=0 tx=0).stop 2023-05-16T13:54:46.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.216+0000 7f12455c0640 1 -- 172.21.15.39:0/3435992138 shutdown_connections 2023-05-16T13:54:46.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.216+0000 7f12455c0640 1 --2- 172.21.15.39:0/3435992138 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f124008a3e0 0x7f1240160670 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:46.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.216+0000 7f12455c0640 1 --2- 172.21.15.39:0/3435992138 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f12400cd0c0 0x7f12400cd490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:46.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.216+0000 7f12455c0640 1 -- 172.21.15.39:0/3435992138 >> 172.21.15.39:0/3435992138 conn(0x7f1240089fe0 msgr2=0x7f12400d05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:46.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.216+0000 7f12455c0640 1 -- 172.21.15.39:0/3435992138 shutdown_connections 2023-05-16T13:54:46.224 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.216+0000 7f12455c0640 1 -- 172.21.15.39:0/3435992138 wait complete. 2023-05-16T13:54:46.224 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.216+0000 7f12455c0640 1 Processor -- start 2023-05-16T13:54:46.224 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.216+0000 7f12455c0640 1 -- start start 2023-05-16T13:54:46.225 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.220+0000 7f12455c0640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f124008a3e0 0x7f12401f57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:46.225 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.220+0000 7f12455c0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f12400cd0c0 0x7f124015d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:46.225 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.220+0000 7f12455c0640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1240160bb0 0x7f1240155c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:46.225 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.220+0000 7f12455c0640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12400c5c50 con 0x7f12400cd0c0 2023-05-16T13:54:46.226 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.220+0000 7f12455c0640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12400c52f0 con 0x7f1240160bb0 2023-05-16T13:54:46.226 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.220+0000 7f12455c0640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12400c5590 con 0x7f124008a3e0 2023-05-16T13:54:46.226 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.220+0000 7f123e7fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f12400cd0c0 0x7f124015d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:46.226 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.220+0000 7f123e7fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f12400cd0c0 0x7f124015d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35042/0 (socket says 172.21.15.39:35042) 2023-05-16T13:54:46.226 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.220+0000 7f123e7fc640 1 -- 172.21.15.39:0/2012273469 learned_addr learned my addr 172.21.15.39:0/2012273469 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:46.227 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.220+0000 7f123effd640 1 --2- 172.21.15.39:0/2012273469 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f124008a3e0 0x7f12401f57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:46.228 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.220+0000 7f123f7fe640 1 --2- 172.21.15.39:0/2012273469 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1240160bb0 0x7f1240155c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:46.228 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.220+0000 7f123e7fc640 1 -- 172.21.15.39:0/2012273469 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f124008a3e0 msgr2=0x7f12401f57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:46.228 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.220+0000 7f123e7fc640 1 --2- 172.21.15.39:0/2012273469 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f124008a3e0 0x7f12401f57b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:46.228 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.220+0000 7f123e7fc640 1 -- 172.21.15.39:0/2012273469 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1240160bb0 msgr2=0x7f1240155c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:46.228 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.220+0000 7f123e7fc640 1 --2- 172.21.15.39:0/2012273469 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1240160bb0 0x7f1240155c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:46.228 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.220+0000 7f123e7fc640 1 -- 172.21.15.39:0/2012273469 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1234009420 con 0x7f12400cd0c0 2023-05-16T13:54:46.229 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.220+0000 7f123e7fc640 1 --2- 172.21.15.39:0/2012273469 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f12400cd0c0 0x7f124015d640 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f12340ad040 tx=0x7f123401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:46.229 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.220+0000 7f12277fe640 1 -- 172.21.15.39:0/2012273469 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12340bf610 con 0x7f12400cd0c0 2023-05-16T13:54:46.229 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.220+0000 7f12277fe640 1 -- 172.21.15.39:0/2012273469 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12340bf7b0 con 0x7f12400cd0c0 2023-05-16T13:54:46.229 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.220+0000 7f12277fe640 1 -- 172.21.15.39:0/2012273469 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12340bfb60 con 0x7f12400cd0c0 2023-05-16T13:54:46.229 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.220+0000 7f12455c0640 1 -- 172.21.15.39:0/2012273469 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1240160fd0 con 0x7f12400cd0c0 2023-05-16T13:54:46.229 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.220+0000 7f12455c0640 1 -- 172.21.15.39:0/2012273469 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12400cdec0 con 0x7f12400cd0c0 2023-05-16T13:54:46.229 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.220+0000 7f12455c0640 1 -- 172.21.15.39:0/2012273469 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f124006ba80 con 0x7f12400cd0c0 2023-05-16T13:54:46.231 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.224+0000 7f12277fe640 1 -- 172.21.15.39:0/2012273469 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f12340bfcc0 con 0x7f12400cd0c0 2023-05-16T13:54:46.231 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.224+0000 7f12277fe640 1 --2- 172.21.15.39:0/2012273469 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f122c066280 0x7f122c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:46.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.224+0000 7f12277fe640 1 -- 172.21.15.39:0/2012273469 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f123411e570 con 0x7f12400cd0c0 2023-05-16T13:54:46.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.224+0000 7f123effd640 1 --2- 172.21.15.39:0/2012273469 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f122c066280 0x7f122c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:46.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.224+0000 7f123effd640 1 --2- 172.21.15.39:0/2012273469 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f122c066280 0x7f122c068730 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f124015bad0 tx=0x7f1230009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:46.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.228+0000 7f12277fe640 1 -- 172.21.15.39:0/2012273469 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f12340ebaa0 con 0x7f12400cd0c0 2023-05-16T13:54:46.390 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.384+0000 7f12455c0640 1 -- 172.21.15.39:0/2012273469 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f12400c5d90 con 0x7f12400cd0c0 2023-05-16T13:54:46.391 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.384+0000 7f12277fe640 1 -- 172.21.15.39:0/2012273469 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18279 (secure 0 0 0) 0x7f12400c5d90 con 0x7f12400cd0c0 2023-05-16T13:54:46.391 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:54:46.392 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":24,"fsid":"9c1e210b-c515-4ea4-a065-397956895c68","created":"2023-05-16T13:53:48.955290+0000","modified":"2023-05-16T13:54:16.194544+0000","last_up_change":"2023-05-16T13:54:01.722051+0000","last_in_change":"2023-05-16T13:53:52.331336+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-16T13:54:00.885009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-16T13:54:08.327895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-16T13:54:12.864823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-16T13:54:14.180225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4ce0f0ba-c4bf-4405-8c95-d2e9a62878ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6809","nonce":3462013698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6811","nonce":3462013698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6815","nonce":3462013698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6813","nonce":3462013698}]},"public_addr":"172.21.15.39:6809/3462013698","cluster_addr":"172.21.15.39:6811/3462013698","heartbeat_back_addr":"172.21.15.39:6815/3462013698","heartbeat_front_addr":"172.21.15.39:6813/3462013698","state":["exists","up"]},{"osd":1,"uuid":"53fdc1ac-2473-472d-af32-2760fdf6e476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6801","nonce":2829970892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6803","nonce":2829970892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6807","nonce":2829970892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6805","nonce":2829970892}]},"public_addr":"172.21.15.39:6801/2829970892","cluster_addr":"172.21.15.39:6803/2829970892","heartbeat_back_addr":"172.21.15.39:6807/2829970892","heartbeat_front_addr":"172.21.15.39:6805/2829970892","state":["exists","up"]},{"osd":2,"uuid":"0b92d770-7030-42fa-a19f-4f7f1ac113c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6817","nonce":3888067413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6819","nonce":3888067413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6823","nonce":3888067413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6821","nonce":3888067413}]},"public_addr":"172.21.15.39:6817/3888067413","cluster_addr":"172.21.15.39:6819/3888067413","heartbeat_back_addr":"172.21.15.39:6823/3888067413","heartbeat_front_addr":"172.21.15.39:6821/3888067413","state":["exists","up"]},{"osd":3,"uuid":"000d9506-cbb2-4017-b875-deca579860ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6825","nonce":405003958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6827","nonce":405003958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6831","nonce":405003958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6829","nonce":405003958}]},"public_addr":"172.21.15.39:6825/405003958","cluster_addr":"172.21.15.39:6827/405003958","heartbeat_back_addr":"172.21.15.39:6831/405003958","heartbeat_front_addr":"172.21.15.39:6829/405003958","state":["exists","up"]},{"osd":4,"uuid":"70f0dacb-e960-40c5-bf6a-183e52bbe2ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6801","nonce":3895278838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6805","nonce":3895278838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6813","nonce":3895278838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6809","nonce":3895278838}]},"public_addr":"172.21.15.118:6801/3895278838","cluster_addr":"172.21.15.118:6805/3895278838","heartbeat_back_addr":"172.21.15.118:6813/3895278838","heartbeat_front_addr":"172.21.15.118:6809/3895278838","state":["exists","up"]},{"osd":5,"uuid":"756feb54-c3ae-4a2a-8f74-85c291ba707c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6804","nonce":3513592808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6808","nonce":3513592808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6815","nonce":3513592808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6812","nonce":3513592808}]},"public_addr":"172.21.15.118:6804/3513592808","cluster_addr":"172.21.15.118:6808/3513592808","heartbeat_back_addr":"172.21.15.118:6815/3513592808","heartbeat_front_addr":"172.21.15.118:6812/3513592808","state":["exists","up"]},{"osd":6,"uuid":"c4a982c1-f497-4b0f-8a23-c77372e4621e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6824","nonce":1863656053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6827","nonce":1863656053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6831","nonce":1863656053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6829","nonce":1863656053}]},"public_addr":"172.21.15.118:6824/1863656053","cluster_addr":"172.21.15.118:6827/1863656053","heartbeat_back_addr":"172.21.15.118:6831/1863656053","heartbeat_front_addr":"172.21.15.118:6829/1863656053","state":["exists","up"]},{"osd":7,"uuid":"6f2888aa-a7ac-4e26-9159-e31817934f44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6817","nonce":3636642904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6819","nonce":3636642904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6825","nonce":3636642904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6821","nonce":3636642904}]},"public_addr":"172.21.15.118:6817/3636642904","cluster_addr":"172.21.15.118:6819/3636642904","heartbeat_back_addr":"172.21.15.118:6825/3636642904","heartbeat_front_addr":"172.21.15.118:6821/3636642904","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.717636+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.724036+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.739144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:58.079275+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:58.073921+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.930466+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.987813+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.941098+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-16T13:54:46.393 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.388+0000 7f12455c0640 1 -- 172.21.15.39:0/2012273469 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f122c066280 msgr2=0x7f122c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:46.393 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.388+0000 7f12455c0640 1 --2- 172.21.15.39:0/2012273469 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f122c066280 0x7f122c068730 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f124015bad0 tx=0x7f1230009190 comp rx=0 tx=0).stop 2023-05-16T13:54:46.394 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.388+0000 7f12455c0640 1 -- 172.21.15.39:0/2012273469 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f12400cd0c0 msgr2=0x7f124015d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:46.394 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.388+0000 7f12455c0640 1 --2- 172.21.15.39:0/2012273469 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f12400cd0c0 0x7f124015d640 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f12340ad040 tx=0x7f123401ac90 comp rx=0 tx=0).stop 2023-05-16T13:54:46.394 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.388+0000 7f12455c0640 1 -- 172.21.15.39:0/2012273469 shutdown_connections 2023-05-16T13:54:46.394 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.388+0000 7f12455c0640 1 --2- 172.21.15.39:0/2012273469 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1240160bb0 0x7f1240155c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:46.394 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.388+0000 7f12455c0640 1 --2- 172.21.15.39:0/2012273469 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f12400cd0c0 0x7f124015d640 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:46.394 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.388+0000 7f12455c0640 1 --2- 172.21.15.39:0/2012273469 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f122c066280 0x7f122c068730 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:46.394 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.388+0000 7f12455c0640 1 --2- 172.21.15.39:0/2012273469 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f124008a3e0 0x7f12401f57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:46.394 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.388+0000 7f12455c0640 1 -- 172.21.15.39:0/2012273469 >> 172.21.15.39:0/2012273469 conn(0x7f1240089fe0 msgr2=0x7f124015ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:46.395 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.388+0000 7f12455c0640 1 -- 172.21.15.39:0/2012273469 shutdown_connections 2023-05-16T13:54:46.395 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.388+0000 7f12455c0640 1 -- 172.21.15.39:0/2012273469 wait complete. 2023-05-16T13:54:46.412 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-16T13:54:00.885009+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-16T13:54:08.327895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-16T13:54:12.864823+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-16T13:54:14.180225+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-16T13:54:46.413 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-16T13:54:46.552 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.544+0000 7f26761f3640 1 Processor -- start 2023-05-16T13:54:46.552 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.544+0000 7f26761f3640 1 -- start start 2023-05-16T13:54:46.554 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.548+0000 7f26761f3640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26700c92e0 0x7f26700cacb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:46.554 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.548+0000 7f26761f3640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f26700cd930 0x7f26700cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:46.554 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.548+0000 7f26761f3640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2670158dc0 con 0x7f26700ce440 2023-05-16T13:54:46.554 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.548+0000 7f26761f3640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26701590a0 con 0x7f26700cd930 2023-05-16T13:54:46.554 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.548+0000 7f26761f3640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2670159380 con 0x7f26700c92e0 2023-05-16T13:54:46.554 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.548+0000 7f266effd640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f26700cd930 0x7f26700cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:46.554 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.548+0000 7f266effd640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f26700cd930 0x7f26700cdd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35046/0 (socket says 172.21.15.39:35046) 2023-05-16T13:54:46.555 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.548+0000 7f266effd640 1 -- 172.21.15.39:0/3115821025 learned_addr learned my addr 172.21.15.39:0/3115821025 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:46.555 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.548+0000 7f266f7fe640 1 --2- 172.21.15.39:0/3115821025 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26700c92e0 0x7f26700cacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:46.555 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.548+0000 7f266effd640 1 -- 172.21.15.39:0/3115821025 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26700c92e0 msgr2=0x7f26700cacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:46.555 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.548+0000 7f266effd640 1 --2- 172.21.15.39:0/3115821025 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26700c92e0 0x7f26700cacb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:46.556 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.548+0000 7f266effd640 1 -- 172.21.15.39:0/3115821025 >> v1:172.21.15.118:6789/0 conn(0x7f26700ce440 legacy=0x7f26700cc920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:46.556 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.548+0000 7f266effd640 1 -- 172.21.15.39:0/3115821025 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2670159660 con 0x7f26700cd930 2023-05-16T13:54:46.557 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.552+0000 7f266effd640 1 --2- 172.21.15.39:0/3115821025 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f26700cd930 0x7f26700cdd80 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2664006fd0 tx=0x7f266401e940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4636b00447e23bc6 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:46.557 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.552+0000 7f266e7fc640 1 -- 172.21.15.39:0/3115821025 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2664004230 con 0x7f26700cd930 2023-05-16T13:54:46.557 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.552+0000 7f266e7fc640 1 -- 172.21.15.39:0/3115821025 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26640ab070 con 0x7f26700cd930 2023-05-16T13:54:46.557 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.552+0000 7f266e7fc640 1 -- 172.21.15.39:0/3115821025 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26640a77d0 con 0x7f26700cd930 2023-05-16T13:54:46.558 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.552+0000 7f26761f3640 1 -- 172.21.15.39:0/3115821025 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f26700cd930 msgr2=0x7f26700cdd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:46.558 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.552+0000 7f26761f3640 1 --2- 172.21.15.39:0/3115821025 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f26700cd930 0x7f26700cdd80 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2664006fd0 tx=0x7f266401e940 comp rx=0 tx=0).stop 2023-05-16T13:54:46.558 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.552+0000 7f26761f3640 1 -- 172.21.15.39:0/3115821025 shutdown_connections 2023-05-16T13:54:46.559 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.552+0000 7f26761f3640 1 --2- 172.21.15.39:0/3115821025 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f26700cd930 0x7f26700cdd80 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:46.559 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.552+0000 7f26761f3640 1 --2- 172.21.15.39:0/3115821025 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26700c92e0 0x7f26700cacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:46.559 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.552+0000 7f26761f3640 1 -- 172.21.15.39:0/3115821025 >> 172.21.15.39:0/3115821025 conn(0x7f2670069a50 msgr2=0x7f2670069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:46.559 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.552+0000 7f26761f3640 1 -- 172.21.15.39:0/3115821025 shutdown_connections 2023-05-16T13:54:46.559 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.552+0000 7f26761f3640 1 -- 172.21.15.39:0/3115821025 wait complete. 2023-05-16T13:54:46.560 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.552+0000 7f26761f3640 1 Processor -- start 2023-05-16T13:54:46.560 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.552+0000 7f26761f3640 1 -- start start 2023-05-16T13:54:46.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.556+0000 7f26761f3640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f26700c92e0 0x7f26700c4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:46.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.556+0000 7f26761f3640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26700cd930 0x7f26700b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:46.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.556+0000 7f26761f3640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26700ce440 0x7f26700b26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:46.562 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.556+0000 7f26761f3640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26700b1a50 con 0x7f26700c92e0 2023-05-16T13:54:46.562 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.556+0000 7f26761f3640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2670071000 con 0x7f26700ce440 2023-05-16T13:54:46.562 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.556+0000 7f26761f3640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26700b1770 con 0x7f26700cd930 2023-05-16T13:54:46.562 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.556+0000 7f266f7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f26700c92e0 0x7f26700c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:46.562 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.556+0000 7f266f7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f26700c92e0 0x7f26700c4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35050/0 (socket says 172.21.15.39:35050) 2023-05-16T13:54:46.562 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.556+0000 7f266f7fe640 1 -- 172.21.15.39:0/3797813856 learned_addr learned my addr 172.21.15.39:0/3797813856 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:46.562 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.556+0000 7f266effd640 1 --2- 172.21.15.39:0/3797813856 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26700cd930 0x7f26700b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:46.562 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.556+0000 7f266ffff640 1 --2- 172.21.15.39:0/3797813856 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26700ce440 0x7f26700b26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:46.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.556+0000 7f266f7fe640 1 -- 172.21.15.39:0/3797813856 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26700cd930 msgr2=0x7f26700b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:46.564 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.556+0000 7f266f7fe640 1 --2- 172.21.15.39:0/3797813856 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26700cd930 0x7f26700b21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:46.564 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.556+0000 7f266f7fe640 1 -- 172.21.15.39:0/3797813856 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26700ce440 msgr2=0x7f26700b26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:46.564 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.556+0000 7f266f7fe640 1 --2- 172.21.15.39:0/3797813856 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26700ce440 0x7f26700b26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:46.564 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.556+0000 7f266f7fe640 1 -- 172.21.15.39:0/3797813856 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f266400b780 con 0x7f26700c92e0 2023-05-16T13:54:46.564 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.556+0000 7f266ffff640 1 --2- 172.21.15.39:0/3797813856 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26700ce440 0x7f26700b26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:54:46.564 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.556+0000 7f266f7fe640 1 --2- 172.21.15.39:0/3797813856 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f26700c92e0 0x7f26700c4920 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f266000e870 tx=0x7f266000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:46.564 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.556+0000 7f2657fff640 1 -- 172.21.15.39:0/3797813856 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2660009510 con 0x7f26700c92e0 2023-05-16T13:54:46.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.556+0000 7f2657fff640 1 -- 172.21.15.39:0/3797813856 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f266000eec0 con 0x7f26700c92e0 2023-05-16T13:54:46.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.556+0000 7f2657fff640 1 -- 172.21.15.39:0/3797813856 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266000cb40 con 0x7f26700c92e0 2023-05-16T13:54:46.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.556+0000 7f26761f3640 1 -- 172.21.15.39:0/3797813856 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26700cec50 con 0x7f26700c92e0 2023-05-16T13:54:46.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.556+0000 7f26761f3640 1 -- 172.21.15.39:0/3797813856 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2670158a20 con 0x7f26700c92e0 2023-05-16T13:54:46.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.556+0000 7f26761f3640 1 -- 172.21.15.39:0/3797813856 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26700cede0 con 0x7f26700c92e0 2023-05-16T13:54:46.566 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.556+0000 7f2657fff640 1 -- 172.21.15.39:0/3797813856 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f266000cca0 con 0x7f26700c92e0 2023-05-16T13:54:46.566 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.560+0000 7f2657fff640 1 --2- 172.21.15.39:0/3797813856 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f265c066280 0x7f265c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:46.566 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.560+0000 7f2657fff640 1 -- 172.21.15.39:0/3797813856 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2660083e30 con 0x7f26700c92e0 2023-05-16T13:54:46.566 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.560+0000 7f266effd640 1 --2- 172.21.15.39:0/3797813856 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f265c066280 0x7f265c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:46.566 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.560+0000 7f266effd640 1 --2- 172.21.15.39:0/3797813856 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f265c066280 0x7f265c068730 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f26640b1000 tx=0x7f26640a9070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:46.569 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.564+0000 7f2657fff640 1 -- 172.21.15.39:0/3797813856 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f26600512c0 con 0x7f26700c92e0 2023-05-16T13:54:46.722 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.716+0000 7f26761f3640 1 -- 172.21.15.39:0/3797813856 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2670073c90 con 0x7f26700c92e0 2023-05-16T13:54:46.722 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.716+0000 7f2657fff640 1 -- 172.21.15.39:0/3797813856 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f26600170a0 con 0x7f26700c92e0 2023-05-16T13:54:46.723 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2023-05-16T13:54:46.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.716+0000 7f26761f3640 1 -- 172.21.15.39:0/3797813856 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f265c066280 msgr2=0x7f265c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:46.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.716+0000 7f26761f3640 1 --2- 172.21.15.39:0/3797813856 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f265c066280 0x7f265c068730 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f26640b1000 tx=0x7f26640a9070 comp rx=0 tx=0).stop 2023-05-16T13:54:46.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.716+0000 7f26761f3640 1 -- 172.21.15.39:0/3797813856 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f26700c92e0 msgr2=0x7f26700c4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:46.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.716+0000 7f26761f3640 1 --2- 172.21.15.39:0/3797813856 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f26700c92e0 0x7f26700c4920 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f266000e870 tx=0x7f266000ec70 comp rx=0 tx=0).stop 2023-05-16T13:54:46.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.716+0000 7f26761f3640 1 -- 172.21.15.39:0/3797813856 shutdown_connections 2023-05-16T13:54:46.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.716+0000 7f26761f3640 1 --2- 172.21.15.39:0/3797813856 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f265c066280 0x7f265c068730 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:46.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.716+0000 7f26761f3640 1 --2- 172.21.15.39:0/3797813856 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26700cd930 0x7f26700b21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:46.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.716+0000 7f26761f3640 1 --2- 172.21.15.39:0/3797813856 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26700ce440 0x7f26700b26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:46.726 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.716+0000 7f26761f3640 1 --2- 172.21.15.39:0/3797813856 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f26700c92e0 0x7f26700c4920 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:46.726 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.716+0000 7f26761f3640 1 -- 172.21.15.39:0/3797813856 >> 172.21.15.39:0/3797813856 conn(0x7f2670069a50 msgr2=0x7f26700cc820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:46.726 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.720+0000 7f26761f3640 1 -- 172.21.15.39:0/3797813856 shutdown_connections 2023-05-16T13:54:46.726 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.720+0000 7f26761f3640 1 -- 172.21.15.39:0/3797813856 wait complete. 2023-05-16T13:54:46.744 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-16T13:54:46.888 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.880+0000 7f9e91820640 1 Processor -- start 2023-05-16T13:54:46.888 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.880+0000 7f9e91820640 1 -- start start 2023-05-16T13:54:46.890 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.884+0000 7f9e91820640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9e8c158460 0x7f9e8c0b0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:46.890 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.884+0000 7f9e91820640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9e8c06f9f0 0x7f9e8c0c8940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:46.890 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.884+0000 7f9e91820640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e8c0cbec0 con 0x7f9e8c0cb810 2023-05-16T13:54:46.891 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.884+0000 7f9e91820640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e8c158830 con 0x7f9e8c06f9f0 2023-05-16T13:54:46.891 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.884+0000 7f9e91820640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e8c0cc110 con 0x7f9e8c158460 2023-05-16T13:54:46.891 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.884+0000 7f9e83fff640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9e8c06f9f0 0x7f9e8c0c8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:46.891 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.884+0000 7f9e83fff640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9e8c06f9f0 0x7f9e8c0c8940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35064/0 (socket says 172.21.15.39:35064) 2023-05-16T13:54:46.891 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.884+0000 7f9e83fff640 1 -- 172.21.15.39:0/2329354590 learned_addr learned my addr 172.21.15.39:0/2329354590 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:46.892 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.884+0000 7f9e8affd640 1 --2- 172.21.15.39:0/2329354590 >> v2:172.21.15.118:3300/0 conn(0x7f9e8c158460 0x7f9e8c0b0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:46.892 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.884+0000 7f9e83fff640 1 -- 172.21.15.39:0/2329354590 >> v2:172.21.15.118:3300/0 conn(0x7f9e8c158460 msgr2=0x7f9e8c0b0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:46.892 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.884+0000 7f9e83fff640 1 --2- 172.21.15.39:0/2329354590 >> v2:172.21.15.118:3300/0 conn(0x7f9e8c158460 0x7f9e8c0b0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:46.892 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.884+0000 7f9e83fff640 1 -- 172.21.15.39:0/2329354590 >> v1:172.21.15.118:6789/0 conn(0x7f9e8c0cb810 legacy=0x7f9e8c0cced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:46.893 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.884+0000 7f9e83fff640 1 -- 172.21.15.39:0/2329354590 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e8c0cc3f0 con 0x7f9e8c06f9f0 2023-05-16T13:54:46.894 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.888+0000 7f9e83fff640 1 --2- 172.21.15.39:0/2329354590 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9e8c06f9f0 0x7f9e8c0c8940 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c06b990 tx=0x7f9e7401e6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45cc954e5d8b60bd server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:46.894 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.888+0000 7f9e8a7fc640 1 -- 172.21.15.39:0/2329354590 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e740ab610 con 0x7f9e8c06f9f0 2023-05-16T13:54:46.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.888+0000 7f9e8a7fc640 1 -- 172.21.15.39:0/2329354590 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e740ab770 con 0x7f9e8c06f9f0 2023-05-16T13:54:46.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.888+0000 7f9e8a7fc640 1 -- 172.21.15.39:0/2329354590 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e740abb00 con 0x7f9e8c06f9f0 2023-05-16T13:54:46.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.888+0000 7f9e91820640 1 -- 172.21.15.39:0/2329354590 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9e8c06f9f0 msgr2=0x7f9e8c0c8940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:46.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.888+0000 7f9e91820640 1 --2- 172.21.15.39:0/2329354590 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9e8c06f9f0 0x7f9e8c0c8940 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c06b990 tx=0x7f9e7401e6b0 comp rx=0 tx=0).stop 2023-05-16T13:54:46.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.888+0000 7f9e91820640 1 -- 172.21.15.39:0/2329354590 shutdown_connections 2023-05-16T13:54:46.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.888+0000 7f9e91820640 1 --2- 172.21.15.39:0/2329354590 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9e8c06f9f0 0x7f9e8c0c8940 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:46.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.888+0000 7f9e91820640 1 --2- 172.21.15.39:0/2329354590 >> v2:172.21.15.118:3300/0 conn(0x7f9e8c158460 0x7f9e8c0b0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:46.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.888+0000 7f9e91820640 1 -- 172.21.15.39:0/2329354590 >> 172.21.15.39:0/2329354590 conn(0x7f9e8c06bac0 msgr2=0x7f9e8c06bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:46.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.888+0000 7f9e91820640 1 -- 172.21.15.39:0/2329354590 shutdown_connections 2023-05-16T13:54:46.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.888+0000 7f9e91820640 1 -- 172.21.15.39:0/2329354590 wait complete. 2023-05-16T13:54:46.897 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.888+0000 7f9e91820640 1 Processor -- start 2023-05-16T13:54:46.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.888+0000 7f9e91820640 1 -- start start 2023-05-16T13:54:46.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.888+0000 7f9e91820640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9e8c06f9f0 0x7f9e8c0b2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:46.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.888+0000 7f9e91820640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e8c0cb810 0x7f9e8c0ae5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:46.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.888+0000 7f9e91820640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9e8c158460 0x7f9e8c0aeb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:46.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.888+0000 7f9e91820640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8c0b2570 con 0x7f9e8c158460 2023-05-16T13:54:46.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.888+0000 7f9e91820640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8c0b2830 con 0x7f9e8c0cb810 2023-05-16T13:54:46.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.888+0000 7f9e91820640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8c0b2b10 con 0x7f9e8c06f9f0 2023-05-16T13:54:46.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.892+0000 7f9e8b7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9e8c158460 0x7f9e8c0aeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:46.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.892+0000 7f9e8b7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9e8c158460 0x7f9e8c0aeb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35068/0 (socket says 172.21.15.39:35068) 2023-05-16T13:54:46.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.892+0000 7f9e8b7fe640 1 -- 172.21.15.39:0/465174084 learned_addr learned my addr 172.21.15.39:0/465174084 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:46.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.892+0000 7f9e83fff640 1 --2- 172.21.15.39:0/465174084 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e8c0cb810 0x7f9e8c0ae5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:46.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.892+0000 7f9e8affd640 1 --2- 172.21.15.39:0/465174084 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9e8c06f9f0 0x7f9e8c0b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:46.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.892+0000 7f9e8b7fe640 1 -- 172.21.15.39:0/465174084 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9e8c06f9f0 msgr2=0x7f9e8c0b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:46.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.892+0000 7f9e8b7fe640 1 --2- 172.21.15.39:0/465174084 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9e8c06f9f0 0x7f9e8c0b2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:46.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.892+0000 7f9e8b7fe640 1 -- 172.21.15.39:0/465174084 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e8c0cb810 msgr2=0x7f9e8c0ae5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:46.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.892+0000 7f9e8b7fe640 1 --2- 172.21.15.39:0/465174084 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e8c0cb810 0x7f9e8c0ae5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:46.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.892+0000 7f9e8b7fe640 1 -- 172.21.15.39:0/465174084 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e740094d0 con 0x7f9e8c158460 2023-05-16T13:54:46.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.892+0000 7f9e8b7fe640 1 --2- 172.21.15.39:0/465174084 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9e8c158460 0x7f9e8c0aeb20 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9e8400c3c0 tx=0x7f9e8400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:46.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.892+0000 7f9e88ff9640 1 -- 172.21.15.39:0/465174084 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e84011790 con 0x7f9e8c158460 2023-05-16T13:54:46.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.892+0000 7f9e88ff9640 1 -- 172.21.15.39:0/465174084 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e840118f0 con 0x7f9e8c158460 2023-05-16T13:54:46.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.892+0000 7f9e91820640 1 -- 172.21.15.39:0/465174084 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e8c0cd5e0 con 0x7f9e8c158460 2023-05-16T13:54:46.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.892+0000 7f9e88ff9640 1 -- 172.21.15.39:0/465174084 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e84011ca0 con 0x7f9e8c158460 2023-05-16T13:54:46.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.892+0000 7f9e91820640 1 -- 172.21.15.39:0/465174084 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e8c0ad9a0 con 0x7f9e8c158460 2023-05-16T13:54:46.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.892+0000 7f9e91820640 1 -- 172.21.15.39:0/465174084 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e8c0cd770 con 0x7f9e8c158460 2023-05-16T13:54:46.902 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.892+0000 7f9e88ff9640 1 -- 172.21.15.39:0/465174084 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9e8401c460 con 0x7f9e8c158460 2023-05-16T13:54:46.902 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.896+0000 7f9e88ff9640 1 --2- 172.21.15.39:0/465174084 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f9e6c066280 0x7f9e6c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:46.902 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.896+0000 7f9e88ff9640 1 -- 172.21.15.39:0/465174084 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9e84083b60 con 0x7f9e8c158460 2023-05-16T13:54:46.902 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.896+0000 7f9e8affd640 1 --2- 172.21.15.39:0/465174084 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f9e6c066280 0x7f9e6c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:46.902 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.896+0000 7f9e8affd640 1 --2- 172.21.15.39:0/465174084 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f9e6c066280 0x7f9e6c068730 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c003ab0 tx=0x7f9e7c009830 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:46.904 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:46.900+0000 7f9e88ff9640 1 -- 172.21.15.39:0/465174084 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f9e84050ff0 con 0x7f9e8c158460 2023-05-16T13:54:47.057 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.052+0000 7f9e91820640 1 -- 172.21.15.39:0/465174084 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9e8c04ed20 con 0x7f9e8c158460 2023-05-16T13:54:47.058 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.052+0000 7f9e88ff9640 1 -- 172.21.15.39:0/465174084 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9e84054610 con 0x7f9e8c158460 2023-05-16T13:54:47.058 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 8 2023-05-16T13:54:47.060 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.052+0000 7f9e91820640 1 -- 172.21.15.39:0/465174084 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f9e6c066280 msgr2=0x7f9e6c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:47.060 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.052+0000 7f9e91820640 1 --2- 172.21.15.39:0/465174084 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f9e6c066280 0x7f9e6c068730 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c003ab0 tx=0x7f9e7c009830 comp rx=0 tx=0).stop 2023-05-16T13:54:47.060 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.052+0000 7f9e91820640 1 -- 172.21.15.39:0/465174084 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9e8c158460 msgr2=0x7f9e8c0aeb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:47.060 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.052+0000 7f9e91820640 1 --2- 172.21.15.39:0/465174084 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9e8c158460 0x7f9e8c0aeb20 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9e8400c3c0 tx=0x7f9e8400c880 comp rx=0 tx=0).stop 2023-05-16T13:54:47.060 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.052+0000 7f9e91820640 1 -- 172.21.15.39:0/465174084 shutdown_connections 2023-05-16T13:54:47.060 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.052+0000 7f9e91820640 1 --2- 172.21.15.39:0/465174084 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9e8c158460 0x7f9e8c0aeb20 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:47.061 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.052+0000 7f9e91820640 1 --2- 172.21.15.39:0/465174084 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9e8c0cb810 0x7f9e8c0ae5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:47.061 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.052+0000 7f9e91820640 1 --2- 172.21.15.39:0/465174084 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f9e6c066280 0x7f9e6c068730 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:47.061 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.052+0000 7f9e91820640 1 --2- 172.21.15.39:0/465174084 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9e8c06f9f0 0x7f9e8c0b2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:47.061 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.052+0000 7f9e91820640 1 -- 172.21.15.39:0/465174084 >> 172.21.15.39:0/465174084 conn(0x7f9e8c06bac0 msgr2=0x7f9e8c06feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:47.061 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.052+0000 7f9e91820640 1 -- 172.21.15.39:0/465174084 shutdown_connections 2023-05-16T13:54:47.061 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.052+0000 7f9e91820640 1 -- 172.21.15.39:0/465174084 wait complete. 2023-05-16T13:54:47.078 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-16T13:54:47.219 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.212+0000 7fd54fc74640 1 Processor -- start 2023-05-16T13:54:47.220 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.212+0000 7fd54fc74640 1 -- start start 2023-05-16T13:54:47.221 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.216+0000 7fd54fc74640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd5480aff50 0x7fd5480b0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:47.221 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.216+0000 7fd54fc74640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd548070420 0x7fd5480708a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:47.221 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.216+0000 7fd54fc74640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5480b08c0 con 0x7fd548158e00 2023-05-16T13:54:47.221 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.216+0000 7fd54fc74640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5480ca030 con 0x7fd5480aff50 2023-05-16T13:54:47.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.216+0000 7fd54fc74640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd54815c890 con 0x7fd548070420 2023-05-16T13:54:47.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.216+0000 7fd54da10640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fd548158e00 0x7fd5480c9530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.39:38908/0 (socket says 172.21.15.39:38908) 2023-05-16T13:54:47.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.216+0000 7fd54da10640 1 -- 172.21.15.39:0/1646681744 learned_addr learned my addr 172.21.15.39:0/1646681744 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:47.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.216+0000 7fd54e211640 1 --2- 172.21.15.39:0/1646681744 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd548070420 0x7fd5480708a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:47.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.216+0000 7fd54d20f640 1 --2- 172.21.15.39:0/1646681744 >> v2:172.21.15.118:3300/0 conn(0x7fd5480aff50 0x7fd5480b0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:47.224 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.216+0000 7fd54d20f640 1 -- 172.21.15.39:0/1646681744 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd548070420 msgr2=0x7fd5480708a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:47.224 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.216+0000 7fd54d20f640 1 --2- 172.21.15.39:0/1646681744 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd548070420 0x7fd5480708a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:47.224 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.216+0000 7fd54d20f640 1 -- 172.21.15.39:0/1646681744 >> v1:172.21.15.118:6789/0 conn(0x7fd548158e00 legacy=0x7fd5480c9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:47.224 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.216+0000 7fd54ca0e640 1 -- 172.21.15.39:0/1646681744 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 53712443 0 0) 0x7fd5480b08c0 con 0x7fd548158e00 2023-05-16T13:54:47.225 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.216+0000 7fd54d20f640 1 -- 172.21.15.39:0/1646681744 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd54815cb70 con 0x7fd5480aff50 2023-05-16T13:54:47.225 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.216+0000 7fd54e211640 1 --2- 172.21.15.39:0/1646681744 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd548070420 0x7fd5480708a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-16T13:54:47.226 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.220+0000 7fd54d20f640 1 --2- 172.21.15.39:0/1646681744 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd5480aff50 0x7fd5480b0380 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd5380097c0 tx=0x7fd53801ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99ae93b842108604 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:47.226 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.220+0000 7fd54ca0e640 1 -- 172.21.15.39:0/1646681744 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5380a8970 con 0x7fd5480aff50 2023-05-16T13:54:47.226 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.220+0000 7fd54ca0e640 1 -- 172.21.15.39:0/1646681744 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5380a8ad0 con 0x7fd5480aff50 2023-05-16T13:54:47.226 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.220+0000 7fd54ca0e640 1 -- 172.21.15.39:0/1646681744 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5380a8e60 con 0x7fd5480aff50 2023-05-16T13:54:47.227 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.220+0000 7fd54fc74640 1 -- 172.21.15.39:0/1646681744 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd5480aff50 msgr2=0x7fd5480b0380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:47.227 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.220+0000 7fd54fc74640 1 --2- 172.21.15.39:0/1646681744 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd5480aff50 0x7fd5480b0380 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd5380097c0 tx=0x7fd53801ec70 comp rx=0 tx=0).stop 2023-05-16T13:54:47.227 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.220+0000 7fd54fc74640 1 -- 172.21.15.39:0/1646681744 shutdown_connections 2023-05-16T13:54:47.227 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.220+0000 7fd54fc74640 1 --2- 172.21.15.39:0/1646681744 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd548070420 0x7fd5480708a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:47.227 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.220+0000 7fd54fc74640 1 --2- 172.21.15.39:0/1646681744 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd5480aff50 0x7fd5480b0380 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:47.228 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.220+0000 7fd54fc74640 1 -- 172.21.15.39:0/1646681744 >> 172.21.15.39:0/1646681744 conn(0x7fd548069a50 msgr2=0x7fd548069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:47.228 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.220+0000 7fd54fc74640 1 -- 172.21.15.39:0/1646681744 shutdown_connections 2023-05-16T13:54:47.228 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.220+0000 7fd54fc74640 1 -- 172.21.15.39:0/1646681744 wait complete. 2023-05-16T13:54:47.228 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.224+0000 7fd54fc74640 1 Processor -- start 2023-05-16T13:54:47.229 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.224+0000 7fd54fc74640 1 -- start start 2023-05-16T13:54:47.230 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.224+0000 7fd54fc74640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd548070420 0x7fd54814a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:47.230 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.224+0000 7fd54fc74640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd5480aff50 0x7fd5480acd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:47.230 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.224+0000 7fd54fc74640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd548158e00 0x7fd5480cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:47.230 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.224+0000 7fd54fc74640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd548157440 con 0x7fd5480aff50 2023-05-16T13:54:47.230 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.224+0000 7fd54fc74640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd54814ae40 con 0x7fd548070420 2023-05-16T13:54:47.230 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.224+0000 7fd54fc74640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5481567c0 con 0x7fd548158e00 2023-05-16T13:54:47.230 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.224+0000 7fd54d20f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd5480aff50 0x7fd5480acd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:47.231 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.224+0000 7fd54d20f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd5480aff50 0x7fd5480acd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35076/0 (socket says 172.21.15.39:35076) 2023-05-16T13:54:47.231 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.224+0000 7fd54d20f640 1 -- 172.21.15.39:0/2887438615 learned_addr learned my addr 172.21.15.39:0/2887438615 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:47.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.224+0000 7fd54da10640 1 --2- 172.21.15.39:0/2887438615 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd548070420 0x7fd54814a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:47.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.224+0000 7fd54e211640 1 --2- 172.21.15.39:0/2887438615 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd548158e00 0x7fd5480cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:47.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.224+0000 7fd54d20f640 1 -- 172.21.15.39:0/2887438615 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd548158e00 msgr2=0x7fd5480cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:47.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.224+0000 7fd54d20f640 1 --2- 172.21.15.39:0/2887438615 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd548158e00 0x7fd5480cdfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:47.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.224+0000 7fd54d20f640 1 -- 172.21.15.39:0/2887438615 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd548070420 msgr2=0x7fd54814a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:47.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.224+0000 7fd54d20f640 1 --2- 172.21.15.39:0/2887438615 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd548070420 0x7fd54814a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:47.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.224+0000 7fd54d20f640 1 -- 172.21.15.39:0/2887438615 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd540009a70 con 0x7fd5480aff50 2023-05-16T13:54:47.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.224+0000 7fd54e211640 1 --2- 172.21.15.39:0/2887438615 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd548158e00 0x7fd5480cdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:54:47.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.224+0000 7fd54d20f640 1 --2- 172.21.15.39:0/2887438615 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd5480aff50 0x7fd5480acd80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd5380097c0 tx=0x7fd53801d4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:47.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.224+0000 7fd53e7fc640 1 -- 172.21.15.39:0/2887438615 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5380b1e00 con 0x7fd5480aff50 2023-05-16T13:54:47.234 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.224+0000 7fd53e7fc640 1 -- 172.21.15.39:0/2887438615 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd538006e20 con 0x7fd5480aff50 2023-05-16T13:54:47.234 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.224+0000 7fd54fc74640 1 -- 172.21.15.39:0/2887438615 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd538009420 con 0x7fd5480aff50 2023-05-16T13:54:47.234 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.224+0000 7fd53e7fc640 1 -- 172.21.15.39:0/2887438615 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd538004230 con 0x7fd5480aff50 2023-05-16T13:54:47.234 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.224+0000 7fd54fc74640 1 -- 172.21.15.39:0/2887438615 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd54815d130 con 0x7fd5480aff50 2023-05-16T13:54:47.235 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.224+0000 7fd54fc74640 1 -- 172.21.15.39:0/2887438615 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd54815ce50 con 0x7fd5480aff50 2023-05-16T13:54:47.235 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.228+0000 7fd53e7fc640 1 -- 172.21.15.39:0/2887438615 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd538004390 con 0x7fd5480aff50 2023-05-16T13:54:47.235 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.228+0000 7fd53e7fc640 1 --2- 172.21.15.39:0/2887438615 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd52c066280 0x7fd52c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:47.235 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.228+0000 7fd53e7fc640 1 -- 172.21.15.39:0/2887438615 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd538121f60 con 0x7fd5480aff50 2023-05-16T13:54:47.236 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.228+0000 7fd54da10640 1 --2- 172.21.15.39:0/2887438615 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd52c066280 0x7fd52c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:47.236 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.228+0000 7fd54da10640 1 --2- 172.21.15.39:0/2887438615 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd52c066280 0x7fd52c068730 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd544007fd0 tx=0x7fd544007d60 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:47.238 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.232+0000 7fd53e7fc640 1 -- 172.21.15.39:0/2887438615 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fd5380ef470 con 0x7fd5480aff50 2023-05-16T13:54:47.393 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.388+0000 7fd54fc74640 1 -- 172.21.15.39:0/2887438615 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd54815ce50 con 0x7fd5480aff50 2023-05-16T13:54:47.393 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.388+0000 7fd53e7fc640 1 -- 172.21.15.39:0/2887438615 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd5380b50a0 con 0x7fd5480aff50 2023-05-16T13:54:47.393 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2023-05-16T13:54:47.395 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.388+0000 7fd54fc74640 1 -- 172.21.15.39:0/2887438615 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd52c066280 msgr2=0x7fd52c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:47.395 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.388+0000 7fd54fc74640 1 --2- 172.21.15.39:0/2887438615 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd52c066280 0x7fd52c068730 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd544007fd0 tx=0x7fd544007d60 comp rx=0 tx=0).stop 2023-05-16T13:54:47.396 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.388+0000 7fd54fc74640 1 -- 172.21.15.39:0/2887438615 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd5480aff50 msgr2=0x7fd5480acd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:47.396 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.388+0000 7fd54fc74640 1 --2- 172.21.15.39:0/2887438615 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd5480aff50 0x7fd5480acd80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd5380097c0 tx=0x7fd53801d4b0 comp rx=0 tx=0).stop 2023-05-16T13:54:47.396 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.388+0000 7fd54fc74640 1 -- 172.21.15.39:0/2887438615 shutdown_connections 2023-05-16T13:54:47.396 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.388+0000 7fd54fc74640 1 --2- 172.21.15.39:0/2887438615 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd52c066280 0x7fd52c068730 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:47.396 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.388+0000 7fd54fc74640 1 --2- 172.21.15.39:0/2887438615 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd548158e00 0x7fd5480cdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:47.396 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.388+0000 7fd54fc74640 1 --2- 172.21.15.39:0/2887438615 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd5480aff50 0x7fd5480acd80 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:47.397 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.388+0000 7fd54fc74640 1 --2- 172.21.15.39:0/2887438615 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd548070420 0x7fd54814a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:47.397 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.388+0000 7fd54fc74640 1 -- 172.21.15.39:0/2887438615 >> 172.21.15.39:0/2887438615 conn(0x7fd548069a50 msgr2=0x7fd5480aee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:47.397 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.388+0000 7fd54fc74640 1 -- 172.21.15.39:0/2887438615 shutdown_connections 2023-05-16T13:54:47.397 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.388+0000 7fd54fc74640 1 -- 172.21.15.39:0/2887438615 wait complete. 2023-05-16T13:54:47.413 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-16T13:54:47.553 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.548+0000 7fe81e295640 1 Processor -- start 2023-05-16T13:54:47.554 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.548+0000 7fe81e295640 1 -- start start 2023-05-16T13:54:47.554 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.548+0000 7fe81e295640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe81806c5a0 0x7fe8180cf610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:47.555 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.548+0000 7fe81e295640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe818071520 con 0x7fe81815b8e0 2023-05-16T13:54:47.555 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.548+0000 7fe81e295640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe81806b370 con 0x7fe8180ccb60 2023-05-16T13:54:47.555 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.548+0000 7fe81e295640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8180cfb50 con 0x7fe81806c5a0 2023-05-16T13:54:47.555 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.548+0000 7fe81c832640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fe81815b8e0 0x7fe81815bd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:41280/0 (socket says 172.21.15.39:41280) 2023-05-16T13:54:47.555 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.548+0000 7fe81c832640 1 -- 172.21.15.39:0/833493808 learned_addr learned my addr 172.21.15.39:0/833493808 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:47.556 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.548+0000 7fe817fff640 1 --2- 172.21.15.39:0/833493808 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe81806c5a0 0x7fe8180cf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:47.556 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.548+0000 7fe816ffd640 1 -- 172.21.15.39:0/833493808 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 612931047 0 0) 0x7fe818071520 con 0x7fe81815b8e0 2023-05-16T13:54:47.556 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.548+0000 7fe816ffd640 1 -- 172.21.15.39:0/833493808 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe800003530 con 0x7fe81815b8e0 2023-05-16T13:54:47.556 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.548+0000 7fe816ffd640 1 -- 172.21.15.39:0/833493808 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1718448081 0 0) 0x7fe81806b370 con 0x7fe8180ccb60 2023-05-16T13:54:47.557 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.548+0000 7fe816ffd640 1 -- 172.21.15.39:0/833493808 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe818071520 con 0x7fe8180ccb60 2023-05-16T13:54:47.557 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.548+0000 7fe817fff640 1 -- 172.21.15.39:0/833493808 >> v1:172.21.15.118:6789/0 conn(0x7fe8180ccb60 legacy=0x7fe81806c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:47.557 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.548+0000 7fe817fff640 1 -- 172.21.15.39:0/833493808 >> v1:172.21.15.39:6789/0 conn(0x7fe81815b8e0 legacy=0x7fe81815bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:47.557 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.548+0000 7fe817fff640 1 -- 172.21.15.39:0/833493808 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe818070f60 con 0x7fe81806c5a0 2023-05-16T13:54:47.559 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.552+0000 7fe817fff640 1 --2- 172.21.15.39:0/833493808 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe81806c5a0 0x7fe8180cf610 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe8080097f0 tx=0x7fe80801c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9fc24fc69d03262 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:47.559 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.552+0000 7fe816ffd640 1 -- 172.21.15.39:0/833493808 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8080aa5f0 con 0x7fe81806c5a0 2023-05-16T13:54:47.559 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.552+0000 7fe816ffd640 1 -- 172.21.15.39:0/833493808 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8080aa750 con 0x7fe81806c5a0 2023-05-16T13:54:47.559 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.552+0000 7fe816ffd640 1 -- 172.21.15.39:0/833493808 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8080aaae0 con 0x7fe81806c5a0 2023-05-16T13:54:47.560 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.552+0000 7fe81e295640 1 -- 172.21.15.39:0/833493808 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe81806c5a0 msgr2=0x7fe8180cf610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:47.560 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.552+0000 7fe81e295640 1 --2- 172.21.15.39:0/833493808 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe81806c5a0 0x7fe8180cf610 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe8080097f0 tx=0x7fe80801c490 comp rx=0 tx=0).stop 2023-05-16T13:54:47.560 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.552+0000 7fe81e295640 1 -- 172.21.15.39:0/833493808 shutdown_connections 2023-05-16T13:54:47.560 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.552+0000 7fe81e295640 1 --2- 172.21.15.39:0/833493808 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe81806c5a0 0x7fe8180cf610 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:47.560 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.552+0000 7fe81e295640 1 -- 172.21.15.39:0/833493808 >> 172.21.15.39:0/833493808 conn(0x7fe8180b14a0 msgr2=0x7fe8180cec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:47.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.552+0000 7fe81e295640 1 -- 172.21.15.39:0/833493808 shutdown_connections 2023-05-16T13:54:47.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.552+0000 7fe81e295640 1 -- 172.21.15.39:0/833493808 wait complete. 2023-05-16T13:54:47.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.556+0000 7fe81e295640 1 Processor -- start 2023-05-16T13:54:47.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.556+0000 7fe81e295640 1 -- start start 2023-05-16T13:54:47.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.556+0000 7fe81e295640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe81806c5a0 0x7fe81806a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:47.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.556+0000 7fe81e295640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe8180ccb60 0x7fe81806a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:47.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.556+0000 7fe81e295640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe81815b8e0 0x7fe8180c3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:47.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.556+0000 7fe81e295640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8180c5500 con 0x7fe81806c5a0 2023-05-16T13:54:47.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.556+0000 7fe81e295640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8181f5ef0 con 0x7fe8180ccb60 2023-05-16T13:54:47.564 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.556+0000 7fe81e295640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8181f6190 con 0x7fe81815b8e0 2023-05-16T13:54:47.564 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.556+0000 7fe817fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe81806c5a0 0x7fe81806a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:47.564 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.556+0000 7fe817fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe81806c5a0 0x7fe81806a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35092/0 (socket says 172.21.15.39:35092) 2023-05-16T13:54:47.564 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.556+0000 7fe817fff640 1 -- 172.21.15.39:0/160179085 learned_addr learned my addr 172.21.15.39:0/160179085 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:47.564 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.556+0000 7fe8177fe640 1 --2- 172.21.15.39:0/160179085 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe8180ccb60 0x7fe81806a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:47.564 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.556+0000 7fe81c832640 1 --2- 172.21.15.39:0/160179085 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe81815b8e0 0x7fe8180c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:47.564 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.556+0000 7fe817fff640 1 -- 172.21.15.39:0/160179085 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe81815b8e0 msgr2=0x7fe8180c3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:47.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.556+0000 7fe817fff640 1 --2- 172.21.15.39:0/160179085 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe81815b8e0 0x7fe8180c3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:47.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.556+0000 7fe817fff640 1 -- 172.21.15.39:0/160179085 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe8180ccb60 msgr2=0x7fe81806a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:47.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.556+0000 7fe817fff640 1 --2- 172.21.15.39:0/160179085 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe8180ccb60 0x7fe81806a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:47.565 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.556+0000 7fe817fff640 1 -- 172.21.15.39:0/160179085 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe808009420 con 0x7fe81806c5a0 2023-05-16T13:54:47.566 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.556+0000 7fe817fff640 1 --2- 172.21.15.39:0/160179085 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe81806c5a0 0x7fe81806a360 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe8080190a0 tx=0x7fe80801acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:47.566 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.556+0000 7fe814ff9640 1 -- 172.21.15.39:0/160179085 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8080be610 con 0x7fe81806c5a0 2023-05-16T13:54:47.566 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.556+0000 7fe814ff9640 1 -- 172.21.15.39:0/160179085 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8080be790 con 0x7fe81806c5a0 2023-05-16T13:54:47.566 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.556+0000 7fe81e295640 1 -- 172.21.15.39:0/160179085 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8180c92b0 con 0x7fe81806c5a0 2023-05-16T13:54:47.566 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.556+0000 7fe814ff9640 1 -- 172.21.15.39:0/160179085 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8080beb40 con 0x7fe81806c5a0 2023-05-16T13:54:47.566 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.556+0000 7fe81e295640 1 -- 172.21.15.39:0/160179085 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe818069e40 con 0x7fe81806c5a0 2023-05-16T13:54:47.567 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.560+0000 7fe81e295640 1 -- 172.21.15.39:0/160179085 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8180caeb0 con 0x7fe81806c5a0 2023-05-16T13:54:47.567 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.560+0000 7fe814ff9640 1 -- 172.21.15.39:0/160179085 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe8080beca0 con 0x7fe81806c5a0 2023-05-16T13:54:47.567 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.560+0000 7fe814ff9640 1 --2- 172.21.15.39:0/160179085 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fe8040662b0 0x7fe804068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:47.568 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.560+0000 7fe814ff9640 1 -- 172.21.15.39:0/160179085 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe8080a7070 con 0x7fe81806c5a0 2023-05-16T13:54:47.568 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.560+0000 7fe8177fe640 1 --2- 172.21.15.39:0/160179085 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fe8040662b0 0x7fe804068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:47.568 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.560+0000 7fe8177fe640 1 --2- 172.21.15.39:0/160179085 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fe8040662b0 0x7fe804068760 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe81815b8b0 tx=0x7fe80c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:47.571 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.564+0000 7fe814ff9640 1 -- 172.21.15.39:0/160179085 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fe8080ebc90 con 0x7fe81806c5a0 2023-05-16T13:54:47.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.720+0000 7fe81e295640 1 -- 172.21.15.39:0/160179085 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe818073c90 con 0x7fe81806c5a0 2023-05-16T13:54:47.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.720+0000 7fe814ff9640 1 -- 172.21.15.39:0/160179085 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe8080ef2b0 con 0x7fe81806c5a0 2023-05-16T13:54:47.726 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 64 2023-05-16T13:54:47.727 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.720+0000 7fe81e295640 1 -- 172.21.15.39:0/160179085 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fe8040662b0 msgr2=0x7fe804068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:47.728 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.720+0000 7fe81e295640 1 --2- 172.21.15.39:0/160179085 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fe8040662b0 0x7fe804068760 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe81815b8b0 tx=0x7fe80c009040 comp rx=0 tx=0).stop 2023-05-16T13:54:47.728 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.720+0000 7fe81e295640 1 -- 172.21.15.39:0/160179085 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe81806c5a0 msgr2=0x7fe81806a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:47.728 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.720+0000 7fe81e295640 1 --2- 172.21.15.39:0/160179085 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe81806c5a0 0x7fe81806a360 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe8080190a0 tx=0x7fe80801acd0 comp rx=0 tx=0).stop 2023-05-16T13:54:47.728 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.720+0000 7fe81e295640 1 -- 172.21.15.39:0/160179085 shutdown_connections 2023-05-16T13:54:47.729 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.720+0000 7fe81e295640 1 --2- 172.21.15.39:0/160179085 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fe8040662b0 0x7fe804068760 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:47.729 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.720+0000 7fe81e295640 1 --2- 172.21.15.39:0/160179085 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe81815b8e0 0x7fe8180c3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:47.729 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.720+0000 7fe81e295640 1 --2- 172.21.15.39:0/160179085 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe8180ccb60 0x7fe81806a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:47.730 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.720+0000 7fe81e295640 1 --2- 172.21.15.39:0/160179085 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe81806c5a0 0x7fe81806a360 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:47.730 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.720+0000 7fe81e295640 1 -- 172.21.15.39:0/160179085 >> 172.21.15.39:0/160179085 conn(0x7fe8180b14a0 msgr2=0x7fe8180ca000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:47.730 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.720+0000 7fe81e295640 1 -- 172.21.15.39:0/160179085 shutdown_connections 2023-05-16T13:54:47.730 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.720+0000 7fe81e295640 1 -- 172.21.15.39:0/160179085 wait complete. 2023-05-16T13:54:47.745 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-16T13:54:47.883 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.876+0000 7fced33a2640 1 Processor -- start 2023-05-16T13:54:47.883 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.876+0000 7fced33a2640 1 -- start start 2023-05-16T13:54:47.884 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.876+0000 7fced33a2640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcecc1598b0 0x7fcecc15cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:47.884 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.880+0000 7fced33a2640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcecc159c80 con 0x7fcecc0b4b00 2023-05-16T13:54:47.885 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.880+0000 7fced33a2640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcecc0ccdd0 con 0x7fcecc0cf000 2023-05-16T13:54:47.885 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.880+0000 7fced33a2640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcecc15d270 con 0x7fcecc1598b0 2023-05-16T13:54:47.885 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.880+0000 7fced1b9f640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fcecc0b4b00 0x7fcecc0d01b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:41282/0 (socket says 172.21.15.39:41282) 2023-05-16T13:54:47.885 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.880+0000 7fced1b9f640 1 -- 172.21.15.39:0/2899089965 learned_addr learned my addr 172.21.15.39:0/2899089965 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:47.886 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.880+0000 7fced23a0640 1 --2- 172.21.15.39:0/2899089965 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcecc1598b0 0x7fcecc15cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:47.887 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.880+0000 7fced139e640 1 -- 172.21.15.39:0/2899089965 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2743402127 0 0) 0x7fcecc159c80 con 0x7fcecc0b4b00 2023-05-16T13:54:47.887 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.880+0000 7fced139e640 1 -- 172.21.15.39:0/2899089965 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fceb8003530 con 0x7fcecc0b4b00 2023-05-16T13:54:47.887 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.880+0000 7fced139e640 1 -- 172.21.15.39:0/2899089965 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3624211630 0 0) 0x7fceb8003530 con 0x7fcecc0b4b00 2023-05-16T13:54:47.887 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.880+0000 7fced139e640 1 -- 172.21.15.39:0/2899089965 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcecc1598b0 msgr2=0x7fcecc15cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:47.887 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.880+0000 7fced139e640 1 --2- 172.21.15.39:0/2899089965 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcecc1598b0 0x7fcecc15cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:47.887 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.880+0000 7fced139e640 1 -- 172.21.15.39:0/2899089965 >> v1:172.21.15.118:6789/0 conn(0x7fcecc0cf000 legacy=0x7fcecc0d2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:47.887 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.880+0000 7fced139e640 1 -- 172.21.15.39:0/2899089965 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcecc0cd0b0 con 0x7fcecc0b4b00 2023-05-16T13:54:47.888 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.880+0000 7fced139e640 1 -- 172.21.15.39:0/2899089965 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1738805496 0 0) 0x7fcebc001680 con 0x7fcecc0b4b00 2023-05-16T13:54:47.888 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.880+0000 7fced139e640 1 -- 172.21.15.39:0/2899089965 >> v1:172.21.15.39:6789/0 conn(0x7fcecc0b4b00 legacy=0x7fcecc0d01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:47.888 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.880+0000 7fced139e640 1 --2- 172.21.15.39:0/2899089965 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcecc1598b0 0x7fceb8003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:47.888 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.880+0000 7fced139e640 1 --2- 172.21.15.39:0/2899089965 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fceb8003f60 0x7fceb80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:47.888 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.880+0000 7fced139e640 1 --2- 172.21.15.39:0/2899089965 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fceb8004d10 0x7fceb8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:47.888 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.880+0000 7fced139e640 1 -- 172.21.15.39:0/2899089965 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcecc15d270 con 0x7fceb8003f60 2023-05-16T13:54:47.888 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.880+0000 7fced139e640 1 -- 172.21.15.39:0/2899089965 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb800ba40 con 0x7fceb8004d10 2023-05-16T13:54:47.889 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.880+0000 7fced139e640 1 -- 172.21.15.39:0/2899089965 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceb800bc00 con 0x7fcecc1598b0 2023-05-16T13:54:47.889 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.880+0000 7fced1b9f640 1 --2- 172.21.15.39:0/2899089965 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fceb8003f60 0x7fceb80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:47.889 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.880+0000 7fced23a0640 1 --2- 172.21.15.39:0/2899089965 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcecc1598b0 0x7fceb8003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:47.889 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.880+0000 7fced2ba1640 1 --2- 172.21.15.39:0/2899089965 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fceb8004d10 0x7fceb8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:47.889 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.880+0000 7fced1b9f640 1 -- 172.21.15.39:0/2899089965 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcecc1598b0 msgr2=0x7fceb8003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:47.889 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.880+0000 7fced1b9f640 1 --2- 172.21.15.39:0/2899089965 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcecc1598b0 0x7fceb8003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:47.889 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.880+0000 7fced1b9f640 1 -- 172.21.15.39:0/2899089965 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fceb8004d10 msgr2=0x7fceb8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:47.890 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.880+0000 7fced1b9f640 1 --2- 172.21.15.39:0/2899089965 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fceb8004d10 0x7fceb8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:47.890 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.880+0000 7fced1b9f640 1 -- 172.21.15.39:0/2899089965 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb8003530 con 0x7fceb8003f60 2023-05-16T13:54:47.890 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.880+0000 7fced2ba1640 1 --2- 172.21.15.39:0/2899089965 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fceb8004d10 0x7fceb8005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:54:47.891 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.884+0000 7fced1b9f640 1 --2- 172.21.15.39:0/2899089965 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fceb8003f60 0x7fceb80047d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fcebc00c160 tx=0x7fcebc01cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c00c4f5fd043614 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:47.891 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.884+0000 7fced139e640 1 -- 172.21.15.39:0/2899089965 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcebc005ae0 con 0x7fceb8003f60 2023-05-16T13:54:47.891 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.884+0000 7fced139e640 1 -- 172.21.15.39:0/2899089965 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcebc005c60 con 0x7fceb8003f60 2023-05-16T13:54:47.891 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.884+0000 7fced139e640 1 -- 172.21.15.39:0/2899089965 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcebc0072b0 con 0x7fceb8003f60 2023-05-16T13:54:47.891 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.884+0000 7fced33a2640 1 -- 172.21.15.39:0/2899089965 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fceb8003f60 msgr2=0x7fceb80047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:47.892 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.884+0000 7fced33a2640 1 --2- 172.21.15.39:0/2899089965 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fceb8003f60 0x7fceb80047d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fcebc00c160 tx=0x7fcebc01cb80 comp rx=0 tx=0).stop 2023-05-16T13:54:47.892 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.884+0000 7fced2ba1640 1 -- 172.21.15.39:0/2899089965 reap_dead start 2023-05-16T13:54:47.892 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.884+0000 7fced33a2640 1 -- 172.21.15.39:0/2899089965 shutdown_connections 2023-05-16T13:54:47.892 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.884+0000 7fced33a2640 1 -- 172.21.15.39:0/2899089965 >> 172.21.15.39:0/2899089965 conn(0x7fcecc06aad0 msgr2=0x7fcecc06aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:47.892 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.884+0000 7fced33a2640 1 -- 172.21.15.39:0/2899089965 shutdown_connections 2023-05-16T13:54:47.892 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.884+0000 7fced33a2640 1 -- 172.21.15.39:0/2899089965 wait complete. 2023-05-16T13:54:47.894 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.884+0000 7fced33a2640 1 Processor -- start 2023-05-16T13:54:47.894 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.884+0000 7fced33a2640 1 -- start start 2023-05-16T13:54:47.894 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.888+0000 7fced33a2640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fceb8003f60 0x7fcecc15b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:47.894 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.888+0000 7fced33a2640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcecc0b16a0 0x7fcecc0d0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:47.894 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.888+0000 7fced33a2640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcecc150250 0x7fcecc0d1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:47.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.888+0000 7fced33a2640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcecc0b1bf0 con 0x7fcecc150250 2023-05-16T13:54:47.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.888+0000 7fced33a2640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcecc0b1ed0 con 0x7fceb8003f60 2023-05-16T13:54:47.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.888+0000 7fced33a2640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcecc152680 con 0x7fcecc0b16a0 2023-05-16T13:54:47.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.888+0000 7fced2ba1640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcecc150250 0x7fcecc0d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:47.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.888+0000 7fced2ba1640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcecc150250 0x7fcecc0d1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35114/0 (socket says 172.21.15.39:35114) 2023-05-16T13:54:47.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.888+0000 7fced2ba1640 1 -- 172.21.15.39:0/1165183119 learned_addr learned my addr 172.21.15.39:0/1165183119 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:47.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.888+0000 7fced1b9f640 1 --2- 172.21.15.39:0/1165183119 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcecc0b16a0 0x7fcecc0d0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:47.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.888+0000 7fced23a0640 1 --2- 172.21.15.39:0/1165183119 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fceb8003f60 0x7fcecc15b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:47.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.888+0000 7fced2ba1640 1 -- 172.21.15.39:0/1165183119 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcecc0b16a0 msgr2=0x7fcecc0d0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:47.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.888+0000 7fced2ba1640 1 --2- 172.21.15.39:0/1165183119 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcecc0b16a0 0x7fcecc0d0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:47.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.888+0000 7fced2ba1640 1 -- 172.21.15.39:0/1165183119 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fceb8003f60 msgr2=0x7fcecc15b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:47.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.888+0000 7fced2ba1640 1 --2- 172.21.15.39:0/1165183119 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fceb8003f60 0x7fcecc15b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:47.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.888+0000 7fced2ba1640 1 -- 172.21.15.39:0/1165183119 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcecc0b4f30 con 0x7fcecc150250 2023-05-16T13:54:47.897 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.888+0000 7fced2ba1640 1 --2- 172.21.15.39:0/1165183119 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcecc150250 0x7fcecc0d1060 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fcecc0d3680 tx=0x7fcec400e770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:47.897 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.888+0000 7fcec2ffd640 1 -- 172.21.15.39:0/1165183119 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec400edb0 con 0x7fcecc150250 2023-05-16T13:54:47.897 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.888+0000 7fcec2ffd640 1 -- 172.21.15.39:0/1165183119 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcec4006b60 con 0x7fcecc150250 2023-05-16T13:54:47.897 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.888+0000 7fcec2ffd640 1 -- 172.21.15.39:0/1165183119 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec4003980 con 0x7fcecc150250 2023-05-16T13:54:47.897 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.888+0000 7fced33a2640 1 -- 172.21.15.39:0/1165183119 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcecc0ce790 con 0x7fcecc150250 2023-05-16T13:54:47.897 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.888+0000 7fced33a2640 1 -- 172.21.15.39:0/1165183119 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcecc0cf400 con 0x7fcecc150250 2023-05-16T13:54:47.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.888+0000 7fced33a2640 1 -- 172.21.15.39:0/1165183119 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcecc152b60 con 0x7fcecc150250 2023-05-16T13:54:47.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.888+0000 7fcec2ffd640 1 -- 172.21.15.39:0/1165183119 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcec4003ae0 con 0x7fcecc150250 2023-05-16T13:54:47.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.892+0000 7fcec2ffd640 1 --2- 172.21.15.39:0/1165183119 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fceb0066280 0x7fceb0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:47.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.892+0000 7fcec2ffd640 1 -- 172.21.15.39:0/1165183119 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcec40825d0 con 0x7fcecc150250 2023-05-16T13:54:47.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.892+0000 7fced23a0640 1 --2- 172.21.15.39:0/1165183119 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fceb0066280 0x7fceb0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:47.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.892+0000 7fced23a0640 1 --2- 172.21.15.39:0/1165183119 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fceb0066280 0x7fceb0068730 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fcec8009be0 tx=0x7fcec8009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:47.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:47.896+0000 7fcec2ffd640 1 -- 172.21.15.39:0/1165183119 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fcec404fa60 con 0x7fcecc150250 2023-05-16T13:54:48.055 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.048+0000 7fced33a2640 1 -- 172.21.15.39:0/1165183119 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcecc04ed20 con 0x7fcecc150250 2023-05-16T13:54:48.056 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.052+0000 7fcec2ffd640 1 -- 172.21.15.39:0/1165183119 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18279 (secure 0 0 0) 0x7fcec4053080 con 0x7fcecc150250 2023-05-16T13:54:48.057 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:54:48.057 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":24,"fsid":"9c1e210b-c515-4ea4-a065-397956895c68","created":"2023-05-16T13:53:48.955290+0000","modified":"2023-05-16T13:54:16.194544+0000","last_up_change":"2023-05-16T13:54:01.722051+0000","last_in_change":"2023-05-16T13:53:52.331336+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-16T13:54:00.885009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-16T13:54:08.327895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-16T13:54:12.864823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-16T13:54:14.180225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4ce0f0ba-c4bf-4405-8c95-d2e9a62878ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6809","nonce":3462013698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6811","nonce":3462013698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6815","nonce":3462013698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6813","nonce":3462013698}]},"public_addr":"172.21.15.39:6809/3462013698","cluster_addr":"172.21.15.39:6811/3462013698","heartbeat_back_addr":"172.21.15.39:6815/3462013698","heartbeat_front_addr":"172.21.15.39:6813/3462013698","state":["exists","up"]},{"osd":1,"uuid":"53fdc1ac-2473-472d-af32-2760fdf6e476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6801","nonce":2829970892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6803","nonce":2829970892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6807","nonce":2829970892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6805","nonce":2829970892}]},"public_addr":"172.21.15.39:6801/2829970892","cluster_addr":"172.21.15.39:6803/2829970892","heartbeat_back_addr":"172.21.15.39:6807/2829970892","heartbeat_front_addr":"172.21.15.39:6805/2829970892","state":["exists","up"]},{"osd":2,"uuid":"0b92d770-7030-42fa-a19f-4f7f1ac113c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6817","nonce":3888067413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6819","nonce":3888067413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6823","nonce":3888067413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6821","nonce":3888067413}]},"public_addr":"172.21.15.39:6817/3888067413","cluster_addr":"172.21.15.39:6819/3888067413","heartbeat_back_addr":"172.21.15.39:6823/3888067413","heartbeat_front_addr":"172.21.15.39:6821/3888067413","state":["exists","up"]},{"osd":3,"uuid":"000d9506-cbb2-4017-b875-deca579860ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6825","nonce":405003958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6827","nonce":405003958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6831","nonce":405003958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6829","nonce":405003958}]},"public_addr":"172.21.15.39:6825/405003958","cluster_addr":"172.21.15.39:6827/405003958","heartbeat_back_addr":"172.21.15.39:6831/405003958","heartbeat_front_addr":"172.21.15.39:6829/405003958","state":["exists","up"]},{"osd":4,"uuid":"70f0dacb-e960-40c5-bf6a-183e52bbe2ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6801","nonce":3895278838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6805","nonce":3895278838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6813","nonce":3895278838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6809","nonce":3895278838}]},"public_addr":"172.21.15.118:6801/3895278838","cluster_addr":"172.21.15.118:6805/3895278838","heartbeat_back_addr":"172.21.15.118:6813/3895278838","heartbeat_front_addr":"172.21.15.118:6809/3895278838","state":["exists","up"]},{"osd":5,"uuid":"756feb54-c3ae-4a2a-8f74-85c291ba707c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6804","nonce":3513592808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6808","nonce":3513592808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6815","nonce":3513592808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6812","nonce":3513592808}]},"public_addr":"172.21.15.118:6804/3513592808","cluster_addr":"172.21.15.118:6808/3513592808","heartbeat_back_addr":"172.21.15.118:6815/3513592808","heartbeat_front_addr":"172.21.15.118:6812/3513592808","state":["exists","up"]},{"osd":6,"uuid":"c4a982c1-f497-4b0f-8a23-c77372e4621e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6824","nonce":1863656053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6827","nonce":1863656053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6831","nonce":1863656053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6829","nonce":1863656053}]},"public_addr":"172.21.15.118:6824/1863656053","cluster_addr":"172.21.15.118:6827/1863656053","heartbeat_back_addr":"172.21.15.118:6831/1863656053","heartbeat_front_addr":"172.21.15.118:6829/1863656053","state":["exists","up"]},{"osd":7,"uuid":"6f2888aa-a7ac-4e26-9159-e31817934f44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6817","nonce":3636642904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6819","nonce":3636642904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6825","nonce":3636642904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6821","nonce":3636642904}]},"public_addr":"172.21.15.118:6817/3636642904","cluster_addr":"172.21.15.118:6819/3636642904","heartbeat_back_addr":"172.21.15.118:6825/3636642904","heartbeat_front_addr":"172.21.15.118:6821/3636642904","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.717636+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.724036+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.739144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:58.079275+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:58.073921+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.930466+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.987813+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.941098+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-16T13:54:48.059 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.052+0000 7fced33a2640 1 -- 172.21.15.39:0/1165183119 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fceb0066280 msgr2=0x7fceb0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:48.059 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.052+0000 7fced33a2640 1 --2- 172.21.15.39:0/1165183119 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fceb0066280 0x7fceb0068730 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fcec8009be0 tx=0x7fcec8009190 comp rx=0 tx=0).stop 2023-05-16T13:54:48.059 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.052+0000 7fced33a2640 1 -- 172.21.15.39:0/1165183119 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcecc150250 msgr2=0x7fcecc0d1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:48.059 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.052+0000 7fced33a2640 1 --2- 172.21.15.39:0/1165183119 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcecc150250 0x7fcecc0d1060 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fcecc0d3680 tx=0x7fcec400e770 comp rx=0 tx=0).stop 2023-05-16T13:54:48.059 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.052+0000 7fced33a2640 1 -- 172.21.15.39:0/1165183119 shutdown_connections 2023-05-16T13:54:48.060 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.052+0000 7fced33a2640 1 --2- 172.21.15.39:0/1165183119 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fceb0066280 0x7fceb0068730 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:48.060 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.052+0000 7fced33a2640 1 --2- 172.21.15.39:0/1165183119 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcecc0b16a0 0x7fcecc0d0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:48.060 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.052+0000 7fced33a2640 1 --2- 172.21.15.39:0/1165183119 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcecc150250 0x7fcecc0d1060 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:48.060 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.052+0000 7fced33a2640 1 --2- 172.21.15.39:0/1165183119 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fceb8003f60 0x7fcecc15b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:48.060 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.052+0000 7fced33a2640 1 -- 172.21.15.39:0/1165183119 >> 172.21.15.39:0/1165183119 conn(0x7fcecc06aad0 msgr2=0x7fcecc15a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:48.060 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.052+0000 7fced33a2640 1 -- 172.21.15.39:0/1165183119 shutdown_connections 2023-05-16T13:54:48.061 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.052+0000 7fced33a2640 1 -- 172.21.15.39:0/1165183119 wait complete. 2023-05-16T13:54:48.077 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-16T13:54:00.885009+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-16T13:54:08.327895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-16T13:54:12.864823+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-16T13:54:14.180225+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-16T13:54:48.078 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-16T13:54:48.218 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.212+0000 7fc84a3a2640 1 Processor -- start 2023-05-16T13:54:48.218 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.212+0000 7fc84a3a2640 1 -- start start 2023-05-16T13:54:48.219 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.212+0000 7fc84a3a2640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc8440cf080 0x7fc84415d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:48.219 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.212+0000 7fc84a3a2640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc84415c360 0x7fc8440cf450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:48.219 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.212+0000 7fc84a3a2640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc8440d0570 0x7fc84415fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:48.219 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.212+0000 7fc84a3a2640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8440cd3b0 con 0x7fc8440cf080 2023-05-16T13:54:48.219 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.212+0000 7fc84a3a2640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc84415d6e0 con 0x7fc84415c360 2023-05-16T13:54:48.220 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.212+0000 7fc84a3a2640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8440cf990 con 0x7fc8440d0570 2023-05-16T13:54:48.220 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.212+0000 7fc8493a0640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc8440cf080 0x7fc84415d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:48.221 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.212+0000 7fc8493a0640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc8440cf080 0x7fc84415d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35130/0 (socket says 172.21.15.39:35130) 2023-05-16T13:54:48.221 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.212+0000 7fc8493a0640 1 -- 172.21.15.39:0/604952095 learned_addr learned my addr 172.21.15.39:0/604952095 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:48.221 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.212+0000 7fc848b9f640 1 --2- 172.21.15.39:0/604952095 >> v2:172.21.15.118:3300/0 conn(0x7fc84415c360 0x7fc8440cf450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:48.221 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.212+0000 7fc849ba1640 1 --2- 172.21.15.39:0/604952095 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc8440d0570 0x7fc84415fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:48.221 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.212+0000 7fc8493a0640 1 -- 172.21.15.39:0/604952095 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc8440d0570 msgr2=0x7fc84415fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:48.221 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.212+0000 7fc8493a0640 1 --2- 172.21.15.39:0/604952095 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc8440d0570 0x7fc84415fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:48.221 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.212+0000 7fc8493a0640 1 -- 172.21.15.39:0/604952095 >> v2:172.21.15.118:3300/0 conn(0x7fc84415c360 msgr2=0x7fc8440cf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:48.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.212+0000 7fc8493a0640 1 --2- 172.21.15.39:0/604952095 >> v2:172.21.15.118:3300/0 conn(0x7fc84415c360 0x7fc8440cf450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:48.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.212+0000 7fc8493a0640 1 -- 172.21.15.39:0/604952095 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8440d0aa0 con 0x7fc8440cf080 2023-05-16T13:54:48.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.212+0000 7fc849ba1640 1 --2- 172.21.15.39:0/604952095 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc8440d0570 0x7fc84415fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-16T13:54:48.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.216+0000 7fc8493a0640 1 --2- 172.21.15.39:0/604952095 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc8440cf080 0x7fc84415d1a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc84408bb10 tx=0x7fc84001c120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b466756613b3e7b8 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:48.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.216+0000 7fc83bfff640 1 -- 172.21.15.39:0/604952095 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8400ab600 con 0x7fc8440cf080 2023-05-16T13:54:48.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.216+0000 7fc83bfff640 1 -- 172.21.15.39:0/604952095 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8400a7050 con 0x7fc8440cf080 2023-05-16T13:54:48.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.216+0000 7fc83bfff640 1 -- 172.21.15.39:0/604952095 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8400ab980 con 0x7fc8440cf080 2023-05-16T13:54:48.224 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.216+0000 7fc84a3a2640 1 -- 172.21.15.39:0/604952095 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc8440cf080 msgr2=0x7fc84415d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:48.224 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.216+0000 7fc84a3a2640 1 --2- 172.21.15.39:0/604952095 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc8440cf080 0x7fc84415d1a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc84408bb10 tx=0x7fc84001c120 comp rx=0 tx=0).stop 2023-05-16T13:54:48.225 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.216+0000 7fc84a3a2640 1 -- 172.21.15.39:0/604952095 shutdown_connections 2023-05-16T13:54:48.225 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.216+0000 7fc84a3a2640 1 --2- 172.21.15.39:0/604952095 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc8440d0570 0x7fc84415fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:48.225 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.216+0000 7fc84a3a2640 1 --2- 172.21.15.39:0/604952095 >> v2:172.21.15.118:3300/0 conn(0x7fc84415c360 0x7fc8440cf450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:48.225 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.216+0000 7fc84a3a2640 1 --2- 172.21.15.39:0/604952095 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc8440cf080 0x7fc84415d1a0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:48.225 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.216+0000 7fc84a3a2640 1 -- 172.21.15.39:0/604952095 >> 172.21.15.39:0/604952095 conn(0x7fc844071aa0 msgr2=0x7fc84409b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:48.225 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.216+0000 7fc84a3a2640 1 -- 172.21.15.39:0/604952095 shutdown_connections 2023-05-16T13:54:48.226 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.216+0000 7fc84a3a2640 1 -- 172.21.15.39:0/604952095 wait complete. 2023-05-16T13:54:48.227 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.220+0000 7fc84a3a2640 1 Processor -- start 2023-05-16T13:54:48.227 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.220+0000 7fc84a3a2640 1 -- start start 2023-05-16T13:54:48.228 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.220+0000 7fc84a3a2640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc8440cf080 0x7fc84414e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:48.228 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.220+0000 7fc84a3a2640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc8440d0570 0x7fc84406bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:48.228 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.220+0000 7fc84a3a2640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc84415c360 0x7fc84406c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:48.228 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.220+0000 7fc84a3a2640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc84414eee0 con 0x7fc84415c360 2023-05-16T13:54:48.228 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.220+0000 7fc84a3a2640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc84414f040 con 0x7fc8440cf080 2023-05-16T13:54:48.228 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.220+0000 7fc84a3a2640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8440b82d0 con 0x7fc8440d0570 2023-05-16T13:54:48.229 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.220+0000 7fc849ba1640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc84415c360 0x7fc84406c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:48.229 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.220+0000 7fc849ba1640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc84415c360 0x7fc84406c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35140/0 (socket says 172.21.15.39:35140) 2023-05-16T13:54:48.229 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.220+0000 7fc849ba1640 1 -- 172.21.15.39:0/689246738 learned_addr learned my addr 172.21.15.39:0/689246738 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:48.229 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.220+0000 7fc848b9f640 1 --2- 172.21.15.39:0/689246738 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc8440d0570 0x7fc84406bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:48.229 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.220+0000 7fc8493a0640 1 --2- 172.21.15.39:0/689246738 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc8440cf080 0x7fc84414e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:48.229 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.220+0000 7fc849ba1640 1 -- 172.21.15.39:0/689246738 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc8440d0570 msgr2=0x7fc84406bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:48.229 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.220+0000 7fc849ba1640 1 --2- 172.21.15.39:0/689246738 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc8440d0570 0x7fc84406bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:48.230 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.220+0000 7fc849ba1640 1 -- 172.21.15.39:0/689246738 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc8440cf080 msgr2=0x7fc84414e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:48.230 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.220+0000 7fc849ba1640 1 --2- 172.21.15.39:0/689246738 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc8440cf080 0x7fc84414e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:48.230 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.220+0000 7fc849ba1640 1 -- 172.21.15.39:0/689246738 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc840009480 con 0x7fc84415c360 2023-05-16T13:54:48.230 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.220+0000 7fc849ba1640 1 --2- 172.21.15.39:0/689246738 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc84415c360 0x7fc84406c0a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc83c00ce20 tx=0x7fc83c00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:48.231 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.220+0000 7fc839ffb640 1 -- 172.21.15.39:0/689246738 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83c003ba0 con 0x7fc84415c360 2023-05-16T13:54:48.231 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.220+0000 7fc839ffb640 1 -- 172.21.15.39:0/689246738 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc83c003d20 con 0x7fc84415c360 2023-05-16T13:54:48.231 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.220+0000 7fc84a3a2640 1 -- 172.21.15.39:0/689246738 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8440cd840 con 0x7fc84415c360 2023-05-16T13:54:48.231 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.220+0000 7fc839ffb640 1 -- 172.21.15.39:0/689246738 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83c00d880 con 0x7fc84415c360 2023-05-16T13:54:48.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.220+0000 7fc84a3a2640 1 -- 172.21.15.39:0/689246738 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8440d0d80 con 0x7fc84415c360 2023-05-16T13:54:48.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.224+0000 7fc84a3a2640 1 -- 172.21.15.39:0/689246738 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8440cd9d0 con 0x7fc84415c360 2023-05-16T13:54:48.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.224+0000 7fc839ffb640 1 -- 172.21.15.39:0/689246738 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc83c00d9e0 con 0x7fc84415c360 2023-05-16T13:54:48.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.224+0000 7fc839ffb640 1 --2- 172.21.15.39:0/689246738 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc828066280 0x7fc828068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:48.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.224+0000 7fc839ffb640 1 -- 172.21.15.39:0/689246738 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc83c084540 con 0x7fc84415c360 2023-05-16T13:54:48.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.224+0000 7fc8493a0640 1 --2- 172.21.15.39:0/689246738 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc828066280 0x7fc828068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:48.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.224+0000 7fc8493a0640 1 --2- 172.21.15.39:0/689246738 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc828066280 0x7fc828068730 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc8400ad000 tx=0x7fc8400a6000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:48.234 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.228+0000 7fc839ffb640 1 -- 172.21.15.39:0/689246738 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fc83c051a60 con 0x7fc84415c360 2023-05-16T13:54:48.388 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.380+0000 7fc84a3a2640 1 -- 172.21.15.39:0/689246738 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc84404ed20 con 0x7fc84415c360 2023-05-16T13:54:48.389 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.384+0000 7fc839ffb640 1 -- 172.21.15.39:0/689246738 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc83c055080 con 0x7fc84415c360 2023-05-16T13:54:48.389 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2023-05-16T13:54:48.390 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.384+0000 7fc84a3a2640 1 -- 172.21.15.39:0/689246738 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc828066280 msgr2=0x7fc828068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:48.390 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.384+0000 7fc84a3a2640 1 --2- 172.21.15.39:0/689246738 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc828066280 0x7fc828068730 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc8400ad000 tx=0x7fc8400a6000 comp rx=0 tx=0).stop 2023-05-16T13:54:48.390 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.384+0000 7fc84a3a2640 1 -- 172.21.15.39:0/689246738 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc84415c360 msgr2=0x7fc84406c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:48.391 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.384+0000 7fc84a3a2640 1 --2- 172.21.15.39:0/689246738 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc84415c360 0x7fc84406c0a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc83c00ce20 tx=0x7fc83c00a710 comp rx=0 tx=0).stop 2023-05-16T13:54:48.391 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.384+0000 7fc84a3a2640 1 -- 172.21.15.39:0/689246738 shutdown_connections 2023-05-16T13:54:48.391 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.384+0000 7fc84a3a2640 1 --2- 172.21.15.39:0/689246738 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc828066280 0x7fc828068730 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:48.391 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.384+0000 7fc84a3a2640 1 --2- 172.21.15.39:0/689246738 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc8440d0570 0x7fc84406bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:48.392 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.384+0000 7fc84a3a2640 1 --2- 172.21.15.39:0/689246738 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc84415c360 0x7fc84406c0a0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:48.392 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.384+0000 7fc84a3a2640 1 --2- 172.21.15.39:0/689246738 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc8440cf080 0x7fc84414e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:48.392 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.384+0000 7fc84a3a2640 1 -- 172.21.15.39:0/689246738 >> 172.21.15.39:0/689246738 conn(0x7fc844071aa0 msgr2=0x7fc844154c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:48.392 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.384+0000 7fc84a3a2640 1 -- 172.21.15.39:0/689246738 shutdown_connections 2023-05-16T13:54:48.392 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.384+0000 7fc84a3a2640 1 -- 172.21.15.39:0/689246738 wait complete. 2023-05-16T13:54:48.409 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-16T13:54:48.550 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.544+0000 7f56818c3640 1 Processor -- start 2023-05-16T13:54:48.550 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.544+0000 7f56818c3640 1 -- start start 2023-05-16T13:54:48.551 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.544+0000 7f56818c3640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f567c0d0410 0x7f567c0d0860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:48.551 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.544+0000 7f56818c3640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f567c0af490 0x7f567c0af8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:48.551 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.544+0000 7f56818c3640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f567c0d0da0 con 0x7f567c0b10a0 2023-05-16T13:54:48.551 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.544+0000 7f56818c3640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f567c06c610 con 0x7f567c0af490 2023-05-16T13:54:48.552 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.544+0000 7f56818c3640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f567c06caa0 con 0x7f567c0d0410 2023-05-16T13:54:48.552 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.544+0000 7f5673fff640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f567c0d0410 0x7f567c0d0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:48.553 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.544+0000 7f567affd640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f567c0b10a0 0x7f567c0d2990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.39:38942/0 (socket says 172.21.15.39:38942) 2023-05-16T13:54:48.553 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.544+0000 7f5673fff640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f567c0d0410 0x7f567c0d0860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.39:46730/0 (socket says 172.21.15.39:46730) 2023-05-16T13:54:48.553 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.544+0000 7f567affd640 1 -- 172.21.15.39:0/2374828322 learned_addr learned my addr 172.21.15.39:0/2374828322 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:48.553 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.544+0000 7f567b7fe640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f567c0af490 0x7f567c0af8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:48.553 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.544+0000 7f567b7fe640 1 -- 172.21.15.39:0/2374828322 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f567c0d0410 msgr2=0x7f567c0d0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:48.553 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.544+0000 7f567b7fe640 1 --2- 172.21.15.39:0/2374828322 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f567c0d0410 0x7f567c0d0860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:48.553 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.544+0000 7f567a7fc640 1 -- 172.21.15.39:0/2374828322 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1279129783 0 0) 0x7f566c001120 con 0x7f567c0b10a0 2023-05-16T13:54:48.553 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.544+0000 7f567b7fe640 1 -- 172.21.15.39:0/2374828322 >> v1:172.21.15.118:6789/0 conn(0x7f567c0b10a0 legacy=0x7f567c0d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:48.554 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.544+0000 7f567b7fe640 1 -- 172.21.15.39:0/2374828322 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f567c06ba00 con 0x7f567c0af490 2023-05-16T13:54:48.554 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.544+0000 7f5673fff640 1 --2- 172.21.15.39:0/2374828322 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f567c0d0410 0x7f567c0d0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-16T13:54:48.555 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.548+0000 7f567b7fe640 1 --2- 172.21.15.39:0/2374828322 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f567c0af490 0x7f567c0af8f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5674009d90 tx=0x7f567401c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d6da7e9be9fb7e4 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:48.555 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.548+0000 7f567a7fc640 1 -- 172.21.15.39:0/2374828322 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56740a5900 con 0x7f567c0af490 2023-05-16T13:54:48.555 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.548+0000 7f567a7fc640 1 -- 172.21.15.39:0/2374828322 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56740a5a60 con 0x7f567c0af490 2023-05-16T13:54:48.555 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.548+0000 7f567a7fc640 1 -- 172.21.15.39:0/2374828322 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56740a5df0 con 0x7f567c0af490 2023-05-16T13:54:48.556 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.548+0000 7f56818c3640 1 -- 172.21.15.39:0/2374828322 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f567c0af490 msgr2=0x7f567c0af8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:48.556 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.548+0000 7f56818c3640 1 --2- 172.21.15.39:0/2374828322 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f567c0af490 0x7f567c0af8f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5674009d90 tx=0x7f567401c920 comp rx=0 tx=0).stop 2023-05-16T13:54:48.556 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.548+0000 7f56818c3640 1 -- 172.21.15.39:0/2374828322 shutdown_connections 2023-05-16T13:54:48.556 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.548+0000 7f56818c3640 1 --2- 172.21.15.39:0/2374828322 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f567c0af490 0x7f567c0af8f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:48.557 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.548+0000 7f56818c3640 1 --2- 172.21.15.39:0/2374828322 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f567c0d0410 0x7f567c0d0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:48.557 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.548+0000 7f56818c3640 1 -- 172.21.15.39:0/2374828322 >> 172.21.15.39:0/2374828322 conn(0x7f567c09bba0 msgr2=0x7f567c089fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:48.557 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.548+0000 7f56818c3640 1 -- 172.21.15.39:0/2374828322 shutdown_connections 2023-05-16T13:54:48.557 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.548+0000 7f56818c3640 1 -- 172.21.15.39:0/2374828322 wait complete. 2023-05-16T13:54:48.557 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.552+0000 7f56818c3640 1 Processor -- start 2023-05-16T13:54:48.558 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.552+0000 7f56818c3640 1 -- start start 2023-05-16T13:54:48.559 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.552+0000 7f56818c3640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f567c0af490 0x7f567c15db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:48.559 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.552+0000 7f56818c3640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f567c0b10a0 0x7f567c153b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:48.559 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.552+0000 7f56818c3640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f567c0d0410 0x7f567c0b3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:48.559 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.552+0000 7f56818c3640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f567c0b8720 con 0x7f567c0d0410 2023-05-16T13:54:48.559 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.552+0000 7f56818c3640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f567c15f430 con 0x7f567c0af490 2023-05-16T13:54:48.560 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.552+0000 7f56818c3640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f567c15ee70 con 0x7f567c0b10a0 2023-05-16T13:54:48.560 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.552+0000 7f567b7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f567c0d0410 0x7f567c0b3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:48.560 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.552+0000 7f567b7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f567c0d0410 0x7f567c0b3fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35152/0 (socket says 172.21.15.39:35152) 2023-05-16T13:54:48.560 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.552+0000 7f567b7fe640 1 -- 172.21.15.39:0/2744726419 learned_addr learned my addr 172.21.15.39:0/2744726419 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:48.560 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.552+0000 7f567affd640 1 --2- 172.21.15.39:0/2744726419 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f567c0af490 0x7f567c15db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:48.560 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.552+0000 7f5673fff640 1 --2- 172.21.15.39:0/2744726419 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f567c0b10a0 0x7f567c153b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:48.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.552+0000 7f567b7fe640 1 -- 172.21.15.39:0/2744726419 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f567c0b10a0 msgr2=0x7f567c153b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:48.561 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.552+0000 7f567b7fe640 1 --2- 172.21.15.39:0/2744726419 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f567c0b10a0 0x7f567c153b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:48.562 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.552+0000 7f567b7fe640 1 -- 172.21.15.39:0/2744726419 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f567c0af490 msgr2=0x7f567c15db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:48.562 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.552+0000 7f567b7fe640 1 --2- 172.21.15.39:0/2744726419 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f567c0af490 0x7f567c15db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:48.562 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.552+0000 7f567b7fe640 1 -- 172.21.15.39:0/2744726419 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5664009420 con 0x7f567c0d0410 2023-05-16T13:54:48.562 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.552+0000 7f567b7fe640 1 --2- 172.21.15.39:0/2744726419 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f567c0d0410 0x7f567c0b3fb0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f567401afd0 tx=0x7f56740196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:48.562 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.552+0000 7f5678ff9640 1 -- 172.21.15.39:0/2744726419 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56740b9860 con 0x7f567c0d0410 2023-05-16T13:54:48.562 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.552+0000 7f5678ff9640 1 -- 172.21.15.39:0/2744726419 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56740b99c0 con 0x7f567c0d0410 2023-05-16T13:54:48.562 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.552+0000 7f5678ff9640 1 -- 172.21.15.39:0/2744726419 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56740b9d30 con 0x7f567c0d0410 2023-05-16T13:54:48.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.552+0000 7f56818c3640 1 -- 172.21.15.39:0/2744726419 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5674009a70 con 0x7f567c0d0410 2023-05-16T13:54:48.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.556+0000 7f56818c3640 1 -- 172.21.15.39:0/2744726419 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f567c0b1470 con 0x7f567c0d0410 2023-05-16T13:54:48.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.556+0000 7f56818c3640 1 -- 172.21.15.39:0/2744726419 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f567c06c2a0 con 0x7f567c0d0410 2023-05-16T13:54:48.563 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.556+0000 7f5678ff9640 1 -- 172.21.15.39:0/2744726419 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f56740ad440 con 0x7f567c0d0410 2023-05-16T13:54:48.564 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.556+0000 7f5678ff9640 1 --2- 172.21.15.39:0/2744726419 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f565c066280 0x7f565c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:48.564 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.556+0000 7f5678ff9640 1 -- 172.21.15.39:0/2744726419 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f567411ee60 con 0x7f567c0d0410 2023-05-16T13:54:48.564 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.556+0000 7f567affd640 1 --2- 172.21.15.39:0/2744726419 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f565c066280 0x7f565c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:48.564 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.556+0000 7f567affd640 1 --2- 172.21.15.39:0/2744726419 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f565c066280 0x7f565c068730 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f566c000f70 tx=0x7f566c007ba0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:48.567 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.560+0000 7f5678ff9640 1 -- 172.21.15.39:0/2744726419 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f56740ec540 con 0x7f567c0d0410 2023-05-16T13:54:48.722 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.716+0000 7f56818c3640 1 -- 172.21.15.39:0/2744726419 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f567c0d30a0 con 0x7f567c0d0410 2023-05-16T13:54:48.722 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.716+0000 7f5678ff9640 1 -- 172.21.15.39:0/2744726419 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f56740efb60 con 0x7f567c0d0410 2023-05-16T13:54:48.723 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 8 2023-05-16T13:54:48.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.716+0000 7f56818c3640 1 -- 172.21.15.39:0/2744726419 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f565c066280 msgr2=0x7f565c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:48.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.716+0000 7f56818c3640 1 --2- 172.21.15.39:0/2744726419 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f565c066280 0x7f565c068730 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f566c000f70 tx=0x7f566c007ba0 comp rx=0 tx=0).stop 2023-05-16T13:54:48.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.716+0000 7f56818c3640 1 -- 172.21.15.39:0/2744726419 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f567c0d0410 msgr2=0x7f567c0b3fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:48.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.716+0000 7f56818c3640 1 --2- 172.21.15.39:0/2744726419 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f567c0d0410 0x7f567c0b3fb0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f567401afd0 tx=0x7f56740196c0 comp rx=0 tx=0).stop 2023-05-16T13:54:48.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.720+0000 7f56818c3640 1 -- 172.21.15.39:0/2744726419 shutdown_connections 2023-05-16T13:54:48.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.720+0000 7f56818c3640 1 --2- 172.21.15.39:0/2744726419 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f565c066280 0x7f565c068730 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:48.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.720+0000 7f56818c3640 1 --2- 172.21.15.39:0/2744726419 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f567c0b10a0 0x7f567c153b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:48.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.720+0000 7f56818c3640 1 --2- 172.21.15.39:0/2744726419 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f567c0d0410 0x7f567c0b3fb0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:48.726 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.720+0000 7f56818c3640 1 --2- 172.21.15.39:0/2744726419 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f567c0af490 0x7f567c15db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:48.726 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.720+0000 7f56818c3640 1 -- 172.21.15.39:0/2744726419 >> 172.21.15.39:0/2744726419 conn(0x7f567c09bba0 msgr2=0x7f567c0b5f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:48.726 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.720+0000 7f56818c3640 1 -- 172.21.15.39:0/2744726419 shutdown_connections 2023-05-16T13:54:48.726 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.720+0000 7f56818c3640 1 -- 172.21.15.39:0/2744726419 wait complete. 2023-05-16T13:54:48.744 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-16T13:54:48.885 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.880+0000 7fca89fa2640 1 Processor -- start 2023-05-16T13:54:48.885 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.880+0000 7fca89fa2640 1 -- start start 2023-05-16T13:54:48.886 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.880+0000 7fca89fa2640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fca84158c60 0x7fca840ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:48.886 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.880+0000 7fca89fa2640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fca840c88a0 0x7fca840caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:48.886 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.880+0000 7fca89fa2640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca840cb450 con 0x7fca840cc500 2023-05-16T13:54:48.886 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.880+0000 7fca89fa2640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca8406bc90 con 0x7fca84158c60 2023-05-16T13:54:48.887 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.880+0000 7fca89fa2640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca8415d560 con 0x7fca840c88a0 2023-05-16T13:54:48.887 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.880+0000 7fca88fa0640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fca84158c60 0x7fca840ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:48.887 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.880+0000 7fca88fa0640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fca84158c60 0x7fca840ca9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35162/0 (socket says 172.21.15.39:35162) 2023-05-16T13:54:48.887 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.880+0000 7fca88fa0640 1 -- 172.21.15.39:0/935715756 learned_addr learned my addr 172.21.15.39:0/935715756 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:48.888 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.880+0000 7fca83fff640 1 --2- 172.21.15.39:0/935715756 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fca840c88a0 0x7fca840caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:48.888 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.880+0000 7fca88fa0640 1 -- 172.21.15.39:0/935715756 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fca840c88a0 msgr2=0x7fca840caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:48.888 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.880+0000 7fca88fa0640 1 --2- 172.21.15.39:0/935715756 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fca840c88a0 0x7fca840caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:48.888 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.880+0000 7fca88fa0640 1 -- 172.21.15.39:0/935715756 >> v1:172.21.15.118:6789/0 conn(0x7fca840cc500 legacy=0x7fca840cca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:48.888 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.880+0000 7fca88fa0640 1 -- 172.21.15.39:0/935715756 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca8415d0d0 con 0x7fca84158c60 2023-05-16T13:54:48.889 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.884+0000 7fca88fa0640 1 --2- 172.21.15.39:0/935715756 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fca84158c60 0x7fca840ca9d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fca780098a0 tx=0x7fca7801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a78626d012c0060 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:48.890 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.884+0000 7fca837fe640 1 -- 172.21.15.39:0/935715756 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca780ab610 con 0x7fca84158c60 2023-05-16T13:54:48.890 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.884+0000 7fca837fe640 1 -- 172.21.15.39:0/935715756 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca780ab770 con 0x7fca84158c60 2023-05-16T13:54:48.890 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.884+0000 7fca837fe640 1 -- 172.21.15.39:0/935715756 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca780abb00 con 0x7fca84158c60 2023-05-16T13:54:48.891 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.884+0000 7fca89fa2640 1 -- 172.21.15.39:0/935715756 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fca84158c60 msgr2=0x7fca840ca9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:48.891 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.884+0000 7fca89fa2640 1 --2- 172.21.15.39:0/935715756 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fca84158c60 0x7fca840ca9d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fca780098a0 tx=0x7fca7801c4f0 comp rx=0 tx=0).stop 2023-05-16T13:54:48.891 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.884+0000 7fca89fa2640 1 -- 172.21.15.39:0/935715756 shutdown_connections 2023-05-16T13:54:48.891 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.884+0000 7fca89fa2640 1 --2- 172.21.15.39:0/935715756 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fca840c88a0 0x7fca840caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:48.891 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.884+0000 7fca89fa2640 1 --2- 172.21.15.39:0/935715756 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fca84158c60 0x7fca840ca9d0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:48.892 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.884+0000 7fca89fa2640 1 -- 172.21.15.39:0/935715756 >> 172.21.15.39:0/935715756 conn(0x7fca84069a50 msgr2=0x7fca84069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:48.892 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.884+0000 7fca89fa2640 1 -- 172.21.15.39:0/935715756 shutdown_connections 2023-05-16T13:54:48.892 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.884+0000 7fca89fa2640 1 -- 172.21.15.39:0/935715756 wait complete. 2023-05-16T13:54:48.893 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.884+0000 7fca89fa2640 1 Processor -- start 2023-05-16T13:54:48.893 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.884+0000 7fca89fa2640 1 -- start start 2023-05-16T13:54:48.894 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.888+0000 7fca89fa2640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fca840c88a0 0x7fca841580f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:48.894 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.888+0000 7fca89fa2640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca840cc500 0x7fca84159a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:48.894 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.888+0000 7fca89fa2640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fca84158c60 0x7fca840affa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:48.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.888+0000 7fca89fa2640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca840b2430 con 0x7fca840c88a0 2023-05-16T13:54:48.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.888+0000 7fca89fa2640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca8415a100 con 0x7fca840cc500 2023-05-16T13:54:48.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.888+0000 7fca89fa2640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca8415a3e0 con 0x7fca84158c60 2023-05-16T13:54:48.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.888+0000 7fca88fa0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fca840c88a0 0x7fca841580f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:48.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.888+0000 7fca88fa0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fca840c88a0 0x7fca841580f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35164/0 (socket says 172.21.15.39:35164) 2023-05-16T13:54:48.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.888+0000 7fca88fa0640 1 -- 172.21.15.39:0/3735109462 learned_addr learned my addr 172.21.15.39:0/3735109462 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:48.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.888+0000 7fca83fff640 1 --2- 172.21.15.39:0/3735109462 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca840cc500 0x7fca84159a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:48.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.888+0000 7fca897a1640 1 --2- 172.21.15.39:0/3735109462 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fca84158c60 0x7fca840affa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:48.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.888+0000 7fca88fa0640 1 -- 172.21.15.39:0/3735109462 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fca84158c60 msgr2=0x7fca840affa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:48.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.888+0000 7fca88fa0640 1 --2- 172.21.15.39:0/3735109462 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fca84158c60 0x7fca840affa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:48.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.888+0000 7fca88fa0640 1 -- 172.21.15.39:0/3735109462 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca840cc500 msgr2=0x7fca84159a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:48.897 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.888+0000 7fca88fa0640 1 --2- 172.21.15.39:0/3735109462 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca840cc500 0x7fca84159a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:48.897 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.888+0000 7fca88fa0640 1 -- 172.21.15.39:0/3735109462 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca780094d0 con 0x7fca840c88a0 2023-05-16T13:54:48.897 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.888+0000 7fca88fa0640 1 --2- 172.21.15.39:0/3735109462 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fca840c88a0 0x7fca841580f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fca780ad040 tx=0x7fca7801ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:48.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.888+0000 7fca817fa640 1 -- 172.21.15.39:0/3735109462 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca780b4800 con 0x7fca840c88a0 2023-05-16T13:54:48.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.888+0000 7fca817fa640 1 -- 172.21.15.39:0/3735109462 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca780b4980 con 0x7fca840c88a0 2023-05-16T13:54:48.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.888+0000 7fca89fa2640 1 -- 172.21.15.39:0/3735109462 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca8406b920 con 0x7fca840c88a0 2023-05-16T13:54:48.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.888+0000 7fca817fa640 1 -- 172.21.15.39:0/3735109462 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca780b4d30 con 0x7fca840c88a0 2023-05-16T13:54:48.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.888+0000 7fca89fa2640 1 -- 172.21.15.39:0/3735109462 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca8415cd60 con 0x7fca840c88a0 2023-05-16T13:54:48.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.888+0000 7fca89fa2640 1 -- 172.21.15.39:0/3735109462 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca8406ff60 con 0x7fca840c88a0 2023-05-16T13:54:48.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.892+0000 7fca817fa640 1 -- 172.21.15.39:0/3735109462 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fca780c7390 con 0x7fca840c88a0 2023-05-16T13:54:48.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.892+0000 7fca817fa640 1 --2- 172.21.15.39:0/3735109462 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fca68066280 0x7fca68068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:48.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.892+0000 7fca817fa640 1 -- 172.21.15.39:0/3735109462 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fca7811e7a0 con 0x7fca840c88a0 2023-05-16T13:54:48.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.892+0000 7fca83fff640 1 --2- 172.21.15.39:0/3735109462 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fca68066280 0x7fca68068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:48.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.892+0000 7fca83fff640 1 --2- 172.21.15.39:0/3735109462 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fca68066280 0x7fca68068730 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fca8414aef0 tx=0x7fca70008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:48.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:48.896+0000 7fca817fa640 1 -- 172.21.15.39:0/3735109462 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fca780ebcc0 con 0x7fca840c88a0 2023-05-16T13:54:49.057 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.052+0000 7fca89fa2640 1 -- 172.21.15.39:0/3735109462 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fca8415a520 con 0x7fca840c88a0 2023-05-16T13:54:49.057 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.052+0000 7fca817fa640 1 -- 172.21.15.39:0/3735109462 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fca8415a520 con 0x7fca840c88a0 2023-05-16T13:54:49.058 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2023-05-16T13:54:49.059 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.052+0000 7fca89fa2640 1 -- 172.21.15.39:0/3735109462 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fca68066280 msgr2=0x7fca68068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:49.060 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.052+0000 7fca89fa2640 1 --2- 172.21.15.39:0/3735109462 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fca68066280 0x7fca68068730 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fca8414aef0 tx=0x7fca70008040 comp rx=0 tx=0).stop 2023-05-16T13:54:49.060 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.052+0000 7fca89fa2640 1 -- 172.21.15.39:0/3735109462 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fca840c88a0 msgr2=0x7fca841580f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:49.060 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.052+0000 7fca89fa2640 1 --2- 172.21.15.39:0/3735109462 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fca840c88a0 0x7fca841580f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fca780ad040 tx=0x7fca7801ad30 comp rx=0 tx=0).stop 2023-05-16T13:54:49.060 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.052+0000 7fca89fa2640 1 -- 172.21.15.39:0/3735109462 shutdown_connections 2023-05-16T13:54:49.060 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.052+0000 7fca89fa2640 1 --2- 172.21.15.39:0/3735109462 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fca68066280 0x7fca68068730 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:49.061 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.052+0000 7fca89fa2640 1 --2- 172.21.15.39:0/3735109462 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fca84158c60 0x7fca840affa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:49.061 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.052+0000 7fca89fa2640 1 --2- 172.21.15.39:0/3735109462 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca840cc500 0x7fca84159a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:49.061 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.052+0000 7fca89fa2640 1 --2- 172.21.15.39:0/3735109462 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fca840c88a0 0x7fca841580f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:49.061 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.052+0000 7fca89fa2640 1 -- 172.21.15.39:0/3735109462 >> 172.21.15.39:0/3735109462 conn(0x7fca84069a50 msgr2=0x7fca84152bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:49.061 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.052+0000 7fca89fa2640 1 -- 172.21.15.39:0/3735109462 shutdown_connections 2023-05-16T13:54:49.061 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.052+0000 7fca89fa2640 1 -- 172.21.15.39:0/3735109462 wait complete. 2023-05-16T13:54:49.079 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-16T13:54:49.221 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.216+0000 7f02099a6640 1 Processor -- start 2023-05-16T13:54:49.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.216+0000 7f02099a6640 1 -- start start 2023-05-16T13:54:49.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.216+0000 7f02099a6640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f02040b4030 0x7f020415d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:49.224 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.216+0000 7f02099a6640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f0204071b70 0x7f02040c91c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:49.224 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.216+0000 7f02099a6640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f020415de40 con 0x7f02040b0710 2023-05-16T13:54:49.224 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.216+0000 7f02099a6640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f020415e910 con 0x7f02040b4030 2023-05-16T13:54:49.225 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.216+0000 7f02099a6640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02040b0ae0 con 0x7f0204071b70 2023-05-16T13:54:49.225 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.216+0000 7f02027fc640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f02040b4030 0x7f020415d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:49.225 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.216+0000 7f02027fc640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f02040b4030 0x7f020415d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35176/0 (socket says 172.21.15.39:35176) 2023-05-16T13:54:49.226 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.216+0000 7f02027fc640 1 -- 172.21.15.39:0/503176832 learned_addr learned my addr 172.21.15.39:0/503176832 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:49.226 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.216+0000 7f02037fe640 1 --2- 172.21.15.39:0/503176832 >> v2:172.21.15.118:3300/0 conn(0x7f0204071b70 0x7f02040c91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:49.226 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.216+0000 7f02027fc640 1 -- 172.21.15.39:0/503176832 >> v2:172.21.15.118:3300/0 conn(0x7f0204071b70 msgr2=0x7f02040c91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:49.227 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.216+0000 7f02027fc640 1 --2- 172.21.15.39:0/503176832 >> v2:172.21.15.118:3300/0 conn(0x7f0204071b70 0x7f02040c91c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:49.227 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.216+0000 7f02027fc640 1 -- 172.21.15.39:0/503176832 >> v1:172.21.15.118:6789/0 conn(0x7f02040b0710 legacy=0x7f0204071460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:49.228 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.216+0000 7f02027fc640 1 -- 172.21.15.39:0/503176832 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f020415e070 con 0x7f02040b4030 2023-05-16T13:54:49.231 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.220+0000 7f02027fc640 1 --2- 172.21.15.39:0/503176832 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f02040b4030 0x7f020415d900 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f02040b44a0 tx=0x7f01f801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=218b59f68151ca76 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:49.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.220+0000 7f0201ffb640 1 -- 172.21.15.39:0/503176832 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f80aa680 con 0x7f02040b4030 2023-05-16T13:54:49.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.220+0000 7f0201ffb640 1 -- 172.21.15.39:0/503176832 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01f80aa7e0 con 0x7f02040b4030 2023-05-16T13:54:49.232 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.220+0000 7f0201ffb640 1 -- 172.21.15.39:0/503176832 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f80aab70 con 0x7f02040b4030 2023-05-16T13:54:49.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.220+0000 7f02099a6640 1 -- 172.21.15.39:0/503176832 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f02040b4030 msgr2=0x7f020415d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:49.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.220+0000 7f02099a6640 1 --2- 172.21.15.39:0/503176832 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f02040b4030 0x7f020415d900 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f02040b44a0 tx=0x7f01f801c500 comp rx=0 tx=0).stop 2023-05-16T13:54:49.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.220+0000 7f02099a6640 1 -- 172.21.15.39:0/503176832 shutdown_connections 2023-05-16T13:54:49.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.220+0000 7f02099a6640 1 --2- 172.21.15.39:0/503176832 >> v2:172.21.15.118:3300/0 conn(0x7f0204071b70 0x7f02040c91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:49.234 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.220+0000 7f02099a6640 1 --2- 172.21.15.39:0/503176832 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f02040b4030 0x7f020415d900 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:49.234 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.220+0000 7f02099a6640 1 -- 172.21.15.39:0/503176832 >> 172.21.15.39:0/503176832 conn(0x7f0204069a50 msgr2=0x7f0204069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:49.234 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.220+0000 7f02099a6640 1 -- 172.21.15.39:0/503176832 shutdown_connections 2023-05-16T13:54:49.234 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.220+0000 7f02099a6640 1 -- 172.21.15.39:0/503176832 wait complete. 2023-05-16T13:54:49.235 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.220+0000 7f02099a6640 1 Processor -- start 2023-05-16T13:54:49.235 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.224+0000 7f02099a6640 1 -- start start 2023-05-16T13:54:49.235 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.224+0000 7f02099a6640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0204071b70 0x7f020414aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:49.236 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.224+0000 7f02099a6640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f02040b0710 0x7f02040c5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:49.236 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.224+0000 7f02099a6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f02040b4030 0x7f02040b2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:49.236 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.224+0000 7f02099a6640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0204152a00 con 0x7f02040b4030 2023-05-16T13:54:49.236 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.224+0000 7f02099a6640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02041593f0 con 0x7f0204071b70 2023-05-16T13:54:49.237 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.224+0000 7f02099a6640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02040c5ac0 con 0x7f02040b0710 2023-05-16T13:54:49.237 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.224+0000 7f02037fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f02040b4030 0x7f02040b2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:49.237 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.224+0000 7f02037fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f02040b4030 0x7f02040b2980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35180/0 (socket says 172.21.15.39:35180) 2023-05-16T13:54:49.237 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.224+0000 7f0202ffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0204071b70 0x7f020414aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:49.238 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.224+0000 7f02037fe640 1 -- 172.21.15.39:0/3765023010 learned_addr learned my addr 172.21.15.39:0/3765023010 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:49.238 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.224+0000 7f02027fc640 1 --2- 172.21.15.39:0/3765023010 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f02040b0710 0x7f02040c5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:49.238 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.224+0000 7f02037fe640 1 -- 172.21.15.39:0/3765023010 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f02040b0710 msgr2=0x7f02040c5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:49.238 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.224+0000 7f02037fe640 1 --2- 172.21.15.39:0/3765023010 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f02040b0710 0x7f02040c5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:49.239 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.224+0000 7f02037fe640 1 -- 172.21.15.39:0/3765023010 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0204071b70 msgr2=0x7f020414aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:49.239 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.224+0000 7f02037fe640 1 --2- 172.21.15.39:0/3765023010 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0204071b70 0x7f020414aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:49.239 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.224+0000 7f02037fe640 1 -- 172.21.15.39:0/3765023010 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01f80094d0 con 0x7f02040b4030 2023-05-16T13:54:49.239 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.224+0000 7f02037fe640 1 --2- 172.21.15.39:0/3765023010 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f02040b4030 0x7f02040b2980 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f01fc00efc0 tx=0x7f01fc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:49.240 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.224+0000 7f01ebfff640 1 -- 172.21.15.39:0/3765023010 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01fc014480 con 0x7f02040b4030 2023-05-16T13:54:49.240 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.224+0000 7f01ebfff640 1 -- 172.21.15.39:0/3765023010 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01fc00f040 con 0x7f02040b4030 2023-05-16T13:54:49.240 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.224+0000 7f01ebfff640 1 -- 172.21.15.39:0/3765023010 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01fc014820 con 0x7f02040b4030 2023-05-16T13:54:49.240 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.224+0000 7f02099a6640 1 -- 172.21.15.39:0/3765023010 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02040c9f10 con 0x7f02040b4030 2023-05-16T13:54:49.241 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.224+0000 7f02099a6640 1 -- 172.21.15.39:0/3765023010 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02040c8ca0 con 0x7f02040b4030 2023-05-16T13:54:49.242 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.224+0000 7f02099a6640 1 -- 172.21.15.39:0/3765023010 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02040ca0a0 con 0x7f02040b4030 2023-05-16T13:54:49.242 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.228+0000 7f01ebfff640 1 -- 172.21.15.39:0/3765023010 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f01fc014980 con 0x7f02040b4030 2023-05-16T13:54:49.243 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.228+0000 7f01ebfff640 1 --2- 172.21.15.39:0/3765023010 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f01f00662d0 0x7f01f0068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:49.243 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.228+0000 7f01ebfff640 1 -- 172.21.15.39:0/3765023010 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f01fc0846c0 con 0x7f02040b4030 2023-05-16T13:54:49.243 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.228+0000 7f0202ffd640 1 --2- 172.21.15.39:0/3765023010 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f01f00662d0 0x7f01f0068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:49.243 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.228+0000 7f0202ffd640 1 --2- 172.21.15.39:0/3765023010 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f01f00662d0 0x7f01f0068780 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f01f4007fd0 tx=0x7f01f4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:49.244 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.232+0000 7f01ebfff640 1 -- 172.21.15.39:0/3765023010 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f01fc051cd0 con 0x7f02040b4030 2023-05-16T13:54:49.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.396+0000 7f02099a6640 1 -- 172.21.15.39:0/3765023010 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0204150a20 con 0x7f02040b4030 2023-05-16T13:54:49.404 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.396+0000 7f01ebfff640 1 -- 172.21.15.39:0/3765023010 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f01fc0552f0 con 0x7f02040b4030 2023-05-16T13:54:49.404 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 64 2023-05-16T13:54:49.406 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.400+0000 7f02099a6640 1 -- 172.21.15.39:0/3765023010 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f01f00662d0 msgr2=0x7f01f0068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:49.406 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.400+0000 7f02099a6640 1 --2- 172.21.15.39:0/3765023010 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f01f00662d0 0x7f01f0068780 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f01f4007fd0 tx=0x7f01f4009040 comp rx=0 tx=0).stop 2023-05-16T13:54:49.406 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.400+0000 7f02099a6640 1 -- 172.21.15.39:0/3765023010 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f02040b4030 msgr2=0x7f02040b2980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:49.406 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.400+0000 7f02099a6640 1 --2- 172.21.15.39:0/3765023010 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f02040b4030 0x7f02040b2980 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f01fc00efc0 tx=0x7f01fc00c490 comp rx=0 tx=0).stop 2023-05-16T13:54:49.406 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.400+0000 7f02099a6640 1 -- 172.21.15.39:0/3765023010 shutdown_connections 2023-05-16T13:54:49.406 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.400+0000 7f02099a6640 1 --2- 172.21.15.39:0/3765023010 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f01f00662d0 0x7f01f0068780 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:49.407 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.400+0000 7f02099a6640 1 --2- 172.21.15.39:0/3765023010 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f02040b0710 0x7f02040c5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:49.407 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.400+0000 7f02099a6640 1 --2- 172.21.15.39:0/3765023010 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f02040b4030 0x7f02040b2980 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:49.407 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.400+0000 7f02099a6640 1 --2- 172.21.15.39:0/3765023010 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0204071b70 0x7f020414aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:49.407 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.400+0000 7f02099a6640 1 -- 172.21.15.39:0/3765023010 >> 172.21.15.39:0/3765023010 conn(0x7f0204069a50 msgr2=0x7f0204153810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:49.407 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.400+0000 7f02099a6640 1 -- 172.21.15.39:0/3765023010 shutdown_connections 2023-05-16T13:54:49.407 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.400+0000 7f02099a6640 1 -- 172.21.15.39:0/3765023010 wait complete. 2023-05-16T13:54:49.459 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-05-16T13:54:49.547 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-05-16T13:54:49.686 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.680+0000 7f9c22d25640 1 Processor -- start 2023-05-16T13:54:49.686 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.680+0000 7f9c22d25640 1 -- start start 2023-05-16T13:54:49.687 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.680+0000 7f9c22d25640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9c1c0703b0 0x7f9c1c15d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:49.687 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.680+0000 7f9c22d25640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c1c15d6a0 con 0x7f9c1c0cb4c0 2023-05-16T13:54:49.687 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.680+0000 7f9c22d25640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c1c070870 con 0x7f9c1c158bf0 2023-05-16T13:54:49.687 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.680+0000 7f9c22d25640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c1c070b50 con 0x7f9c1c0703b0 2023-05-16T13:54:49.688 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.680+0000 7f9c212c2640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9c1c0703b0 0x7f9c1c15d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:49.688 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.680+0000 7f9c13fff640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f9c1c0cb4c0 0x7f9c1c0ccda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:41290/0 (socket says 172.21.15.39:41290) 2023-05-16T13:54:49.688 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.680+0000 7f9c13fff640 1 -- 172.21.15.39:0/2618172120 learned_addr learned my addr 172.21.15.39:0/2618172120 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:49.689 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.680+0000 7f9c212c2640 1 -- 172.21.15.39:0/2618172120 >> v1:172.21.15.118:6789/0 conn(0x7f9c1c158bf0 legacy=0x7f9c1c0cadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:49.689 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.680+0000 7f9c212c2640 1 -- 172.21.15.39:0/2618172120 >> v1:172.21.15.39:6789/0 conn(0x7f9c1c0cb4c0 legacy=0x7f9c1c0ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:49.689 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.680+0000 7f9c212c2640 1 -- 172.21.15.39:0/2618172120 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c1c070e30 con 0x7f9c1c0703b0 2023-05-16T13:54:49.690 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.684+0000 7f9c212c2640 1 --2- 172.21.15.39:0/2618172120 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9c1c0703b0 0x7f9c1c15d160 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9c14009d90 tx=0x7f9c1401c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d74e871d6bff402 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:49.691 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.684+0000 7f9c137fe640 1 -- 172.21.15.39:0/2618172120 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c140a5950 con 0x7f9c1c0703b0 2023-05-16T13:54:49.691 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.684+0000 7f9c137fe640 1 -- 172.21.15.39:0/2618172120 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c140a5ab0 con 0x7f9c1c0703b0 2023-05-16T13:54:49.691 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.684+0000 7f9c137fe640 1 -- 172.21.15.39:0/2618172120 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c140a5e40 con 0x7f9c1c0703b0 2023-05-16T13:54:49.692 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.684+0000 7f9c22d25640 1 -- 172.21.15.39:0/2618172120 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9c1c0703b0 msgr2=0x7f9c1c15d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:49.692 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.684+0000 7f9c22d25640 1 --2- 172.21.15.39:0/2618172120 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9c1c0703b0 0x7f9c1c15d160 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9c14009d90 tx=0x7f9c1401c890 comp rx=0 tx=0).stop 2023-05-16T13:54:49.692 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.684+0000 7f9c22d25640 1 -- 172.21.15.39:0/2618172120 shutdown_connections 2023-05-16T13:54:49.692 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.684+0000 7f9c22d25640 1 --2- 172.21.15.39:0/2618172120 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9c1c0703b0 0x7f9c1c15d160 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:49.692 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.684+0000 7f9c22d25640 1 -- 172.21.15.39:0/2618172120 >> 172.21.15.39:0/2618172120 conn(0x7f9c1c069a50 msgr2=0x7f9c1c069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:49.693 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.684+0000 7f9c22d25640 1 -- 172.21.15.39:0/2618172120 shutdown_connections 2023-05-16T13:54:49.693 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.684+0000 7f9c22d25640 1 -- 172.21.15.39:0/2618172120 wait complete. 2023-05-16T13:54:49.694 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.688+0000 7f9c22d25640 1 Processor -- start 2023-05-16T13:54:49.694 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.688+0000 7f9c22d25640 1 -- start start 2023-05-16T13:54:49.694 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.688+0000 7f9c22d25640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c1c0703b0 0x7f9c1c0b1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:49.694 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.688+0000 7f9c22d25640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9c1c0cb4c0 0x7f9c1c0b37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:49.695 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.688+0000 7f9c22d25640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9c1c158bf0 0x7f9c1c146420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:49.695 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.688+0000 7f9c22d25640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1c14f5d0 con 0x7f9c1c158bf0 2023-05-16T13:54:49.695 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.688+0000 7f9c22d25640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1c14f010 con 0x7f9c1c0703b0 2023-05-16T13:54:49.695 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.688+0000 7f9c22d25640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1c14f2f0 con 0x7f9c1c0cb4c0 2023-05-16T13:54:49.695 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.688+0000 7f9c212c2640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9c1c158bf0 0x7f9c1c146420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:49.697 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.688+0000 7f9c212c2640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9c1c158bf0 0x7f9c1c146420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35204/0 (socket says 172.21.15.39:35204) 2023-05-16T13:54:49.697 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.688+0000 7f9c212c2640 1 -- 172.21.15.39:0/2110964954 learned_addr learned my addr 172.21.15.39:0/2110964954 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:49.697 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.688+0000 7f9c20ac1640 1 --2- 172.21.15.39:0/2110964954 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c1c0703b0 0x7f9c1c0b1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:49.697 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.688+0000 7f9c13fff640 1 --2- 172.21.15.39:0/2110964954 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9c1c0cb4c0 0x7f9c1c0b37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:49.697 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.688+0000 7f9c212c2640 1 -- 172.21.15.39:0/2110964954 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9c1c0cb4c0 msgr2=0x7f9c1c0b37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:49.697 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.688+0000 7f9c212c2640 1 --2- 172.21.15.39:0/2110964954 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9c1c0cb4c0 0x7f9c1c0b37b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:49.698 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.688+0000 7f9c212c2640 1 -- 172.21.15.39:0/2110964954 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c1c0703b0 msgr2=0x7f9c1c0b1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:49.698 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.688+0000 7f9c212c2640 1 --2- 172.21.15.39:0/2110964954 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c1c0703b0 0x7f9c1c0b1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:49.698 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.688+0000 7f9c212c2640 1 -- 172.21.15.39:0/2110964954 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c14009a70 con 0x7f9c1c158bf0 2023-05-16T13:54:49.698 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.688+0000 7f9c212c2640 1 --2- 172.21.15.39:0/2110964954 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9c1c158bf0 0x7f9c1c146420 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f9c1401a4c0 tx=0x7f9c14019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:49.698 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.688+0000 7f9c117fa640 1 -- 172.21.15.39:0/2110964954 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c140ade40 con 0x7f9c1c158bf0 2023-05-16T13:54:49.698 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.688+0000 7f9c117fa640 1 -- 172.21.15.39:0/2110964954 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c140b7410 con 0x7f9c1c158bf0 2023-05-16T13:54:49.698 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.688+0000 7f9c22d25640 1 -- 172.21.15.39:0/2110964954 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c1c0ad950 con 0x7f9c1c158bf0 2023-05-16T13:54:49.699 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.688+0000 7f9c117fa640 1 -- 172.21.15.39:0/2110964954 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c140b77a0 con 0x7f9c1c158bf0 2023-05-16T13:54:49.699 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.688+0000 7f9c22d25640 1 -- 172.21.15.39:0/2110964954 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c1c158fc0 con 0x7f9c1c158bf0 2023-05-16T13:54:49.699 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.692+0000 7f9c22d25640 1 -- 172.21.15.39:0/2110964954 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c1c0cdcc0 con 0x7f9c1c158bf0 2023-05-16T13:54:49.699 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.692+0000 7f9c117fa640 1 -- 172.21.15.39:0/2110964954 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9c140b4050 con 0x7f9c1c158bf0 2023-05-16T13:54:49.700 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.692+0000 7f9c117fa640 1 --2- 172.21.15.39:0/2110964954 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f9c08066280 0x7f9c08068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:49.700 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.692+0000 7f9c117fa640 1 -- 172.21.15.39:0/2110964954 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9c1411f150 con 0x7f9c1c158bf0 2023-05-16T13:54:49.700 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.692+0000 7f9c20ac1640 1 --2- 172.21.15.39:0/2110964954 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f9c08066280 0x7f9c08068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:49.700 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.692+0000 7f9c20ac1640 1 --2- 172.21.15.39:0/2110964954 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f9c08066280 0x7f9c08068730 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9c18007fd0 tx=0x7f9c18009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:49.702 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.696+0000 7f9c117fa640 1 -- 172.21.15.39:0/2110964954 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f9c140ec740 con 0x7f9c1c158bf0 2023-05-16T13:54:49.917 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:49.912+0000 7f9c22d25640 1 -- 172.21.15.39:0/2110964954 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7f9c1c1561f0 con 0x7f9c1c158bf0 2023-05-16T13:54:50.806 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.800+0000 7f9c117fa640 1 -- 172.21.15.39:0/2110964954 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v57) v1 ==== 147+0+0 (secure 0 0 0) 0x7f9c1c1561f0 con 0x7f9c1c158bf0 2023-05-16T13:54:50.809 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.804+0000 7f9c22d25640 1 -- 172.21.15.39:0/2110964954 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f9c08066280 msgr2=0x7f9c08068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:50.809 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.804+0000 7f9c22d25640 1 --2- 172.21.15.39:0/2110964954 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f9c08066280 0x7f9c08068730 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9c18007fd0 tx=0x7f9c18009040 comp rx=0 tx=0).stop 2023-05-16T13:54:50.809 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.804+0000 7f9c22d25640 1 -- 172.21.15.39:0/2110964954 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9c1c158bf0 msgr2=0x7f9c1c146420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:50.809 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.804+0000 7f9c22d25640 1 --2- 172.21.15.39:0/2110964954 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9c1c158bf0 0x7f9c1c146420 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f9c1401a4c0 tx=0x7f9c14019630 comp rx=0 tx=0).stop 2023-05-16T13:54:50.810 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.804+0000 7f9c22d25640 1 -- 172.21.15.39:0/2110964954 shutdown_connections 2023-05-16T13:54:50.810 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.804+0000 7f9c22d25640 1 --2- 172.21.15.39:0/2110964954 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f9c08066280 0x7f9c08068730 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:50.810 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.804+0000 7f9c22d25640 1 --2- 172.21.15.39:0/2110964954 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9c1c0cb4c0 0x7f9c1c0b37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:50.810 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.804+0000 7f9c22d25640 1 --2- 172.21.15.39:0/2110964954 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9c1c158bf0 0x7f9c1c146420 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:50.810 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.804+0000 7f9c22d25640 1 --2- 172.21.15.39:0/2110964954 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c1c0703b0 0x7f9c1c0b1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:50.810 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.804+0000 7f9c22d25640 1 -- 172.21.15.39:0/2110964954 >> 172.21.15.39:0/2110964954 conn(0x7f9c1c069a50 msgr2=0x7f9c1c153560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:50.810 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.804+0000 7f9c22d25640 1 -- 172.21.15.39:0/2110964954 shutdown_connections 2023-05-16T13:54:50.810 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.804+0000 7f9c22d25640 1 -- 172.21.15.39:0/2110964954 wait complete. 2023-05-16T13:54:50.832 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-05-16T13:54:50.978 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.972+0000 7f6213fa6640 1 Processor -- start 2023-05-16T13:54:50.979 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.972+0000 7f6213fa6640 1 -- start start 2023-05-16T13:54:50.980 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.972+0000 7f6213fa6640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f620c0b0710 0x7f620c15d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:50.980 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.972+0000 7f6213fa6640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f620c0b4030 0x7f620c071460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:50.980 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.972+0000 7f6213fa6640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f620c15de40 con 0x7f620c0719a0 2023-05-16T13:54:50.980 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.972+0000 7f6213fa6640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f620c15e910 con 0x7f620c0b4030 2023-05-16T13:54:50.980 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.972+0000 7f6213fa6640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f620c0b0ae0 con 0x7f620c0b0710 2023-05-16T13:54:50.981 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.972+0000 7f6211d42640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f620c0b0710 0x7f620c15d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:50.981 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.972+0000 7f6211541640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f620c0b4030 0x7f620c071460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:50.981 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.972+0000 7f6212543640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f620c0719a0 0x7f620c0ce420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.39:48242/0 (socket says 172.21.15.39:48242) 2023-05-16T13:54:50.981 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.972+0000 7f6212543640 1 -- 172.21.15.39:0/3357712159 learned_addr learned my addr 172.21.15.39:0/3357712159 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:50.982 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.976+0000 7f6211541640 1 -- 172.21.15.39:0/3357712159 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f620c0b0710 msgr2=0x7f620c15d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:50.982 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.976+0000 7f6211541640 1 --2- 172.21.15.39:0/3357712159 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f620c0b0710 0x7f620c15d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:50.982 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.976+0000 7f6211541640 1 -- 172.21.15.39:0/3357712159 >> v1:172.21.15.118:6789/0 conn(0x7f620c0719a0 legacy=0x7f620c0ce420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:50.982 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.976+0000 7f6211541640 1 -- 172.21.15.39:0/3357712159 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f620c15e070 con 0x7f620c0b4030 2023-05-16T13:54:50.982 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.976+0000 7f6211d42640 1 --2- 172.21.15.39:0/3357712159 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f620c0b0710 0x7f620c15d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-16T13:54:50.983 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.976+0000 7f6211541640 1 --2- 172.21.15.39:0/3357712159 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f620c0b4030 0x7f620c071460 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f61fc0097c0 tx=0x7f61fc01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9c2559fc400be0c server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:50.984 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.976+0000 7f6210d40640 1 -- 172.21.15.39:0/3357712159 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61fc0ad640 con 0x7f620c0b4030 2023-05-16T13:54:50.984 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.976+0000 7f6210d40640 1 -- 172.21.15.39:0/3357712159 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61fc0ad7a0 con 0x7f620c0b4030 2023-05-16T13:54:50.984 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.976+0000 7f6210d40640 1 -- 172.21.15.39:0/3357712159 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61fc0adb30 con 0x7f620c0b4030 2023-05-16T13:54:50.985 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.976+0000 7f6213fa6640 1 -- 172.21.15.39:0/3357712159 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f620c0b4030 msgr2=0x7f620c071460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:50.985 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.976+0000 7f6213fa6640 1 --2- 172.21.15.39:0/3357712159 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f620c0b4030 0x7f620c071460 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f61fc0097c0 tx=0x7f61fc01c480 comp rx=0 tx=0).stop 2023-05-16T13:54:50.985 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.980+0000 7f6213fa6640 1 -- 172.21.15.39:0/3357712159 shutdown_connections 2023-05-16T13:54:50.985 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.980+0000 7f6213fa6640 1 --2- 172.21.15.39:0/3357712159 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f620c0b4030 0x7f620c071460 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:50.985 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.980+0000 7f6213fa6640 1 --2- 172.21.15.39:0/3357712159 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f620c0b0710 0x7f620c15d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:50.986 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.980+0000 7f6213fa6640 1 -- 172.21.15.39:0/3357712159 >> 172.21.15.39:0/3357712159 conn(0x7f620c069a50 msgr2=0x7f620c069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:50.986 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.980+0000 7f6213fa6640 1 -- 172.21.15.39:0/3357712159 shutdown_connections 2023-05-16T13:54:50.986 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.980+0000 7f6213fa6640 1 -- 172.21.15.39:0/3357712159 wait complete. 2023-05-16T13:54:50.986 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.980+0000 7f6213fa6640 1 Processor -- start 2023-05-16T13:54:50.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.980+0000 7f6213fa6640 1 -- start start 2023-05-16T13:54:50.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.980+0000 7f6213fa6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f620c0719a0 0x7f620c150280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:50.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.980+0000 7f6213fa6640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f620c0b0710 0x7f620c14af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:50.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.980+0000 7f6213fa6640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f620c0b4030 0x7f620c0cc750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:50.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.980+0000 7f6213fa6640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f620c14bf10 con 0x7f620c0719a0 2023-05-16T13:54:50.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.980+0000 7f6213fa6640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f620c14b490 con 0x7f620c0b4030 2023-05-16T13:54:50.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.980+0000 7f6213fa6640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f620c152f70 con 0x7f620c0b0710 2023-05-16T13:54:50.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.980+0000 7f6211d42640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f620c0719a0 0x7f620c150280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:50.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.980+0000 7f6211d42640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f620c0719a0 0x7f620c150280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34478/0 (socket says 172.21.15.39:34478) 2023-05-16T13:54:50.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.980+0000 7f6211d42640 1 -- 172.21.15.39:0/966664818 learned_addr learned my addr 172.21.15.39:0/966664818 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:50.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.980+0000 7f6211541640 1 --2- 172.21.15.39:0/966664818 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f620c0b0710 0x7f620c14af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:50.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.980+0000 7f6212543640 1 --2- 172.21.15.39:0/966664818 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f620c0b4030 0x7f620c0cc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:50.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.980+0000 7f6211d42640 1 -- 172.21.15.39:0/966664818 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f620c0b0710 msgr2=0x7f620c14af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:50.990 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.980+0000 7f6211d42640 1 --2- 172.21.15.39:0/966664818 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f620c0b0710 0x7f620c14af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:50.990 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.980+0000 7f6211d42640 1 -- 172.21.15.39:0/966664818 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f620c0b4030 msgr2=0x7f620c0cc750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:50.990 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.980+0000 7f6211d42640 1 --2- 172.21.15.39:0/966664818 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f620c0b4030 0x7f620c0cc750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:50.990 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.980+0000 7f6211d42640 1 -- 172.21.15.39:0/966664818 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6208009420 con 0x7f620c0719a0 2023-05-16T13:54:50.991 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.980+0000 7f6211d42640 1 --2- 172.21.15.39:0/966664818 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f620c0719a0 0x7f620c150280 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f620800ebe0 tx=0x7f620800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:50.991 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.984+0000 7f62027fc640 1 -- 172.21.15.39:0/966664818 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620800eee0 con 0x7f620c0719a0 2023-05-16T13:54:50.991 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.984+0000 7f62027fc640 1 -- 172.21.15.39:0/966664818 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f620800cc30 con 0x7f620c0719a0 2023-05-16T13:54:50.991 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.984+0000 7f62027fc640 1 -- 172.21.15.39:0/966664818 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6208013470 con 0x7f620c0719a0 2023-05-16T13:54:50.992 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.984+0000 7f6213fa6640 1 -- 172.21.15.39:0/966664818 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61fc009420 con 0x7f620c0719a0 2023-05-16T13:54:50.992 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.984+0000 7f6213fa6640 1 -- 172.21.15.39:0/966664818 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f620c071da0 con 0x7f620c0719a0 2023-05-16T13:54:50.992 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.984+0000 7f6213fa6640 1 -- 172.21.15.39:0/966664818 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f620c0c8ca0 con 0x7f620c0719a0 2023-05-16T13:54:50.992 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.984+0000 7f62027fc640 1 -- 172.21.15.39:0/966664818 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f62080135d0 con 0x7f620c0719a0 2023-05-16T13:54:50.992 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.984+0000 7f62027fc640 1 --2- 172.21.15.39:0/966664818 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f61f0066280 0x7f61f0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:50.993 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.984+0000 7f62027fc640 1 -- 172.21.15.39:0/966664818 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6208084010 con 0x7f620c0719a0 2023-05-16T13:54:50.993 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.984+0000 7f6211541640 1 --2- 172.21.15.39:0/966664818 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f61f0066280 0x7f61f0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:50.993 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.984+0000 7f6211541640 1 --2- 172.21.15.39:0/966664818 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f61f0066280 0x7f61f0068730 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f61fc0af000 tx=0x7f61fc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:50.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:50.988+0000 7f62027fc640 1 -- 172.21.15.39:0/966664818 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f62080514a0 con 0x7f620c0719a0 2023-05-16T13:54:51.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.140+0000 7f6213fa6640 1 -- 172.21.15.39:0/966664818 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f620c166ca0 con 0x7f620c0719a0 2023-05-16T13:54:51.154 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.148+0000 7f62027fc640 1 -- 172.21.15.39:0/966664818 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6208054ac0 con 0x7f620c0719a0 2023-05-16T13:54:51.156 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.148+0000 7f6213fa6640 1 -- 172.21.15.39:0/966664818 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f61f0066280 msgr2=0x7f61f0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:51.156 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.148+0000 7f6213fa6640 1 --2- 172.21.15.39:0/966664818 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f61f0066280 0x7f61f0068730 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f61fc0af000 tx=0x7f61fc008040 comp rx=0 tx=0).stop 2023-05-16T13:54:51.156 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.148+0000 7f6213fa6640 1 -- 172.21.15.39:0/966664818 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f620c0719a0 msgr2=0x7f620c150280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:51.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.148+0000 7f6213fa6640 1 --2- 172.21.15.39:0/966664818 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f620c0719a0 0x7f620c150280 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f620800ebe0 tx=0x7f620800c520 comp rx=0 tx=0).stop 2023-05-16T13:54:51.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.148+0000 7f6213fa6640 1 -- 172.21.15.39:0/966664818 shutdown_connections 2023-05-16T13:54:51.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.148+0000 7f6213fa6640 1 --2- 172.21.15.39:0/966664818 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f61f0066280 0x7f61f0068730 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:51.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.148+0000 7f6213fa6640 1 --2- 172.21.15.39:0/966664818 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f620c0b0710 0x7f620c14af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:51.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.148+0000 7f6213fa6640 1 --2- 172.21.15.39:0/966664818 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f620c0b4030 0x7f620c0cc750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:51.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.148+0000 7f6213fa6640 1 --2- 172.21.15.39:0/966664818 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f620c0719a0 0x7f620c150280 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:51.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.148+0000 7f6213fa6640 1 -- 172.21.15.39:0/966664818 >> 172.21.15.39:0/966664818 conn(0x7f620c069a50 msgr2=0x7f620c0ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:51.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.148+0000 7f6213fa6640 1 -- 172.21.15.39:0/966664818 shutdown_connections 2023-05-16T13:54:51.158 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.148+0000 7f6213fa6640 1 -- 172.21.15.39:0/966664818 wait complete. 2023-05-16T13:54:51.175 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-05-16T13:54:51.175 DEBUG:teuthology.orchestra.run.smithi039:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-16T13:54:51.235 DEBUG:teuthology.orchestra.run.smithi118:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-16T13:54:51.292 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-05-16T13:54:51.293 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-05-16T13:54:51.293 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-16T13:54:51.301 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-05-16T13:54:51.302 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-16T13:54:51.356 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-16T13:54:51.533 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.528+0000 7f94c11a6640 1 Processor -- start 2023-05-16T13:54:51.533 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.528+0000 7f94c11a6640 1 -- start start 2023-05-16T13:54:51.534 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.528+0000 7f94c11a6640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f94bc158bf0 0x7f94bc15d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:51.534 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.528+0000 7f94c11a6640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94bc15d6a0 con 0x7f94bc0703b0 2023-05-16T13:54:51.534 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.528+0000 7f94c11a6640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94bc070870 con 0x7f94bc0cb4c0 2023-05-16T13:54:51.534 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.528+0000 7f94c11a6640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94bc070b50 con 0x7f94bc158bf0 2023-05-16T13:54:51.535 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.528+0000 7f94b3fff640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f94bc0703b0 0x7f94bc0cadb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:35552/0 (socket says 172.21.15.39:35552) 2023-05-16T13:54:51.535 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.528+0000 7f94b3fff640 1 -- 172.21.15.39:0/7123225 learned_addr learned my addr 172.21.15.39:0/7123225 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:51.536 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.528+0000 7f94bad9d640 1 --2- 172.21.15.39:0/7123225 >> v2:172.21.15.118:3300/0 conn(0x7f94bc158bf0 0x7f94bc15d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:51.537 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.528+0000 7f94ba59c640 1 -- 172.21.15.39:0/7123225 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2410640883 0 0) 0x7f94a4001120 con 0x7f94bc0703b0 2023-05-16T13:54:51.537 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.528+0000 7f94ba59c640 1 -- 172.21.15.39:0/7123225 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94a8005740 con 0x7f94bc0703b0 2023-05-16T13:54:51.537 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.528+0000 7f94ba59c640 1 -- 172.21.15.39:0/7123225 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 194691899 0 0) 0x7f94a8005740 con 0x7f94bc0703b0 2023-05-16T13:54:51.537 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.528+0000 7f94ba59c640 1 -- 172.21.15.39:0/7123225 >> v2:172.21.15.118:3300/0 conn(0x7f94bc158bf0 msgr2=0x7f94bc15d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:51.537 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.528+0000 7f94ba59c640 1 --2- 172.21.15.39:0/7123225 >> v2:172.21.15.118:3300/0 conn(0x7f94bc158bf0 0x7f94bc15d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:51.538 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.528+0000 7f94ba59c640 1 -- 172.21.15.39:0/7123225 >> v1:172.21.15.118:6789/0 conn(0x7f94bc0cb4c0 legacy=0x7f94bc0ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:51.538 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.528+0000 7f94ba59c640 1 -- 172.21.15.39:0/7123225 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94bc070e30 con 0x7f94bc0703b0 2023-05-16T13:54:51.538 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.528+0000 7f94ba59c640 1 -- 172.21.15.39:0/7123225 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1738805496 0 0) 0x7f94a4001810 con 0x7f94bc0703b0 2023-05-16T13:54:51.538 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.528+0000 7f94ba59c640 1 -- 172.21.15.39:0/7123225 >> v1:172.21.15.39:6789/0 conn(0x7f94bc0703b0 legacy=0x7f94bc0cadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:51.538 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.528+0000 7f94ba59c640 1 --2- 172.21.15.39:0/7123225 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f94a8005c50 0x7f94a8006060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:51.538 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.528+0000 7f94ba59c640 1 --2- 172.21.15.39:0/7123225 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f94a80069e0 0x7f94a8006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:51.538 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.528+0000 7f94ba59c640 1 --2- 172.21.15.39:0/7123225 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f94a80074b0 0x7f94a800dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:51.539 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.528+0000 7f94ba59c640 1 -- 172.21.15.39:0/7123225 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94bc070b50 con 0x7f94a80074b0 2023-05-16T13:54:51.539 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.528+0000 7f94ba59c640 1 -- 172.21.15.39:0/7123225 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94a800e370 con 0x7f94a80069e0 2023-05-16T13:54:51.539 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.528+0000 7f94ba59c640 1 -- 172.21.15.39:0/7123225 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94a800e530 con 0x7f94a8005c50 2023-05-16T13:54:51.539 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.528+0000 7f94bb59e640 1 --2- 172.21.15.39:0/7123225 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f94a80074b0 0x7f94a800dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:51.539 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.528+0000 7f94b3fff640 1 --2- 172.21.15.39:0/7123225 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f94a80069e0 0x7f94a8006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:51.540 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.528+0000 7f94bad9d640 1 --2- 172.21.15.39:0/7123225 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f94a8005c50 0x7f94a8006060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:51.540 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.528+0000 7f94bb59e640 1 -- 172.21.15.39:0/7123225 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f94a8005c50 msgr2=0x7f94a8006060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:51.540 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.528+0000 7f94bb59e640 1 --2- 172.21.15.39:0/7123225 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f94a8005c50 0x7f94a8006060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:51.540 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.528+0000 7f94bb59e640 1 -- 172.21.15.39:0/7123225 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f94a80069e0 msgr2=0x7f94a8006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:51.540 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.528+0000 7f94bb59e640 1 --2- 172.21.15.39:0/7123225 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f94a80069e0 0x7f94a8006e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:51.541 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.528+0000 7f94bb59e640 1 -- 172.21.15.39:0/7123225 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94a8005740 con 0x7f94a80074b0 2023-05-16T13:54:51.542 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.532+0000 7f94bb59e640 1 -- 172.21.15.39:0/7123225 reap_dead start 2023-05-16T13:54:51.542 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.532+0000 7f94bb59e640 1 --2- 172.21.15.39:0/7123225 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f94a80074b0 0x7f94a800dba0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f94bc0cb8b0 tx=0x7f94b401c6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab16ecb0afc17934 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:51.542 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.532+0000 7f94ba59c640 1 -- 172.21.15.39:0/7123225 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b4003b80 con 0x7f94a80074b0 2023-05-16T13:54:51.542 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.532+0000 7f94ba59c640 1 -- 172.21.15.39:0/7123225 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94b4003ce0 con 0x7f94a80074b0 2023-05-16T13:54:51.542 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.532+0000 7f94ba59c640 1 -- 172.21.15.39:0/7123225 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b4005310 con 0x7f94a80074b0 2023-05-16T13:54:51.543 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.532+0000 7f94c11a6640 1 -- 172.21.15.39:0/7123225 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f94a80074b0 msgr2=0x7f94a800dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:51.543 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.532+0000 7f94c11a6640 1 --2- 172.21.15.39:0/7123225 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f94a80074b0 0x7f94a800dba0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f94bc0cb8b0 tx=0x7f94b401c6d0 comp rx=0 tx=0).stop 2023-05-16T13:54:51.543 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.532+0000 7f94c11a6640 1 -- 172.21.15.39:0/7123225 shutdown_connections 2023-05-16T13:54:51.543 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.532+0000 7f94c11a6640 1 --2- 172.21.15.39:0/7123225 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f94a80074b0 0x7f94a800dba0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:51.543 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.532+0000 7f94c11a6640 1 -- 172.21.15.39:0/7123225 >> 172.21.15.39:0/7123225 conn(0x7f94bc069a50 msgr2=0x7f94bc069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:51.543 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.532+0000 7f94c11a6640 1 -- 172.21.15.39:0/7123225 shutdown_connections 2023-05-16T13:54:51.543 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.532+0000 7f94c11a6640 1 -- 172.21.15.39:0/7123225 wait complete. 2023-05-16T13:54:51.543 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.536+0000 7f94c11a6640 1 Processor -- start 2023-05-16T13:54:51.544 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.536+0000 7f94c11a6640 1 -- start start 2023-05-16T13:54:51.545 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.536+0000 7f94c11a6640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f94a80074b0 0x7f94bc0c5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:51.545 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.536+0000 7f94c11a6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f94bc152b00 0x7f94bc0c6f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:51.546 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.536+0000 7f94c11a6640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f94bc152f70 0x7f94bc0c74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:51.546 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.536+0000 7f94c11a6640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94bc0b03c0 con 0x7f94bc152b00 2023-05-16T13:54:51.546 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.536+0000 7f94c11a6640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94bc0b05d0 con 0x7f94a80074b0 2023-05-16T13:54:51.546 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.536+0000 7f94c11a6640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94bc0b08b0 con 0x7f94bc152f70 2023-05-16T13:54:51.546 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.536+0000 7f94b3fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f94bc152b00 0x7f94bc0c6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:51.546 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.536+0000 7f94b3fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f94bc152b00 0x7f94bc0c6f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34494/0 (socket says 172.21.15.39:34494) 2023-05-16T13:54:51.546 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.536+0000 7f94b3fff640 1 -- 172.21.15.39:0/306485020 learned_addr learned my addr 172.21.15.39:0/306485020 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:51.546 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.536+0000 7f94bad9d640 1 --2- 172.21.15.39:0/306485020 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f94a80074b0 0x7f94bc0c5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:51.547 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.536+0000 7f94bb59e640 1 --2- 172.21.15.39:0/306485020 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f94bc152f70 0x7f94bc0c74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:51.547 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.536+0000 7f94b3fff640 1 -- 172.21.15.39:0/306485020 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f94bc152f70 msgr2=0x7f94bc0c74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:51.547 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.536+0000 7f94b3fff640 1 --2- 172.21.15.39:0/306485020 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f94bc152f70 0x7f94bc0c74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:51.547 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.536+0000 7f94b3fff640 1 -- 172.21.15.39:0/306485020 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f94a80074b0 msgr2=0x7f94bc0c5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:51.547 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.536+0000 7f94b3fff640 1 --2- 172.21.15.39:0/306485020 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f94a80074b0 0x7f94bc0c5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:51.547 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.536+0000 7f94b3fff640 1 -- 172.21.15.39:0/306485020 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94bc0713f0 con 0x7f94bc152b00 2023-05-16T13:54:51.547 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.536+0000 7f94b3fff640 1 --2- 172.21.15.39:0/306485020 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f94bc152b00 0x7f94bc0c6f60 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f94a40124c0 tx=0x7f94a40128c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:51.548 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.536+0000 7f94b37fe640 1 -- 172.21.15.39:0/306485020 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a4005780 con 0x7f94bc152b00 2023-05-16T13:54:51.548 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.536+0000 7f94b37fe640 1 -- 172.21.15.39:0/306485020 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94a4014770 con 0x7f94bc152b00 2023-05-16T13:54:51.548 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.536+0000 7f94b37fe640 1 -- 172.21.15.39:0/306485020 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a4014b20 con 0x7f94bc152b00 2023-05-16T13:54:51.548 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.536+0000 7f94c11a6640 1 -- 172.21.15.39:0/306485020 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94bc071110 con 0x7f94bc152b00 2023-05-16T13:54:51.548 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.536+0000 7f94c11a6640 1 -- 172.21.15.39:0/306485020 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94bc158fc0 con 0x7f94bc152b00 2023-05-16T13:54:51.548 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.540+0000 7f94c11a6640 1 -- 172.21.15.39:0/306485020 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94bc073c90 con 0x7f94bc152b00 2023-05-16T13:54:51.549 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.540+0000 7f94b37fe640 1 -- 172.21.15.39:0/306485020 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f94a4014c80 con 0x7f94bc152b00 2023-05-16T13:54:51.549 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.540+0000 7f94b37fe640 1 --2- 172.21.15.39:0/306485020 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f949c066280 0x7f949c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:51.549 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.540+0000 7f94b37fe640 1 -- 172.21.15.39:0/306485020 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f94a4086070 con 0x7f94bc152b00 2023-05-16T13:54:51.549 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.540+0000 7f94bad9d640 1 --2- 172.21.15.39:0/306485020 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f949c066280 0x7f949c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:51.549 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.540+0000 7f94bad9d640 1 --2- 172.21.15.39:0/306485020 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f949c066280 0x7f949c068730 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f94ac009b60 tx=0x7f94ac009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:51.550 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.544+0000 7f94b37fe640 1 -- 172.21.15.39:0/306485020 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f94a40b66f0 con 0x7f94bc152b00 2023-05-16T13:54:51.706 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.700+0000 7f94c11a6640 1 -- 172.21.15.39:0/306485020 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f94bc15d6a0 con 0x7f94bc152b00 2023-05-16T13:54:51.707 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.700+0000 7f94b37fe640 1 -- 172.21.15.39:0/306485020 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18279 (secure 0 0 0) 0x7f94bc15d6a0 con 0x7f94bc152b00 2023-05-16T13:54:51.707 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:54:51.707 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":24,"fsid":"9c1e210b-c515-4ea4-a065-397956895c68","created":"2023-05-16T13:53:48.955290+0000","modified":"2023-05-16T13:54:16.194544+0000","last_up_change":"2023-05-16T13:54:01.722051+0000","last_in_change":"2023-05-16T13:53:52.331336+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-16T13:54:00.885009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-16T13:54:08.327895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-16T13:54:12.864823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-16T13:54:14.180225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4ce0f0ba-c4bf-4405-8c95-d2e9a62878ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6809","nonce":3462013698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6811","nonce":3462013698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6815","nonce":3462013698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6813","nonce":3462013698}]},"public_addr":"172.21.15.39:6809/3462013698","cluster_addr":"172.21.15.39:6811/3462013698","heartbeat_back_addr":"172.21.15.39:6815/3462013698","heartbeat_front_addr":"172.21.15.39:6813/3462013698","state":["exists","up"]},{"osd":1,"uuid":"53fdc1ac-2473-472d-af32-2760fdf6e476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6801","nonce":2829970892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6803","nonce":2829970892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6807","nonce":2829970892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6805","nonce":2829970892}]},"public_addr":"172.21.15.39:6801/2829970892","cluster_addr":"172.21.15.39:6803/2829970892","heartbeat_back_addr":"172.21.15.39:6807/2829970892","heartbeat_front_addr":"172.21.15.39:6805/2829970892","state":["exists","up"]},{"osd":2,"uuid":"0b92d770-7030-42fa-a19f-4f7f1ac113c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6817","nonce":3888067413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6819","nonce":3888067413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6823","nonce":3888067413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6821","nonce":3888067413}]},"public_addr":"172.21.15.39:6817/3888067413","cluster_addr":"172.21.15.39:6819/3888067413","heartbeat_back_addr":"172.21.15.39:6823/3888067413","heartbeat_front_addr":"172.21.15.39:6821/3888067413","state":["exists","up"]},{"osd":3,"uuid":"000d9506-cbb2-4017-b875-deca579860ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6825","nonce":405003958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6827","nonce":405003958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6831","nonce":405003958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6829","nonce":405003958}]},"public_addr":"172.21.15.39:6825/405003958","cluster_addr":"172.21.15.39:6827/405003958","heartbeat_back_addr":"172.21.15.39:6831/405003958","heartbeat_front_addr":"172.21.15.39:6829/405003958","state":["exists","up"]},{"osd":4,"uuid":"70f0dacb-e960-40c5-bf6a-183e52bbe2ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6801","nonce":3895278838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6805","nonce":3895278838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6813","nonce":3895278838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6809","nonce":3895278838}]},"public_addr":"172.21.15.118:6801/3895278838","cluster_addr":"172.21.15.118:6805/3895278838","heartbeat_back_addr":"172.21.15.118:6813/3895278838","heartbeat_front_addr":"172.21.15.118:6809/3895278838","state":["exists","up"]},{"osd":5,"uuid":"756feb54-c3ae-4a2a-8f74-85c291ba707c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6804","nonce":3513592808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6808","nonce":3513592808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6815","nonce":3513592808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6812","nonce":3513592808}]},"public_addr":"172.21.15.118:6804/3513592808","cluster_addr":"172.21.15.118:6808/3513592808","heartbeat_back_addr":"172.21.15.118:6815/3513592808","heartbeat_front_addr":"172.21.15.118:6812/3513592808","state":["exists","up"]},{"osd":6,"uuid":"c4a982c1-f497-4b0f-8a23-c77372e4621e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6824","nonce":1863656053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6827","nonce":1863656053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6831","nonce":1863656053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6829","nonce":1863656053}]},"public_addr":"172.21.15.118:6824/1863656053","cluster_addr":"172.21.15.118:6827/1863656053","heartbeat_back_addr":"172.21.15.118:6831/1863656053","heartbeat_front_addr":"172.21.15.118:6829/1863656053","state":["exists","up"]},{"osd":7,"uuid":"6f2888aa-a7ac-4e26-9159-e31817934f44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6817","nonce":3636642904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6819","nonce":3636642904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6825","nonce":3636642904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6821","nonce":3636642904}]},"public_addr":"172.21.15.118:6817/3636642904","cluster_addr":"172.21.15.118:6819/3636642904","heartbeat_back_addr":"172.21.15.118:6825/3636642904","heartbeat_front_addr":"172.21.15.118:6821/3636642904","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.717636+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.724036+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.739144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:58.079275+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:58.073921+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.930466+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.987813+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.941098+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-16T13:54:51.709 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.704+0000 7f94c11a6640 1 -- 172.21.15.39:0/306485020 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f949c066280 msgr2=0x7f949c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:51.710 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.704+0000 7f94c11a6640 1 --2- 172.21.15.39:0/306485020 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f949c066280 0x7f949c068730 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f94ac009b60 tx=0x7f94ac009190 comp rx=0 tx=0).stop 2023-05-16T13:54:51.710 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.704+0000 7f94c11a6640 1 -- 172.21.15.39:0/306485020 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f94bc152b00 msgr2=0x7f94bc0c6f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:51.710 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.704+0000 7f94c11a6640 1 --2- 172.21.15.39:0/306485020 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f94bc152b00 0x7f94bc0c6f60 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f94a40124c0 tx=0x7f94a40128c0 comp rx=0 tx=0).stop 2023-05-16T13:54:51.710 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.704+0000 7f94c11a6640 1 -- 172.21.15.39:0/306485020 shutdown_connections 2023-05-16T13:54:51.710 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.704+0000 7f94c11a6640 1 --2- 172.21.15.39:0/306485020 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f949c066280 0x7f949c068730 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:51.711 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.704+0000 7f94c11a6640 1 --2- 172.21.15.39:0/306485020 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f94bc152f70 0x7f94bc0c74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:51.711 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.704+0000 7f94c11a6640 1 --2- 172.21.15.39:0/306485020 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f94bc152b00 0x7f94bc0c6f60 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:51.711 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.704+0000 7f94c11a6640 1 --2- 172.21.15.39:0/306485020 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f94a80074b0 0x7f94bc0c5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:51.711 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.704+0000 7f94c11a6640 1 -- 172.21.15.39:0/306485020 >> 172.21.15.39:0/306485020 conn(0x7f94bc069a50 msgr2=0x7f94bc0cd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:51.711 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.704+0000 7f94c11a6640 1 -- 172.21.15.39:0/306485020 shutdown_connections 2023-05-16T13:54:51.711 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.704+0000 7f94c11a6640 1 -- 172.21.15.39:0/306485020 wait complete. 2023-05-16T13:54:51.728 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-16T13:54:00.885009+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-16T13:54:08.327895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-16T13:54:12.864823+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-16T13:54:14.180225+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-16T13:54:51.729 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-16T13:54:51.870 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.864+0000 7fd08b517640 1 Processor -- start 2023-05-16T13:54:51.871 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.864+0000 7fd08b517640 1 -- start start 2023-05-16T13:54:51.871 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.864+0000 7fd08b517640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd0840aff50 0x7fd0840b0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:51.872 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.864+0000 7fd08b517640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd084070420 0x7fd0840708a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:51.872 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.864+0000 7fd08b517640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0840b08c0 con 0x7fd084158e00 2023-05-16T13:54:51.872 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.864+0000 7fd08b517640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0840ca030 con 0x7fd0840aff50 2023-05-16T13:54:51.872 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.864+0000 7fd08b517640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd08415c890 con 0x7fd084070420 2023-05-16T13:54:51.872 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.864+0000 7fd088ab2640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd0840aff50 0x7fd0840b0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:51.872 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.864+0000 7fd088ab2640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd0840aff50 0x7fd0840b0380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34506/0 (socket says 172.21.15.39:34506) 2023-05-16T13:54:51.873 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.864+0000 7fd088ab2640 1 -- 172.21.15.39:0/3706997283 learned_addr learned my addr 172.21.15.39:0/3706997283 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:51.873 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.864+0000 7fd089ab4640 1 --2- 172.21.15.39:0/3706997283 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd084070420 0x7fd0840708a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:51.873 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.864+0000 7fd088ab2640 1 -- 172.21.15.39:0/3706997283 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd084070420 msgr2=0x7fd0840708a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:51.874 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.864+0000 7fd088ab2640 1 --2- 172.21.15.39:0/3706997283 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd084070420 0x7fd0840708a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:51.874 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.864+0000 7fd088ab2640 1 -- 172.21.15.39:0/3706997283 >> v1:172.21.15.118:6789/0 conn(0x7fd084158e00 legacy=0x7fd0840c9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:51.874 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.864+0000 7fd088ab2640 1 -- 172.21.15.39:0/3706997283 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd08415cb70 con 0x7fd0840aff50 2023-05-16T13:54:51.874 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.868+0000 7fd088ab2640 1 --2- 172.21.15.39:0/3706997283 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd0840aff50 0x7fd0840b0380 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd074009870 tx=0x7fd07401ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89c719c1b5bdcf4d server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:51.875 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.868+0000 7fd07bfff640 1 -- 172.21.15.39:0/3706997283 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0740a8a30 con 0x7fd0840aff50 2023-05-16T13:54:51.875 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.868+0000 7fd07bfff640 1 -- 172.21.15.39:0/3706997283 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0740a8b90 con 0x7fd0840aff50 2023-05-16T13:54:51.875 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.868+0000 7fd07bfff640 1 -- 172.21.15.39:0/3706997283 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0740b0440 con 0x7fd0840aff50 2023-05-16T13:54:51.876 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.868+0000 7fd08b517640 1 -- 172.21.15.39:0/3706997283 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd0840aff50 msgr2=0x7fd0840b0380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:51.876 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.868+0000 7fd08b517640 1 --2- 172.21.15.39:0/3706997283 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd0840aff50 0x7fd0840b0380 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd074009870 tx=0x7fd07401ed30 comp rx=0 tx=0).stop 2023-05-16T13:54:51.876 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.868+0000 7fd08b517640 1 -- 172.21.15.39:0/3706997283 shutdown_connections 2023-05-16T13:54:51.877 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.868+0000 7fd08b517640 1 --2- 172.21.15.39:0/3706997283 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd084070420 0x7fd0840708a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:51.877 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.868+0000 7fd08b517640 1 --2- 172.21.15.39:0/3706997283 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd0840aff50 0x7fd0840b0380 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:51.877 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.868+0000 7fd08b517640 1 -- 172.21.15.39:0/3706997283 >> 172.21.15.39:0/3706997283 conn(0x7fd084069a50 msgr2=0x7fd084069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:51.877 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.868+0000 7fd08b517640 1 -- 172.21.15.39:0/3706997283 shutdown_connections 2023-05-16T13:54:51.877 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.868+0000 7fd08b517640 1 -- 172.21.15.39:0/3706997283 wait complete. 2023-05-16T13:54:51.879 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.872+0000 7fd08b517640 1 Processor -- start 2023-05-16T13:54:51.879 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.872+0000 7fd08b517640 1 -- start start 2023-05-16T13:54:51.879 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.872+0000 7fd08b517640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd084070420 0x7fd084147960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:51.879 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.872+0000 7fd08b517640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd0840aff50 0x7fd0840b14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:51.879 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.872+0000 7fd08b517640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd084158e00 0x7fd08414b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:51.880 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.872+0000 7fd08b517640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0840cbd50 con 0x7fd0840aff50 2023-05-16T13:54:51.880 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.872+0000 7fd08b517640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0840c60c0 con 0x7fd084158e00 2023-05-16T13:54:51.880 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.872+0000 7fd08b517640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0840cba70 con 0x7fd084070420 2023-05-16T13:54:51.880 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.872+0000 7fd088ab2640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd0840aff50 0x7fd0840b14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:51.880 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.872+0000 7fd088ab2640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd0840aff50 0x7fd0840b14f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34522/0 (socket says 172.21.15.39:34522) 2023-05-16T13:54:51.880 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.872+0000 7fd088ab2640 1 -- 172.21.15.39:0/756956199 learned_addr learned my addr 172.21.15.39:0/756956199 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:51.881 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.872+0000 7fd0892b3640 1 --2- 172.21.15.39:0/756956199 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd084070420 0x7fd084147960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:51.881 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.872+0000 7fd089ab4640 1 --2- 172.21.15.39:0/756956199 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd084158e00 0x7fd08414b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:51.881 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.872+0000 7fd088ab2640 1 -- 172.21.15.39:0/756956199 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd084070420 msgr2=0x7fd084147960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:51.881 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.872+0000 7fd088ab2640 1 --2- 172.21.15.39:0/756956199 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd084070420 0x7fd084147960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:51.881 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.872+0000 7fd088ab2640 1 -- 172.21.15.39:0/756956199 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd084158e00 msgr2=0x7fd08414b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:51.881 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.872+0000 7fd088ab2640 1 --2- 172.21.15.39:0/756956199 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd084158e00 0x7fd08414b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:51.881 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.872+0000 7fd088ab2640 1 -- 172.21.15.39:0/756956199 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0740094d0 con 0x7fd0840aff50 2023-05-16T13:54:51.882 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.872+0000 7fd088ab2640 1 --2- 172.21.15.39:0/756956199 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd0840aff50 0x7fd0840b14f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd0740b3040 tx=0x7fd07401bad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:51.882 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.872+0000 7fd079ffb640 1 -- 172.21.15.39:0/756956199 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0740b0dd0 con 0x7fd0840aff50 2023-05-16T13:54:51.882 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.872+0000 7fd079ffb640 1 -- 172.21.15.39:0/756956199 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0740bb460 con 0x7fd0840aff50 2023-05-16T13:54:51.883 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.872+0000 7fd079ffb640 1 -- 172.21.15.39:0/756956199 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0740bb810 con 0x7fd0840aff50 2023-05-16T13:54:51.883 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.872+0000 7fd08b517640 1 -- 172.21.15.39:0/756956199 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd08415d130 con 0x7fd0840aff50 2023-05-16T13:54:51.883 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.872+0000 7fd08b517640 1 -- 172.21.15.39:0/756956199 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd08415ce50 con 0x7fd0840aff50 2023-05-16T13:54:51.883 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.876+0000 7fd08b517640 1 -- 172.21.15.39:0/756956199 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0840cc730 con 0x7fd0840aff50 2023-05-16T13:54:51.883 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.876+0000 7fd079ffb640 1 -- 172.21.15.39:0/756956199 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd0740b83f0 con 0x7fd0840aff50 2023-05-16T13:54:51.884 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.876+0000 7fd079ffb640 1 --2- 172.21.15.39:0/756956199 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd068066280 0x7fd068068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:51.884 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.876+0000 7fd079ffb640 1 -- 172.21.15.39:0/756956199 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd074121560 con 0x7fd0840aff50 2023-05-16T13:54:51.884 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.876+0000 7fd0892b3640 1 --2- 172.21.15.39:0/756956199 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd068066280 0x7fd068068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:51.884 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.876+0000 7fd0892b3640 1 --2- 172.21.15.39:0/756956199 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd068066280 0x7fd068068730 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd0800012f0 tx=0x7fd080009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:51.887 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:51.880+0000 7fd079ffb640 1 -- 172.21.15.39:0/756956199 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fd0740eea80 con 0x7fd0840aff50 2023-05-16T13:54:52.042 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.036+0000 7fd08b517640 1 -- 172.21.15.39:0/756956199 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd084073c90 con 0x7fd0840aff50 2023-05-16T13:54:52.043 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.036+0000 7fd079ffb640 1 -- 172.21.15.39:0/756956199 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd0740f20a0 con 0x7fd0840aff50 2023-05-16T13:54:52.043 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2023-05-16T13:54:52.045 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.036+0000 7fd08b517640 1 -- 172.21.15.39:0/756956199 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd068066280 msgr2=0x7fd068068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:52.045 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.036+0000 7fd08b517640 1 --2- 172.21.15.39:0/756956199 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd068066280 0x7fd068068730 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd0800012f0 tx=0x7fd080009040 comp rx=0 tx=0).stop 2023-05-16T13:54:52.045 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.036+0000 7fd08b517640 1 -- 172.21.15.39:0/756956199 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd0840aff50 msgr2=0x7fd0840b14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:52.045 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.036+0000 7fd08b517640 1 --2- 172.21.15.39:0/756956199 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd0840aff50 0x7fd0840b14f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd0740b3040 tx=0x7fd07401bad0 comp rx=0 tx=0).stop 2023-05-16T13:54:52.046 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.036+0000 7fd08b517640 1 -- 172.21.15.39:0/756956199 shutdown_connections 2023-05-16T13:54:52.046 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.036+0000 7fd08b517640 1 --2- 172.21.15.39:0/756956199 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd084158e00 0x7fd08414b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:52.046 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.036+0000 7fd08b517640 1 --2- 172.21.15.39:0/756956199 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd0840aff50 0x7fd0840b14f0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:52.046 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.036+0000 7fd08b517640 1 --2- 172.21.15.39:0/756956199 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd068066280 0x7fd068068730 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:52.046 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.036+0000 7fd08b517640 1 --2- 172.21.15.39:0/756956199 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd084070420 0x7fd084147960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:52.047 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.036+0000 7fd08b517640 1 -- 172.21.15.39:0/756956199 >> 172.21.15.39:0/756956199 conn(0x7fd084069a50 msgr2=0x7fd084156c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:52.047 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.040+0000 7fd08b517640 1 -- 172.21.15.39:0/756956199 shutdown_connections 2023-05-16T13:54:52.047 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.040+0000 7fd08b517640 1 -- 172.21.15.39:0/756956199 wait complete. 2023-05-16T13:54:52.063 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-16T13:54:52.204 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.196+0000 7f8f2e125640 1 Processor -- start 2023-05-16T13:54:52.205 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.196+0000 7f8f2e125640 1 -- start start 2023-05-16T13:54:52.205 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.200+0000 7f8f2e125640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f8f280b4030 0x7f8f2815d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:52.205 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.200+0000 7f8f2e125640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f2815de40 con 0x7f8f28071b70 2023-05-16T13:54:52.206 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.200+0000 7f8f2e125640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f280b0ae0 con 0x7f8f280b0710 2023-05-16T13:54:52.206 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.200+0000 7f8f2e125640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f2815e910 con 0x7f8f280b4030 2023-05-16T13:54:52.206 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.200+0000 7f8f26ffd640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f8f280b4030 0x7f8f2815d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:52.207 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.200+0000 7f8f27fff640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f8f28071b70 0x7f8f280c91c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:35566/0 (socket says 172.21.15.39:35566) 2023-05-16T13:54:52.207 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.200+0000 7f8f27fff640 1 -- 172.21.15.39:0/3715438830 learned_addr learned my addr 172.21.15.39:0/3715438830 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:52.207 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.200+0000 7f8f26ffd640 1 -- 172.21.15.39:0/3715438830 >> v1:172.21.15.118:6789/0 conn(0x7f8f280b0710 legacy=0x7f8f28071460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:52.207 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.200+0000 7f8f26ffd640 1 -- 172.21.15.39:0/3715438830 >> v1:172.21.15.39:6789/0 conn(0x7f8f28071b70 legacy=0x7f8f280c91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:52.207 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.200+0000 7f8f26ffd640 1 -- 172.21.15.39:0/3715438830 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f2815e070 con 0x7f8f280b4030 2023-05-16T13:54:52.207 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.200+0000 7f8f267fc640 1 -- 172.21.15.39:0/3715438830 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3786105297 0 0) 0x7f8f2815de40 con 0x7f8f28071b70 2023-05-16T13:54:52.209 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.204+0000 7f8f26ffd640 1 --2- 172.21.15.39:0/3715438830 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8f280b4030 0x7f8f2815d900 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c0097c0 tx=0x7f8f1c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe4306a9cbccc216 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:52.210 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.204+0000 7f8f267fc640 1 -- 172.21.15.39:0/3715438830 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f1c004230 con 0x7f8f280b4030 2023-05-16T13:54:52.210 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.204+0000 7f8f267fc640 1 -- 172.21.15.39:0/3715438830 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f1c0a7050 con 0x7f8f280b4030 2023-05-16T13:54:52.210 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.204+0000 7f8f267fc640 1 -- 172.21.15.39:0/3715438830 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f1c003620 con 0x7f8f280b4030 2023-05-16T13:54:52.210 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.204+0000 7f8f2e125640 1 -- 172.21.15.39:0/3715438830 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8f280b4030 msgr2=0x7f8f2815d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:52.210 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.204+0000 7f8f2e125640 1 --2- 172.21.15.39:0/3715438830 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8f280b4030 0x7f8f2815d900 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c0097c0 tx=0x7f8f1c01c440 comp rx=0 tx=0).stop 2023-05-16T13:54:52.211 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.204+0000 7f8f2e125640 1 -- 172.21.15.39:0/3715438830 shutdown_connections 2023-05-16T13:54:52.211 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.204+0000 7f8f2e125640 1 --2- 172.21.15.39:0/3715438830 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8f280b4030 0x7f8f2815d900 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:52.211 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.204+0000 7f8f2e125640 1 -- 172.21.15.39:0/3715438830 >> 172.21.15.39:0/3715438830 conn(0x7f8f28069a50 msgr2=0x7f8f28069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:52.211 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.204+0000 7f8f2e125640 1 -- 172.21.15.39:0/3715438830 shutdown_connections 2023-05-16T13:54:52.211 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.204+0000 7f8f2e125640 1 -- 172.21.15.39:0/3715438830 wait complete. 2023-05-16T13:54:52.212 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.204+0000 7f8f2e125640 1 Processor -- start 2023-05-16T13:54:52.212 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.204+0000 7f8f2e125640 1 -- start start 2023-05-16T13:54:52.213 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.208+0000 7f8f2e125640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8f28071b70 0x7f8f280c4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:52.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.208+0000 7f8f2e125640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8f280b0710 0x7f8f281489e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:52.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.208+0000 7f8f2e125640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f280b4030 0x7f8f280af690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:52.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.208+0000 7f8f2e125640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f280c4240 con 0x7f8f280b0710 2023-05-16T13:54:52.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.208+0000 7f8f2e125640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f280c3db0 con 0x7f8f280b4030 2023-05-16T13:54:52.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.208+0000 7f8f2e125640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f280c4f40 con 0x7f8f28071b70 2023-05-16T13:54:52.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.208+0000 7f8f26ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8f280b0710 0x7f8f281489e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:52.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.208+0000 7f8f26ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8f280b0710 0x7f8f281489e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34538/0 (socket says 172.21.15.39:34538) 2023-05-16T13:54:52.215 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.208+0000 7f8f26ffd640 1 -- 172.21.15.39:0/3660290000 learned_addr learned my addr 172.21.15.39:0/3660290000 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:52.215 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.208+0000 7f8f277fe640 1 --2- 172.21.15.39:0/3660290000 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8f28071b70 0x7f8f280c4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:52.215 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.208+0000 7f8f27fff640 1 --2- 172.21.15.39:0/3660290000 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f280b4030 0x7f8f280af690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:52.215 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.208+0000 7f8f26ffd640 1 -- 172.21.15.39:0/3660290000 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8f28071b70 msgr2=0x7f8f280c4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:52.215 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.208+0000 7f8f26ffd640 1 --2- 172.21.15.39:0/3660290000 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8f28071b70 0x7f8f280c4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:52.215 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.208+0000 7f8f26ffd640 1 -- 172.21.15.39:0/3660290000 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f280b4030 msgr2=0x7f8f280af690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:52.215 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.208+0000 7f8f26ffd640 1 --2- 172.21.15.39:0/3660290000 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f280b4030 0x7f8f280af690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:52.216 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.208+0000 7f8f26ffd640 1 -- 172.21.15.39:0/3660290000 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f1c009420 con 0x7f8f280b0710 2023-05-16T13:54:52.216 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.208+0000 7f8f26ffd640 1 --2- 172.21.15.39:0/3660290000 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8f280b0710 0x7f8f281489e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c0ae040 tx=0x7f8f1c0191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:52.216 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.208+0000 7f8f0ffff640 1 -- 172.21.15.39:0/3660290000 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f1c003c70 con 0x7f8f280b0710 2023-05-16T13:54:52.217 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.208+0000 7f8f0ffff640 1 -- 172.21.15.39:0/3660290000 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f1c003dd0 con 0x7f8f280b0710 2023-05-16T13:54:52.217 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.208+0000 7f8f0ffff640 1 -- 172.21.15.39:0/3660290000 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f1c0b66c0 con 0x7f8f280b0710 2023-05-16T13:54:52.217 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.208+0000 7f8f2e125640 1 -- 172.21.15.39:0/3660290000 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f280ca0e0 con 0x7f8f280b0710 2023-05-16T13:54:52.217 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.208+0000 7f8f2e125640 1 -- 172.21.15.39:0/3660290000 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f280c8ca0 con 0x7f8f280b0710 2023-05-16T13:54:52.217 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.208+0000 7f8f2e125640 1 -- 172.21.15.39:0/3660290000 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f280ca270 con 0x7f8f280b0710 2023-05-16T13:54:52.217 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.208+0000 7f8f0ffff640 1 -- 172.21.15.39:0/3660290000 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8f1c0b2040 con 0x7f8f280b0710 2023-05-16T13:54:52.218 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.212+0000 7f8f0ffff640 1 --2- 172.21.15.39:0/3660290000 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f8f14066280 0x7f8f14068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:52.218 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.212+0000 7f8f0ffff640 1 -- 172.21.15.39:0/3660290000 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8f1c11e430 con 0x7f8f280b0710 2023-05-16T13:54:52.218 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.212+0000 7f8f277fe640 1 --2- 172.21.15.39:0/3660290000 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f8f14066280 0x7f8f14068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:52.218 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.212+0000 7f8f277fe640 1 --2- 172.21.15.39:0/3660290000 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f8f14066280 0x7f8f14068730 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8f28165c70 tx=0x7f8f18009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:52.221 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.216+0000 7f8f0ffff640 1 -- 172.21.15.39:0/3660290000 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f8f1c0eb8a0 con 0x7f8f280b0710 2023-05-16T13:54:52.377 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.372+0000 7f8f2e125640 1 -- 172.21.15.39:0/3660290000 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8f280b0ae0 con 0x7f8f280b0710 2023-05-16T13:54:52.378 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.372+0000 7f8f0ffff640 1 -- 172.21.15.39:0/3660290000 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8f280b0ae0 con 0x7f8f280b0710 2023-05-16T13:54:52.378 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 8 2023-05-16T13:54:52.380 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.372+0000 7f8f2e125640 1 -- 172.21.15.39:0/3660290000 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f8f14066280 msgr2=0x7f8f14068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:52.380 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.372+0000 7f8f2e125640 1 --2- 172.21.15.39:0/3660290000 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f8f14066280 0x7f8f14068730 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8f28165c70 tx=0x7f8f18009040 comp rx=0 tx=0).stop 2023-05-16T13:54:52.380 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.372+0000 7f8f2e125640 1 -- 172.21.15.39:0/3660290000 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8f280b0710 msgr2=0x7f8f281489e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:52.380 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.372+0000 7f8f2e125640 1 --2- 172.21.15.39:0/3660290000 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8f280b0710 0x7f8f281489e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c0ae040 tx=0x7f8f1c0191e0 comp rx=0 tx=0).stop 2023-05-16T13:54:52.381 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.372+0000 7f8f2e125640 1 -- 172.21.15.39:0/3660290000 shutdown_connections 2023-05-16T13:54:52.381 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.372+0000 7f8f2e125640 1 --2- 172.21.15.39:0/3660290000 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8f280b4030 0x7f8f280af690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:52.381 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.372+0000 7f8f2e125640 1 --2- 172.21.15.39:0/3660290000 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8f280b0710 0x7f8f281489e0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:52.381 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.372+0000 7f8f2e125640 1 --2- 172.21.15.39:0/3660290000 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f8f14066280 0x7f8f14068730 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:52.381 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.372+0000 7f8f2e125640 1 --2- 172.21.15.39:0/3660290000 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8f28071b70 0x7f8f280c4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:52.381 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.372+0000 7f8f2e125640 1 -- 172.21.15.39:0/3660290000 >> 172.21.15.39:0/3660290000 conn(0x7f8f28069a50 msgr2=0x7f8f28159a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:52.381 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.372+0000 7f8f2e125640 1 -- 172.21.15.39:0/3660290000 shutdown_connections 2023-05-16T13:54:52.382 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.372+0000 7f8f2e125640 1 -- 172.21.15.39:0/3660290000 wait complete. 2023-05-16T13:54:52.399 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-16T13:54:52.539 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.532+0000 7fe0421bc640 1 Processor -- start 2023-05-16T13:54:52.539 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.532+0000 7fe0421bc640 1 -- start start 2023-05-16T13:54:52.540 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.532+0000 7fe0421bc640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe03c158e00 0x7fe03c0c9530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:52.540 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.532+0000 7fe0421bc640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe03c0ca030 con 0x7fe03c0c9a70 2023-05-16T13:54:52.540 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.532+0000 7fe0421bc640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe03c15c890 con 0x7fe03c0b0660 2023-05-16T13:54:52.540 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.532+0000 7fe0421bc640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe03c15cb70 con 0x7fe03c158e00 2023-05-16T13:54:52.542 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.536+0000 7fe03affd640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fe03c0c9a70 0x7fe03c0aff50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:35578/0 (socket says 172.21.15.39:35578) 2023-05-16T13:54:52.542 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.536+0000 7fe03affd640 1 -- 172.21.15.39:0/299971843 learned_addr learned my addr 172.21.15.39:0/299971843 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:52.542 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.536+0000 7fe03b7fe640 1 --2- 172.21.15.39:0/299971843 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe03c158e00 0x7fe03c0c9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:52.542 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.536+0000 7fe03a7fc640 1 -- 172.21.15.39:0/299971843 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 48531891 0 0) 0x7fe03c0ca030 con 0x7fe03c0c9a70 2023-05-16T13:54:52.542 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.536+0000 7fe03a7fc640 1 -- 172.21.15.39:0/299971843 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe024005740 con 0x7fe03c0c9a70 2023-05-16T13:54:52.543 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.536+0000 7fe03a7fc640 1 -- 172.21.15.39:0/299971843 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 855222031 0 0) 0x7fe03c15c890 con 0x7fe03c0b0660 2023-05-16T13:54:52.543 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.536+0000 7fe03a7fc640 1 -- 172.21.15.39:0/299971843 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe03c0ca030 con 0x7fe03c0b0660 2023-05-16T13:54:52.543 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.536+0000 7fe03a7fc640 1 -- 172.21.15.39:0/299971843 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2036918401 0 0) 0x7fe024005740 con 0x7fe03c0c9a70 2023-05-16T13:54:52.543 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.536+0000 7fe03a7fc640 1 -- 172.21.15.39:0/299971843 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe03c158e00 msgr2=0x7fe03c0c9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:52.543 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.536+0000 7fe03a7fc640 1 --2- 172.21.15.39:0/299971843 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe03c158e00 0x7fe03c0c9530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:52.543 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.536+0000 7fe03a7fc640 1 -- 172.21.15.39:0/299971843 >> v1:172.21.15.118:6789/0 conn(0x7fe03c0b0660 legacy=0x7fe03c070420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:52.543 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.536+0000 7fe03a7fc640 1 -- 172.21.15.39:0/299971843 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe03c15ce50 con 0x7fe03c0c9a70 2023-05-16T13:54:52.543 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.536+0000 7fe03a7fc640 1 -- 172.21.15.39:0/299971843 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1738805496 0 0) 0x7fe030001680 con 0x7fe03c0c9a70 2023-05-16T13:54:52.544 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.536+0000 7fe03a7fc640 1 -- 172.21.15.39:0/299971843 >> v1:172.21.15.39:6789/0 conn(0x7fe03c0c9a70 legacy=0x7fe03c0aff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:52.544 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.536+0000 7fe03a7fc640 1 --2- 172.21.15.39:0/299971843 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe024005d50 0x7fe024006140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:52.544 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.536+0000 7fe03a7fc640 1 --2- 172.21.15.39:0/299971843 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0240069e0 0x7fe024006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:52.544 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.536+0000 7fe03a7fc640 1 --2- 172.21.15.39:0/299971843 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe024007390 0x7fe02400dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:52.544 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.536+0000 7fe03a7fc640 1 -- 172.21.15.39:0/299971843 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe03c15cb70 con 0x7fe024007390 2023-05-16T13:54:52.544 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.536+0000 7fe03a7fc640 1 -- 172.21.15.39:0/299971843 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe02400e0e0 con 0x7fe0240069e0 2023-05-16T13:54:52.544 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.536+0000 7fe03a7fc640 1 -- 172.21.15.39:0/299971843 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe02400e270 con 0x7fe024005d50 2023-05-16T13:54:52.545 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.536+0000 7fe03b7fe640 1 --2- 172.21.15.39:0/299971843 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe03c158e00 0x7fe03c0c9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-16T13:54:52.545 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.536+0000 7fe03bfff640 1 --2- 172.21.15.39:0/299971843 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe024007390 0x7fe02400dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:52.545 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.536+0000 7fe03affd640 1 --2- 172.21.15.39:0/299971843 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0240069e0 0x7fe024006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:52.545 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.536+0000 7fe03b7fe640 1 --2- 172.21.15.39:0/299971843 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe024005d50 0x7fe024006140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:52.545 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.536+0000 7fe03bfff640 1 -- 172.21.15.39:0/299971843 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe024005d50 msgr2=0x7fe024006140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:52.545 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.536+0000 7fe03bfff640 1 --2- 172.21.15.39:0/299971843 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe024005d50 0x7fe024006140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:52.545 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.536+0000 7fe03bfff640 1 -- 172.21.15.39:0/299971843 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0240069e0 msgr2=0x7fe024006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:52.545 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.536+0000 7fe03bfff640 1 --2- 172.21.15.39:0/299971843 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0240069e0 0x7fe024006e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:52.546 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.536+0000 7fe03bfff640 1 -- 172.21.15.39:0/299971843 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe024005740 con 0x7fe024007390 2023-05-16T13:54:52.546 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.540+0000 7fe03bfff640 1 --2- 172.21.15.39:0/299971843 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe024007390 0x7fe02400dba0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe03c0adee0 tx=0x7fe03401c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d3015fd2b288a60 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:52.547 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.540+0000 7fe03a7fc640 1 -- 172.21.15.39:0/299971843 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe034003b80 con 0x7fe024007390 2023-05-16T13:54:52.547 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.540+0000 7fe03a7fc640 1 -- 172.21.15.39:0/299971843 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe034003d00 con 0x7fe024007390 2023-05-16T13:54:52.547 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.540+0000 7fe03a7fc640 1 -- 172.21.15.39:0/299971843 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe034005310 con 0x7fe024007390 2023-05-16T13:54:52.547 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.540+0000 7fe0421bc640 1 -- 172.21.15.39:0/299971843 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe024007390 msgr2=0x7fe02400dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:52.547 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.540+0000 7fe0421bc640 1 --2- 172.21.15.39:0/299971843 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe024007390 0x7fe02400dba0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe03c0adee0 tx=0x7fe03401c8c0 comp rx=0 tx=0).stop 2023-05-16T13:54:52.547 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.540+0000 7fe03bfff640 1 -- 172.21.15.39:0/299971843 reap_dead start 2023-05-16T13:54:52.547 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.540+0000 7fe0421bc640 1 -- 172.21.15.39:0/299971843 shutdown_connections 2023-05-16T13:54:52.548 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.540+0000 7fe0421bc640 1 -- 172.21.15.39:0/299971843 >> 172.21.15.39:0/299971843 conn(0x7fe03c069a50 msgr2=0x7fe03c069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:52.548 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.540+0000 7fe0421bc640 1 -- 172.21.15.39:0/299971843 shutdown_connections 2023-05-16T13:54:52.548 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.540+0000 7fe0421bc640 1 -- 172.21.15.39:0/299971843 wait complete. 2023-05-16T13:54:52.549 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.540+0000 7fe0421bc640 1 Processor -- start 2023-05-16T13:54:52.549 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.540+0000 7fe0421bc640 1 -- start start 2023-05-16T13:54:52.549 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.540+0000 7fe0421bc640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe024007390 0x7fe03c0b12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:52.550 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.544+0000 7fe0421bc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe03c1f5620 0x7fe03c0b1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:52.550 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.544+0000 7fe0421bc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe03c0b3390 0x7fe03c0b3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:52.550 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.544+0000 7fe0421bc640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe03c146450 con 0x7fe03c0b3390 2023-05-16T13:54:52.550 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.544+0000 7fe0421bc640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe03c145e90 con 0x7fe03c1f5620 2023-05-16T13:54:52.550 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.544+0000 7fe0421bc640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe03c146170 con 0x7fe024007390 2023-05-16T13:54:52.550 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.544+0000 7fe03bfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe03c0b3390 0x7fe03c0b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:52.550 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.544+0000 7fe03bfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe03c0b3390 0x7fe03c0b3810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34558/0 (socket says 172.21.15.39:34558) 2023-05-16T13:54:52.550 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.544+0000 7fe03bfff640 1 -- 172.21.15.39:0/551009374 learned_addr learned my addr 172.21.15.39:0/551009374 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:52.551 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.544+0000 7fe03b7fe640 1 --2- 172.21.15.39:0/551009374 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe024007390 0x7fe03c0b12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:52.551 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.544+0000 7fe03affd640 1 --2- 172.21.15.39:0/551009374 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe03c1f5620 0x7fe03c0b1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:52.551 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.544+0000 7fe03bfff640 1 -- 172.21.15.39:0/551009374 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe024007390 msgr2=0x7fe03c0b12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:52.551 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.544+0000 7fe03bfff640 1 --2- 172.21.15.39:0/551009374 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe024007390 0x7fe03c0b12e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:52.551 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.544+0000 7fe03bfff640 1 -- 172.21.15.39:0/551009374 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe03c1f5620 msgr2=0x7fe03c0b1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:52.551 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.544+0000 7fe03bfff640 1 --2- 172.21.15.39:0/551009374 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe03c1f5620 0x7fe03c0b1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:52.551 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.544+0000 7fe03bfff640 1 -- 172.21.15.39:0/551009374 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe03c0cc730 con 0x7fe03c0b3390 2023-05-16T13:54:52.551 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.544+0000 7fe03b7fe640 1 --2- 172.21.15.39:0/551009374 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe024007390 0x7fe03c0b12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-16T13:54:52.552 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.544+0000 7fe03bfff640 1 --2- 172.21.15.39:0/551009374 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe03c0b3390 0x7fe03c0b3810 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe03401c6f0 tx=0x7fe024007a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:52.552 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.544+0000 7fe023fff640 1 -- 172.21.15.39:0/551009374 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe034003b90 con 0x7fe03c0b3390 2023-05-16T13:54:52.553 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.544+0000 7fe023fff640 1 -- 172.21.15.39:0/551009374 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe034007e00 con 0x7fe03c0b3390 2023-05-16T13:54:52.553 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.544+0000 7fe023fff640 1 -- 172.21.15.39:0/551009374 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0340057f0 con 0x7fe03c0b3390 2023-05-16T13:54:52.553 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.544+0000 7fe0421bc640 1 -- 172.21.15.39:0/551009374 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe03c15d130 con 0x7fe03c0b3390 2023-05-16T13:54:52.553 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.544+0000 7fe0421bc640 1 -- 172.21.15.39:0/551009374 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe03c15d650 con 0x7fe03c0b3390 2023-05-16T13:54:52.553 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.544+0000 7fe0421bc640 1 -- 172.21.15.39:0/551009374 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe03c073c90 con 0x7fe03c0b3390 2023-05-16T13:54:52.553 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.544+0000 7fe023fff640 1 -- 172.21.15.39:0/551009374 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe034006b60 con 0x7fe03c0b3390 2023-05-16T13:54:52.554 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.548+0000 7fe023fff640 1 --2- 172.21.15.39:0/551009374 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fe028066280 0x7fe028068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:52.554 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.548+0000 7fe023fff640 1 -- 172.21.15.39:0/551009374 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe03411d3e0 con 0x7fe03c0b3390 2023-05-16T13:54:52.554 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.548+0000 7fe03b7fe640 1 --2- 172.21.15.39:0/551009374 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fe028066280 0x7fe028068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:52.554 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.548+0000 7fe03b7fe640 1 --2- 172.21.15.39:0/551009374 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fe028066280 0x7fe028068730 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe03c0c5b00 tx=0x7fe02c009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:52.557 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.552+0000 7fe023fff640 1 -- 172.21.15.39:0/551009374 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fe0340ea900 con 0x7fe03c0b3390 2023-05-16T13:54:52.710 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.704+0000 7fe0421bc640 1 -- 172.21.15.39:0/551009374 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe03c073c90 con 0x7fe03c0b3390 2023-05-16T13:54:52.710 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.704+0000 7fe023fff640 1 -- 172.21.15.39:0/551009374 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe0340edf20 con 0x7fe03c0b3390 2023-05-16T13:54:52.711 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2023-05-16T13:54:52.712 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.704+0000 7fe0421bc640 1 -- 172.21.15.39:0/551009374 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fe028066280 msgr2=0x7fe028068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:52.712 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.704+0000 7fe0421bc640 1 --2- 172.21.15.39:0/551009374 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fe028066280 0x7fe028068730 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe03c0c5b00 tx=0x7fe02c009190 comp rx=0 tx=0).stop 2023-05-16T13:54:52.712 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.704+0000 7fe0421bc640 1 -- 172.21.15.39:0/551009374 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe03c0b3390 msgr2=0x7fe03c0b3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:52.713 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.704+0000 7fe0421bc640 1 --2- 172.21.15.39:0/551009374 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe03c0b3390 0x7fe03c0b3810 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe03401c6f0 tx=0x7fe024007a10 comp rx=0 tx=0).stop 2023-05-16T13:54:52.713 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.704+0000 7fe0421bc640 1 -- 172.21.15.39:0/551009374 shutdown_connections 2023-05-16T13:54:52.713 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.704+0000 7fe0421bc640 1 --2- 172.21.15.39:0/551009374 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe03c0b3390 0x7fe03c0b3810 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:52.713 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.704+0000 7fe0421bc640 1 --2- 172.21.15.39:0/551009374 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe03c1f5620 0x7fe03c0b1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:52.713 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.704+0000 7fe0421bc640 1 --2- 172.21.15.39:0/551009374 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fe028066280 0x7fe028068730 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:52.713 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.704+0000 7fe0421bc640 1 --2- 172.21.15.39:0/551009374 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe024007390 0x7fe03c0b12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:52.713 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.704+0000 7fe0421bc640 1 -- 172.21.15.39:0/551009374 >> 172.21.15.39:0/551009374 conn(0x7fe03c069a50 msgr2=0x7fe03c0abae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:52.714 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.704+0000 7fe0421bc640 1 -- 172.21.15.39:0/551009374 shutdown_connections 2023-05-16T13:54:52.714 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.704+0000 7fe0421bc640 1 -- 172.21.15.39:0/551009374 wait complete. 2023-05-16T13:54:52.731 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-16T13:54:52.872 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.864+0000 7fb00358e640 1 Processor -- start 2023-05-16T13:54:52.872 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.864+0000 7fb00358e640 1 -- start start 2023-05-16T13:54:52.873 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.868+0000 7fb00358e640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faffc15c360 0x7faffc0cf450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:52.873 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.868+0000 7fb00358e640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7faffc0d0570 0x7faffc0cd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:52.874 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.868+0000 7fb00358e640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faffc0cd3b0 con 0x7faffc0cf080 2023-05-16T13:54:52.874 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.868+0000 7fb00358e640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faffc0cf990 con 0x7faffc0d0570 2023-05-16T13:54:52.874 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.868+0000 7fb00358e640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faffc0d0aa0 con 0x7faffc15c360 2023-05-16T13:54:52.874 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.868+0000 7fb002d8d640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7faffc0d0570 0x7faffc0cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:52.874 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.868+0000 7fb00258c640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7faffc0cf080 0x7faffc15d1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:35588/0 (socket says 172.21.15.39:35588) 2023-05-16T13:54:52.874 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.868+0000 7fb00258c640 1 -- 172.21.15.39:0/3408296774 learned_addr learned my addr 172.21.15.39:0/3408296774 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:52.874 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.868+0000 7fb001d8b640 1 --2- 172.21.15.39:0/3408296774 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faffc15c360 0x7faffc0cf450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:52.875 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.868+0000 7fb002d8d640 1 -- 172.21.15.39:0/3408296774 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faffc15c360 msgr2=0x7faffc0cf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:52.875 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.868+0000 7fb002d8d640 1 --2- 172.21.15.39:0/3408296774 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faffc15c360 0x7faffc0cf450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:52.875 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.868+0000 7fb002d8d640 1 -- 172.21.15.39:0/3408296774 >> v1:172.21.15.39:6789/0 conn(0x7faffc0cf080 legacy=0x7faffc15d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:52.875 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.868+0000 7fb002d8d640 1 -- 172.21.15.39:0/3408296774 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faffc0ccd60 con 0x7faffc0d0570 2023-05-16T13:54:52.876 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.868+0000 7fb00158a640 1 -- 172.21.15.39:0/3408296774 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2226344858 0 0) 0x7faffc0cd3b0 con 0x7faffc0cf080 2023-05-16T13:54:52.876 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.872+0000 7fb002d8d640 1 --2- 172.21.15.39:0/3408296774 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faffc0d0570 0x7faffc0cd840 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7faff4009d90 tx=0x7faff401c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f91d457dfd22420 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:52.877 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.872+0000 7fb00158a640 1 -- 172.21.15.39:0/3408296774 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff40a58d0 con 0x7faffc0d0570 2023-05-16T13:54:52.877 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.872+0000 7fb00158a640 1 -- 172.21.15.39:0/3408296774 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faff40a5a30 con 0x7faffc0d0570 2023-05-16T13:54:52.877 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.872+0000 7fb00158a640 1 -- 172.21.15.39:0/3408296774 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff40a5dc0 con 0x7faffc0d0570 2023-05-16T13:54:52.878 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.872+0000 7fb00358e640 1 -- 172.21.15.39:0/3408296774 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faffc0d0570 msgr2=0x7faffc0cd840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:52.878 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.872+0000 7fb00358e640 1 --2- 172.21.15.39:0/3408296774 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faffc0d0570 0x7faffc0cd840 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7faff4009d90 tx=0x7faff401c830 comp rx=0 tx=0).stop 2023-05-16T13:54:52.878 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.872+0000 7fb00358e640 1 -- 172.21.15.39:0/3408296774 shutdown_connections 2023-05-16T13:54:52.878 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.872+0000 7fb00358e640 1 --2- 172.21.15.39:0/3408296774 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faffc0d0570 0x7faffc0cd840 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:52.879 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.872+0000 7fb00358e640 1 --2- 172.21.15.39:0/3408296774 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faffc15c360 0x7faffc0cf450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:52.879 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.872+0000 7fb00358e640 1 -- 172.21.15.39:0/3408296774 >> 172.21.15.39:0/3408296774 conn(0x7faffc071aa0 msgr2=0x7faffc09b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:52.879 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.872+0000 7fb00358e640 1 -- 172.21.15.39:0/3408296774 shutdown_connections 2023-05-16T13:54:52.879 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.872+0000 7fb00358e640 1 -- 172.21.15.39:0/3408296774 wait complete. 2023-05-16T13:54:52.879 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.872+0000 7fb00358e640 1 Processor -- start 2023-05-16T13:54:52.880 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.872+0000 7fb00358e640 1 -- start start 2023-05-16T13:54:52.881 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.872+0000 7fb00358e640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faffc0cf080 0x7faffc151a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:52.881 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.872+0000 7fb00358e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faffc0d0570 0x7faffc1547f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:52.881 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.872+0000 7fb00358e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faffc15c360 0x7faffc154d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:52.881 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.872+0000 7fb00358e640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faffc153300 con 0x7faffc0d0570 2023-05-16T13:54:52.881 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.872+0000 7fb00358e640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faffc1535e0 con 0x7faffc15c360 2023-05-16T13:54:52.881 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.872+0000 7fb00358e640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faffc1538c0 con 0x7faffc0cf080 2023-05-16T13:54:52.882 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.872+0000 7fb001d8b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faffc0d0570 0x7faffc1547f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:52.882 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.876+0000 7fb00258c640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faffc0cf080 0x7faffc151a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:52.882 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.876+0000 7fb001d8b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faffc0d0570 0x7faffc1547f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34572/0 (socket says 172.21.15.39:34572) 2023-05-16T13:54:52.882 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.876+0000 7fb001d8b640 1 -- 172.21.15.39:0/3941529728 learned_addr learned my addr 172.21.15.39:0/3941529728 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:52.882 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.876+0000 7fb002d8d640 1 --2- 172.21.15.39:0/3941529728 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faffc15c360 0x7faffc154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:52.882 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.876+0000 7fb00258c640 1 -- 172.21.15.39:0/3941529728 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faffc15c360 msgr2=0x7faffc154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:52.882 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.876+0000 7fb00258c640 1 --2- 172.21.15.39:0/3941529728 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faffc15c360 0x7faffc154d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:52.882 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.876+0000 7fb00258c640 1 -- 172.21.15.39:0/3941529728 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faffc0d0570 msgr2=0x7faffc1547f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:52.883 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.876+0000 7fb00258c640 1 --2- 172.21.15.39:0/3941529728 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faffc0d0570 0x7faffc1547f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:52.883 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.876+0000 7fb00258c640 1 -- 172.21.15.39:0/3941529728 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faff4009a70 con 0x7faffc0cf080 2023-05-16T13:54:52.883 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.876+0000 7fb001d8b640 1 --2- 172.21.15.39:0/3941529728 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faffc0d0570 0x7faffc1547f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-16T13:54:52.884 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.876+0000 7fb00258c640 1 --2- 172.21.15.39:0/3941529728 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faffc0cf080 0x7faffc151a40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7faff8001370 tx=0x7faff800cbe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:52.884 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.876+0000 7faff2ffd640 1 -- 172.21.15.39:0/3941529728 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff8007270 con 0x7faffc0cf080 2023-05-16T13:54:52.884 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.876+0000 7faff2ffd640 1 -- 172.21.15.39:0/3941529728 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faff80073f0 con 0x7faffc0cf080 2023-05-16T13:54:52.884 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.876+0000 7fb00358e640 1 -- 172.21.15.39:0/3941529728 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faffc0ce720 con 0x7faffc0cf080 2023-05-16T13:54:52.884 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.876+0000 7faff2ffd640 1 -- 172.21.15.39:0/3941529728 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff8001d10 con 0x7faffc0cf080 2023-05-16T13:54:52.884 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.876+0000 7fb00358e640 1 -- 172.21.15.39:0/3941529728 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faffc0ce590 con 0x7faffc0cf080 2023-05-16T13:54:52.885 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.876+0000 7fb00358e640 1 -- 172.21.15.39:0/3941529728 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faffc0ce8b0 con 0x7faffc0cf080 2023-05-16T13:54:52.885 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.876+0000 7faff2ffd640 1 -- 172.21.15.39:0/3941529728 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7faff80057b0 con 0x7faffc0cf080 2023-05-16T13:54:52.885 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.880+0000 7faff2ffd640 1 --2- 172.21.15.39:0/3941529728 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fafe0066280 0x7fafe0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:52.885 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.880+0000 7faff2ffd640 1 -- 172.21.15.39:0/3941529728 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7faff8083330 con 0x7faffc0cf080 2023-05-16T13:54:52.886 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.880+0000 7fb001d8b640 1 --2- 172.21.15.39:0/3941529728 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fafe0066280 0x7fafe0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:52.886 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.880+0000 7fb001d8b640 1 --2- 172.21.15.39:0/3941529728 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fafe0066280 0x7fafe0068730 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7faffc0cc440 tx=0x7fafec008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:52.888 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:52.880+0000 7faff2ffd640 1 -- 172.21.15.39:0/3941529728 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7faff80508d0 con 0x7faffc0cf080 2023-05-16T13:54:53.043 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.036+0000 7fb00358e640 1 -- 172.21.15.39:0/3941529728 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7faffc166cc0 con 0x7faffc0cf080 2023-05-16T13:54:53.044 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.036+0000 7faff2ffd640 1 -- 172.21.15.39:0/3941529728 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7faff8053ef0 con 0x7faffc0cf080 2023-05-16T13:54:53.044 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 64 2023-05-16T13:54:53.045 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.040+0000 7fb00358e640 1 -- 172.21.15.39:0/3941529728 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fafe0066280 msgr2=0x7fafe0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:53.046 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.040+0000 7fb00358e640 1 --2- 172.21.15.39:0/3941529728 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fafe0066280 0x7fafe0068730 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7faffc0cc440 tx=0x7fafec008040 comp rx=0 tx=0).stop 2023-05-16T13:54:53.046 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.040+0000 7fb00358e640 1 -- 172.21.15.39:0/3941529728 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faffc0cf080 msgr2=0x7faffc151a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:53.046 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.040+0000 7fb00358e640 1 --2- 172.21.15.39:0/3941529728 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faffc0cf080 0x7faffc151a40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7faff8001370 tx=0x7faff800cbe0 comp rx=0 tx=0).stop 2023-05-16T13:54:53.046 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.040+0000 7fb00358e640 1 -- 172.21.15.39:0/3941529728 shutdown_connections 2023-05-16T13:54:53.046 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.040+0000 7fb00358e640 1 --2- 172.21.15.39:0/3941529728 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faffc15c360 0x7faffc154d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:53.046 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.040+0000 7fb00358e640 1 --2- 172.21.15.39:0/3941529728 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faffc0d0570 0x7faffc1547f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:53.046 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.040+0000 7fb00358e640 1 --2- 172.21.15.39:0/3941529728 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fafe0066280 0x7fafe0068730 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:53.047 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.040+0000 7fb00358e640 1 --2- 172.21.15.39:0/3941529728 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faffc0cf080 0x7faffc151a40 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:53.047 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.040+0000 7fb00358e640 1 -- 172.21.15.39:0/3941529728 >> 172.21.15.39:0/3941529728 conn(0x7faffc071aa0 msgr2=0x7faffc0b4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:53.047 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.040+0000 7fb00358e640 1 -- 172.21.15.39:0/3941529728 shutdown_connections 2023-05-16T13:54:53.047 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.040+0000 7fb00358e640 1 -- 172.21.15.39:0/3941529728 wait complete. 2023-05-16T13:54:53.064 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-16T13:54:53.203 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.196+0000 7feb7518f640 1 Processor -- start 2023-05-16T13:54:53.203 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.196+0000 7feb7518f640 1 -- start start 2023-05-16T13:54:53.204 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.196+0000 7feb7518f640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb7008a3e0 0x7feb700cb130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:53.204 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.196+0000 7feb7518f640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7feb7006c530 0x7feb700cb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:53.204 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.196+0000 7feb7518f640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb700caca0 con 0x7feb700cced0 2023-05-16T13:54:53.205 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.196+0000 7feb7518f640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb7015c710 con 0x7feb7006c530 2023-05-16T13:54:53.205 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.196+0000 7feb7518f640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb700cdd10 con 0x7feb7008a3e0 2023-05-16T13:54:53.205 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.196+0000 7feb6ed9d640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7feb700cced0 0x7feb700cd2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:35600/0 (socket says 172.21.15.39:35600) 2023-05-16T13:54:53.205 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.200+0000 7feb6ed9d640 1 -- 172.21.15.39:0/4178539689 learned_addr learned my addr 172.21.15.39:0/4178539689 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:53.206 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.200+0000 7feb67fff640 1 --2- 172.21.15.39:0/4178539689 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb7008a3e0 0x7feb700cb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:53.207 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.200+0000 7feb6f59e640 1 --2- 172.21.15.39:0/4178539689 >> v2:172.21.15.118:3300/0 conn(0x7feb7006c530 0x7feb700cb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:53.207 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.200+0000 7feb6e59c640 1 -- 172.21.15.39:0/4178539689 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3970032520 0 0) 0x7feb700caca0 con 0x7feb700cced0 2023-05-16T13:54:53.207 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.200+0000 7feb6e59c640 1 -- 172.21.15.39:0/4178539689 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb5c003530 con 0x7feb700cced0 2023-05-16T13:54:53.207 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.200+0000 7feb6e59c640 1 -- 172.21.15.39:0/4178539689 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3942942569 0 0) 0x7feb5c003530 con 0x7feb700cced0 2023-05-16T13:54:53.207 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.200+0000 7feb6e59c640 1 -- 172.21.15.39:0/4178539689 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb7008a3e0 msgr2=0x7feb700cb130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:53.207 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.200+0000 7feb6e59c640 1 --2- 172.21.15.39:0/4178539689 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb7008a3e0 0x7feb700cb130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:53.207 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.200+0000 7feb6e59c640 1 -- 172.21.15.39:0/4178539689 >> v2:172.21.15.118:3300/0 conn(0x7feb7006c530 msgr2=0x7feb700cb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:53.208 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.200+0000 7feb6e59c640 1 --2- 172.21.15.39:0/4178539689 >> v2:172.21.15.118:3300/0 conn(0x7feb7006c530 0x7feb700cb670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:53.208 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.200+0000 7feb6e59c640 1 -- 172.21.15.39:0/4178539689 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb700ce5f0 con 0x7feb700cced0 2023-05-16T13:54:53.208 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.200+0000 7feb6e59c640 1 -- 172.21.15.39:0/4178539689 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1738805496 0 0) 0x7feb60001680 con 0x7feb700cced0 2023-05-16T13:54:53.208 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.200+0000 7feb6e59c640 1 -- 172.21.15.39:0/4178539689 >> v1:172.21.15.39:6789/0 conn(0x7feb700cced0 legacy=0x7feb700cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:53.208 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.200+0000 7feb6e59c640 1 --2- 172.21.15.39:0/4178539689 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb7008a3e0 0x7feb5c003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:53.208 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.200+0000 7feb6e59c640 1 --2- 172.21.15.39:0/4178539689 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feb5c003f00 0x7feb5c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:53.208 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.200+0000 7feb6e59c640 1 --2- 172.21.15.39:0/4178539689 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb5c004d10 0x7feb5c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:53.208 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.200+0000 7feb6e59c640 1 -- 172.21.15.39:0/4178539689 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb7015c710 con 0x7feb5c003f00 2023-05-16T13:54:53.209 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.200+0000 7feb6e59c640 1 -- 172.21.15.39:0/4178539689 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb700cdd10 con 0x7feb5c004d10 2023-05-16T13:54:53.209 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.200+0000 7feb6e59c640 1 -- 172.21.15.39:0/4178539689 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb5c00b9c0 con 0x7feb7008a3e0 2023-05-16T13:54:53.209 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.200+0000 7feb67fff640 1 --2- 172.21.15.39:0/4178539689 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feb5c003f00 0x7feb5c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:53.209 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.200+0000 7feb6ed9d640 1 --2- 172.21.15.39:0/4178539689 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb7008a3e0 0x7feb5c003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:53.209 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.200+0000 7feb6f59e640 1 --2- 172.21.15.39:0/4178539689 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb5c004d10 0x7feb5c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:53.209 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.200+0000 7feb67fff640 1 -- 172.21.15.39:0/4178539689 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb7008a3e0 msgr2=0x7feb5c003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:53.209 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.200+0000 7feb67fff640 1 --2- 172.21.15.39:0/4178539689 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb7008a3e0 0x7feb5c003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:53.210 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.200+0000 7feb67fff640 1 -- 172.21.15.39:0/4178539689 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb5c004d10 msgr2=0x7feb5c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:53.210 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.200+0000 7feb67fff640 1 --2- 172.21.15.39:0/4178539689 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb5c004d10 0x7feb5c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:53.210 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.200+0000 7feb67fff640 1 -- 172.21.15.39:0/4178539689 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb5c003530 con 0x7feb5c003f00 2023-05-16T13:54:53.211 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.204+0000 7feb67fff640 1 --2- 172.21.15.39:0/4178539689 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feb5c003f00 0x7feb5c0047d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7feb58009ae0 tx=0x7feb5801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e00ceed161fb995 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:53.211 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.204+0000 7feb6e59c640 1 -- 172.21.15.39:0/4178539689 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb580a5530 con 0x7feb5c003f00 2023-05-16T13:54:53.211 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.204+0000 7feb6e59c640 1 -- 172.21.15.39:0/4178539689 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb580a5690 con 0x7feb5c003f00 2023-05-16T13:54:53.211 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.204+0000 7feb6e59c640 1 -- 172.21.15.39:0/4178539689 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb580a5a40 con 0x7feb5c003f00 2023-05-16T13:54:53.211 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.204+0000 7feb7518f640 1 -- 172.21.15.39:0/4178539689 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feb5c003f00 msgr2=0x7feb5c0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:53.211 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.204+0000 7feb7518f640 1 --2- 172.21.15.39:0/4178539689 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feb5c003f00 0x7feb5c0047d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7feb58009ae0 tx=0x7feb5801c9f0 comp rx=0 tx=0).stop 2023-05-16T13:54:53.212 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.204+0000 7feb6f59e640 1 -- 172.21.15.39:0/4178539689 reap_dead start 2023-05-16T13:54:53.212 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.204+0000 7feb7518f640 1 -- 172.21.15.39:0/4178539689 shutdown_connections 2023-05-16T13:54:53.212 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.204+0000 7feb7518f640 1 -- 172.21.15.39:0/4178539689 >> 172.21.15.39:0/4178539689 conn(0x7feb70089fe0 msgr2=0x7feb700d0650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:53.212 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.204+0000 7feb7518f640 1 -- 172.21.15.39:0/4178539689 shutdown_connections 2023-05-16T13:54:53.212 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.204+0000 7feb7518f640 1 -- 172.21.15.39:0/4178539689 wait complete. 2023-05-16T13:54:53.213 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.204+0000 7feb7518f640 1 Processor -- start 2023-05-16T13:54:53.213 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.204+0000 7feb7518f640 1 -- start start 2023-05-16T13:54:53.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.208+0000 7feb7518f640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb5c003f00 0x7feb700c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:53.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.208+0000 7feb7518f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb70151e10 0x7feb70156dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:53.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.208+0000 7feb7518f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feb70157300 0x7feb7015a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:53.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.208+0000 7feb7518f640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb700c7b00 con 0x7feb70157300 2023-05-16T13:54:53.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.208+0000 7feb7518f640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb700c7de0 con 0x7feb70151e10 2023-05-16T13:54:53.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.208+0000 7feb7518f640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb700c80c0 con 0x7feb5c003f00 2023-05-16T13:54:53.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.208+0000 7feb6f59e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feb70157300 0x7feb7015a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:53.215 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.208+0000 7feb6f59e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feb70157300 0x7feb7015a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34578/0 (socket says 172.21.15.39:34578) 2023-05-16T13:54:53.215 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.208+0000 7feb6f59e640 1 -- 172.21.15.39:0/3746849962 learned_addr learned my addr 172.21.15.39:0/3746849962 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:53.215 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.208+0000 7feb6ed9d640 1 --2- 172.21.15.39:0/3746849962 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb5c003f00 0x7feb700c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:53.215 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.208+0000 7feb67fff640 1 --2- 172.21.15.39:0/3746849962 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb70151e10 0x7feb70156dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:53.215 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.208+0000 7feb6f59e640 1 -- 172.21.15.39:0/3746849962 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb5c003f00 msgr2=0x7feb700c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:53.215 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.208+0000 7feb6f59e640 1 --2- 172.21.15.39:0/3746849962 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb5c003f00 0x7feb700c8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:53.215 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.208+0000 7feb6f59e640 1 -- 172.21.15.39:0/3746849962 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb70151e10 msgr2=0x7feb70156dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:53.215 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.208+0000 7feb6f59e640 1 --2- 172.21.15.39:0/3746849962 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb70151e10 0x7feb70156dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:53.216 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.208+0000 7feb6f59e640 1 -- 172.21.15.39:0/3746849962 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb700afb20 con 0x7feb70157300 2023-05-16T13:54:53.217 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.208+0000 7feb6f59e640 1 --2- 172.21.15.39:0/3746849962 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feb70157300 0x7feb7015a320 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7feb7015fd60 tx=0x7feb68011bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:53.217 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.208+0000 7feb677fe640 1 -- 172.21.15.39:0/3746849962 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6800e040 con 0x7feb70157300 2023-05-16T13:54:53.217 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.208+0000 7feb677fe640 1 -- 172.21.15.39:0/3746849962 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb6800f040 con 0x7feb70157300 2023-05-16T13:54:53.217 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.208+0000 7feb677fe640 1 -- 172.21.15.39:0/3746849962 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb68015a80 con 0x7feb70157300 2023-05-16T13:54:53.218 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.208+0000 7feb7518f640 1 -- 172.21.15.39:0/3746849962 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb700cd9b0 con 0x7feb70157300 2023-05-16T13:54:53.218 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.208+0000 7feb7518f640 1 -- 172.21.15.39:0/3746849962 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb700afcb0 con 0x7feb70157300 2023-05-16T13:54:53.218 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.208+0000 7feb7518f640 1 -- 172.21.15.39:0/3746849962 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb70073c90 con 0x7feb70157300 2023-05-16T13:54:53.218 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.208+0000 7feb677fe640 1 -- 172.21.15.39:0/3746849962 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7feb68015be0 con 0x7feb70157300 2023-05-16T13:54:53.218 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.212+0000 7feb677fe640 1 --2- 172.21.15.39:0/3746849962 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7feb50066280 0x7feb50068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:53.218 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.212+0000 7feb677fe640 1 -- 172.21.15.39:0/3746849962 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7feb68083bd0 con 0x7feb70157300 2023-05-16T13:54:53.219 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.212+0000 7feb6ed9d640 1 --2- 172.21.15.39:0/3746849962 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7feb50066280 0x7feb50068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:53.219 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.212+0000 7feb6ed9d640 1 --2- 172.21.15.39:0/3746849962 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7feb50066280 0x7feb50068730 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7feb60001600 tx=0x7feb60007900 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:53.221 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.216+0000 7feb677fe640 1 -- 172.21.15.39:0/3746849962 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7feb68051040 con 0x7feb70157300 2023-05-16T13:54:53.386 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.380+0000 7feb7518f640 1 -- 172.21.15.39:0/3746849962 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7feb7006bdb0 con 0x7feb70157300 2023-05-16T13:54:53.387 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.380+0000 7feb677fe640 1 -- 172.21.15.39:0/3746849962 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7feb68054660 con 0x7feb70157300 2023-05-16T13:54:53.387 INFO:teuthology.orchestra.run.smithi039.stderr:listed 0 entries 2023-05-16T13:54:53.389 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.380+0000 7feb7518f640 1 -- 172.21.15.39:0/3746849962 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7feb50066280 msgr2=0x7feb50068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:53.389 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.380+0000 7feb7518f640 1 --2- 172.21.15.39:0/3746849962 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7feb50066280 0x7feb50068730 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7feb60001600 tx=0x7feb60007900 comp rx=0 tx=0).stop 2023-05-16T13:54:53.389 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.380+0000 7feb7518f640 1 -- 172.21.15.39:0/3746849962 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feb70157300 msgr2=0x7feb7015a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:53.389 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.380+0000 7feb7518f640 1 --2- 172.21.15.39:0/3746849962 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feb70157300 0x7feb7015a320 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7feb7015fd60 tx=0x7feb68011bf0 comp rx=0 tx=0).stop 2023-05-16T13:54:53.390 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.384+0000 7feb7518f640 1 -- 172.21.15.39:0/3746849962 shutdown_connections 2023-05-16T13:54:53.390 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.384+0000 7feb7518f640 1 --2- 172.21.15.39:0/3746849962 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feb70157300 0x7feb7015a320 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:53.390 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.384+0000 7feb7518f640 1 --2- 172.21.15.39:0/3746849962 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb70151e10 0x7feb70156dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:53.390 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.384+0000 7feb7518f640 1 --2- 172.21.15.39:0/3746849962 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7feb50066280 0x7feb50068730 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:53.390 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.384+0000 7feb7518f640 1 --2- 172.21.15.39:0/3746849962 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7feb5c003f00 0x7feb700c8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:53.390 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.384+0000 7feb7518f640 1 -- 172.21.15.39:0/3746849962 >> 172.21.15.39:0/3746849962 conn(0x7feb70089fe0 msgr2=0x7feb7006f770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:53.390 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.384+0000 7feb7518f640 1 -- 172.21.15.39:0/3746849962 shutdown_connections 2023-05-16T13:54:53.391 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.384+0000 7feb7518f640 1 -- 172.21.15.39:0/3746849962 wait complete. 2023-05-16T13:54:53.407 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-05-16T13:54:53.408 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-16T13:54:53.416 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-16T13:54:53.592 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.584+0000 7f8c9da8c640 1 Processor -- start 2023-05-16T13:54:53.593 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.584+0000 7f8c9da8c640 1 -- start start 2023-05-16T13:54:53.594 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.588+0000 7f8c9da8c640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8c9806d4d0 0x7f8c9815cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:53.594 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.588+0000 7f8c9da8c640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f8c9815faa0 0x7f8c98069f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:53.594 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.588+0000 7f8c9da8c640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c98145c30 con 0x7f8c98145860 2023-05-16T13:54:53.594 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.588+0000 7f8c9da8c640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c98160060 con 0x7f8c9815faa0 2023-05-16T13:54:53.594 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.588+0000 7f8c9da8c640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c98160340 con 0x7f8c9806d4d0 2023-05-16T13:54:53.594 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.588+0000 7f8c97fff640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f8c9815faa0 0x7f8c98069f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:53.595 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.588+0000 7f8c97fff640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f8c9815faa0 0x7f8c98069f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34582/0 (socket says 172.21.15.39:34582) 2023-05-16T13:54:53.595 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.588+0000 7f8c977fe640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f8c98145860 0x7f8c9806cdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:35614/0 (socket says 172.21.15.39:35614) 2023-05-16T13:54:53.595 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.588+0000 7f8c97fff640 1 -- 172.21.15.39:0/4015899569 learned_addr learned my addr 172.21.15.39:0/4015899569 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:53.595 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.588+0000 7f8c96ffd640 1 --2- 172.21.15.39:0/4015899569 >> v2:172.21.15.118:3300/0 conn(0x7f8c9806d4d0 0x7f8c9815cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:53.596 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.588+0000 7f8c97fff640 1 -- 172.21.15.39:0/4015899569 >> v2:172.21.15.118:3300/0 conn(0x7f8c9806d4d0 msgr2=0x7f8c9815cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:53.596 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.588+0000 7f8c97fff640 1 --2- 172.21.15.39:0/4015899569 >> v2:172.21.15.118:3300/0 conn(0x7f8c9806d4d0 0x7f8c9815cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:53.596 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.588+0000 7f8c97fff640 1 -- 172.21.15.39:0/4015899569 >> v1:172.21.15.39:6789/0 conn(0x7f8c98145860 legacy=0x7f8c9806cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:53.596 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.588+0000 7f8c97fff640 1 -- 172.21.15.39:0/4015899569 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c98160620 con 0x7f8c9815faa0 2023-05-16T13:54:53.597 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.592+0000 7f8c97fff640 1 --2- 172.21.15.39:0/4015899569 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8c9815faa0 0x7f8c98069f70 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8c980cec00 tx=0x7f8c9001c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99c3580be88800bc server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:53.597 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.592+0000 7f8c967fc640 1 -- 172.21.15.39:0/4015899569 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c900a57a0 con 0x7f8c9815faa0 2023-05-16T13:54:53.598 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.592+0000 7f8c967fc640 1 -- 172.21.15.39:0/4015899569 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c900a5900 con 0x7f8c9815faa0 2023-05-16T13:54:53.598 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.592+0000 7f8c967fc640 1 -- 172.21.15.39:0/4015899569 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c900a5c90 con 0x7f8c9815faa0 2023-05-16T13:54:53.599 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.592+0000 7f8c9da8c640 1 -- 172.21.15.39:0/4015899569 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8c9815faa0 msgr2=0x7f8c98069f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:53.599 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.592+0000 7f8c9da8c640 1 --2- 172.21.15.39:0/4015899569 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8c9815faa0 0x7f8c98069f70 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8c980cec00 tx=0x7f8c9001c9d0 comp rx=0 tx=0).stop 2023-05-16T13:54:53.599 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.592+0000 7f8c9da8c640 1 -- 172.21.15.39:0/4015899569 shutdown_connections 2023-05-16T13:54:53.599 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.592+0000 7f8c9da8c640 1 --2- 172.21.15.39:0/4015899569 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8c9815faa0 0x7f8c98069f70 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:53.599 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.592+0000 7f8c9da8c640 1 --2- 172.21.15.39:0/4015899569 >> v2:172.21.15.118:3300/0 conn(0x7f8c9806d4d0 0x7f8c9815cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:53.600 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.592+0000 7f8c9da8c640 1 -- 172.21.15.39:0/4015899569 >> 172.21.15.39:0/4015899569 conn(0x7f8c980cb6d0 msgr2=0x7f8c980cbad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:53.600 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.592+0000 7f8c9da8c640 1 -- 172.21.15.39:0/4015899569 shutdown_connections 2023-05-16T13:54:53.600 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.592+0000 7f8c9da8c640 1 -- 172.21.15.39:0/4015899569 wait complete. 2023-05-16T13:54:53.601 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.592+0000 7f8c9da8c640 1 Processor -- start 2023-05-16T13:54:53.602 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.592+0000 7f8c9da8c640 1 -- start start 2023-05-16T13:54:53.602 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.596+0000 7f8c9da8c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8c9806d4d0 0x7f8c980b4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:53.602 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.596+0000 7f8c9da8c640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c98145860 0x7f8c98139e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:53.602 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.596+0000 7f8c9da8c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c9815faa0 0x7f8c98158370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:53.602 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.596+0000 7f8c9da8c640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c98159140 con 0x7f8c9806d4d0 2023-05-16T13:54:53.602 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.596+0000 7f8c9da8c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c98140ec0 con 0x7f8c9815faa0 2023-05-16T13:54:53.603 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.596+0000 7f8c9da8c640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c981411a0 con 0x7f8c98145860 2023-05-16T13:54:53.603 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.596+0000 7f8c977fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8c9806d4d0 0x7f8c980b4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:53.603 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.596+0000 7f8c977fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8c9806d4d0 0x7f8c980b4660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34598/0 (socket says 172.21.15.39:34598) 2023-05-16T13:54:53.603 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.596+0000 7f8c977fe640 1 -- 172.21.15.39:0/1010013325 learned_addr learned my addr 172.21.15.39:0/1010013325 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:53.603 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.596+0000 7f8c96ffd640 1 --2- 172.21.15.39:0/1010013325 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c98145860 0x7f8c98139e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:53.603 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.596+0000 7f8c97fff640 1 --2- 172.21.15.39:0/1010013325 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c9815faa0 0x7f8c98158370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:53.603 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.596+0000 7f8c977fe640 1 -- 172.21.15.39:0/1010013325 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c98145860 msgr2=0x7f8c98139e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:53.604 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.596+0000 7f8c977fe640 1 --2- 172.21.15.39:0/1010013325 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c98145860 0x7f8c98139e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:53.604 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.596+0000 7f8c977fe640 1 -- 172.21.15.39:0/1010013325 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c9815faa0 msgr2=0x7f8c98158370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:53.604 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.596+0000 7f8c977fe640 1 --2- 172.21.15.39:0/1010013325 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c9815faa0 0x7f8c98158370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:53.604 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.596+0000 7f8c977fe640 1 -- 172.21.15.39:0/1010013325 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c90009b30 con 0x7f8c9806d4d0 2023-05-16T13:54:53.604 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.596+0000 7f8c977fe640 1 --2- 172.21.15.39:0/1010013325 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8c9806d4d0 0x7f8c980b4660 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8c8800c4c0 tx=0x7f8c8800c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:53.605 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.596+0000 7f8c7ffff640 1 -- 172.21.15.39:0/1010013325 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c88007480 con 0x7f8c9806d4d0 2023-05-16T13:54:53.606 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.596+0000 7f8c7ffff640 1 -- 172.21.15.39:0/1010013325 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c880075e0 con 0x7f8c9806d4d0 2023-05-16T13:54:53.606 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.596+0000 7f8c7ffff640 1 -- 172.21.15.39:0/1010013325 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c88004a10 con 0x7f8c9806d4d0 2023-05-16T13:54:53.606 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.596+0000 7f8c9da8c640 1 -- 172.21.15.39:0/1010013325 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c9806ae50 con 0x7f8c9806d4d0 2023-05-16T13:54:53.606 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.596+0000 7f8c9da8c640 1 -- 172.21.15.39:0/1010013325 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c9806acc0 con 0x7f8c9806d4d0 2023-05-16T13:54:53.606 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.596+0000 7f8c9da8c640 1 -- 172.21.15.39:0/1010013325 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c9806afe0 con 0x7f8c9806d4d0 2023-05-16T13:54:53.607 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.596+0000 7f8c7ffff640 1 -- 172.21.15.39:0/1010013325 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8c88004b70 con 0x7f8c9806d4d0 2023-05-16T13:54:53.607 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.600+0000 7f8c7ffff640 1 --2- 172.21.15.39:0/1010013325 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f8c84066280 0x7f8c84068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:53.607 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.600+0000 7f8c7ffff640 1 -- 172.21.15.39:0/1010013325 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8c88082f70 con 0x7f8c9806d4d0 2023-05-16T13:54:53.607 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.600+0000 7f8c96ffd640 1 --2- 172.21.15.39:0/1010013325 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f8c84066280 0x7f8c84068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:53.607 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.600+0000 7f8c96ffd640 1 --2- 172.21.15.39:0/1010013325 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f8c84066280 0x7f8c84068730 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8c98142e10 tx=0x7f8c8c009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:53.609 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.604+0000 7f8c7ffff640 1 -- 172.21.15.39:0/1010013325 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f8c88050380 con 0x7f8c9806d4d0 2023-05-16T13:54:53.766 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.760+0000 7f8c9da8c640 1 -- 172.21.15.39:0/1010013325 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8c98073c90 con 0x7f8c9806d4d0 2023-05-16T13:54:53.767 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.760+0000 7f8c7ffff640 1 -- 172.21.15.39:0/1010013325 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18279 (secure 0 0 0) 0x7f8c880539a0 con 0x7f8c9806d4d0 2023-05-16T13:54:53.767 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:54:53.767 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":24,"fsid":"9c1e210b-c515-4ea4-a065-397956895c68","created":"2023-05-16T13:53:48.955290+0000","modified":"2023-05-16T13:54:16.194544+0000","last_up_change":"2023-05-16T13:54:01.722051+0000","last_in_change":"2023-05-16T13:53:52.331336+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-16T13:54:00.885009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-16T13:54:08.327895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-16T13:54:12.864823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-16T13:54:14.180225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4ce0f0ba-c4bf-4405-8c95-d2e9a62878ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6809","nonce":3462013698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6811","nonce":3462013698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6815","nonce":3462013698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6813","nonce":3462013698}]},"public_addr":"172.21.15.39:6809/3462013698","cluster_addr":"172.21.15.39:6811/3462013698","heartbeat_back_addr":"172.21.15.39:6815/3462013698","heartbeat_front_addr":"172.21.15.39:6813/3462013698","state":["exists","up"]},{"osd":1,"uuid":"53fdc1ac-2473-472d-af32-2760fdf6e476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6801","nonce":2829970892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6803","nonce":2829970892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6807","nonce":2829970892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6805","nonce":2829970892}]},"public_addr":"172.21.15.39:6801/2829970892","cluster_addr":"172.21.15.39:6803/2829970892","heartbeat_back_addr":"172.21.15.39:6807/2829970892","heartbeat_front_addr":"172.21.15.39:6805/2829970892","state":["exists","up"]},{"osd":2,"uuid":"0b92d770-7030-42fa-a19f-4f7f1ac113c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6817","nonce":3888067413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6819","nonce":3888067413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6823","nonce":3888067413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6821","nonce":3888067413}]},"public_addr":"172.21.15.39:6817/3888067413","cluster_addr":"172.21.15.39:6819/3888067413","heartbeat_back_addr":"172.21.15.39:6823/3888067413","heartbeat_front_addr":"172.21.15.39:6821/3888067413","state":["exists","up"]},{"osd":3,"uuid":"000d9506-cbb2-4017-b875-deca579860ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6825","nonce":405003958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6827","nonce":405003958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6831","nonce":405003958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6829","nonce":405003958}]},"public_addr":"172.21.15.39:6825/405003958","cluster_addr":"172.21.15.39:6827/405003958","heartbeat_back_addr":"172.21.15.39:6831/405003958","heartbeat_front_addr":"172.21.15.39:6829/405003958","state":["exists","up"]},{"osd":4,"uuid":"70f0dacb-e960-40c5-bf6a-183e52bbe2ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6801","nonce":3895278838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6805","nonce":3895278838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6813","nonce":3895278838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6809","nonce":3895278838}]},"public_addr":"172.21.15.118:6801/3895278838","cluster_addr":"172.21.15.118:6805/3895278838","heartbeat_back_addr":"172.21.15.118:6813/3895278838","heartbeat_front_addr":"172.21.15.118:6809/3895278838","state":["exists","up"]},{"osd":5,"uuid":"756feb54-c3ae-4a2a-8f74-85c291ba707c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6804","nonce":3513592808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6808","nonce":3513592808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6815","nonce":3513592808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6812","nonce":3513592808}]},"public_addr":"172.21.15.118:6804/3513592808","cluster_addr":"172.21.15.118:6808/3513592808","heartbeat_back_addr":"172.21.15.118:6815/3513592808","heartbeat_front_addr":"172.21.15.118:6812/3513592808","state":["exists","up"]},{"osd":6,"uuid":"c4a982c1-f497-4b0f-8a23-c77372e4621e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6824","nonce":1863656053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6827","nonce":1863656053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6831","nonce":1863656053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6829","nonce":1863656053}]},"public_addr":"172.21.15.118:6824/1863656053","cluster_addr":"172.21.15.118:6827/1863656053","heartbeat_back_addr":"172.21.15.118:6831/1863656053","heartbeat_front_addr":"172.21.15.118:6829/1863656053","state":["exists","up"]},{"osd":7,"uuid":"6f2888aa-a7ac-4e26-9159-e31817934f44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6817","nonce":3636642904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6819","nonce":3636642904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6825","nonce":3636642904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6821","nonce":3636642904}]},"public_addr":"172.21.15.118:6817/3636642904","cluster_addr":"172.21.15.118:6819/3636642904","heartbeat_back_addr":"172.21.15.118:6825/3636642904","heartbeat_front_addr":"172.21.15.118:6821/3636642904","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.717636+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.724036+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.739144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:58.079275+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:58.073921+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.930466+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.987813+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.941098+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-16T13:54:53.769 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.764+0000 7f8c9da8c640 1 -- 172.21.15.39:0/1010013325 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f8c84066280 msgr2=0x7f8c84068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:53.769 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.764+0000 7f8c9da8c640 1 --2- 172.21.15.39:0/1010013325 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f8c84066280 0x7f8c84068730 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8c98142e10 tx=0x7f8c8c009190 comp rx=0 tx=0).stop 2023-05-16T13:54:53.769 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.764+0000 7f8c9da8c640 1 -- 172.21.15.39:0/1010013325 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8c9806d4d0 msgr2=0x7f8c980b4660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:53.769 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.764+0000 7f8c9da8c640 1 --2- 172.21.15.39:0/1010013325 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8c9806d4d0 0x7f8c980b4660 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8c8800c4c0 tx=0x7f8c8800c980 comp rx=0 tx=0).stop 2023-05-16T13:54:53.769 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.764+0000 7f8c9da8c640 1 -- 172.21.15.39:0/1010013325 shutdown_connections 2023-05-16T13:54:53.770 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.764+0000 7f8c9da8c640 1 --2- 172.21.15.39:0/1010013325 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f8c84066280 0x7f8c84068730 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:53.770 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.764+0000 7f8c9da8c640 1 --2- 172.21.15.39:0/1010013325 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c98145860 0x7f8c98139e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:53.770 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.764+0000 7f8c9da8c640 1 --2- 172.21.15.39:0/1010013325 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c9815faa0 0x7f8c98158370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:53.770 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.764+0000 7f8c9da8c640 1 --2- 172.21.15.39:0/1010013325 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8c9806d4d0 0x7f8c980b4660 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:53.770 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.764+0000 7f8c9da8c640 1 -- 172.21.15.39:0/1010013325 >> 172.21.15.39:0/1010013325 conn(0x7f8c980cb6d0 msgr2=0x7f8c9815c410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:53.770 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.764+0000 7f8c9da8c640 1 -- 172.21.15.39:0/1010013325 shutdown_connections 2023-05-16T13:54:53.770 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.764+0000 7f8c9da8c640 1 -- 172.21.15.39:0/1010013325 wait complete. 2023-05-16T13:54:53.788 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-16T13:54:00.885009+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-16T13:54:08.327895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-16T13:54:12.864823+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-16T13:54:14.180225+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-16T13:54:53.789 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-16T13:54:53.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.928+0000 7f61ba48c640 1 Processor -- start 2023-05-16T13:54:53.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.928+0000 7f61ba48c640 1 -- start start 2023-05-16T13:54:53.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.928+0000 7f61ba48c640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f61b415c490 0x7f61b40ad300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:53.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.928+0000 7f61ba48c640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f61b406c690 0x7f61b40b0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:53.936 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.928+0000 7f61ba48c640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61b406b520 con 0x7f61b40b1a70 2023-05-16T13:54:53.936 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.928+0000 7f61ba48c640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61b40cee10 con 0x7f61b415c490 2023-05-16T13:54:53.936 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.928+0000 7f61ba48c640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61b40ad840 con 0x7f61b406c690 2023-05-16T13:54:53.937 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.928+0000 7f61b8a29640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f61b406c690 0x7f61b40b0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:53.937 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.928+0000 7f61b8a29640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f61b406c690 0x7f61b40b0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.39:44740/0 (socket says 172.21.15.39:44740) 2023-05-16T13:54:53.937 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.928+0000 7f61b8a29640 1 -- 172.21.15.39:0/1125978611 learned_addr learned my addr 172.21.15.39:0/1125978611 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:53.937 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.928+0000 7f61b3fff640 1 --2- 172.21.15.39:0/1125978611 >> v2:172.21.15.118:3300/0 conn(0x7f61b415c490 0x7f61b40ad300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:53.937 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.928+0000 7f61b8a29640 1 -- 172.21.15.39:0/1125978611 >> v2:172.21.15.118:3300/0 conn(0x7f61b415c490 msgr2=0x7f61b40ad300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:53.937 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.928+0000 7f61b8a29640 1 --2- 172.21.15.39:0/1125978611 >> v2:172.21.15.118:3300/0 conn(0x7f61b415c490 0x7f61b40ad300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:53.938 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.928+0000 7f61b8a29640 1 -- 172.21.15.39:0/1125978611 >> v1:172.21.15.118:6789/0 conn(0x7f61b40b1a70 legacy=0x7f61b406bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:53.938 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.928+0000 7f61b8a29640 1 -- 172.21.15.39:0/1125978611 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61b406cb10 con 0x7f61b406c690 2023-05-16T13:54:53.938 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.932+0000 7f61b3fff640 1 --2- 172.21.15.39:0/1125978611 >> v2:172.21.15.118:3300/0 conn(0x7f61b415c490 0x7f61b40ad300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-16T13:54:53.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.932+0000 7f61b8a29640 1 --2- 172.21.15.39:0/1125978611 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f61b406c690 0x7f61b40b0ab0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f61ac009e50 tx=0x7f61ac01c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48421406b35a2c8 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:53.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.932+0000 7f61b2ffd640 1 -- 172.21.15.39:0/1125978611 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61ac0a58d0 con 0x7f61b406c690 2023-05-16T13:54:53.940 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.932+0000 7f61b2ffd640 1 -- 172.21.15.39:0/1125978611 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61ac0a5a30 con 0x7f61b406c690 2023-05-16T13:54:53.940 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.932+0000 7f61b2ffd640 1 -- 172.21.15.39:0/1125978611 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61ac0a5dc0 con 0x7f61b406c690 2023-05-16T13:54:53.940 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.932+0000 7f61ba48c640 1 -- 172.21.15.39:0/1125978611 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f61b406c690 msgr2=0x7f61b40b0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:53.941 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.932+0000 7f61ba48c640 1 --2- 172.21.15.39:0/1125978611 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f61b406c690 0x7f61b40b0ab0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f61ac009e50 tx=0x7f61ac01c9e0 comp rx=0 tx=0).stop 2023-05-16T13:54:53.941 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.932+0000 7f61ba48c640 1 -- 172.21.15.39:0/1125978611 shutdown_connections 2023-05-16T13:54:53.941 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.932+0000 7f61ba48c640 1 --2- 172.21.15.39:0/1125978611 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f61b406c690 0x7f61b40b0ab0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:53.941 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.932+0000 7f61ba48c640 1 --2- 172.21.15.39:0/1125978611 >> v2:172.21.15.118:3300/0 conn(0x7f61b415c490 0x7f61b40ad300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:53.941 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.932+0000 7f61ba48c640 1 -- 172.21.15.39:0/1125978611 >> 172.21.15.39:0/1125978611 conn(0x7f61b40999a0 msgr2=0x7f61b40d0670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:53.941 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.932+0000 7f61ba48c640 1 -- 172.21.15.39:0/1125978611 shutdown_connections 2023-05-16T13:54:53.941 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.932+0000 7f61ba48c640 1 -- 172.21.15.39:0/1125978611 wait complete. 2023-05-16T13:54:53.942 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.936+0000 7f61ba48c640 1 Processor -- start 2023-05-16T13:54:53.942 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.936+0000 7f61ba48c640 1 -- start start 2023-05-16T13:54:53.943 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.936+0000 7f61ba48c640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f61b406c690 0x7f61b414f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:53.943 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.936+0000 7f61ba48c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f61b40b1a70 0x7f61b4147190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:53.943 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.936+0000 7f61ba48c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f61b415c490 0x7f61b4158d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:53.943 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.936+0000 7f61ba48c640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b414f780 con 0x7f61b415c490 2023-05-16T13:54:53.944 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.936+0000 7f61ba48c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b41588d0 con 0x7f61b40b1a70 2023-05-16T13:54:53.944 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.936+0000 7f61ba48c640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61b414ef10 con 0x7f61b406c690 2023-05-16T13:54:53.944 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.936+0000 7f61b8a29640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f61b415c490 0x7f61b4158d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:53.944 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.936+0000 7f61b8a29640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f61b415c490 0x7f61b4158d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34602/0 (socket says 172.21.15.39:34602) 2023-05-16T13:54:53.944 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.936+0000 7f61b8a29640 1 -- 172.21.15.39:0/422654040 learned_addr learned my addr 172.21.15.39:0/422654040 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:53.945 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.936+0000 7f61b37fe640 1 --2- 172.21.15.39:0/422654040 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f61b40b1a70 0x7f61b4147190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:53.945 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.936+0000 7f61b3fff640 1 --2- 172.21.15.39:0/422654040 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f61b406c690 0x7f61b414f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:53.945 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.936+0000 7f61b8a29640 1 -- 172.21.15.39:0/422654040 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f61b406c690 msgr2=0x7f61b414f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:53.946 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.936+0000 7f61b8a29640 1 --2- 172.21.15.39:0/422654040 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f61b406c690 0x7f61b414f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:53.946 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.936+0000 7f61b8a29640 1 -- 172.21.15.39:0/422654040 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f61b40b1a70 msgr2=0x7f61b4147190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:53.946 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.936+0000 7f61b8a29640 1 --2- 172.21.15.39:0/422654040 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f61b40b1a70 0x7f61b4147190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:53.946 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.936+0000 7f61b8a29640 1 -- 172.21.15.39:0/422654040 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a4009420 con 0x7f61b415c490 2023-05-16T13:54:53.946 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.936+0000 7f61b8a29640 1 --2- 172.21.15.39:0/422654040 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f61b415c490 0x7f61b4158d60 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f61ac0af040 tx=0x7f61ac019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:53.946 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.936+0000 7f61b0ff9640 1 -- 172.21.15.39:0/422654040 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61ac0b8670 con 0x7f61b415c490 2023-05-16T13:54:53.946 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.936+0000 7f61b0ff9640 1 -- 172.21.15.39:0/422654040 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61ac0b87d0 con 0x7f61b415c490 2023-05-16T13:54:53.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.936+0000 7f61b0ff9640 1 -- 172.21.15.39:0/422654040 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61ac0b8b80 con 0x7f61b415c490 2023-05-16T13:54:53.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.936+0000 7f61ba48c640 1 -- 172.21.15.39:0/422654040 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61ac009b30 con 0x7f61b415c490 2023-05-16T13:54:53.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.940+0000 7f61ba48c640 1 -- 172.21.15.39:0/422654040 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61b406b780 con 0x7f61b415c490 2023-05-16T13:54:53.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.940+0000 7f61ba48c640 1 -- 172.21.15.39:0/422654040 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61b40ceb30 con 0x7f61b415c490 2023-05-16T13:54:53.948 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.940+0000 7f61b0ff9640 1 -- 172.21.15.39:0/422654040 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f61ac0b8ce0 con 0x7f61b415c490 2023-05-16T13:54:53.948 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.940+0000 7f61b0ff9640 1 --2- 172.21.15.39:0/422654040 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f61a0066280 0x7f61a0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:53.948 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.940+0000 7f61b0ff9640 1 -- 172.21.15.39:0/422654040 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f61ac11f230 con 0x7f61b415c490 2023-05-16T13:54:53.948 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.940+0000 7f61b3fff640 1 --2- 172.21.15.39:0/422654040 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f61a0066280 0x7f61a0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:53.948 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.940+0000 7f61b3fff640 1 --2- 172.21.15.39:0/422654040 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f61a0066280 0x7f61a0068730 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f61a4009c80 tx=0x7f61a4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:53.951 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:53.944+0000 7f61b0ff9640 1 -- 172.21.15.39:0/422654040 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f61ac0ec750 con 0x7f61b415c490 2023-05-16T13:54:54.106 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.100+0000 7f61ba48c640 1 -- 172.21.15.39:0/422654040 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f61b406ba60 con 0x7f61b415c490 2023-05-16T13:54:54.106 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.100+0000 7f61b0ff9640 1 -- 172.21.15.39:0/422654040 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f61ac0efd70 con 0x7f61b415c490 2023-05-16T13:54:54.106 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2023-05-16T13:54:54.108 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.100+0000 7f61ba48c640 1 -- 172.21.15.39:0/422654040 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f61a0066280 msgr2=0x7f61a0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:54.108 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.100+0000 7f61ba48c640 1 --2- 172.21.15.39:0/422654040 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f61a0066280 0x7f61a0068730 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f61a4009c80 tx=0x7f61a4008040 comp rx=0 tx=0).stop 2023-05-16T13:54:54.108 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.100+0000 7f61ba48c640 1 -- 172.21.15.39:0/422654040 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f61b415c490 msgr2=0x7f61b4158d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:54.108 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.100+0000 7f61ba48c640 1 --2- 172.21.15.39:0/422654040 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f61b415c490 0x7f61b4158d60 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f61ac0af040 tx=0x7f61ac019780 comp rx=0 tx=0).stop 2023-05-16T13:54:54.109 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.100+0000 7f61ba48c640 1 -- 172.21.15.39:0/422654040 shutdown_connections 2023-05-16T13:54:54.109 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.100+0000 7f61ba48c640 1 --2- 172.21.15.39:0/422654040 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f61b415c490 0x7f61b4158d60 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:54.109 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.100+0000 7f61ba48c640 1 --2- 172.21.15.39:0/422654040 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f61b40b1a70 0x7f61b4147190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:54.109 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.100+0000 7f61ba48c640 1 --2- 172.21.15.39:0/422654040 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f61a0066280 0x7f61a0068730 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:54.109 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.100+0000 7f61ba48c640 1 --2- 172.21.15.39:0/422654040 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f61b406c690 0x7f61b414f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:54.109 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.100+0000 7f61ba48c640 1 -- 172.21.15.39:0/422654040 >> 172.21.15.39:0/422654040 conn(0x7f61b40999a0 msgr2=0x7f61b40d0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:54.109 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.100+0000 7f61ba48c640 1 -- 172.21.15.39:0/422654040 shutdown_connections 2023-05-16T13:54:54.109 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.100+0000 7f61ba48c640 1 -- 172.21.15.39:0/422654040 wait complete. 2023-05-16T13:54:54.127 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-16T13:54:54.268 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.260+0000 7f8164220640 1 Processor -- start 2023-05-16T13:54:54.269 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.264+0000 7f8164220640 1 -- start start 2023-05-16T13:54:54.270 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.264+0000 7f8164220640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f815c0cb0f0 0x7f815c160430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:54.270 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.264+0000 7f8164220640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f815c160970 0x7f815c0718a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:54.270 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.264+0000 7f8164220640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f815c0cee40 con 0x7f815c071de0 2023-05-16T13:54:54.270 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.264+0000 7f8164220640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f815c0cd490 con 0x7f815c160970 2023-05-16T13:54:54.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.264+0000 7f8164220640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f815c0cf120 con 0x7f815c0cb0f0 2023-05-16T13:54:54.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.264+0000 7f81617bb640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f815c160970 0x7f815c0718a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:54.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.264+0000 7f81627bd640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f815c071de0 0x7f815c069a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:35628/0 (socket says 172.21.15.39:35628) 2023-05-16T13:54:54.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.264+0000 7f81627bd640 1 -- 172.21.15.39:0/3646866109 learned_addr learned my addr 172.21.15.39:0/3646866109 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:54.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.264+0000 7f8161fbc640 1 --2- 172.21.15.39:0/3646866109 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f815c0cb0f0 0x7f815c160430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:54.272 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.264+0000 7f81617bb640 1 -- 172.21.15.39:0/3646866109 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f815c0cb0f0 msgr2=0x7f815c160430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:54.272 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.264+0000 7f8160fba640 1 -- 172.21.15.39:0/3646866109 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3047945584 0 0) 0x7f815c0cee40 con 0x7f815c071de0 2023-05-16T13:54:54.272 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.264+0000 7f81617bb640 1 --2- 172.21.15.39:0/3646866109 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f815c0cb0f0 0x7f815c160430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:54.272 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.264+0000 7f81617bb640 1 -- 172.21.15.39:0/3646866109 >> v1:172.21.15.39:6789/0 conn(0x7f815c071de0 legacy=0x7f815c069a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:54.272 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.264+0000 7f81617bb640 1 -- 172.21.15.39:0/3646866109 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f815c0cf400 con 0x7f815c160970 2023-05-16T13:54:54.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.264+0000 7f8161fbc640 1 --2- 172.21.15.39:0/3646866109 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f815c0cb0f0 0x7f815c160430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-16T13:54:54.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.268+0000 7f81617bb640 1 --2- 172.21.15.39:0/3646866109 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f815c160970 0x7f815c0718a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f814c0097c0 tx=0x7f814c01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5156833ec8301e6 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:54.274 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.268+0000 7f8160fba640 1 -- 172.21.15.39:0/3646866109 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814c0ab680 con 0x7f815c160970 2023-05-16T13:54:54.274 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.268+0000 7f8160fba640 1 -- 172.21.15.39:0/3646866109 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f814c0ab7e0 con 0x7f815c160970 2023-05-16T13:54:54.274 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.268+0000 7f8160fba640 1 -- 172.21.15.39:0/3646866109 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814c0abb70 con 0x7f815c160970 2023-05-16T13:54:54.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.268+0000 7f8164220640 1 -- 172.21.15.39:0/3646866109 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f815c160970 msgr2=0x7f815c0718a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:54.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.268+0000 7f8164220640 1 --2- 172.21.15.39:0/3646866109 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f815c160970 0x7f815c0718a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f814c0097c0 tx=0x7f814c01c480 comp rx=0 tx=0).stop 2023-05-16T13:54:54.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.268+0000 7f8164220640 1 -- 172.21.15.39:0/3646866109 shutdown_connections 2023-05-16T13:54:54.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.268+0000 7f8164220640 1 --2- 172.21.15.39:0/3646866109 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f815c160970 0x7f815c0718a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:54.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.268+0000 7f8164220640 1 --2- 172.21.15.39:0/3646866109 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f815c0cb0f0 0x7f815c160430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:54.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.268+0000 7f8164220640 1 -- 172.21.15.39:0/3646866109 >> 172.21.15.39:0/3646866109 conn(0x7f815c06ce40 msgr2=0x7f815c06d240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:54.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.268+0000 7f8164220640 1 -- 172.21.15.39:0/3646866109 shutdown_connections 2023-05-16T13:54:54.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.268+0000 7f8164220640 1 -- 172.21.15.39:0/3646866109 wait complete. 2023-05-16T13:54:54.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.268+0000 7f8164220640 1 Processor -- start 2023-05-16T13:54:54.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.272+0000 7f8164220640 1 -- start start 2023-05-16T13:54:54.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.272+0000 7f8164220640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f815c071de0 0x7f815c154fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:54.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.272+0000 7f8164220640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f815c0cb0f0 0x7f815c15e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:54.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.272+0000 7f8164220640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f815c160970 0x7f815c0c9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:54.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.272+0000 7f8164220640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f815c155510 con 0x7f815c0cb0f0 2023-05-16T13:54:54.279 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.272+0000 7f8164220640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f815c15f9c0 con 0x7f815c160970 2023-05-16T13:54:54.279 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.272+0000 7f8164220640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f815c15edb0 con 0x7f815c071de0 2023-05-16T13:54:54.279 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.272+0000 7f81617bb640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f815c0cb0f0 0x7f815c15e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:54.279 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.272+0000 7f81617bb640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f815c0cb0f0 0x7f815c15e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34610/0 (socket says 172.21.15.39:34610) 2023-05-16T13:54:54.279 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.272+0000 7f81617bb640 1 -- 172.21.15.39:0/484962591 learned_addr learned my addr 172.21.15.39:0/484962591 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:54.279 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.272+0000 7f81627bd640 1 --2- 172.21.15.39:0/484962591 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f815c160970 0x7f815c0c9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:54.279 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.272+0000 7f8161fbc640 1 --2- 172.21.15.39:0/484962591 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f815c071de0 0x7f815c154fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:54.279 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.272+0000 7f81617bb640 1 -- 172.21.15.39:0/484962591 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f815c071de0 msgr2=0x7f815c154fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:54.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.272+0000 7f81617bb640 1 --2- 172.21.15.39:0/484962591 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f815c071de0 0x7f815c154fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:54.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.272+0000 7f81617bb640 1 -- 172.21.15.39:0/484962591 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f815c160970 msgr2=0x7f815c0c9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:54.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.272+0000 7f81617bb640 1 --2- 172.21.15.39:0/484962591 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f815c160970 0x7f815c0c9ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:54.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.272+0000 7f81617bb640 1 -- 172.21.15.39:0/484962591 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8158009420 con 0x7f815c0cb0f0 2023-05-16T13:54:54.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.272+0000 7f81617bb640 1 --2- 172.21.15.39:0/484962591 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f815c0cb0f0 0x7f815c15e460 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f814c0ad040 tx=0x7f814c019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:54.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.272+0000 7f81527fc640 1 -- 172.21.15.39:0/484962591 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814c004220 con 0x7f815c0cb0f0 2023-05-16T13:54:54.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.272+0000 7f81527fc640 1 -- 172.21.15.39:0/484962591 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f814c004380 con 0x7f815c0cb0f0 2023-05-16T13:54:54.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.272+0000 7f81527fc640 1 -- 172.21.15.39:0/484962591 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814c0abb50 con 0x7f815c0cb0f0 2023-05-16T13:54:54.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.272+0000 7f8164220640 1 -- 172.21.15.39:0/484962591 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f814c009420 con 0x7f815c0cb0f0 2023-05-16T13:54:54.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.272+0000 7f8164220640 1 -- 172.21.15.39:0/484962591 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f815c0ceaa0 con 0x7f815c0cb0f0 2023-05-16T13:54:54.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.272+0000 7f8164220640 1 -- 172.21.15.39:0/484962591 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f815c0cb4c0 con 0x7f815c0cb0f0 2023-05-16T13:54:54.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.276+0000 7f81527fc640 1 -- 172.21.15.39:0/484962591 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f814c0bc070 con 0x7f815c0cb0f0 2023-05-16T13:54:54.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.276+0000 7f81527fc640 1 --2- 172.21.15.39:0/484962591 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f8140066280 0x7f8140068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:54.283 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.276+0000 7f81527fc640 1 -- 172.21.15.39:0/484962591 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f814c11e1f0 con 0x7f815c0cb0f0 2023-05-16T13:54:54.283 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.276+0000 7f8161fbc640 1 --2- 172.21.15.39:0/484962591 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f8140066280 0x7f8140068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:54.283 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.276+0000 7f8161fbc640 1 --2- 172.21.15.39:0/484962591 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f8140066280 0x7f8140068730 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8158009c80 tx=0x7f8158008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:54.286 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.280+0000 7f81527fc640 1 -- 172.21.15.39:0/484962591 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f814c0eb5d0 con 0x7f815c0cb0f0 2023-05-16T13:54:54.440 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.432+0000 7f8164220640 1 -- 172.21.15.39:0/484962591 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f815c0cc670 con 0x7f815c0cb0f0 2023-05-16T13:54:54.441 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.436+0000 7f81527fc640 1 -- 172.21.15.39:0/484962591 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f814c0044f0 con 0x7f815c0cb0f0 2023-05-16T13:54:54.441 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 8 2023-05-16T13:54:54.443 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.436+0000 7f8164220640 1 -- 172.21.15.39:0/484962591 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f8140066280 msgr2=0x7f8140068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:54.443 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.436+0000 7f8164220640 1 --2- 172.21.15.39:0/484962591 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f8140066280 0x7f8140068730 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8158009c80 tx=0x7f8158008040 comp rx=0 tx=0).stop 2023-05-16T13:54:54.443 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.436+0000 7f8164220640 1 -- 172.21.15.39:0/484962591 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f815c0cb0f0 msgr2=0x7f815c15e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:54.443 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.436+0000 7f8164220640 1 --2- 172.21.15.39:0/484962591 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f815c0cb0f0 0x7f815c15e460 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f814c0ad040 tx=0x7f814c019220 comp rx=0 tx=0).stop 2023-05-16T13:54:54.443 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.436+0000 7f8164220640 1 -- 172.21.15.39:0/484962591 shutdown_connections 2023-05-16T13:54:54.444 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.436+0000 7f8164220640 1 --2- 172.21.15.39:0/484962591 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f815c160970 0x7f815c0c9ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:54.444 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.436+0000 7f8164220640 1 --2- 172.21.15.39:0/484962591 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f815c0cb0f0 0x7f815c15e460 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:54.444 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.436+0000 7f8164220640 1 --2- 172.21.15.39:0/484962591 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f8140066280 0x7f8140068730 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:54.444 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.436+0000 7f8164220640 1 --2- 172.21.15.39:0/484962591 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f815c071de0 0x7f815c154fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:54.444 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.436+0000 7f8164220640 1 -- 172.21.15.39:0/484962591 >> 172.21.15.39:0/484962591 conn(0x7f815c06ce40 msgr2=0x7f815c0b2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:54.444 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.436+0000 7f8164220640 1 -- 172.21.15.39:0/484962591 shutdown_connections 2023-05-16T13:54:54.444 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.436+0000 7f8164220640 1 -- 172.21.15.39:0/484962591 wait complete. 2023-05-16T13:54:54.462 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-16T13:54:54.602 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.596+0000 7f62df6fc640 1 Processor -- start 2023-05-16T13:54:54.602 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.596+0000 7f62df6fc640 1 -- start start 2023-05-16T13:54:54.603 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.596+0000 7f62df6fc640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f62d80aff50 0x7f62d80b0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:54.604 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.596+0000 7f62df6fc640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f62d8070420 0x7f62d8070880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:54.604 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.596+0000 7f62df6fc640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62d80b08c0 con 0x7f62d8158e00 2023-05-16T13:54:54.604 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.596+0000 7f62df6fc640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62d80ca030 con 0x7f62d8070420 2023-05-16T13:54:54.604 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.596+0000 7f62df6fc640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62d815c890 con 0x7f62d80aff50 2023-05-16T13:54:54.604 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.596+0000 7f62ddc99640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f62d8070420 0x7f62d8070880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:54.604 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.596+0000 7f62ddc99640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f62d8070420 0x7f62d8070880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34624/0 (socket says 172.21.15.39:34624) 2023-05-16T13:54:54.604 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.596+0000 7f62ddc99640 1 -- 172.21.15.39:0/2405444354 learned_addr learned my addr 172.21.15.39:0/2405444354 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:54.605 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.596+0000 7f62dcc97640 1 --2- 172.21.15.39:0/2405444354 >> v2:172.21.15.118:3300/0 conn(0x7f62d80aff50 0x7f62d80b0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:54.605 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.596+0000 7f62ddc99640 1 -- 172.21.15.39:0/2405444354 >> v2:172.21.15.118:3300/0 conn(0x7f62d80aff50 msgr2=0x7f62d80b0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:54.605 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.596+0000 7f62ddc99640 1 --2- 172.21.15.39:0/2405444354 >> v2:172.21.15.118:3300/0 conn(0x7f62d80aff50 0x7f62d80b0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:54.605 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.596+0000 7f62ddc99640 1 -- 172.21.15.39:0/2405444354 >> v1:172.21.15.39:6789/0 conn(0x7f62d8158e00 legacy=0x7f62d80c9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:54.606 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.596+0000 7f62ddc99640 1 -- 172.21.15.39:0/2405444354 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62d815cb70 con 0x7f62d8070420 2023-05-16T13:54:54.606 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.600+0000 7f62ddc99640 1 --2- 172.21.15.39:0/2405444354 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62d8070420 0x7f62d8070880 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f62d806dd90 tx=0x7f62d00213d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8afebfd589d00e55 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:54.607 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.600+0000 7f62cffff640 1 -- 172.21.15.39:0/2405444354 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d00b1400 con 0x7f62d8070420 2023-05-16T13:54:54.607 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.600+0000 7f62cffff640 1 -- 172.21.15.39:0/2405444354 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62d00ad050 con 0x7f62d8070420 2023-05-16T13:54:54.607 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.600+0000 7f62cffff640 1 -- 172.21.15.39:0/2405444354 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d00b1780 con 0x7f62d8070420 2023-05-16T13:54:54.608 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.600+0000 7f62df6fc640 1 -- 172.21.15.39:0/2405444354 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62d8070420 msgr2=0x7f62d8070880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:54.608 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.600+0000 7f62df6fc640 1 --2- 172.21.15.39:0/2405444354 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62d8070420 0x7f62d8070880 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f62d806dd90 tx=0x7f62d00213d0 comp rx=0 tx=0).stop 2023-05-16T13:54:54.608 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.600+0000 7f62df6fc640 1 -- 172.21.15.39:0/2405444354 shutdown_connections 2023-05-16T13:54:54.609 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.600+0000 7f62df6fc640 1 --2- 172.21.15.39:0/2405444354 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62d8070420 0x7f62d8070880 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:54.609 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.600+0000 7f62df6fc640 1 --2- 172.21.15.39:0/2405444354 >> v2:172.21.15.118:3300/0 conn(0x7f62d80aff50 0x7f62d80b0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:54.609 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.600+0000 7f62df6fc640 1 -- 172.21.15.39:0/2405444354 >> 172.21.15.39:0/2405444354 conn(0x7f62d8069a50 msgr2=0x7f62d8069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:54.609 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.600+0000 7f62df6fc640 1 -- 172.21.15.39:0/2405444354 shutdown_connections 2023-05-16T13:54:54.609 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.600+0000 7f62df6fc640 1 -- 172.21.15.39:0/2405444354 wait complete. 2023-05-16T13:54:54.609 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.604+0000 7f62df6fc640 1 Processor -- start 2023-05-16T13:54:54.610 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.604+0000 7f62df6fc640 1 -- start start 2023-05-16T13:54:54.611 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.604+0000 7f62df6fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62d8070420 0x7f62d8153a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:54.611 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.604+0000 7f62df6fc640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f62d80aff50 0x7f62d80ce830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:54.611 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.604+0000 7f62df6fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f62d8158e00 0x7f62d80c92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:54.611 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.604+0000 7f62df6fc640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62d80b23e0 con 0x7f62d8070420 2023-05-16T13:54:54.611 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.604+0000 7f62df6fc640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62d80b26c0 con 0x7f62d8158e00 2023-05-16T13:54:54.612 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.604+0000 7f62df6fc640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62d80b29a0 con 0x7f62d80aff50 2023-05-16T13:54:54.612 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.604+0000 7f62dd498640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62d8070420 0x7f62d8153a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:54.612 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.604+0000 7f62dd498640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62d8070420 0x7f62d8153a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34640/0 (socket says 172.21.15.39:34640) 2023-05-16T13:54:54.612 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.604+0000 7f62dd498640 1 -- 172.21.15.39:0/1749630136 learned_addr learned my addr 172.21.15.39:0/1749630136 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:54.613 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.604+0000 7f62ddc99640 1 --2- 172.21.15.39:0/1749630136 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f62d8158e00 0x7f62d80c92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:54.613 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.604+0000 7f62dcc97640 1 --2- 172.21.15.39:0/1749630136 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f62d80aff50 0x7f62d80ce830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:54.613 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.604+0000 7f62dd498640 1 -- 172.21.15.39:0/1749630136 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f62d80aff50 msgr2=0x7f62d80ce830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:54.613 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.604+0000 7f62dd498640 1 --2- 172.21.15.39:0/1749630136 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f62d80aff50 0x7f62d80ce830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:54.614 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.604+0000 7f62dd498640 1 -- 172.21.15.39:0/1749630136 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f62d8158e00 msgr2=0x7f62d80c92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:54.614 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.604+0000 7f62dd498640 1 --2- 172.21.15.39:0/1749630136 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f62d8158e00 0x7f62d80c92e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:54.614 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.604+0000 7f62dd498640 1 -- 172.21.15.39:0/1749630136 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62d0009b30 con 0x7f62d8070420 2023-05-16T13:54:54.614 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.604+0000 7f62ddc99640 1 --2- 172.21.15.39:0/1749630136 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f62d8158e00 0x7f62d80c92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:54:54.614 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.604+0000 7f62dd498640 1 --2- 172.21.15.39:0/1749630136 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62d8070420 0x7f62d8153a00 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f62d400c450 tx=0x7f62d400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:54.614 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.604+0000 7f62cdffb640 1 -- 172.21.15.39:0/1749630136 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d40052d0 con 0x7f62d8070420 2023-05-16T13:54:54.614 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.604+0000 7f62cdffb640 1 -- 172.21.15.39:0/1749630136 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62d4005450 con 0x7f62d8070420 2023-05-16T13:54:54.615 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.604+0000 7f62cdffb640 1 -- 172.21.15.39:0/1749630136 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d4012870 con 0x7f62d8070420 2023-05-16T13:54:54.615 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.604+0000 7f62df6fc640 1 -- 172.21.15.39:0/1749630136 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62d815d130 con 0x7f62d8070420 2023-05-16T13:54:54.615 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.604+0000 7f62df6fc640 1 -- 172.21.15.39:0/1749630136 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62d815ce50 con 0x7f62d8070420 2023-05-16T13:54:54.615 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.608+0000 7f62df6fc640 1 -- 172.21.15.39:0/1749630136 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62d80cc730 con 0x7f62d8070420 2023-05-16T13:54:54.616 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.608+0000 7f62cdffb640 1 -- 172.21.15.39:0/1749630136 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f62d40129d0 con 0x7f62d8070420 2023-05-16T13:54:54.616 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.608+0000 7f62cdffb640 1 --2- 172.21.15.39:0/1749630136 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f62bc066280 0x7f62bc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:54.616 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.608+0000 7f62cdffb640 1 -- 172.21.15.39:0/1749630136 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f62d4083880 con 0x7f62d8070420 2023-05-16T13:54:54.616 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.608+0000 7f62dcc97640 1 --2- 172.21.15.39:0/1749630136 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f62bc066280 0x7f62bc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:54.616 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.608+0000 7f62dcc97640 1 --2- 172.21.15.39:0/1749630136 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f62bc066280 0x7f62bc068730 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f62d81f4a20 tx=0x7f62c8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:54.619 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.612+0000 7f62cdffb640 1 -- 172.21.15.39:0/1749630136 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f62d4050cf0 con 0x7f62d8070420 2023-05-16T13:54:54.771 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.764+0000 7f62df6fc640 1 -- 172.21.15.39:0/1749630136 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f62d8073c90 con 0x7f62d8070420 2023-05-16T13:54:54.771 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.764+0000 7f62cdffb640 1 -- 172.21.15.39:0/1749630136 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f62d4054310 con 0x7f62d8070420 2023-05-16T13:54:54.772 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2023-05-16T13:54:54.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.768+0000 7f62df6fc640 1 -- 172.21.15.39:0/1749630136 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f62bc066280 msgr2=0x7f62bc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:54.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.768+0000 7f62df6fc640 1 --2- 172.21.15.39:0/1749630136 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f62bc066280 0x7f62bc068730 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f62d81f4a20 tx=0x7f62c8008040 comp rx=0 tx=0).stop 2023-05-16T13:54:54.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.768+0000 7f62df6fc640 1 -- 172.21.15.39:0/1749630136 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62d8070420 msgr2=0x7f62d8153a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:54.774 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.768+0000 7f62df6fc640 1 --2- 172.21.15.39:0/1749630136 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62d8070420 0x7f62d8153a00 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f62d400c450 tx=0x7f62d400c910 comp rx=0 tx=0).stop 2023-05-16T13:54:54.774 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.768+0000 7f62df6fc640 1 -- 172.21.15.39:0/1749630136 shutdown_connections 2023-05-16T13:54:54.774 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.768+0000 7f62df6fc640 1 --2- 172.21.15.39:0/1749630136 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f62bc066280 0x7f62bc068730 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:54.774 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.768+0000 7f62df6fc640 1 --2- 172.21.15.39:0/1749630136 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f62d80aff50 0x7f62d80ce830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:54.774 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.768+0000 7f62df6fc640 1 --2- 172.21.15.39:0/1749630136 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f62d8158e00 0x7f62d80c92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:54.774 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.768+0000 7f62df6fc640 1 --2- 172.21.15.39:0/1749630136 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62d8070420 0x7f62d8153a00 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:54.774 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.768+0000 7f62df6fc640 1 -- 172.21.15.39:0/1749630136 >> 172.21.15.39:0/1749630136 conn(0x7f62d8069a50 msgr2=0x7f62d8158020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:54.775 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.768+0000 7f62df6fc640 1 -- 172.21.15.39:0/1749630136 shutdown_connections 2023-05-16T13:54:54.775 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.768+0000 7f62df6fc640 1 -- 172.21.15.39:0/1749630136 wait complete. 2023-05-16T13:54:54.792 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-16T13:54:54.936 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.928+0000 7f4d59b7f640 1 Processor -- start 2023-05-16T13:54:54.936 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.928+0000 7f4d59b7f640 1 -- start start 2023-05-16T13:54:54.937 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.932+0000 7f4d59b7f640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f4d540cf080 0x7f4d5415d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:54.937 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.932+0000 7f4d59b7f640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d540cd3b0 con 0x7f4d540d0570 2023-05-16T13:54:54.938 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.932+0000 7f4d59b7f640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d5415d6e0 con 0x7f4d5415c360 2023-05-16T13:54:54.938 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.932+0000 7f4d59b7f640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d540d0aa0 con 0x7f4d540cf080 2023-05-16T13:54:54.938 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.932+0000 7f4d58b7d640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f4d540cf080 0x7f4d5415d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:54.938 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.932+0000 7f4d5937e640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f4d540d0570 0x7f4d540cd840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:35632/0 (socket says 172.21.15.39:35632) 2023-05-16T13:54:54.938 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.932+0000 7f4d58b7d640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f4d540cf080 0x7f4d5415d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34656/0 (socket says 172.21.15.39:34656) 2023-05-16T13:54:54.938 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.932+0000 7f4d5937e640 1 -- 172.21.15.39:0/1560075027 learned_addr learned my addr 172.21.15.39:0/1560075027 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:54.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.932+0000 7f4d58b7d640 1 -- 172.21.15.39:0/1560075027 >> v1:172.21.15.118:6789/0 conn(0x7f4d5415c360 legacy=0x7f4d540cf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:54.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.932+0000 7f4d58b7d640 1 -- 172.21.15.39:0/1560075027 >> v1:172.21.15.39:6789/0 conn(0x7f4d540d0570 legacy=0x7f4d540cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:54.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.932+0000 7f4d58b7d640 1 -- 172.21.15.39:0/1560075027 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d540ccd60 con 0x7f4d540cf080 2023-05-16T13:54:54.941 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.936+0000 7f4d58b7d640 1 --2- 172.21.15.39:0/1560075027 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4d540cf080 0x7f4d5415d1a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4d480097a0 tx=0x7f4d4801c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c58931884e27a7f server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:54.941 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.936+0000 7f4d537fe640 1 -- 172.21.15.39:0/1560075027 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d480ab600 con 0x7f4d540cf080 2023-05-16T13:54:54.941 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.936+0000 7f4d537fe640 1 -- 172.21.15.39:0/1560075027 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d480a7050 con 0x7f4d540cf080 2023-05-16T13:54:54.942 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.936+0000 7f4d537fe640 1 -- 172.21.15.39:0/1560075027 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d480ab980 con 0x7f4d540cf080 2023-05-16T13:54:54.942 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.936+0000 7f4d59b7f640 1 -- 172.21.15.39:0/1560075027 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4d540cf080 msgr2=0x7f4d5415d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:54.942 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.936+0000 7f4d59b7f640 1 --2- 172.21.15.39:0/1560075027 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4d540cf080 0x7f4d5415d1a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4d480097a0 tx=0x7f4d4801c340 comp rx=0 tx=0).stop 2023-05-16T13:54:54.943 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.936+0000 7f4d59b7f640 1 -- 172.21.15.39:0/1560075027 shutdown_connections 2023-05-16T13:54:54.943 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.936+0000 7f4d59b7f640 1 --2- 172.21.15.39:0/1560075027 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4d540cf080 0x7f4d5415d1a0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:54.943 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.936+0000 7f4d59b7f640 1 -- 172.21.15.39:0/1560075027 >> 172.21.15.39:0/1560075027 conn(0x7f4d54071aa0 msgr2=0x7f4d5409b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:54.943 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.936+0000 7f4d59b7f640 1 -- 172.21.15.39:0/1560075027 shutdown_connections 2023-05-16T13:54:54.943 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.936+0000 7f4d59b7f640 1 -- 172.21.15.39:0/1560075027 wait complete. 2023-05-16T13:54:54.944 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.936+0000 7f4d59b7f640 1 Processor -- start 2023-05-16T13:54:54.944 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.936+0000 7f4d59b7f640 1 -- start start 2023-05-16T13:54:54.945 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.940+0000 7f4d59b7f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4d540cf080 0x7f4d5415b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:54.945 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.940+0000 7f4d59b7f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4d540d0570 0x7f4d54151f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:54.945 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.940+0000 7f4d59b7f640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4d5415c360 0x7f4d54153f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:54.945 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.940+0000 7f4d59b7f640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5415af00 con 0x7f4d540d0570 2023-05-16T13:54:54.945 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.940+0000 7f4d59b7f640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d541549f0 con 0x7f4d540cf080 2023-05-16T13:54:54.946 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.940+0000 7f4d59b7f640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5415a5d0 con 0x7f4d5415c360 2023-05-16T13:54:54.946 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.940+0000 7f4d53fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4d540d0570 0x7f4d54151f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:54.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.940+0000 7f4d53fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4d540d0570 0x7f4d54151f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34668/0 (socket says 172.21.15.39:34668) 2023-05-16T13:54:54.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.940+0000 7f4d53fff640 1 -- 172.21.15.39:0/4061166948 learned_addr learned my addr 172.21.15.39:0/4061166948 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:54.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.940+0000 7f4d58b7d640 1 --2- 172.21.15.39:0/4061166948 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4d540cf080 0x7f4d5415b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:54.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.940+0000 7f4d5937e640 1 --2- 172.21.15.39:0/4061166948 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4d5415c360 0x7f4d54153f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:54.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.940+0000 7f4d53fff640 1 -- 172.21.15.39:0/4061166948 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4d5415c360 msgr2=0x7f4d54153f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:54.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.940+0000 7f4d53fff640 1 --2- 172.21.15.39:0/4061166948 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4d5415c360 0x7f4d54153f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:54.948 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.940+0000 7f4d53fff640 1 -- 172.21.15.39:0/4061166948 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4d540cf080 msgr2=0x7f4d5415b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:54.948 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.940+0000 7f4d53fff640 1 --2- 172.21.15.39:0/4061166948 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4d540cf080 0x7f4d5415b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:54.948 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.940+0000 7f4d53fff640 1 -- 172.21.15.39:0/4061166948 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d480093b0 con 0x7f4d540d0570 2023-05-16T13:54:54.948 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.940+0000 7f4d53fff640 1 --2- 172.21.15.39:0/4061166948 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4d540d0570 0x7f4d54151f90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4d4000c4d0 tx=0x7f4d4000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:54.948 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.940+0000 7f4d517fa640 1 -- 172.21.15.39:0/4061166948 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d400052d0 con 0x7f4d540d0570 2023-05-16T13:54:54.948 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.940+0000 7f4d517fa640 1 -- 172.21.15.39:0/4061166948 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d40005430 con 0x7f4d540d0570 2023-05-16T13:54:54.948 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.940+0000 7f4d517fa640 1 -- 172.21.15.39:0/4061166948 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d40012830 con 0x7f4d540d0570 2023-05-16T13:54:54.948 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.940+0000 7f4d59b7f640 1 -- 172.21.15.39:0/4061166948 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d540ce8f0 con 0x7f4d540d0570 2023-05-16T13:54:54.949 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.940+0000 7f4d59b7f640 1 -- 172.21.15.39:0/4061166948 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d540ce760 con 0x7f4d540d0570 2023-05-16T13:54:54.949 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.940+0000 7f4d59b7f640 1 -- 172.21.15.39:0/4061166948 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d540cea80 con 0x7f4d540d0570 2023-05-16T13:54:54.949 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.940+0000 7f4d517fa640 1 -- 172.21.15.39:0/4061166948 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4d40012990 con 0x7f4d540d0570 2023-05-16T13:54:54.950 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.944+0000 7f4d517fa640 1 --2- 172.21.15.39:0/4061166948 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f4d38066280 0x7f4d38068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:54.950 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.944+0000 7f4d517fa640 1 -- 172.21.15.39:0/4061166948 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4d40083710 con 0x7f4d540d0570 2023-05-16T13:54:54.950 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.944+0000 7f4d58b7d640 1 --2- 172.21.15.39:0/4061166948 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f4d38066280 0x7f4d38068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:54.950 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.944+0000 7f4d58b7d640 1 --2- 172.21.15.39:0/4061166948 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f4d38066280 0x7f4d38068730 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4d480ad000 tx=0x7f4d48008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:54.953 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:54.948+0000 7f4d517fa640 1 -- 172.21.15.39:0/4061166948 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f4d40050c30 con 0x7f4d540d0570 2023-05-16T13:54:55.106 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.100+0000 7f4d59b7f640 1 -- 172.21.15.39:0/4061166948 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4d5404ed20 con 0x7f4d540d0570 2023-05-16T13:54:55.107 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.100+0000 7f4d517fa640 1 -- 172.21.15.39:0/4061166948 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4d40081e60 con 0x7f4d540d0570 2023-05-16T13:54:55.107 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 64 2023-05-16T13:54:55.108 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.100+0000 7f4d59b7f640 1 -- 172.21.15.39:0/4061166948 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f4d38066280 msgr2=0x7f4d38068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:55.109 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.100+0000 7f4d59b7f640 1 --2- 172.21.15.39:0/4061166948 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f4d38066280 0x7f4d38068730 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4d480ad000 tx=0x7f4d48008040 comp rx=0 tx=0).stop 2023-05-16T13:54:55.109 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.100+0000 7f4d59b7f640 1 -- 172.21.15.39:0/4061166948 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4d540d0570 msgr2=0x7f4d54151f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:55.109 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.100+0000 7f4d59b7f640 1 --2- 172.21.15.39:0/4061166948 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4d540d0570 0x7f4d54151f90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4d4000c4d0 tx=0x7f4d4000c990 comp rx=0 tx=0).stop 2023-05-16T13:54:55.109 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.104+0000 7f4d59b7f640 1 -- 172.21.15.39:0/4061166948 shutdown_connections 2023-05-16T13:54:55.109 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.104+0000 7f4d59b7f640 1 --2- 172.21.15.39:0/4061166948 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f4d38066280 0x7f4d38068730 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:55.109 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.104+0000 7f4d59b7f640 1 --2- 172.21.15.39:0/4061166948 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4d5415c360 0x7f4d54153f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:55.109 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.104+0000 7f4d59b7f640 1 --2- 172.21.15.39:0/4061166948 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4d540d0570 0x7f4d54151f90 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:55.110 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.104+0000 7f4d59b7f640 1 --2- 172.21.15.39:0/4061166948 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4d540cf080 0x7f4d5415b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:55.110 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.104+0000 7f4d59b7f640 1 -- 172.21.15.39:0/4061166948 >> 172.21.15.39:0/4061166948 conn(0x7f4d54071aa0 msgr2=0x7f4d540b0ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:55.110 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.104+0000 7f4d59b7f640 1 -- 172.21.15.39:0/4061166948 shutdown_connections 2023-05-16T13:54:55.110 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.104+0000 7f4d59b7f640 1 -- 172.21.15.39:0/4061166948 wait complete. 2023-05-16T13:54:55.128 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-16T13:54:55.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.268+0000 7fbbcbdce640 1 Processor -- start 2023-05-16T13:54:55.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.268+0000 7fbbcbdce640 1 -- start start 2023-05-16T13:54:55.274 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.268+0000 7fbbcbdce640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbbc415e700 0x7fbbc406c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:55.274 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.268+0000 7fbbcbdce640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbc415ead0 con 0x7fbbc40b0610 2023-05-16T13:54:55.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.268+0000 7fbbcbdce640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbc4071ca0 con 0x7fbbc406fc80 2023-05-16T13:54:55.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.268+0000 7fbbcbdce640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbc40ad860 con 0x7fbbc415e700 2023-05-16T13:54:55.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.268+0000 7fbbca36b640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fbbc40b0610 0x7fbbc40cc380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:35638/0 (socket says 172.21.15.39:35638) 2023-05-16T13:54:55.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.268+0000 7fbbca36b640 1 -- 172.21.15.39:0/1320151000 learned_addr learned my addr 172.21.15.39:0/1320151000 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:55.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.268+0000 7fbbc9b6a640 1 --2- 172.21.15.39:0/1320151000 >> v2:172.21.15.118:3300/0 conn(0x7fbbc415e700 0x7fbbc406c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:55.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.268+0000 7fbbc8b68640 1 -- 172.21.15.39:0/1320151000 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 317294167 0 0) 0x7fbbbc0014a0 con 0x7fbbc40b0610 2023-05-16T13:54:55.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.268+0000 7fbbc8b68640 1 -- 172.21.15.39:0/1320151000 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbb0003530 con 0x7fbbc40b0610 2023-05-16T13:54:55.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.268+0000 7fbbc8b68640 1 -- 172.21.15.39:0/1320151000 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3913164053 0 0) 0x7fbbb0003530 con 0x7fbbc40b0610 2023-05-16T13:54:55.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.268+0000 7fbbc8b68640 1 -- 172.21.15.39:0/1320151000 >> v2:172.21.15.118:3300/0 conn(0x7fbbc415e700 msgr2=0x7fbbc406c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:55.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.268+0000 7fbbc8b68640 1 --2- 172.21.15.39:0/1320151000 >> v2:172.21.15.118:3300/0 conn(0x7fbbc415e700 0x7fbbc406c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:55.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.268+0000 7fbbc8b68640 1 -- 172.21.15.39:0/1320151000 >> v1:172.21.15.118:6789/0 conn(0x7fbbc406fc80 legacy=0x7fbbc40aff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:55.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.268+0000 7fbbc8b68640 1 -- 172.21.15.39:0/1320151000 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc40adb40 con 0x7fbbc40b0610 2023-05-16T13:54:55.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.268+0000 7fbbc8b68640 1 -- 172.21.15.39:0/1320151000 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1738805496 0 0) 0x7fbbbc001b90 con 0x7fbbc40b0610 2023-05-16T13:54:55.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.268+0000 7fbbc8b68640 1 -- 172.21.15.39:0/1320151000 >> v1:172.21.15.39:6789/0 conn(0x7fbbc40b0610 legacy=0x7fbbc40cc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:55.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.268+0000 7fbbc8b68640 1 --2- 172.21.15.39:0/1320151000 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbbb0003980 0x7fbbb0003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:55.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.268+0000 7fbbc8b68640 1 --2- 172.21.15.39:0/1320151000 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbbb0004370 0x7fbbb0004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:55.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.268+0000 7fbbc8b68640 1 --2- 172.21.15.39:0/1320151000 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbbb00050d0 0x7fbbb000fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:55.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.268+0000 7fbbc8b68640 1 -- 172.21.15.39:0/1320151000 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc40ad860 con 0x7fbbb0004370 2023-05-16T13:54:55.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.268+0000 7fbbc8b68640 1 -- 172.21.15.39:0/1320151000 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb0010410 con 0x7fbbb0003980 2023-05-16T13:54:55.279 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.268+0000 7fbbc8b68640 1 -- 172.21.15.39:0/1320151000 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb00105d0 con 0x7fbbb00050d0 2023-05-16T13:54:55.279 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.268+0000 7fbbc9369640 1 --2- 172.21.15.39:0/1320151000 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbbb0004370 0x7fbbb0004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:55.279 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.268+0000 7fbbc9b6a640 1 --2- 172.21.15.39:0/1320151000 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbbb0003980 0x7fbbb0003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:55.279 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.268+0000 7fbbca36b640 1 --2- 172.21.15.39:0/1320151000 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbbb00050d0 0x7fbbb000fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:55.279 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.268+0000 7fbbc9369640 1 -- 172.21.15.39:0/1320151000 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbbb00050d0 msgr2=0x7fbbb000fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:55.279 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.268+0000 7fbbc9369640 1 --2- 172.21.15.39:0/1320151000 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbbb00050d0 0x7fbbb000fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:55.279 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.268+0000 7fbbc9369640 1 -- 172.21.15.39:0/1320151000 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbbb0003980 msgr2=0x7fbbb0003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:55.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.268+0000 7fbbc9369640 1 --2- 172.21.15.39:0/1320151000 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbbb0003980 0x7fbbb0003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:55.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.268+0000 7fbbc9369640 1 -- 172.21.15.39:0/1320151000 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb0003530 con 0x7fbbb0004370 2023-05-16T13:54:55.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.268+0000 7fbbca36b640 1 -- 172.21.15.39:0/1320151000 reap_dead start 2023-05-16T13:54:55.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.272+0000 7fbbc9369640 1 --2- 172.21.15.39:0/1320151000 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbbb0004370 0x7fbbb0004830 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4001910 tx=0x7fbbb401ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5edab285549352fc server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:55.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.272+0000 7fbbc8b68640 1 -- 172.21.15.39:0/1320151000 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb40a88b0 con 0x7fbbb0004370 2023-05-16T13:54:55.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.272+0000 7fbbc8b68640 1 -- 172.21.15.39:0/1320151000 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbb40a8a30 con 0x7fbbb0004370 2023-05-16T13:54:55.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.272+0000 7fbbc8b68640 1 -- 172.21.15.39:0/1320151000 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb40a8de0 con 0x7fbbb0004370 2023-05-16T13:54:55.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.272+0000 7fbbcbdce640 1 -- 172.21.15.39:0/1320151000 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbbb0004370 msgr2=0x7fbbb0004830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:55.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.272+0000 7fbbcbdce640 1 --2- 172.21.15.39:0/1320151000 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbbb0004370 0x7fbbb0004830 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4001910 tx=0x7fbbb401ec90 comp rx=0 tx=0).stop 2023-05-16T13:54:55.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.272+0000 7fbbcbdce640 1 -- 172.21.15.39:0/1320151000 shutdown_connections 2023-05-16T13:54:55.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.272+0000 7fbbcbdce640 1 --2- 172.21.15.39:0/1320151000 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbbb0004370 0x7fbbb0004830 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:55.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.272+0000 7fbbcbdce640 1 -- 172.21.15.39:0/1320151000 >> 172.21.15.39:0/1320151000 conn(0x7fbbc4069a50 msgr2=0x7fbbc4069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:55.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.272+0000 7fbbcbdce640 1 -- 172.21.15.39:0/1320151000 shutdown_connections 2023-05-16T13:54:55.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.272+0000 7fbbcbdce640 1 -- 172.21.15.39:0/1320151000 wait complete. 2023-05-16T13:54:55.284 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.276+0000 7fbbcbdce640 1 Processor -- start 2023-05-16T13:54:55.284 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.276+0000 7fbbcbdce640 1 -- start start 2023-05-16T13:54:55.284 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.276+0000 7fbbcbdce640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbbb0004370 0x7fbbc40adeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:55.285 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.276+0000 7fbbcbdce640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbbc4148840 0x7fbbc40af610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:55.285 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.276+0000 7fbbcbdce640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbbc40b12b0 0x7fbbc40b1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:55.285 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.276+0000 7fbbcbdce640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc40b1c60 con 0x7fbbc4148840 2023-05-16T13:54:55.285 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.276+0000 7fbbcbdce640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc40ae490 con 0x7fbbb0004370 2023-05-16T13:54:55.285 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.276+0000 7fbbcbdce640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc40ae770 con 0x7fbbc40b12b0 2023-05-16T13:54:55.286 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.276+0000 7fbbc9369640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbbc4148840 0x7fbbc40af610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:55.286 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.276+0000 7fbbc9369640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbbc4148840 0x7fbbc40af610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34688/0 (socket says 172.21.15.39:34688) 2023-05-16T13:54:55.286 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.276+0000 7fbbc9369640 1 -- 172.21.15.39:0/311475526 learned_addr learned my addr 172.21.15.39:0/311475526 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:55.286 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.276+0000 7fbbc9b6a640 1 --2- 172.21.15.39:0/311475526 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbbb0004370 0x7fbbc40adeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:55.286 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.276+0000 7fbbca36b640 1 --2- 172.21.15.39:0/311475526 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbbc40b12b0 0x7fbbc40b1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:55.286 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.276+0000 7fbbc9369640 1 -- 172.21.15.39:0/311475526 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbbc40b12b0 msgr2=0x7fbbc40b1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:55.287 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.276+0000 7fbbc9369640 1 --2- 172.21.15.39:0/311475526 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbbc40b12b0 0x7fbbc40b1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:55.287 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.276+0000 7fbbc9369640 1 -- 172.21.15.39:0/311475526 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbbb0004370 msgr2=0x7fbbc40adeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:55.287 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.276+0000 7fbbc9369640 1 --2- 172.21.15.39:0/311475526 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbbb0004370 0x7fbbc40adeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:55.287 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.276+0000 7fbbc9369640 1 -- 172.21.15.39:0/311475526 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc40700d0 con 0x7fbbc4148840 2023-05-16T13:54:55.287 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.276+0000 7fbbc9b6a640 1 --2- 172.21.15.39:0/311475526 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbbb0004370 0x7fbbc40adeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:54:55.287 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.276+0000 7fbbca36b640 1 --2- 172.21.15.39:0/311475526 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbbc40b12b0 0x7fbbc40b1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:54:55.288 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.276+0000 7fbbc9369640 1 --2- 172.21.15.39:0/311475526 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbbc4148840 0x7fbbc40af610 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fbbb401eac0 tx=0x7fbbb401ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:55.288 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.276+0000 7fbbba7fc640 1 -- 172.21.15.39:0/311475526 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb40069e0 con 0x7fbbc4148840 2023-05-16T13:54:55.288 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.276+0000 7fbbba7fc640 1 -- 172.21.15.39:0/311475526 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbb4006b40 con 0x7fbbc4148840 2023-05-16T13:54:55.288 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.276+0000 7fbbba7fc640 1 -- 172.21.15.39:0/311475526 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb4007030 con 0x7fbbc4148840 2023-05-16T13:54:55.288 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.276+0000 7fbbcbdce640 1 -- 172.21.15.39:0/311475526 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbc4071930 con 0x7fbbc4148840 2023-05-16T13:54:55.288 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.276+0000 7fbbcbdce640 1 -- 172.21.15.39:0/311475526 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbc40715e0 con 0x7fbbc4148840 2023-05-16T13:54:55.289 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.280+0000 7fbbcbdce640 1 -- 172.21.15.39:0/311475526 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbc4073c90 con 0x7fbbc4148840 2023-05-16T13:54:55.290 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.280+0000 7fbbba7fc640 1 -- 172.21.15.39:0/311475526 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbbb40b7070 con 0x7fbbc4148840 2023-05-16T13:54:55.290 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.280+0000 7fbbba7fc640 1 --2- 172.21.15.39:0/311475526 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fbba8066280 0x7fbba8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:55.290 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.280+0000 7fbbba7fc640 1 -- 172.21.15.39:0/311475526 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbbb4120fa0 con 0x7fbbc4148840 2023-05-16T13:54:55.290 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.280+0000 7fbbc9b6a640 1 --2- 172.21.15.39:0/311475526 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fbba8066280 0x7fbba8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:55.290 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.280+0000 7fbbc9b6a640 1 --2- 172.21.15.39:0/311475526 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fbba8066280 0x7fbba8068730 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fbbc40636a0 tx=0x7fbbc0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:55.291 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.284+0000 7fbbba7fc640 1 -- 172.21.15.39:0/311475526 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fbbb40ee410 con 0x7fbbc4148840 2023-05-16T13:54:55.459 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.452+0000 7fbbcbdce640 1 -- 172.21.15.39:0/311475526 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fbbc4159400 con 0x7fbbc4148840 2023-05-16T13:54:55.460 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.452+0000 7fbbba7fc640 1 -- 172.21.15.39:0/311475526 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7fbbb40b5080 con 0x7fbbc4148840 2023-05-16T13:54:55.460 INFO:teuthology.orchestra.run.smithi039.stderr:listed 0 entries 2023-05-16T13:54:55.461 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.456+0000 7fbbcbdce640 1 -- 172.21.15.39:0/311475526 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fbba8066280 msgr2=0x7fbba8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:55.461 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.456+0000 7fbbcbdce640 1 --2- 172.21.15.39:0/311475526 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fbba8066280 0x7fbba8068730 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fbbc40636a0 tx=0x7fbbc0008040 comp rx=0 tx=0).stop 2023-05-16T13:54:55.462 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.456+0000 7fbbcbdce640 1 -- 172.21.15.39:0/311475526 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbbc4148840 msgr2=0x7fbbc40af610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:55.462 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.456+0000 7fbbcbdce640 1 --2- 172.21.15.39:0/311475526 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbbc4148840 0x7fbbc40af610 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fbbb401eac0 tx=0x7fbbb401ba30 comp rx=0 tx=0).stop 2023-05-16T13:54:55.462 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.456+0000 7fbbcbdce640 1 -- 172.21.15.39:0/311475526 shutdown_connections 2023-05-16T13:54:55.462 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.456+0000 7fbbcbdce640 1 --2- 172.21.15.39:0/311475526 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fbba8066280 0x7fbba8068730 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:55.462 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.456+0000 7fbbcbdce640 1 --2- 172.21.15.39:0/311475526 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbbc40b12b0 0x7fbbc40b1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:55.462 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.456+0000 7fbbcbdce640 1 --2- 172.21.15.39:0/311475526 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbbc4148840 0x7fbbc40af610 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:55.463 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.456+0000 7fbbcbdce640 1 --2- 172.21.15.39:0/311475526 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbbb0004370 0x7fbbc40adeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:55.463 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.456+0000 7fbbcbdce640 1 -- 172.21.15.39:0/311475526 >> 172.21.15.39:0/311475526 conn(0x7fbbc4069a50 msgr2=0x7fbbc4158a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:55.463 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.456+0000 7fbbcbdce640 1 -- 172.21.15.39:0/311475526 shutdown_connections 2023-05-16T13:54:55.463 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.456+0000 7fbbcbdce640 1 -- 172.21.15.39:0/311475526 wait complete. 2023-05-16T13:54:55.480 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi039.front.sepia.ceph.com... 2023-05-16T13:54:55.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:55.481 DEBUG:teuthology.orchestra.run.smithi039:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-05-16T13:54:55.505 INFO:teuthology.orchestra.run:waiting for 300 2023-05-16T13:54:55.505 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi039.front.sepia.ceph.com 2023-05-16T13:54:55.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:55.506 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-05-16T13:54:55.562 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-05-16T13:54:55.562 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-16T13:54:55.571 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-05-16T13:54:55.571 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-16T13:54:55.620 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-16T13:54:55.758 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.752+0000 7fb6343bc640 1 Processor -- start 2023-05-16T13:54:55.759 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.752+0000 7fb6343bc640 1 -- start start 2023-05-16T13:54:55.760 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.752+0000 7fb6343bc640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb62c0cb4c0 0x7fb62c15d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:55.760 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.752+0000 7fb6343bc640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb62c0703b0 0x7fb62c0ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:55.760 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.752+0000 7fb6343bc640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb62c15d6a0 con 0x7fb62c158bf0 2023-05-16T13:54:55.760 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.752+0000 7fb6343bc640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb62c070870 con 0x7fb62c0703b0 2023-05-16T13:54:55.760 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.752+0000 7fb6343bc640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c070b50 con 0x7fb62c0cb4c0 2023-05-16T13:54:55.761 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.752+0000 7fb631957640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb62c0cb4c0 0x7fb62c15d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:55.761 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.752+0000 7fb632959640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb62c0703b0 0x7fb62c0ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:55.761 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.752+0000 7fb631957640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb62c0cb4c0 0x7fb62c15d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.39:44820/0 (socket says 172.21.15.39:44820) 2023-05-16T13:54:55.761 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.752+0000 7fb631957640 1 -- 172.21.15.39:0/2671743407 learned_addr learned my addr 172.21.15.39:0/2671743407 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:55.762 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.752+0000 7fb632158640 1 --1- 172.21.15.39:0/2671743407 >> v1:172.21.15.118:6789/0 conn(0x7fb62c158bf0 0x7fb62c0cadb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.39:48300/0 (socket says 172.21.15.39:48300) 2023-05-16T13:54:55.762 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.756+0000 7fb631957640 1 -- 172.21.15.39:0/2671743407 >> v2:172.21.15.118:3300/0 conn(0x7fb62c0703b0 msgr2=0x7fb62c0ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:55.762 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.756+0000 7fb631957640 1 --2- 172.21.15.39:0/2671743407 >> v2:172.21.15.118:3300/0 conn(0x7fb62c0703b0 0x7fb62c0ccda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:55.762 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.756+0000 7fb631957640 1 -- 172.21.15.39:0/2671743407 >> v1:172.21.15.118:6789/0 conn(0x7fb62c158bf0 legacy=0x7fb62c0cadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:55.762 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.756+0000 7fb631957640 1 -- 172.21.15.39:0/2671743407 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb62c070e30 con 0x7fb62c0cb4c0 2023-05-16T13:54:55.762 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.756+0000 7fb632959640 1 --2- 172.21.15.39:0/2671743407 >> v2:172.21.15.118:3300/0 conn(0x7fb62c0703b0 0x7fb62c0ccda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-16T13:54:55.763 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.756+0000 7fb631957640 1 --2- 172.21.15.39:0/2671743407 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb62c0cb4c0 0x7fb62c15d160 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb61c00bb10 tx=0x7fb61c01eb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a772a92313b48611 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:55.764 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.756+0000 7fb631156640 1 -- 172.21.15.39:0/2671743407 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb61c0a7c20 con 0x7fb62c0cb4c0 2023-05-16T13:54:55.764 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.756+0000 7fb631156640 1 -- 172.21.15.39:0/2671743407 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb61c0a7d80 con 0x7fb62c0cb4c0 2023-05-16T13:54:55.764 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.756+0000 7fb631156640 1 -- 172.21.15.39:0/2671743407 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb61c0af660 con 0x7fb62c0cb4c0 2023-05-16T13:54:55.765 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.756+0000 7fb6343bc640 1 -- 172.21.15.39:0/2671743407 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb62c0cb4c0 msgr2=0x7fb62c15d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:55.765 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.756+0000 7fb6343bc640 1 --2- 172.21.15.39:0/2671743407 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb62c0cb4c0 0x7fb62c15d160 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb61c00bb10 tx=0x7fb61c01eb50 comp rx=0 tx=0).stop 2023-05-16T13:54:55.765 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.760+0000 7fb6343bc640 1 -- 172.21.15.39:0/2671743407 shutdown_connections 2023-05-16T13:54:55.765 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.760+0000 7fb6343bc640 1 --2- 172.21.15.39:0/2671743407 >> v2:172.21.15.118:3300/0 conn(0x7fb62c0703b0 0x7fb62c0ccda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:55.765 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.760+0000 7fb6343bc640 1 --2- 172.21.15.39:0/2671743407 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb62c0cb4c0 0x7fb62c15d160 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:55.766 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.760+0000 7fb6343bc640 1 -- 172.21.15.39:0/2671743407 >> 172.21.15.39:0/2671743407 conn(0x7fb62c069a50 msgr2=0x7fb62c069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:55.766 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.760+0000 7fb6343bc640 1 -- 172.21.15.39:0/2671743407 shutdown_connections 2023-05-16T13:54:55.766 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.760+0000 7fb6343bc640 1 -- 172.21.15.39:0/2671743407 wait complete. 2023-05-16T13:54:55.766 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.760+0000 7fb6343bc640 1 Processor -- start 2023-05-16T13:54:55.766 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.760+0000 7fb6343bc640 1 -- start start 2023-05-16T13:54:55.768 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.760+0000 7fb6343bc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb62c0703b0 0x7fb62c14ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:55.768 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.760+0000 7fb6343bc640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb62c0cb4c0 0x7fb62c15b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:55.768 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.760+0000 7fb6343bc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb62c158bf0 0x7fb62c145ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:55.768 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.760+0000 7fb6343bc640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c14f200 con 0x7fb62c158bf0 2023-05-16T13:54:55.768 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.760+0000 7fb6343bc640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c0b2360 con 0x7fb62c0703b0 2023-05-16T13:54:55.769 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.760+0000 7fb6343bc640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c14f6f0 con 0x7fb62c0cb4c0 2023-05-16T13:54:55.769 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.760+0000 7fb632959640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb62c158bf0 0x7fb62c145ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:55.769 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.760+0000 7fb632959640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb62c158bf0 0x7fb62c145ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34694/0 (socket says 172.21.15.39:34694) 2023-05-16T13:54:55.769 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.760+0000 7fb632959640 1 -- 172.21.15.39:0/1769200572 learned_addr learned my addr 172.21.15.39:0/1769200572 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:55.769 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.760+0000 7fb632158640 1 --2- 172.21.15.39:0/1769200572 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb62c0703b0 0x7fb62c14ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:55.769 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.760+0000 7fb631957640 1 --2- 172.21.15.39:0/1769200572 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb62c0cb4c0 0x7fb62c15b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:55.769 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.760+0000 7fb632959640 1 -- 172.21.15.39:0/1769200572 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb62c0cb4c0 msgr2=0x7fb62c15b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:55.770 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.760+0000 7fb632959640 1 --2- 172.21.15.39:0/1769200572 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb62c0cb4c0 0x7fb62c15b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:55.770 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.760+0000 7fb632959640 1 -- 172.21.15.39:0/1769200572 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb62c0703b0 msgr2=0x7fb62c14ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:55.770 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.760+0000 7fb632959640 1 --2- 172.21.15.39:0/1769200572 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb62c0703b0 0x7fb62c14ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:55.770 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.760+0000 7fb632959640 1 -- 172.21.15.39:0/1769200572 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb624009a70 con 0x7fb62c158bf0 2023-05-16T13:54:55.771 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.760+0000 7fb632959640 1 --2- 172.21.15.39:0/1769200572 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb62c158bf0 0x7fb62c145ed0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fb62400ef90 tx=0x7fb624009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:55.771 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.764+0000 7fb622ffd640 1 -- 172.21.15.39:0/1769200572 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb624009d70 con 0x7fb62c158bf0 2023-05-16T13:54:55.771 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.764+0000 7fb622ffd640 1 -- 172.21.15.39:0/1769200572 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb62400f040 con 0x7fb62c158bf0 2023-05-16T13:54:55.771 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.764+0000 7fb622ffd640 1 -- 172.21.15.39:0/1769200572 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6240146c0 con 0x7fb62c158bf0 2023-05-16T13:54:55.771 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.764+0000 7fb6343bc640 1 -- 172.21.15.39:0/1769200572 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb61c00b770 con 0x7fb62c158bf0 2023-05-16T13:54:55.772 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.764+0000 7fb6343bc640 1 -- 172.21.15.39:0/1769200572 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb62c0ad950 con 0x7fb62c158bf0 2023-05-16T13:54:55.772 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.764+0000 7fb6343bc640 1 -- 172.21.15.39:0/1769200572 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb62c0cdaf0 con 0x7fb62c158bf0 2023-05-16T13:54:55.772 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.764+0000 7fb622ffd640 1 -- 172.21.15.39:0/1769200572 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb624014820 con 0x7fb62c158bf0 2023-05-16T13:54:55.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.764+0000 7fb622ffd640 1 --2- 172.21.15.39:0/1769200572 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fb610066280 0x7fb610068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:55.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.764+0000 7fb622ffd640 1 -- 172.21.15.39:0/1769200572 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb624084bc0 con 0x7fb62c158bf0 2023-05-16T13:54:55.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.764+0000 7fb632158640 1 --2- 172.21.15.39:0/1769200572 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fb610066280 0x7fb610068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:55.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.768+0000 7fb632158640 1 --2- 172.21.15.39:0/1769200572 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fb610066280 0x7fb610068730 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb628000f70 tx=0x7fb628007e10 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:55.775 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.768+0000 7fb622ffd640 1 -- 172.21.15.39:0/1769200572 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fb6240520e0 con 0x7fb62c158bf0 2023-05-16T13:54:55.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.928+0000 7fb6343bc640 1 -- 172.21.15.39:0/1769200572 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb62c0c9000 con 0x7fb62c158bf0 2023-05-16T13:54:55.936 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.928+0000 7fb622ffd640 1 -- 172.21.15.39:0/1769200572 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18375 (secure 0 0 0) 0x7fb624018090 con 0x7fb62c158bf0 2023-05-16T13:54:55.937 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:54:55.937 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":25,"fsid":"9c1e210b-c515-4ea4-a065-397956895c68","created":"2023-05-16T13:53:48.955290+0000","modified":"2023-05-16T13:54:55.816407+0000","last_up_change":"2023-05-16T13:54:01.722051+0000","last_in_change":"2023-05-16T13:53:52.331336+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-16T13:54:00.885009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-16T13:54:08.327895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-16T13:54:12.864823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-16T13:54:14.180225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4ce0f0ba-c4bf-4405-8c95-d2e9a62878ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6809","nonce":3462013698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6811","nonce":3462013698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6815","nonce":3462013698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6813","nonce":3462013698}]},"public_addr":"172.21.15.39:6809/3462013698","cluster_addr":"172.21.15.39:6811/3462013698","heartbeat_back_addr":"172.21.15.39:6815/3462013698","heartbeat_front_addr":"172.21.15.39:6813/3462013698","state":["exists","up"]},{"osd":1,"uuid":"53fdc1ac-2473-472d-af32-2760fdf6e476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6801","nonce":2829970892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6803","nonce":2829970892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6807","nonce":2829970892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6805","nonce":2829970892}]},"public_addr":"172.21.15.39:6801/2829970892","cluster_addr":"172.21.15.39:6803/2829970892","heartbeat_back_addr":"172.21.15.39:6807/2829970892","heartbeat_front_addr":"172.21.15.39:6805/2829970892","state":["exists","up"]},{"osd":2,"uuid":"0b92d770-7030-42fa-a19f-4f7f1ac113c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6817","nonce":3888067413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6819","nonce":3888067413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6823","nonce":3888067413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6821","nonce":3888067413}]},"public_addr":"172.21.15.39:6817/3888067413","cluster_addr":"172.21.15.39:6819/3888067413","heartbeat_back_addr":"172.21.15.39:6823/3888067413","heartbeat_front_addr":"172.21.15.39:6821/3888067413","state":["exists","up"]},{"osd":3,"uuid":"000d9506-cbb2-4017-b875-deca579860ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6825","nonce":405003958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6827","nonce":405003958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6831","nonce":405003958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6829","nonce":405003958}]},"public_addr":"172.21.15.39:6825/405003958","cluster_addr":"172.21.15.39:6827/405003958","heartbeat_back_addr":"172.21.15.39:6831/405003958","heartbeat_front_addr":"172.21.15.39:6829/405003958","state":["exists","up"]},{"osd":4,"uuid":"70f0dacb-e960-40c5-bf6a-183e52bbe2ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6801","nonce":3895278838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6805","nonce":3895278838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6813","nonce":3895278838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6809","nonce":3895278838}]},"public_addr":"172.21.15.118:6801/3895278838","cluster_addr":"172.21.15.118:6805/3895278838","heartbeat_back_addr":"172.21.15.118:6813/3895278838","heartbeat_front_addr":"172.21.15.118:6809/3895278838","state":["exists","up"]},{"osd":5,"uuid":"756feb54-c3ae-4a2a-8f74-85c291ba707c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6804","nonce":3513592808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6808","nonce":3513592808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6815","nonce":3513592808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6812","nonce":3513592808}]},"public_addr":"172.21.15.118:6804/3513592808","cluster_addr":"172.21.15.118:6808/3513592808","heartbeat_back_addr":"172.21.15.118:6815/3513592808","heartbeat_front_addr":"172.21.15.118:6812/3513592808","state":["exists","up"]},{"osd":6,"uuid":"c4a982c1-f497-4b0f-8a23-c77372e4621e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6824","nonce":1863656053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6827","nonce":1863656053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6831","nonce":1863656053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6829","nonce":1863656053}]},"public_addr":"172.21.15.118:6824/1863656053","cluster_addr":"172.21.15.118:6827/1863656053","heartbeat_back_addr":"172.21.15.118:6831/1863656053","heartbeat_front_addr":"172.21.15.118:6829/1863656053","state":["exists","up"]},{"osd":7,"uuid":"6f2888aa-a7ac-4e26-9159-e31817934f44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6817","nonce":3636642904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6819","nonce":3636642904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6825","nonce":3636642904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6821","nonce":3636642904}]},"public_addr":"172.21.15.118:6817/3636642904","cluster_addr":"172.21.15.118:6819/3636642904","heartbeat_back_addr":"172.21.15.118:6825/3636642904","heartbeat_front_addr":"172.21.15.118:6821/3636642904","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.717636+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.724036+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.739144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:58.079275+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:58.073921+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.930466+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.987813+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.941098+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.24","mappings":[{"from":1,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-16T13:54:55.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.932+0000 7fb6343bc640 1 -- 172.21.15.39:0/1769200572 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fb610066280 msgr2=0x7fb610068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:55.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.932+0000 7fb6343bc640 1 --2- 172.21.15.39:0/1769200572 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fb610066280 0x7fb610068730 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb628000f70 tx=0x7fb628007e10 comp rx=0 tx=0).stop 2023-05-16T13:54:55.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.932+0000 7fb6343bc640 1 -- 172.21.15.39:0/1769200572 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb62c158bf0 msgr2=0x7fb62c145ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:55.940 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.932+0000 7fb6343bc640 1 --2- 172.21.15.39:0/1769200572 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb62c158bf0 0x7fb62c145ed0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fb62400ef90 tx=0x7fb624009f90 comp rx=0 tx=0).stop 2023-05-16T13:54:55.940 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.932+0000 7fb6343bc640 1 -- 172.21.15.39:0/1769200572 shutdown_connections 2023-05-16T13:54:55.940 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.932+0000 7fb6343bc640 1 --2- 172.21.15.39:0/1769200572 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fb610066280 0x7fb610068730 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:55.941 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.932+0000 7fb6343bc640 1 --2- 172.21.15.39:0/1769200572 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb62c0cb4c0 0x7fb62c15b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:55.941 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.932+0000 7fb6343bc640 1 --2- 172.21.15.39:0/1769200572 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb62c158bf0 0x7fb62c145ed0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:55.941 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.932+0000 7fb6343bc640 1 --2- 172.21.15.39:0/1769200572 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb62c0703b0 0x7fb62c14ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:55.941 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.932+0000 7fb6343bc640 1 -- 172.21.15.39:0/1769200572 >> 172.21.15.39:0/1769200572 conn(0x7fb62c069a50 msgr2=0x7fb62c069e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:55.942 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.932+0000 7fb6343bc640 1 -- 172.21.15.39:0/1769200572 shutdown_connections 2023-05-16T13:54:55.942 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:55.932+0000 7fb6343bc640 1 -- 172.21.15.39:0/1769200572 wait complete. 2023-05-16T13:54:55.958 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-16T13:54:00.885009+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-16T13:54:08.327895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-16T13:54:12.864823+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-16T13:54:14.180225+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-16T13:54:55.959 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-16T13:54:56.100 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.092+0000 7f3ddec8c640 1 Processor -- start 2023-05-16T13:54:56.101 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.096+0000 7f3ddec8c640 1 -- start start 2023-05-16T13:54:56.102 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.096+0000 7f3ddec8c640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3dd8158e00 0x7f3dd80c9530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:56.102 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.096+0000 7f3ddec8c640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f3dd80b0660 0x7f3dd8070420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:56.102 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.096+0000 7f3ddec8c640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dd80ca030 con 0x7f3dd80c9a70 2023-05-16T13:54:56.102 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.096+0000 7f3ddec8c640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dd815c890 con 0x7f3dd80b0660 2023-05-16T13:54:56.102 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.096+0000 7f3ddec8c640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dd815cb70 con 0x7f3dd8158e00 2023-05-16T13:54:56.102 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.096+0000 7f3ddd229640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f3dd80b0660 0x7f3dd8070420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:56.103 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.096+0000 7f3dd7fff640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f3dd80c9a70 0x7f3dd80aff50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:35640/0 (socket says 172.21.15.39:35640) 2023-05-16T13:54:56.103 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.096+0000 7f3dd7fff640 1 -- 172.21.15.39:0/1364851936 learned_addr learned my addr 172.21.15.39:0/1364851936 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:56.103 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.096+0000 7f3ddca28640 1 --2- 172.21.15.39:0/1364851936 >> v2:172.21.15.118:3300/0 conn(0x7f3dd8158e00 0x7f3dd80c9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:56.104 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.096+0000 7f3ddd229640 1 -- 172.21.15.39:0/1364851936 >> v2:172.21.15.118:3300/0 conn(0x7f3dd8158e00 msgr2=0x7f3dd80c9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:56.104 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.096+0000 7f3ddd229640 1 --2- 172.21.15.39:0/1364851936 >> v2:172.21.15.118:3300/0 conn(0x7f3dd8158e00 0x7f3dd80c9530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:56.104 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.096+0000 7f3ddd229640 1 -- 172.21.15.39:0/1364851936 >> v1:172.21.15.39:6789/0 conn(0x7f3dd80c9a70 legacy=0x7f3dd80aff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:56.104 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.096+0000 7f3ddd229640 1 -- 172.21.15.39:0/1364851936 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd815ce50 con 0x7f3dd80b0660 2023-05-16T13:54:56.104 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.096+0000 7f3dd77fe640 1 -- 172.21.15.39:0/1364851936 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 575732328 0 0) 0x7f3dd80ca030 con 0x7f3dd80c9a70 2023-05-16T13:54:56.105 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.100+0000 7f3ddd229640 1 --2- 172.21.15.39:0/1364851936 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3dd80b0660 0x7f3dd8070420 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3dd80cc450 tx=0x7f3dd001f0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c6930192a39f6 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:56.106 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.100+0000 7f3dd77fe640 1 -- 172.21.15.39:0/1364851936 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd00b0440 con 0x7f3dd80b0660 2023-05-16T13:54:56.106 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.100+0000 7f3dd77fe640 1 -- 172.21.15.39:0/1364851936 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dd00b05a0 con 0x7f3dd80b0660 2023-05-16T13:54:56.106 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.100+0000 7f3dd77fe640 1 -- 172.21.15.39:0/1364851936 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd00b0930 con 0x7f3dd80b0660 2023-05-16T13:54:56.107 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.100+0000 7f3ddec8c640 1 -- 172.21.15.39:0/1364851936 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3dd80b0660 msgr2=0x7f3dd8070420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:56.107 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.100+0000 7f3ddec8c640 1 --2- 172.21.15.39:0/1364851936 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3dd80b0660 0x7f3dd8070420 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3dd80cc450 tx=0x7f3dd001f0f0 comp rx=0 tx=0).stop 2023-05-16T13:54:56.107 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.100+0000 7f3ddec8c640 1 -- 172.21.15.39:0/1364851936 shutdown_connections 2023-05-16T13:54:56.107 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.100+0000 7f3ddec8c640 1 --2- 172.21.15.39:0/1364851936 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3dd80b0660 0x7f3dd8070420 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:56.107 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.100+0000 7f3ddec8c640 1 --2- 172.21.15.39:0/1364851936 >> v2:172.21.15.118:3300/0 conn(0x7f3dd8158e00 0x7f3dd80c9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:56.107 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.100+0000 7f3ddec8c640 1 -- 172.21.15.39:0/1364851936 >> 172.21.15.39:0/1364851936 conn(0x7f3dd8069a50 msgr2=0x7f3dd8069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:56.107 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.100+0000 7f3ddec8c640 1 -- 172.21.15.39:0/1364851936 shutdown_connections 2023-05-16T13:54:56.108 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.100+0000 7f3ddec8c640 1 -- 172.21.15.39:0/1364851936 wait complete. 2023-05-16T13:54:56.108 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.100+0000 7f3ddec8c640 1 Processor -- start 2023-05-16T13:54:56.108 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.100+0000 7f3ddec8c640 1 -- start start 2023-05-16T13:54:56.109 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.104+0000 7f3ddec8c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3dd80b0660 0x7f3dd80ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:56.109 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.104+0000 7f3ddec8c640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3dd80c9a70 0x7f3dd80ccec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:56.109 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.104+0000 7f3ddec8c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3dd8158e00 0x7f3dd8154d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:56.110 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.104+0000 7f3ddec8c640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd80cee10 con 0x7f3dd80b0660 2023-05-16T13:54:56.110 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.104+0000 7f3ddec8c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd80cf060 con 0x7f3dd8158e00 2023-05-16T13:54:56.110 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.104+0000 7f3ddec8c640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd8147a30 con 0x7f3dd80c9a70 2023-05-16T13:54:56.110 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.104+0000 7f3ddca28640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3dd80b0660 0x7f3dd80ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:56.110 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.104+0000 7f3ddca28640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3dd80b0660 0x7f3dd80ce8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34706/0 (socket says 172.21.15.39:34706) 2023-05-16T13:54:56.110 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.104+0000 7f3ddca28640 1 -- 172.21.15.39:0/2344404512 learned_addr learned my addr 172.21.15.39:0/2344404512 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:56.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.104+0000 7f3ddca28640 1 -- 172.21.15.39:0/2344404512 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3dd80c9a70 msgr2=0x7f3dd80ccec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:56.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.104+0000 7f3ddca28640 1 --2- 172.21.15.39:0/2344404512 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3dd80c9a70 0x7f3dd80ccec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:56.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.104+0000 7f3ddca28640 1 -- 172.21.15.39:0/2344404512 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3dd8158e00 msgr2=0x7f3dd8154d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:56.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.104+0000 7f3ddca28640 1 --2- 172.21.15.39:0/2344404512 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3dd8158e00 0x7f3dd8154d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:56.113 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.104+0000 7f3ddca28640 1 -- 172.21.15.39:0/2344404512 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd0009a70 con 0x7f3dd80b0660 2023-05-16T13:54:56.113 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.104+0000 7f3ddca28640 1 --2- 172.21.15.39:0/2344404512 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3dd80b0660 0x7f3dd80ce8d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc00d5f0 tx=0x7f3dcc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:56.113 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.104+0000 7f3dd57fa640 1 -- 172.21.15.39:0/2344404512 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc0125f0 con 0x7f3dd80b0660 2023-05-16T13:54:56.113 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.104+0000 7f3dd57fa640 1 -- 172.21.15.39:0/2344404512 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dcc012750 con 0x7f3dd80b0660 2023-05-16T13:54:56.113 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.104+0000 7f3ddec8c640 1 -- 172.21.15.39:0/2344404512 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dd80cc730 con 0x7f3dd80b0660 2023-05-16T13:54:56.113 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.104+0000 7f3dd57fa640 1 -- 172.21.15.39:0/2344404512 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc012ae0 con 0x7f3dd80b0660 2023-05-16T13:54:56.113 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.104+0000 7f3ddec8c640 1 -- 172.21.15.39:0/2344404512 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dd815d130 con 0x7f3dd80b0660 2023-05-16T13:54:56.114 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.104+0000 7f3ddec8c640 1 -- 172.21.15.39:0/2344404512 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dd815d650 con 0x7f3dd80b0660 2023-05-16T13:54:56.114 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.104+0000 7f3dd57fa640 1 -- 172.21.15.39:0/2344404512 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3dcc012c40 con 0x7f3dd80b0660 2023-05-16T13:54:56.115 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.108+0000 7f3dd57fa640 1 --2- 172.21.15.39:0/2344404512 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f3dbc0662b0 0x7f3dbc068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:56.115 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.108+0000 7f3dd57fa640 1 -- 172.21.15.39:0/2344404512 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f3dcc0841b0 con 0x7f3dd80b0660 2023-05-16T13:54:56.115 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.108+0000 7f3dd7fff640 1 --2- 172.21.15.39:0/2344404512 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f3dbc0662b0 0x7f3dbc068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:56.115 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.108+0000 7f3dd7fff640 1 --2- 172.21.15.39:0/2344404512 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f3dbc0662b0 0x7f3dbc068760 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3dc4007fd0 tx=0x7f3dc4007960 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:56.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.112+0000 7f3dd57fa640 1 -- 172.21.15.39:0/2344404512 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f3dcc051680 con 0x7f3dd80b0660 2023-05-16T13:54:56.272 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.264+0000 7f3ddec8c640 1 -- 172.21.15.39:0/2344404512 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3dd8073c90 con 0x7f3dd80b0660 2023-05-16T13:54:56.272 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.264+0000 7f3dd57fa640 1 -- 172.21.15.39:0/2344404512 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3dcc054ca0 con 0x7f3dd80b0660 2023-05-16T13:54:56.273 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2023-05-16T13:54:56.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.268+0000 7f3ddec8c640 1 -- 172.21.15.39:0/2344404512 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f3dbc0662b0 msgr2=0x7f3dbc068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:56.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.268+0000 7f3ddec8c640 1 --2- 172.21.15.39:0/2344404512 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f3dbc0662b0 0x7f3dbc068760 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3dc4007fd0 tx=0x7f3dc4007960 comp rx=0 tx=0).stop 2023-05-16T13:54:56.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.268+0000 7f3ddec8c640 1 -- 172.21.15.39:0/2344404512 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3dd80b0660 msgr2=0x7f3dd80ce8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:56.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.268+0000 7f3ddec8c640 1 --2- 172.21.15.39:0/2344404512 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3dd80b0660 0x7f3dd80ce8d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc00d5f0 tx=0x7f3dcc00dab0 comp rx=0 tx=0).stop 2023-05-16T13:54:56.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.268+0000 7f3ddec8c640 1 -- 172.21.15.39:0/2344404512 shutdown_connections 2023-05-16T13:54:56.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.268+0000 7f3ddec8c640 1 --2- 172.21.15.39:0/2344404512 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f3dbc0662b0 0x7f3dbc068760 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:56.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.268+0000 7f3ddec8c640 1 --2- 172.21.15.39:0/2344404512 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3dd80c9a70 0x7f3dd80ccec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:56.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.268+0000 7f3ddec8c640 1 --2- 172.21.15.39:0/2344404512 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3dd8158e00 0x7f3dd8154d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:56.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.268+0000 7f3ddec8c640 1 --2- 172.21.15.39:0/2344404512 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3dd80b0660 0x7f3dd80ce8d0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:56.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.268+0000 7f3ddec8c640 1 -- 172.21.15.39:0/2344404512 >> 172.21.15.39:0/2344404512 conn(0x7f3dd8069a50 msgr2=0x7f3dd8157ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:56.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.268+0000 7f3ddec8c640 1 -- 172.21.15.39:0/2344404512 shutdown_connections 2023-05-16T13:54:56.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.268+0000 7f3ddec8c640 1 -- 172.21.15.39:0/2344404512 wait complete. 2023-05-16T13:54:56.293 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-16T13:54:56.434 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.428+0000 7fec01b69640 1 Processor -- start 2023-05-16T13:54:56.434 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.428+0000 7fec01b69640 1 -- start start 2023-05-16T13:54:56.435 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.428+0000 7fec01b69640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7febfc15f310 0x7febfc06fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:56.435 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.428+0000 7fec01b69640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7febfc0b2a60 0x7febfc06c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:56.435 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.428+0000 7fec01b69640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febfc0cd630 con 0x7febfc15f6e0 2023-05-16T13:54:56.435 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.428+0000 7fec01b69640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febfc0b1f80 con 0x7febfc0b2a60 2023-05-16T13:54:56.436 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.428+0000 7fec01b69640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febfc0b2260 con 0x7febfc15f310 2023-05-16T13:54:56.436 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.428+0000 7fec00b67640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7febfc15f310 0x7febfc06fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:56.437 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.428+0000 7fec00b67640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7febfc15f310 0x7febfc06fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.39:44842/0 (socket says 172.21.15.39:44842) 2023-05-16T13:54:56.437 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.428+0000 7fec00b67640 1 -- 172.21.15.39:0/1734937597 learned_addr learned my addr 172.21.15.39:0/1734937597 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:56.437 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.428+0000 7fec01368640 1 --2- 172.21.15.39:0/1734937597 >> v2:172.21.15.118:3300/0 conn(0x7febfc0b2a60 0x7febfc06c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:56.437 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.428+0000 7fec00b67640 1 -- 172.21.15.39:0/1734937597 >> v2:172.21.15.118:3300/0 conn(0x7febfc0b2a60 msgr2=0x7febfc06c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:56.437 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.428+0000 7fec00b67640 1 --2- 172.21.15.39:0/1734937597 >> v2:172.21.15.118:3300/0 conn(0x7febfc0b2a60 0x7febfc06c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:56.437 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.428+0000 7fec00b67640 1 -- 172.21.15.39:0/1734937597 >> v1:172.21.15.118:6789/0 conn(0x7febfc15f6e0 legacy=0x7febfc0cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:56.437 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.428+0000 7fec00b67640 1 -- 172.21.15.39:0/1734937597 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febfc0b2540 con 0x7febfc15f310 2023-05-16T13:54:56.439 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.432+0000 7fec00b67640 1 --2- 172.21.15.39:0/1734937597 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7febfc15f310 0x7febfc06fb80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7febf8009870 tx=0x7febf801c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3424ce04e810d53b server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:56.439 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.432+0000 7febf37fe640 1 -- 172.21.15.39:0/1734937597 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf80ab650 con 0x7febfc15f310 2023-05-16T13:54:56.439 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.432+0000 7febf37fe640 1 -- 172.21.15.39:0/1734937597 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf80ab7b0 con 0x7febfc15f310 2023-05-16T13:54:56.440 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.432+0000 7febf37fe640 1 -- 172.21.15.39:0/1734937597 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf80abb40 con 0x7febfc15f310 2023-05-16T13:54:56.440 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.432+0000 7fec01b69640 1 -- 172.21.15.39:0/1734937597 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7febfc15f310 msgr2=0x7febfc06fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:56.441 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.432+0000 7fec01b69640 1 --2- 172.21.15.39:0/1734937597 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7febfc15f310 0x7febfc06fb80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7febf8009870 tx=0x7febf801c540 comp rx=0 tx=0).stop 2023-05-16T13:54:56.441 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.432+0000 7fec01b69640 1 -- 172.21.15.39:0/1734937597 shutdown_connections 2023-05-16T13:54:56.441 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.432+0000 7fec01b69640 1 --2- 172.21.15.39:0/1734937597 >> v2:172.21.15.118:3300/0 conn(0x7febfc0b2a60 0x7febfc06c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:56.441 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.432+0000 7fec01b69640 1 --2- 172.21.15.39:0/1734937597 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7febfc15f310 0x7febfc06fb80 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:56.441 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.432+0000 7fec01b69640 1 -- 172.21.15.39:0/1734937597 >> 172.21.15.39:0/1734937597 conn(0x7febfc06ddf0 msgr2=0x7febfc06e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:56.441 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.432+0000 7fec01b69640 1 -- 172.21.15.39:0/1734937597 shutdown_connections 2023-05-16T13:54:56.442 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.432+0000 7fec01b69640 1 -- 172.21.15.39:0/1734937597 wait complete. 2023-05-16T13:54:56.442 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.436+0000 7fec01b69640 1 Processor -- start 2023-05-16T13:54:56.442 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.436+0000 7fec01b69640 1 -- start start 2023-05-16T13:54:56.443 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.436+0000 7fec01b69640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7febfc0b2a60 0x7febfc15d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:56.444 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.436+0000 7fec01b69640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7febfc15f310 0x7febfc15e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:56.444 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.436+0000 7fec01b69640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7febfc15f6e0 0x7febfc0c8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:56.444 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.436+0000 7fec01b69640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febfc0c9240 con 0x7febfc0b2a60 2023-05-16T13:54:56.444 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.436+0000 7fec01b69640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febfc15dc10 con 0x7febfc15f310 2023-05-16T13:54:56.444 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.436+0000 7fec01b69640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febfc0c7f40 con 0x7febfc15f6e0 2023-05-16T13:54:56.444 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.436+0000 7fec00b67640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7febfc0b2a60 0x7febfc15d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:56.444 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.436+0000 7fec00b67640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7febfc0b2a60 0x7febfc15d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34716/0 (socket says 172.21.15.39:34716) 2023-05-16T13:54:56.445 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.436+0000 7fec00b67640 1 -- 172.21.15.39:0/2810036029 learned_addr learned my addr 172.21.15.39:0/2810036029 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:56.445 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.436+0000 7febf3fff640 1 --2- 172.21.15.39:0/2810036029 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7febfc15f310 0x7febfc15e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:56.445 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.436+0000 7fec01368640 1 --2- 172.21.15.39:0/2810036029 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7febfc15f6e0 0x7febfc0c8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:56.445 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.436+0000 7fec00b67640 1 -- 172.21.15.39:0/2810036029 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7febfc15f6e0 msgr2=0x7febfc0c8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:56.445 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.436+0000 7fec00b67640 1 --2- 172.21.15.39:0/2810036029 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7febfc15f6e0 0x7febfc0c8d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:56.445 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.436+0000 7fec00b67640 1 -- 172.21.15.39:0/2810036029 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7febfc15f310 msgr2=0x7febfc15e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:56.445 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.436+0000 7fec00b67640 1 --2- 172.21.15.39:0/2810036029 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7febfc15f310 0x7febfc15e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:56.446 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.436+0000 7fec00b67640 1 -- 172.21.15.39:0/2810036029 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf80094d0 con 0x7febfc0b2a60 2023-05-16T13:54:56.446 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.436+0000 7fec00b67640 1 --2- 172.21.15.39:0/2810036029 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7febfc0b2a60 0x7febfc15d580 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7febf80ad040 tx=0x7febf801ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:56.446 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.436+0000 7febf17fa640 1 -- 172.21.15.39:0/2810036029 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf80b4800 con 0x7febfc0b2a60 2023-05-16T13:54:56.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.436+0000 7febf17fa640 1 -- 172.21.15.39:0/2810036029 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf80b4960 con 0x7febfc0b2a60 2023-05-16T13:54:56.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.436+0000 7febf17fa640 1 -- 172.21.15.39:0/2810036029 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf80b4d10 con 0x7febfc0b2a60 2023-05-16T13:54:56.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.436+0000 7fec01b69640 1 -- 172.21.15.39:0/2810036029 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febfc1605a0 con 0x7febfc0b2a60 2023-05-16T13:54:56.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.440+0000 7fec01b69640 1 -- 172.21.15.39:0/2810036029 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febfc160410 con 0x7febfc0b2a60 2023-05-16T13:54:56.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.440+0000 7fec01b69640 1 -- 172.21.15.39:0/2810036029 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febfc160730 con 0x7febfc0b2a60 2023-05-16T13:54:56.448 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.440+0000 7febf17fa640 1 -- 172.21.15.39:0/2810036029 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7febf80c83a0 con 0x7febfc0b2a60 2023-05-16T13:54:56.448 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.440+0000 7febf17fa640 1 --2- 172.21.15.39:0/2810036029 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7febe8066280 0x7febe8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:56.448 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.440+0000 7febf17fa640 1 -- 172.21.15.39:0/2810036029 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7febf811ea60 con 0x7febfc0b2a60 2023-05-16T13:54:56.449 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.440+0000 7febf3fff640 1 --2- 172.21.15.39:0/2810036029 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7febe8066280 0x7febe8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:56.449 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.440+0000 7febf3fff640 1 --2- 172.21.15.39:0/2810036029 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7febe8066280 0x7febe8068730 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7febfc0c72e0 tx=0x7febec009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:56.451 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.444+0000 7febf17fa640 1 -- 172.21.15.39:0/2810036029 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7febf80ebf40 con 0x7febfc0b2a60 2023-05-16T13:54:56.605 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.600+0000 7fec01b69640 1 -- 172.21.15.39:0/2810036029 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7febfc04ed20 con 0x7febfc0b2a60 2023-05-16T13:54:56.606 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.600+0000 7febf17fa640 1 -- 172.21.15.39:0/2810036029 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7febf811e070 con 0x7febfc0b2a60 2023-05-16T13:54:56.606 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 8 2023-05-16T13:54:56.608 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.600+0000 7fec01b69640 1 -- 172.21.15.39:0/2810036029 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7febe8066280 msgr2=0x7febe8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:56.608 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.600+0000 7fec01b69640 1 --2- 172.21.15.39:0/2810036029 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7febe8066280 0x7febe8068730 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7febfc0c72e0 tx=0x7febec009040 comp rx=0 tx=0).stop 2023-05-16T13:54:56.608 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.600+0000 7fec01b69640 1 -- 172.21.15.39:0/2810036029 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7febfc0b2a60 msgr2=0x7febfc15d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:56.608 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.600+0000 7fec01b69640 1 --2- 172.21.15.39:0/2810036029 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7febfc0b2a60 0x7febfc15d580 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7febf80ad040 tx=0x7febf801ad80 comp rx=0 tx=0).stop 2023-05-16T13:54:56.609 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.600+0000 7fec01b69640 1 -- 172.21.15.39:0/2810036029 shutdown_connections 2023-05-16T13:54:56.609 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.600+0000 7fec01b69640 1 --2- 172.21.15.39:0/2810036029 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7febe8066280 0x7febe8068730 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:56.609 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.600+0000 7fec01b69640 1 --2- 172.21.15.39:0/2810036029 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7febfc15f6e0 0x7febfc0c8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:56.609 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.600+0000 7fec01b69640 1 --2- 172.21.15.39:0/2810036029 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7febfc15f310 0x7febfc15e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:56.609 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.600+0000 7fec01b69640 1 --2- 172.21.15.39:0/2810036029 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7febfc0b2a60 0x7febfc15d580 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:56.609 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.600+0000 7fec01b69640 1 -- 172.21.15.39:0/2810036029 >> 172.21.15.39:0/2810036029 conn(0x7febfc06ddf0 msgr2=0x7febfc0cdbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:56.609 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.600+0000 7fec01b69640 1 -- 172.21.15.39:0/2810036029 shutdown_connections 2023-05-16T13:54:56.609 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.600+0000 7fec01b69640 1 -- 172.21.15.39:0/2810036029 wait complete. 2023-05-16T13:54:56.627 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-16T13:54:56.767 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.760+0000 7f2060ed1640 1 Processor -- start 2023-05-16T13:54:56.767 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.760+0000 7f2060ed1640 1 -- start start 2023-05-16T13:54:56.769 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.760+0000 7f2060ed1640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f205c0d0410 0x7f205c0d07e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:56.770 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.760+0000 7f2060ed1640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f205c0af490 0x7f205c0af930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:56.770 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.760+0000 7f2060ed1640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f205c0d3210 con 0x7f205c06b620 2023-05-16T13:54:56.770 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.760+0000 7f2060ed1640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f205c15c620 con 0x7f205c0af490 2023-05-16T13:54:56.771 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.760+0000 7f2060ed1640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f205c0d0d20 con 0x7f205c0d0410 2023-05-16T13:54:56.771 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.760+0000 7f205ad9d640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f205c0af490 0x7f205c0af930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:56.771 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.760+0000 7f205ad9d640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f205c0af490 0x7f205c0af930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34730/0 (socket says 172.21.15.39:34730) 2023-05-16T13:54:56.771 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.760+0000 7f205ad9d640 1 -- 172.21.15.39:0/3900867882 learned_addr learned my addr 172.21.15.39:0/3900867882 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:56.772 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.760+0000 7f2053fff640 1 --1- 172.21.15.39:0/3900867882 >> v1:172.21.15.39:6789/0 conn(0x7f205c06b620 0x7f205c0d2b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:35642/0 (socket says 172.21.15.39:35642) 2023-05-16T13:54:56.772 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.764+0000 7f205a59c640 1 --2- 172.21.15.39:0/3900867882 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f205c0d0410 0x7f205c0d07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:56.772 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.764+0000 7f205ad9d640 1 -- 172.21.15.39:0/3900867882 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f205c0d0410 msgr2=0x7f205c0d07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:56.772 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.764+0000 7f205ad9d640 1 --2- 172.21.15.39:0/3900867882 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f205c0d0410 0x7f205c0d07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:56.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.764+0000 7f205ad9d640 1 -- 172.21.15.39:0/3900867882 >> v1:172.21.15.39:6789/0 conn(0x7f205c06b620 legacy=0x7f205c0d2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:56.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.764+0000 7f205ad9d640 1 -- 172.21.15.39:0/3900867882 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f205c06bb20 con 0x7f205c0af490 2023-05-16T13:54:56.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.764+0000 7f2059d9b640 1 -- 172.21.15.39:0/3900867882 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2466199080 0 0) 0x7f205c0d3210 con 0x7f205c06b620 2023-05-16T13:54:56.775 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.764+0000 7f205ad9d640 1 --2- 172.21.15.39:0/3900867882 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f205c0af490 0x7f205c0af930 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2054009e50 tx=0x7f205401f1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82a0e08915695423 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:56.776 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.764+0000 7f2059d9b640 1 -- 172.21.15.39:0/3900867882 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20540af400 con 0x7f205c0af490 2023-05-16T13:54:56.776 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.764+0000 7f2059d9b640 1 -- 172.21.15.39:0/3900867882 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20540ab050 con 0x7f205c0af490 2023-05-16T13:54:56.776 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.764+0000 7f2059d9b640 1 -- 172.21.15.39:0/3900867882 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20540af780 con 0x7f205c0af490 2023-05-16T13:54:56.776 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.764+0000 7f2060ed1640 1 -- 172.21.15.39:0/3900867882 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f205c0af490 msgr2=0x7f205c0af930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:56.776 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.764+0000 7f2060ed1640 1 --2- 172.21.15.39:0/3900867882 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f205c0af490 0x7f205c0af930 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2054009e50 tx=0x7f205401f1f0 comp rx=0 tx=0).stop 2023-05-16T13:54:56.776 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.764+0000 7f2060ed1640 1 -- 172.21.15.39:0/3900867882 shutdown_connections 2023-05-16T13:54:56.777 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.764+0000 7f2060ed1640 1 --2- 172.21.15.39:0/3900867882 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f205c0af490 0x7f205c0af930 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:56.777 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.764+0000 7f2060ed1640 1 --2- 172.21.15.39:0/3900867882 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f205c0d0410 0x7f205c0d07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:56.777 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.764+0000 7f2060ed1640 1 -- 172.21.15.39:0/3900867882 >> 172.21.15.39:0/3900867882 conn(0x7f205c09bba0 msgr2=0x7f205c089fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:56.777 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.764+0000 7f2060ed1640 1 -- 172.21.15.39:0/3900867882 shutdown_connections 2023-05-16T13:54:56.777 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.764+0000 7f2060ed1640 1 -- 172.21.15.39:0/3900867882 wait complete. 2023-05-16T13:54:56.777 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.768+0000 7f2060ed1640 1 Processor -- start 2023-05-16T13:54:56.777 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.768+0000 7f2060ed1640 1 -- start start 2023-05-16T13:54:56.777 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.768+0000 7f2060ed1640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f205c06b620 0x7f205c0b2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:56.778 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.768+0000 7f2060ed1640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f205c0af490 0x7f205c0cab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:56.778 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.768+0000 7f2060ed1640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f205c0d0410 0x7f205c0c6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:56.778 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.768+0000 7f2060ed1640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f205c0c8720 con 0x7f205c0af490 2023-05-16T13:54:56.778 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.768+0000 7f2060ed1640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f205c0c8a00 con 0x7f205c06b620 2023-05-16T13:54:56.778 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.768+0000 7f2060ed1640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f205c0c8ce0 con 0x7f205c0d0410 2023-05-16T13:54:56.778 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.768+0000 7f2053fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f205c0af490 0x7f205c0cab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:56.778 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.768+0000 7f2053fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f205c0af490 0x7f205c0cab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34738/0 (socket says 172.21.15.39:34738) 2023-05-16T13:54:56.778 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.768+0000 7f2053fff640 1 -- 172.21.15.39:0/1041072210 learned_addr learned my addr 172.21.15.39:0/1041072210 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:56.779 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.768+0000 7f205ad9d640 1 --2- 172.21.15.39:0/1041072210 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f205c0d0410 0x7f205c0c6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:56.779 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.768+0000 7f205a59c640 1 --2- 172.21.15.39:0/1041072210 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f205c06b620 0x7f205c0b2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:56.780 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.768+0000 7f2053fff640 1 -- 172.21.15.39:0/1041072210 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f205c0d0410 msgr2=0x7f205c0c6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:56.780 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.768+0000 7f2053fff640 1 --2- 172.21.15.39:0/1041072210 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f205c0d0410 0x7f205c0c6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:56.780 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.768+0000 7f2053fff640 1 -- 172.21.15.39:0/1041072210 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f205c06b620 msgr2=0x7f205c0b2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:56.781 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.768+0000 7f2053fff640 1 --2- 172.21.15.39:0/1041072210 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f205c06b620 0x7f205c0b2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:56.781 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.768+0000 7f2053fff640 1 -- 172.21.15.39:0/1041072210 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2054009b30 con 0x7f205c0af490 2023-05-16T13:54:56.781 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.768+0000 7f2053fff640 1 --2- 172.21.15.39:0/1041072210 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f205c0af490 0x7f205c0cab60 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f204400c450 tx=0x7f204400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:56.781 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.768+0000 7f2052ffd640 1 -- 172.21.15.39:0/1041072210 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20440074e0 con 0x7f205c0af490 2023-05-16T13:54:56.781 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.768+0000 7f2052ffd640 1 -- 172.21.15.39:0/1041072210 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2044007640 con 0x7f205c0af490 2023-05-16T13:54:56.781 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.768+0000 7f2052ffd640 1 -- 172.21.15.39:0/1041072210 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20440049f0 con 0x7f205c0af490 2023-05-16T13:54:56.781 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.768+0000 7f2060ed1640 1 -- 172.21.15.39:0/1041072210 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f205c06c0e0 con 0x7f205c0af490 2023-05-16T13:54:56.782 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.772+0000 7f2060ed1640 1 -- 172.21.15.39:0/1041072210 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f205c06be00 con 0x7f205c0af490 2023-05-16T13:54:56.782 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.772+0000 7f2060ed1640 1 -- 172.21.15.39:0/1041072210 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f205c06c3c0 con 0x7f205c0af490 2023-05-16T13:54:56.782 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.772+0000 7f2052ffd640 1 -- 172.21.15.39:0/1041072210 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2044004b50 con 0x7f205c0af490 2023-05-16T13:54:56.782 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.772+0000 7f2052ffd640 1 --2- 172.21.15.39:0/1041072210 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f203c066280 0x7f203c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:56.782 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.772+0000 7f2052ffd640 1 -- 172.21.15.39:0/1041072210 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f2044082dc0 con 0x7f205c0af490 2023-05-16T13:54:56.782 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.772+0000 7f205a59c640 1 --2- 172.21.15.39:0/1041072210 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f203c066280 0x7f203c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:56.782 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.772+0000 7f205a59c640 1 --2- 172.21.15.39:0/1041072210 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f203c066280 0x7f203c068730 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f204c007a60 tx=0x7f204c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:56.783 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.776+0000 7f2052ffd640 1 -- 172.21.15.39:0/1041072210 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f2044050340 con 0x7f205c0af490 2023-05-16T13:54:56.940 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.932+0000 7f2060ed1640 1 -- 172.21.15.39:0/1041072210 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f205c073c90 con 0x7f205c0af490 2023-05-16T13:54:56.941 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.936+0000 7f2052ffd640 1 -- 172.21.15.39:0/1041072210 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f20440180a0 con 0x7f205c0af490 2023-05-16T13:54:56.941 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2023-05-16T13:54:56.943 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.936+0000 7f2060ed1640 1 -- 172.21.15.39:0/1041072210 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f203c066280 msgr2=0x7f203c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:56.943 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.936+0000 7f2060ed1640 1 --2- 172.21.15.39:0/1041072210 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f203c066280 0x7f203c068730 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f204c007a60 tx=0x7f204c008040 comp rx=0 tx=0).stop 2023-05-16T13:54:56.943 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.936+0000 7f2060ed1640 1 -- 172.21.15.39:0/1041072210 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f205c0af490 msgr2=0x7f205c0cab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:56.944 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.936+0000 7f2060ed1640 1 --2- 172.21.15.39:0/1041072210 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f205c0af490 0x7f205c0cab60 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f204400c450 tx=0x7f204400c910 comp rx=0 tx=0).stop 2023-05-16T13:54:56.944 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.936+0000 7f2060ed1640 1 -- 172.21.15.39:0/1041072210 shutdown_connections 2023-05-16T13:54:56.944 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.936+0000 7f2060ed1640 1 --2- 172.21.15.39:0/1041072210 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f203c066280 0x7f203c068730 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:56.944 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.936+0000 7f2060ed1640 1 --2- 172.21.15.39:0/1041072210 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f205c0d0410 0x7f205c0c6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:56.944 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.936+0000 7f2060ed1640 1 --2- 172.21.15.39:0/1041072210 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f205c0af490 0x7f205c0cab60 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:56.944 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.936+0000 7f2060ed1640 1 --2- 172.21.15.39:0/1041072210 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f205c06b620 0x7f205c0b2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:56.944 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.936+0000 7f2060ed1640 1 -- 172.21.15.39:0/1041072210 >> 172.21.15.39:0/1041072210 conn(0x7f205c09bba0 msgr2=0x7f205c0af860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:56.945 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.936+0000 7f2060ed1640 1 -- 172.21.15.39:0/1041072210 shutdown_connections 2023-05-16T13:54:56.945 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:56.936+0000 7f2060ed1640 1 -- 172.21.15.39:0/1041072210 wait complete. 2023-05-16T13:54:56.962 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-16T13:54:57.104 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.096+0000 7f1929e74640 1 Processor -- start 2023-05-16T13:54:57.105 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.100+0000 7f1929e74640 1 -- start start 2023-05-16T13:54:57.106 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.100+0000 7f1929e74640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19240b10a0 0x7f19240d2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:57.107 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.100+0000 7f1929e74640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f19240d2ed0 0x7f19240d0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:57.107 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.100+0000 7f1929e74640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19240d0db0 con 0x7f19240d0950 2023-05-16T13:54:57.107 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.100+0000 7f1929e74640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f192406c610 con 0x7f19240d2ed0 2023-05-16T13:54:57.107 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.100+0000 7f1929e74640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f192406caa0 con 0x7f19240b10a0 2023-05-16T13:54:57.107 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.100+0000 7f1923fff640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f19240d0950 0x7f192415faf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:35650/0 (socket says 172.21.15.39:35650) 2023-05-16T13:54:57.107 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.100+0000 7f1923fff640 1 -- 172.21.15.39:0/2741746599 learned_addr learned my addr 172.21.15.39:0/2741746599 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:57.107 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.100+0000 7f19237fe640 1 --2- 172.21.15.39:0/2741746599 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19240b10a0 0x7f19240d2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:57.108 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.100+0000 7f1922ffd640 1 --2- 172.21.15.39:0/2741746599 >> v2:172.21.15.118:3300/0 conn(0x7f19240d2ed0 0x7f19240d0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:57.108 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.100+0000 7f19237fe640 1 -- 172.21.15.39:0/2741746599 >> v2:172.21.15.118:3300/0 conn(0x7f19240d2ed0 msgr2=0x7f19240d0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:57.108 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.100+0000 7f19237fe640 1 --2- 172.21.15.39:0/2741746599 >> v2:172.21.15.118:3300/0 conn(0x7f19240d2ed0 0x7f19240d0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:57.108 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.100+0000 7f19237fe640 1 -- 172.21.15.39:0/2741746599 >> v1:172.21.15.39:6789/0 conn(0x7f19240d0950 legacy=0x7f192415faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:57.109 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.100+0000 7f19237fe640 1 -- 172.21.15.39:0/2741746599 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f192406ba00 con 0x7f19240b10a0 2023-05-16T13:54:57.110 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.104+0000 7f19237fe640 1 --2- 172.21.15.39:0/2741746599 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19240b10a0 0x7f19240d2990 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f19140097c0 tx=0x7f191401c310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6373694c4e400239 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:57.110 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.104+0000 7f19227fc640 1 -- 172.21.15.39:0/2741746599 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19140ab600 con 0x7f19240b10a0 2023-05-16T13:54:57.111 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.104+0000 7f19227fc640 1 -- 172.21.15.39:0/2741746599 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19140a7050 con 0x7f19240b10a0 2023-05-16T13:54:57.111 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.104+0000 7f19227fc640 1 -- 172.21.15.39:0/2741746599 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19140ab980 con 0x7f19240b10a0 2023-05-16T13:54:57.111 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.104+0000 7f1929e74640 1 -- 172.21.15.39:0/2741746599 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19240b10a0 msgr2=0x7f19240d2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:57.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.104+0000 7f1929e74640 1 --2- 172.21.15.39:0/2741746599 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19240b10a0 0x7f19240d2990 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f19140097c0 tx=0x7f191401c310 comp rx=0 tx=0).stop 2023-05-16T13:54:57.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.104+0000 7f1929e74640 1 -- 172.21.15.39:0/2741746599 shutdown_connections 2023-05-16T13:54:57.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.104+0000 7f1929e74640 1 --2- 172.21.15.39:0/2741746599 >> v2:172.21.15.118:3300/0 conn(0x7f19240d2ed0 0x7f19240d0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:57.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.104+0000 7f1929e74640 1 --2- 172.21.15.39:0/2741746599 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19240b10a0 0x7f19240d2990 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:57.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.104+0000 7f1929e74640 1 -- 172.21.15.39:0/2741746599 >> 172.21.15.39:0/2741746599 conn(0x7f192409bba0 msgr2=0x7f1924089fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:57.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.104+0000 7f1929e74640 1 -- 172.21.15.39:0/2741746599 shutdown_connections 2023-05-16T13:54:57.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.104+0000 7f1929e74640 1 -- 172.21.15.39:0/2741746599 wait complete. 2023-05-16T13:54:57.113 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.108+0000 7f1929e74640 1 Processor -- start 2023-05-16T13:54:57.113 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.108+0000 7f1929e74640 1 -- start start 2023-05-16T13:54:57.114 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.108+0000 7f1929e74640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19240b10a0 0x7f192415f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:57.114 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.108+0000 7f1929e74640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19240d0950 0x7f192415c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:57.114 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.108+0000 7f1929e74640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19240d2ed0 0x7f1924156be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:57.114 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.108+0000 7f1929e74640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f192415cad0 con 0x7f19240d2ed0 2023-05-16T13:54:57.115 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.108+0000 7f1929e74640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1924157120 con 0x7f19240d0950 2023-05-16T13:54:57.115 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.108+0000 7f1929e74640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f192415cd10 con 0x7f19240b10a0 2023-05-16T13:54:57.115 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.108+0000 7f1923fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19240d2ed0 0x7f1924156be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:57.116 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.108+0000 7f19237fe640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19240b10a0 0x7f192415f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:57.116 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.108+0000 7f1923fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19240d2ed0 0x7f1924156be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34752/0 (socket says 172.21.15.39:34752) 2023-05-16T13:54:57.116 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.108+0000 7f1923fff640 1 -- 172.21.15.39:0/1628819853 learned_addr learned my addr 172.21.15.39:0/1628819853 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:57.116 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.108+0000 7f1922ffd640 1 --2- 172.21.15.39:0/1628819853 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19240d0950 0x7f192415c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:57.116 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.108+0000 7f19237fe640 1 -- 172.21.15.39:0/1628819853 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19240d0950 msgr2=0x7f192415c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:57.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.108+0000 7f19237fe640 1 --2- 172.21.15.39:0/1628819853 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19240d0950 0x7f192415c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:57.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.108+0000 7f19237fe640 1 -- 172.21.15.39:0/1628819853 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19240d2ed0 msgr2=0x7f1924156be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:57.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.108+0000 7f19237fe640 1 --2- 172.21.15.39:0/1628819853 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19240d2ed0 0x7f1924156be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:57.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.108+0000 7f19237fe640 1 -- 172.21.15.39:0/1628819853 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1914009420 con 0x7f19240b10a0 2023-05-16T13:54:57.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.108+0000 7f1923fff640 1 --2- 172.21.15.39:0/1628819853 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19240d2ed0 0x7f1924156be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-16T13:54:57.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.108+0000 7f19237fe640 1 --2- 172.21.15.39:0/1628819853 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19240b10a0 0x7f192415f240 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f19140ab000 tx=0x7f19140190b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:57.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.108+0000 7f190bfff640 1 -- 172.21.15.39:0/1628819853 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19140b4820 con 0x7f19240b10a0 2023-05-16T13:54:57.118 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.108+0000 7f190bfff640 1 -- 172.21.15.39:0/1628819853 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19140b49c0 con 0x7f19240b10a0 2023-05-16T13:54:57.118 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.108+0000 7f1929e74640 1 -- 172.21.15.39:0/1628819853 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f192406bfc0 con 0x7f19240b10a0 2023-05-16T13:54:57.118 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.108+0000 7f190bfff640 1 -- 172.21.15.39:0/1628819853 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19140b4d70 con 0x7f19240b10a0 2023-05-16T13:54:57.118 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.108+0000 7f1929e74640 1 -- 172.21.15.39:0/1628819853 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f192406bce0 con 0x7f19240b10a0 2023-05-16T13:54:57.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.112+0000 7f1929e74640 1 -- 172.21.15.39:0/1628819853 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f192406c2a0 con 0x7f19240b10a0 2023-05-16T13:54:57.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.112+0000 7f190bfff640 1 -- 172.21.15.39:0/1628819853 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f19140b2040 con 0x7f19240b10a0 2023-05-16T13:54:57.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.112+0000 7f190bfff640 1 --2- 172.21.15.39:0/1628819853 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f1910066300 0x7f19100687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:57.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.112+0000 7f190bfff640 1 -- 172.21.15.39:0/1628819853 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f191411dff0 con 0x7f19240b10a0 2023-05-16T13:54:57.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.112+0000 7f1922ffd640 1 --2- 172.21.15.39:0/1628819853 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f1910066300 0x7f19100687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:57.120 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.112+0000 7f1922ffd640 1 --2- 172.21.15.39:0/1628819853 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f1910066300 0x7f19100687b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1924157620 tx=0x7f1918009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:57.123 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.116+0000 7f190bfff640 1 -- 172.21.15.39:0/1628819853 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f19140eb590 con 0x7f19240b10a0 2023-05-16T13:54:57.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.268+0000 7f1929e74640 1 -- 172.21.15.39:0/1628819853 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1924073c90 con 0x7f19240b10a0 2023-05-16T13:54:57.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.272+0000 7f190bfff640 1 -- 172.21.15.39:0/1628819853 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f19140c20a0 con 0x7f19240b10a0 2023-05-16T13:54:57.277 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 64 2023-05-16T13:54:57.279 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.272+0000 7f1929e74640 1 -- 172.21.15.39:0/1628819853 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f1910066300 msgr2=0x7f19100687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:57.279 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.272+0000 7f1929e74640 1 --2- 172.21.15.39:0/1628819853 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f1910066300 0x7f19100687b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1924157620 tx=0x7f1918009190 comp rx=0 tx=0).stop 2023-05-16T13:54:57.279 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.272+0000 7f1929e74640 1 -- 172.21.15.39:0/1628819853 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19240b10a0 msgr2=0x7f192415f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:57.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.272+0000 7f1929e74640 1 --2- 172.21.15.39:0/1628819853 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19240b10a0 0x7f192415f240 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f19140ab000 tx=0x7f19140190b0 comp rx=0 tx=0).stop 2023-05-16T13:54:57.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.272+0000 7f1929e74640 1 -- 172.21.15.39:0/1628819853 shutdown_connections 2023-05-16T13:54:57.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.272+0000 7f1929e74640 1 --2- 172.21.15.39:0/1628819853 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19240d2ed0 0x7f1924156be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:57.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.272+0000 7f1929e74640 1 --2- 172.21.15.39:0/1628819853 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19240d0950 0x7f192415c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:57.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.272+0000 7f1929e74640 1 --2- 172.21.15.39:0/1628819853 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f1910066300 0x7f19100687b0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:57.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.272+0000 7f1929e74640 1 --2- 172.21.15.39:0/1628819853 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f19240b10a0 0x7f192415f240 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:57.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.272+0000 7f1929e74640 1 -- 172.21.15.39:0/1628819853 >> 172.21.15.39:0/1628819853 conn(0x7f192409bba0 msgr2=0x7f192415bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:57.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.272+0000 7f1929e74640 1 -- 172.21.15.39:0/1628819853 shutdown_connections 2023-05-16T13:54:57.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.272+0000 7f1929e74640 1 -- 172.21.15.39:0/1628819853 wait complete. 2023-05-16T13:54:57.298 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-16T13:54:57.436 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.428+0000 7f47d758f640 1 Processor -- start 2023-05-16T13:54:57.436 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.428+0000 7f47d758f640 1 -- start start 2023-05-16T13:54:57.437 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.432+0000 7f47d758f640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f47d0158e90 0x7f47d00704b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:57.437 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.432+0000 7f47d758f640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47d00cda10 con 0x7f47d015d2c0 2023-05-16T13:54:57.438 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.432+0000 7f47d758f640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47d00709f0 con 0x7f47d00cb2f0 2023-05-16T13:54:57.438 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.432+0000 7f47d758f640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47d0159260 con 0x7f47d0158e90 2023-05-16T13:54:57.438 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.432+0000 7f47d532b640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f47d0158e90 0x7f47d00704b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:57.438 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.432+0000 7f47d4b2a640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f47d015d2c0 0x7f47d00cabe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:35664/0 (socket says 172.21.15.39:35664) 2023-05-16T13:54:57.438 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.432+0000 7f47d4b2a640 1 -- 172.21.15.39:0/1329538533 learned_addr learned my addr 172.21.15.39:0/1329538533 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:57.439 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.432+0000 7f47d532b640 1 -- 172.21.15.39:0/1329538533 >> v1:172.21.15.118:6789/0 conn(0x7f47d00cb2f0 legacy=0x7f47d00c9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:57.439 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.432+0000 7f47d532b640 1 -- 172.21.15.39:0/1329538533 >> v1:172.21.15.39:6789/0 conn(0x7f47d015d2c0 legacy=0x7f47d00cabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:57.439 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.432+0000 7f47d532b640 1 -- 172.21.15.39:0/1329538533 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47d00cce90 con 0x7f47d0158e90 2023-05-16T13:54:57.439 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.432+0000 7f47c7fff640 1 -- 172.21.15.39:0/1329538533 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 232318987 0 0) 0x7f47d00cda10 con 0x7f47d015d2c0 2023-05-16T13:54:57.441 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.436+0000 7f47d532b640 1 --2- 172.21.15.39:0/1329538533 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f47d0158e90 0x7f47d00704b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f47cc0097c0 tx=0x7f47cc01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46fefefb023174fa server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:57.441 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.436+0000 7f47c7fff640 1 -- 172.21.15.39:0/1329538533 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47cc0ac620 con 0x7f47d0158e90 2023-05-16T13:54:57.441 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.436+0000 7f47c7fff640 1 -- 172.21.15.39:0/1329538533 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47cc0ac780 con 0x7f47d0158e90 2023-05-16T13:54:57.442 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.436+0000 7f47c7fff640 1 -- 172.21.15.39:0/1329538533 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47cc0acb10 con 0x7f47d0158e90 2023-05-16T13:54:57.442 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.436+0000 7f47d758f640 1 -- 172.21.15.39:0/1329538533 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f47d0158e90 msgr2=0x7f47d00704b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:57.442 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.436+0000 7f47d758f640 1 --2- 172.21.15.39:0/1329538533 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f47d0158e90 0x7f47d00704b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f47cc0097c0 tx=0x7f47cc01c3c0 comp rx=0 tx=0).stop 2023-05-16T13:54:57.443 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.436+0000 7f47d758f640 1 -- 172.21.15.39:0/1329538533 shutdown_connections 2023-05-16T13:54:57.443 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.436+0000 7f47d758f640 1 --2- 172.21.15.39:0/1329538533 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f47d0158e90 0x7f47d00704b0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:57.443 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.436+0000 7f47d758f640 1 -- 172.21.15.39:0/1329538533 >> 172.21.15.39:0/1329538533 conn(0x7f47d0069a50 msgr2=0x7f47d0069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:57.443 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.436+0000 7f47d758f640 1 -- 172.21.15.39:0/1329538533 shutdown_connections 2023-05-16T13:54:57.443 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.436+0000 7f47d758f640 1 -- 172.21.15.39:0/1329538533 wait complete. 2023-05-16T13:54:57.444 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.436+0000 7f47d758f640 1 Processor -- start 2023-05-16T13:54:57.444 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.436+0000 7f47d758f640 1 -- start start 2023-05-16T13:54:57.445 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.436+0000 7f47d758f640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f47d00cb2f0 0x7f47d015bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:57.445 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.436+0000 7f47d758f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f47d0158e90 0x7f47d0135eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:57.445 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.436+0000 7f47d758f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47d015d2c0 0x7f47d00c4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:57.445 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.436+0000 7f47d758f640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47d014a790 con 0x7f47d0158e90 2023-05-16T13:54:57.445 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.436+0000 7f47d758f640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47d00c4840 con 0x7f47d015d2c0 2023-05-16T13:54:57.445 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.436+0000 7f47d758f640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47d0149e60 con 0x7f47d00cb2f0 2023-05-16T13:54:57.446 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.440+0000 7f47d4b2a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f47d0158e90 0x7f47d0135eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:57.446 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.440+0000 7f47d4b2a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f47d0158e90 0x7f47d0135eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34770/0 (socket says 172.21.15.39:34770) 2023-05-16T13:54:57.446 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.440+0000 7f47d4b2a640 1 -- 172.21.15.39:0/138609092 learned_addr learned my addr 172.21.15.39:0/138609092 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:57.446 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.440+0000 7f47d532b640 1 --2- 172.21.15.39:0/138609092 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f47d00cb2f0 0x7f47d015bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:57.446 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.440+0000 7f47d5b2c640 1 --2- 172.21.15.39:0/138609092 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47d015d2c0 0x7f47d00c4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:57.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.440+0000 7f47d4b2a640 1 -- 172.21.15.39:0/138609092 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f47d00cb2f0 msgr2=0x7f47d015bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:57.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.440+0000 7f47d4b2a640 1 --2- 172.21.15.39:0/138609092 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f47d00cb2f0 0x7f47d015bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:57.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.440+0000 7f47d4b2a640 1 -- 172.21.15.39:0/138609092 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47d015d2c0 msgr2=0x7f47d00c4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:57.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.440+0000 7f47d4b2a640 1 --2- 172.21.15.39:0/138609092 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47d015d2c0 0x7f47d00c4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:57.448 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.440+0000 7f47d4b2a640 1 -- 172.21.15.39:0/138609092 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47cc009420 con 0x7f47d0158e90 2023-05-16T13:54:57.448 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.440+0000 7f47d4b2a640 1 --2- 172.21.15.39:0/138609092 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f47d0158e90 0x7f47d0135eb0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f47c000c410 tx=0x7f47c000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:57.448 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.440+0000 7f47c5ffb640 1 -- 172.21.15.39:0/138609092 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c0005cf0 con 0x7f47d0158e90 2023-05-16T13:54:57.448 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.440+0000 7f47c5ffb640 1 -- 172.21.15.39:0/138609092 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47c0005e50 con 0x7f47d0158e90 2023-05-16T13:54:57.448 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.440+0000 7f47c5ffb640 1 -- 172.21.15.39:0/138609092 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c0007310 con 0x7f47d0158e90 2023-05-16T13:54:57.448 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.440+0000 7f47d758f640 1 -- 172.21.15.39:0/138609092 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47d00c8e10 con 0x7f47d0158e90 2023-05-16T13:54:57.448 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.440+0000 7f47d758f640 1 -- 172.21.15.39:0/138609092 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47d00cd730 con 0x7f47d0158e90 2023-05-16T13:54:57.449 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.440+0000 7f47d758f640 1 -- 172.21.15.39:0/138609092 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47d015d700 con 0x7f47d0158e90 2023-05-16T13:54:57.449 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.440+0000 7f47c5ffb640 1 -- 172.21.15.39:0/138609092 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f47c0007470 con 0x7f47d0158e90 2023-05-16T13:54:57.449 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.444+0000 7f47c5ffb640 1 --2- 172.21.15.39:0/138609092 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f47b4066280 0x7f47b4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:57.450 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.444+0000 7f47c5ffb640 1 -- 172.21.15.39:0/138609092 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f47c0083390 con 0x7f47d0158e90 2023-05-16T13:54:57.450 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.444+0000 7f47d532b640 1 --2- 172.21.15.39:0/138609092 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f47b4066280 0x7f47b4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:57.450 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.444+0000 7f47d532b640 1 --2- 172.21.15.39:0/138609092 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f47b4066280 0x7f47b4068730 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f47cc0ae000 tx=0x7f47cc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:57.452 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.444+0000 7f47c5ffb640 1 -- 172.21.15.39:0/138609092 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f47c0050750 con 0x7f47d0158e90 2023-05-16T13:54:57.619 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.612+0000 7f47d758f640 1 -- 172.21.15.39:0/138609092 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f47d0073c90 con 0x7f47d0158e90 2023-05-16T13:54:57.619 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.612+0000 7f47c5ffb640 1 -- 172.21.15.39:0/138609092 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f47c0053d70 con 0x7f47d0158e90 2023-05-16T13:54:57.620 INFO:teuthology.orchestra.run.smithi039.stderr:listed 0 entries 2023-05-16T13:54:57.622 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.616+0000 7f47d758f640 1 -- 172.21.15.39:0/138609092 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f47b4066280 msgr2=0x7f47b4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:57.622 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.616+0000 7f47d758f640 1 --2- 172.21.15.39:0/138609092 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f47b4066280 0x7f47b4068730 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f47cc0ae000 tx=0x7f47cc008040 comp rx=0 tx=0).stop 2023-05-16T13:54:57.622 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.616+0000 7f47d758f640 1 -- 172.21.15.39:0/138609092 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f47d0158e90 msgr2=0x7f47d0135eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:57.622 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.616+0000 7f47d758f640 1 --2- 172.21.15.39:0/138609092 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f47d0158e90 0x7f47d0135eb0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f47c000c410 tx=0x7f47c000c8d0 comp rx=0 tx=0).stop 2023-05-16T13:54:57.622 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.616+0000 7f47d758f640 1 -- 172.21.15.39:0/138609092 shutdown_connections 2023-05-16T13:54:57.622 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.616+0000 7f47d758f640 1 --2- 172.21.15.39:0/138609092 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47d015d2c0 0x7f47d00c4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:57.623 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.616+0000 7f47d758f640 1 --2- 172.21.15.39:0/138609092 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f47d0158e90 0x7f47d0135eb0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:57.623 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.616+0000 7f47d758f640 1 --2- 172.21.15.39:0/138609092 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f47b4066280 0x7f47b4068730 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:57.623 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.616+0000 7f47d758f640 1 --2- 172.21.15.39:0/138609092 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f47d00cb2f0 0x7f47d015bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:57.623 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.616+0000 7f47d758f640 1 -- 172.21.15.39:0/138609092 >> 172.21.15.39:0/138609092 conn(0x7f47d0069a50 msgr2=0x7f47d014c750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:57.623 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.616+0000 7f47d758f640 1 -- 172.21.15.39:0/138609092 shutdown_connections 2023-05-16T13:54:57.623 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.616+0000 7f47d758f640 1 -- 172.21.15.39:0/138609092 wait complete. 2023-05-16T13:54:57.640 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-05-16T13:54:57.641 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-16T13:54:57.650 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-16T13:54:57.787 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.780+0000 7fbac0b8f640 1 Processor -- start 2023-05-16T13:54:57.787 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.780+0000 7fbac0b8f640 1 -- start start 2023-05-16T13:54:57.788 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.780+0000 7fbac0b8f640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbabc160d80 0x7fbabc0cd490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:57.789 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.780+0000 7fbac0b8f640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fbabc08a3e0 0x7fbabc0afea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:57.789 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.780+0000 7fbac0b8f640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbabc0ced80 con 0x7fbabc0cd0c0 2023-05-16T13:54:57.789 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.780+0000 7fbac0b8f640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbabc0cd9d0 con 0x7fbabc08a3e0 2023-05-16T13:54:57.789 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.784+0000 7fbac0b8f640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbabc0cdbe0 con 0x7fbabc160d80 2023-05-16T13:54:57.789 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.784+0000 7fbabad9d640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fbabc08a3e0 0x7fbabc0afea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:57.789 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.784+0000 7fbaba59c640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fbabc0cd0c0 0x7fbabc160670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:35666/0 (socket says 172.21.15.39:35666) 2023-05-16T13:54:57.790 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.784+0000 7fbaba59c640 1 -- 172.21.15.39:0/3564745227 learned_addr learned my addr 172.21.15.39:0/3564745227 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:57.790 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.784+0000 7fbab9d9b640 1 --2- 172.21.15.39:0/3564745227 >> v2:172.21.15.118:3300/0 conn(0x7fbabc160d80 0x7fbabc0cd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:57.790 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.784+0000 7fbabad9d640 1 -- 172.21.15.39:0/3564745227 >> v2:172.21.15.118:3300/0 conn(0x7fbabc160d80 msgr2=0x7fbabc0cd490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:57.790 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.784+0000 7fbabad9d640 1 --2- 172.21.15.39:0/3564745227 >> v2:172.21.15.118:3300/0 conn(0x7fbabc160d80 0x7fbabc0cd490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:57.791 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.784+0000 7fbabad9d640 1 -- 172.21.15.39:0/3564745227 >> v1:172.21.15.39:6789/0 conn(0x7fbabc0cd0c0 legacy=0x7fbabc160670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:57.791 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.784+0000 7fbabad9d640 1 -- 172.21.15.39:0/3564745227 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbabc0ce580 con 0x7fbabc08a3e0 2023-05-16T13:54:57.791 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.784+0000 7fbab959a640 1 -- 172.21.15.39:0/3564745227 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 166013295 0 0) 0x7fbaac001120 con 0x7fbabc0cd0c0 2023-05-16T13:54:57.791 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.784+0000 7fbab9d9b640 1 --2- 172.21.15.39:0/3564745227 >> v2:172.21.15.118:3300/0 conn(0x7fbabc160d80 0x7fbabc0cd490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-16T13:54:57.792 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.784+0000 7fbabad9d640 1 --2- 172.21.15.39:0/3564745227 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbabc08a3e0 0x7fbabc0afea0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fbabc071860 tx=0x7fbab401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f78195c9db1f7a68 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:57.792 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.784+0000 7fbab959a640 1 -- 172.21.15.39:0/3564745227 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab40a59c0 con 0x7fbabc08a3e0 2023-05-16T13:54:57.792 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.784+0000 7fbab959a640 1 -- 172.21.15.39:0/3564745227 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbab40a5b20 con 0x7fbabc08a3e0 2023-05-16T13:54:57.793 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.784+0000 7fbab959a640 1 -- 172.21.15.39:0/3564745227 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab40ad440 con 0x7fbabc08a3e0 2023-05-16T13:54:57.793 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.788+0000 7fbac0b8f640 1 -- 172.21.15.39:0/3564745227 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbabc08a3e0 msgr2=0x7fbabc0afea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:57.793 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.788+0000 7fbac0b8f640 1 --2- 172.21.15.39:0/3564745227 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbabc08a3e0 0x7fbabc0afea0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fbabc071860 tx=0x7fbab401c8e0 comp rx=0 tx=0).stop 2023-05-16T13:54:57.794 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.788+0000 7fbac0b8f640 1 -- 172.21.15.39:0/3564745227 shutdown_connections 2023-05-16T13:54:57.794 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.788+0000 7fbac0b8f640 1 --2- 172.21.15.39:0/3564745227 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbabc08a3e0 0x7fbabc0afea0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:57.794 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.788+0000 7fbac0b8f640 1 --2- 172.21.15.39:0/3564745227 >> v2:172.21.15.118:3300/0 conn(0x7fbabc160d80 0x7fbabc0cd490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:57.794 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.788+0000 7fbac0b8f640 1 -- 172.21.15.39:0/3564745227 >> 172.21.15.39:0/3564745227 conn(0x7fbabc089fe0 msgr2=0x7fbabc0d05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:57.794 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.788+0000 7fbac0b8f640 1 -- 172.21.15.39:0/3564745227 shutdown_connections 2023-05-16T13:54:57.794 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.788+0000 7fbac0b8f640 1 -- 172.21.15.39:0/3564745227 wait complete. 2023-05-16T13:54:57.795 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.788+0000 7fbac0b8f640 1 Processor -- start 2023-05-16T13:54:57.795 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.788+0000 7fbac0b8f640 1 -- start start 2023-05-16T13:54:57.796 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.788+0000 7fbac0b8f640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbabc08a3e0 0x7fbabc15b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:57.796 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.788+0000 7fbac0b8f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbabc0cd0c0 0x7fbabc155d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:57.796 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.788+0000 7fbac0b8f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbabc160d80 0x7fbabc06e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:57.797 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.788+0000 7fbac0b8f640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbabc15aed0 con 0x7fbabc0cd0c0 2023-05-16T13:54:57.797 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.788+0000 7fbac0b8f640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbabc159c10 con 0x7fbabc160d80 2023-05-16T13:54:57.797 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.788+0000 7fbac0b8f640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbabc15b8a0 con 0x7fbabc08a3e0 2023-05-16T13:54:57.797 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.788+0000 7fbab9d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbabc0cd0c0 0x7fbabc155d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:57.797 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.788+0000 7fbab9d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbabc0cd0c0 0x7fbabc155d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34784/0 (socket says 172.21.15.39:34784) 2023-05-16T13:54:57.797 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.788+0000 7fbab9d9b640 1 -- 172.21.15.39:0/3748860672 learned_addr learned my addr 172.21.15.39:0/3748860672 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:57.797 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.788+0000 7fbaba59c640 1 --2- 172.21.15.39:0/3748860672 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbabc08a3e0 0x7fbabc15b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:57.797 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.788+0000 7fbabad9d640 1 --2- 172.21.15.39:0/3748860672 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbabc160d80 0x7fbabc06e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:57.798 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.792+0000 7fbab9d9b640 1 -- 172.21.15.39:0/3748860672 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbabc08a3e0 msgr2=0x7fbabc15b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:57.799 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.792+0000 7fbab9d9b640 1 --2- 172.21.15.39:0/3748860672 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbabc08a3e0 0x7fbabc15b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:57.799 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.792+0000 7fbab9d9b640 1 -- 172.21.15.39:0/3748860672 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbabc160d80 msgr2=0x7fbabc06e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:57.799 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.792+0000 7fbab9d9b640 1 --2- 172.21.15.39:0/3748860672 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbabc160d80 0x7fbabc06e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:57.799 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.792+0000 7fbab9d9b640 1 -- 172.21.15.39:0/3748860672 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbab4009a70 con 0x7fbabc0cd0c0 2023-05-16T13:54:57.799 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.792+0000 7fbaba59c640 1 --2- 172.21.15.39:0/3748860672 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbabc08a3e0 0x7fbabc15b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:54:57.799 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.792+0000 7fbab9d9b640 1 --2- 172.21.15.39:0/3748860672 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbabc0cd0c0 0x7fbabc155d70 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fbab000c7f0 tx=0x7fbab000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:57.800 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.792+0000 7fbaaaffd640 1 -- 172.21.15.39:0/3748860672 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab0007820 con 0x7fbabc0cd0c0 2023-05-16T13:54:57.800 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.792+0000 7fbaaaffd640 1 -- 172.21.15.39:0/3748860672 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbab0007980 con 0x7fbabc0cd0c0 2023-05-16T13:54:57.800 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.792+0000 7fbaaaffd640 1 -- 172.21.15.39:0/3748860672 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab0007d30 con 0x7fbabc0cd0c0 2023-05-16T13:54:57.800 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.792+0000 7fbac0b8f640 1 -- 172.21.15.39:0/3748860672 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbabc06bb70 con 0x7fbabc0cd0c0 2023-05-16T13:54:57.800 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.792+0000 7fbac0b8f640 1 -- 172.21.15.39:0/3748860672 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbabc0cdec0 con 0x7fbabc0cd0c0 2023-05-16T13:54:57.800 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.792+0000 7fbac0b8f640 1 -- 172.21.15.39:0/3748860672 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbabc06bd00 con 0x7fbabc0cd0c0 2023-05-16T13:54:57.801 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.792+0000 7fbaaaffd640 1 -- 172.21.15.39:0/3748860672 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbab00113f0 con 0x7fbabc0cd0c0 2023-05-16T13:54:57.801 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.792+0000 7fbaaaffd640 1 --2- 172.21.15.39:0/3748860672 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fba9c066280 0x7fba9c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:57.801 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.792+0000 7fbaaaffd640 1 -- 172.21.15.39:0/3748860672 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fbab0083fe0 con 0x7fbabc0cd0c0 2023-05-16T13:54:57.801 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.792+0000 7fbaba59c640 1 --2- 172.21.15.39:0/3748860672 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fba9c066280 0x7fba9c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:57.801 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.796+0000 7fbaba59c640 1 --2- 172.21.15.39:0/3748860672 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fba9c066280 0x7fba9c068730 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbaac000f70 tx=0x7fbaac007a80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:57.804 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.796+0000 7fbaaaffd640 1 -- 172.21.15.39:0/3748860672 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fbab0051520 con 0x7fbabc0cd0c0 2023-05-16T13:54:57.962 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.956+0000 7fbac0b8f640 1 -- 172.21.15.39:0/3748860672 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbabc073c90 con 0x7fbabc0cd0c0 2023-05-16T13:54:57.963 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.956+0000 7fbaaaffd640 1 -- 172.21.15.39:0/3748860672 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18375 (secure 0 0 0) 0x7fbab0054b40 con 0x7fbabc0cd0c0 2023-05-16T13:54:57.963 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:54:57.964 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":26,"fsid":"9c1e210b-c515-4ea4-a065-397956895c68","created":"2023-05-16T13:53:48.955290+0000","modified":"2023-05-16T13:54:56.831431+0000","last_up_change":"2023-05-16T13:54:01.722051+0000","last_in_change":"2023-05-16T13:53:52.331336+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-16T13:54:00.885009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-16T13:54:08.327895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-16T13:54:12.864823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-16T13:54:14.180225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4ce0f0ba-c4bf-4405-8c95-d2e9a62878ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6809","nonce":3462013698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6811","nonce":3462013698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6815","nonce":3462013698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6813","nonce":3462013698}]},"public_addr":"172.21.15.39:6809/3462013698","cluster_addr":"172.21.15.39:6811/3462013698","heartbeat_back_addr":"172.21.15.39:6815/3462013698","heartbeat_front_addr":"172.21.15.39:6813/3462013698","state":["exists","up"]},{"osd":1,"uuid":"53fdc1ac-2473-472d-af32-2760fdf6e476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6801","nonce":2829970892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6803","nonce":2829970892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6807","nonce":2829970892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6805","nonce":2829970892}]},"public_addr":"172.21.15.39:6801/2829970892","cluster_addr":"172.21.15.39:6803/2829970892","heartbeat_back_addr":"172.21.15.39:6807/2829970892","heartbeat_front_addr":"172.21.15.39:6805/2829970892","state":["exists","up"]},{"osd":2,"uuid":"0b92d770-7030-42fa-a19f-4f7f1ac113c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6817","nonce":3888067413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6819","nonce":3888067413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6823","nonce":3888067413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6821","nonce":3888067413}]},"public_addr":"172.21.15.39:6817/3888067413","cluster_addr":"172.21.15.39:6819/3888067413","heartbeat_back_addr":"172.21.15.39:6823/3888067413","heartbeat_front_addr":"172.21.15.39:6821/3888067413","state":["exists","up"]},{"osd":3,"uuid":"000d9506-cbb2-4017-b875-deca579860ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6825","nonce":405003958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6827","nonce":405003958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6831","nonce":405003958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6829","nonce":405003958}]},"public_addr":"172.21.15.39:6825/405003958","cluster_addr":"172.21.15.39:6827/405003958","heartbeat_back_addr":"172.21.15.39:6831/405003958","heartbeat_front_addr":"172.21.15.39:6829/405003958","state":["exists","up"]},{"osd":4,"uuid":"70f0dacb-e960-40c5-bf6a-183e52bbe2ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6801","nonce":3895278838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6805","nonce":3895278838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6813","nonce":3895278838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6809","nonce":3895278838}]},"public_addr":"172.21.15.118:6801/3895278838","cluster_addr":"172.21.15.118:6805/3895278838","heartbeat_back_addr":"172.21.15.118:6813/3895278838","heartbeat_front_addr":"172.21.15.118:6809/3895278838","state":["exists","up"]},{"osd":5,"uuid":"756feb54-c3ae-4a2a-8f74-85c291ba707c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6804","nonce":3513592808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6808","nonce":3513592808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6815","nonce":3513592808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6812","nonce":3513592808}]},"public_addr":"172.21.15.118:6804/3513592808","cluster_addr":"172.21.15.118:6808/3513592808","heartbeat_back_addr":"172.21.15.118:6815/3513592808","heartbeat_front_addr":"172.21.15.118:6812/3513592808","state":["exists","up"]},{"osd":6,"uuid":"c4a982c1-f497-4b0f-8a23-c77372e4621e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6824","nonce":1863656053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6827","nonce":1863656053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6831","nonce":1863656053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6829","nonce":1863656053}]},"public_addr":"172.21.15.118:6824/1863656053","cluster_addr":"172.21.15.118:6827/1863656053","heartbeat_back_addr":"172.21.15.118:6831/1863656053","heartbeat_front_addr":"172.21.15.118:6829/1863656053","state":["exists","up"]},{"osd":7,"uuid":"6f2888aa-a7ac-4e26-9159-e31817934f44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6817","nonce":3636642904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6819","nonce":3636642904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6825","nonce":3636642904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6821","nonce":3636642904}]},"public_addr":"172.21.15.118:6817/3636642904","cluster_addr":"172.21.15.118:6819/3636642904","heartbeat_back_addr":"172.21.15.118:6825/3636642904","heartbeat_front_addr":"172.21.15.118:6821/3636642904","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.717636+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.724036+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.739144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:58.079275+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:58.073921+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.930466+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.987813+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.941098+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.24","mappings":[{"from":1,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-16T13:54:57.965 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.960+0000 7fbac0b8f640 1 -- 172.21.15.39:0/3748860672 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fba9c066280 msgr2=0x7fba9c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:57.966 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.960+0000 7fbac0b8f640 1 --2- 172.21.15.39:0/3748860672 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fba9c066280 0x7fba9c068730 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbaac000f70 tx=0x7fbaac007a80 comp rx=0 tx=0).stop 2023-05-16T13:54:57.966 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.960+0000 7fbac0b8f640 1 -- 172.21.15.39:0/3748860672 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbabc0cd0c0 msgr2=0x7fbabc155d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:57.966 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.960+0000 7fbac0b8f640 1 --2- 172.21.15.39:0/3748860672 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbabc0cd0c0 0x7fbabc155d70 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fbab000c7f0 tx=0x7fbab000ccb0 comp rx=0 tx=0).stop 2023-05-16T13:54:57.966 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.960+0000 7fbac0b8f640 1 -- 172.21.15.39:0/3748860672 shutdown_connections 2023-05-16T13:54:57.967 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.960+0000 7fbac0b8f640 1 --2- 172.21.15.39:0/3748860672 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbabc160d80 0x7fbabc06e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:57.967 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.960+0000 7fbac0b8f640 1 --2- 172.21.15.39:0/3748860672 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbabc0cd0c0 0x7fbabc155d70 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:57.967 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.960+0000 7fbac0b8f640 1 --2- 172.21.15.39:0/3748860672 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fba9c066280 0x7fba9c068730 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:57.967 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.960+0000 7fbac0b8f640 1 --2- 172.21.15.39:0/3748860672 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbabc08a3e0 0x7fbabc15b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:57.968 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.960+0000 7fbac0b8f640 1 -- 172.21.15.39:0/3748860672 >> 172.21.15.39:0/3748860672 conn(0x7fbabc089fe0 msgr2=0x7fbabc0d05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:57.968 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.960+0000 7fbac0b8f640 1 -- 172.21.15.39:0/3748860672 shutdown_connections 2023-05-16T13:54:57.968 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:57.960+0000 7fbac0b8f640 1 -- 172.21.15.39:0/3748860672 wait complete. 2023-05-16T13:54:57.984 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-16T13:54:00.885009+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-16T13:54:08.327895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-16T13:54:12.864823+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-16T13:54:14.180225+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-16T13:54:57.985 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-16T13:54:58.126 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.120+0000 7fb02e6c4640 1 Processor -- start 2023-05-16T13:54:58.126 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.120+0000 7fb02e6c4640 1 -- start start 2023-05-16T13:54:58.127 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.120+0000 7fb02e6c4640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fb028158e00 0x7fb0280c9530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:58.127 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.120+0000 7fb02e6c4640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb0280c9a70 0x7fb0280aff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:58.127 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.120+0000 7fb02e6c4640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0280ca030 con 0x7fb0280b0490 2023-05-16T13:54:58.127 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.120+0000 7fb02e6c4640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0280b0910 con 0x7fb028158e00 2023-05-16T13:54:58.128 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.120+0000 7fb02e6c4640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb02815c890 con 0x7fb0280c9a70 2023-05-16T13:54:58.128 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.120+0000 7fb027fff640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fb028158e00 0x7fb0280c9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:58.128 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.120+0000 7fb027fff640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fb028158e00 0x7fb0280c9530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34800/0 (socket says 172.21.15.39:34800) 2023-05-16T13:54:58.128 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.120+0000 7fb027fff640 1 -- 172.21.15.39:0/3048506925 learned_addr learned my addr 172.21.15.39:0/3048506925 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:58.129 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.120+0000 7fb0277fe640 1 --2- 172.21.15.39:0/3048506925 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb0280c9a70 0x7fb0280aff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:58.129 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.120+0000 7fb027fff640 1 -- 172.21.15.39:0/3048506925 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb0280c9a70 msgr2=0x7fb0280aff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:58.129 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.120+0000 7fb027fff640 1 --2- 172.21.15.39:0/3048506925 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb0280c9a70 0x7fb0280aff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:58.129 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.120+0000 7fb027fff640 1 -- 172.21.15.39:0/3048506925 >> v1:172.21.15.118:6789/0 conn(0x7fb0280b0490 legacy=0x7fb0280caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:58.129 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.120+0000 7fb027fff640 1 -- 172.21.15.39:0/3048506925 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb02815cb70 con 0x7fb028158e00 2023-05-16T13:54:58.129 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.120+0000 7fb0277fe640 1 --2- 172.21.15.39:0/3048506925 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb0280c9a70 0x7fb0280aff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-16T13:54:58.130 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.124+0000 7fb027fff640 1 --2- 172.21.15.39:0/3048506925 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb028158e00 0x7fb0280c9530 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb018009870 tx=0x7fb01801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f308cd48419b3be3 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:58.131 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.124+0000 7fb026ffd640 1 -- 172.21.15.39:0/3048506925 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0180a89b0 con 0x7fb028158e00 2023-05-16T13:54:58.131 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.124+0000 7fb026ffd640 1 -- 172.21.15.39:0/3048506925 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0180a8b10 con 0x7fb028158e00 2023-05-16T13:54:58.131 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.124+0000 7fb026ffd640 1 -- 172.21.15.39:0/3048506925 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0180a8ea0 con 0x7fb028158e00 2023-05-16T13:54:58.131 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.124+0000 7fb02e6c4640 1 -- 172.21.15.39:0/3048506925 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb028158e00 msgr2=0x7fb0280c9530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:58.132 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.124+0000 7fb02e6c4640 1 --2- 172.21.15.39:0/3048506925 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb028158e00 0x7fb0280c9530 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb018009870 tx=0x7fb01801ecf0 comp rx=0 tx=0).stop 2023-05-16T13:54:58.132 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.124+0000 7fb02e6c4640 1 -- 172.21.15.39:0/3048506925 shutdown_connections 2023-05-16T13:54:58.132 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.124+0000 7fb02e6c4640 1 --2- 172.21.15.39:0/3048506925 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb0280c9a70 0x7fb0280aff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:58.133 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.124+0000 7fb02e6c4640 1 --2- 172.21.15.39:0/3048506925 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb028158e00 0x7fb0280c9530 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:58.133 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.124+0000 7fb02e6c4640 1 -- 172.21.15.39:0/3048506925 >> 172.21.15.39:0/3048506925 conn(0x7fb028069a50 msgr2=0x7fb028069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:58.133 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.124+0000 7fb02e6c4640 1 -- 172.21.15.39:0/3048506925 shutdown_connections 2023-05-16T13:54:58.133 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.124+0000 7fb02e6c4640 1 -- 172.21.15.39:0/3048506925 wait complete. 2023-05-16T13:54:58.133 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.128+0000 7fb02e6c4640 1 Processor -- start 2023-05-16T13:54:58.134 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.128+0000 7fb02e6c4640 1 -- start start 2023-05-16T13:54:58.134 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.128+0000 7fb02e6c4640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb0280b0490 0x7fb0280c1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:58.135 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.128+0000 7fb02e6c4640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb0280c9a70 0x7fb0280c3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:58.135 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.128+0000 7fb02e6c4640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb028158e00 0x7fb0281f3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:58.135 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.128+0000 7fb02e6c4640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb028151d50 con 0x7fb0280c9a70 2023-05-16T13:54:58.135 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.128+0000 7fb02e6c4640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0280c23e0 con 0x7fb0280b0490 2023-05-16T13:54:58.135 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.128+0000 7fb02e6c4640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb02815bd20 con 0x7fb028158e00 2023-05-16T13:54:58.135 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.128+0000 7fb0277fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb0280c9a70 0x7fb0280c3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:58.135 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.128+0000 7fb0277fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb0280c9a70 0x7fb0280c3b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34806/0 (socket says 172.21.15.39:34806) 2023-05-16T13:54:58.136 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.128+0000 7fb0277fe640 1 -- 172.21.15.39:0/2172392371 learned_addr learned my addr 172.21.15.39:0/2172392371 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:58.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.128+0000 7fb027fff640 1 --2- 172.21.15.39:0/2172392371 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb0280b0490 0x7fb0280c1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:58.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.128+0000 7fb0277fe640 1 -- 172.21.15.39:0/2172392371 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb028158e00 msgr2=0x7fb0281f3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:58.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.128+0000 7fb02cc61640 1 --2- 172.21.15.39:0/2172392371 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb028158e00 0x7fb0281f3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:58.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.128+0000 7fb0277fe640 1 --2- 172.21.15.39:0/2172392371 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb028158e00 0x7fb0281f3070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:58.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.128+0000 7fb0277fe640 1 -- 172.21.15.39:0/2172392371 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb0280b0490 msgr2=0x7fb0280c1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:58.138 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.128+0000 7fb0277fe640 1 --2- 172.21.15.39:0/2172392371 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb0280b0490 0x7fb0280c1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:58.138 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.128+0000 7fb0277fe640 1 -- 172.21.15.39:0/2172392371 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0180094d0 con 0x7fb0280c9a70 2023-05-16T13:54:58.138 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.128+0000 7fb027fff640 1 --2- 172.21.15.39:0/2172392371 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb0280b0490 0x7fb0280c1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-16T13:54:58.138 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.128+0000 7fb02cc61640 1 --2- 172.21.15.39:0/2172392371 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb028158e00 0x7fb0281f3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-16T13:54:58.138 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.128+0000 7fb0277fe640 1 --2- 172.21.15.39:0/2172392371 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb0280c9a70 0x7fb0280c3b60 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb01c00c7f0 tx=0x7fb01c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:58.138 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.128+0000 7fb024ff9640 1 -- 172.21.15.39:0/2172392371 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01c0077c0 con 0x7fb0280c9a70 2023-05-16T13:54:58.138 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.128+0000 7fb024ff9640 1 -- 172.21.15.39:0/2172392371 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb01c007920 con 0x7fb0280c9a70 2023-05-16T13:54:58.138 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.128+0000 7fb02e6c4640 1 -- 172.21.15.39:0/2172392371 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb02815d130 con 0x7fb0280c9a70 2023-05-16T13:54:58.139 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.128+0000 7fb024ff9640 1 -- 172.21.15.39:0/2172392371 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01c007cd0 con 0x7fb0280c9a70 2023-05-16T13:54:58.139 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.128+0000 7fb02e6c4640 1 -- 172.21.15.39:0/2172392371 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb02815ce50 con 0x7fb0280c9a70 2023-05-16T13:54:58.139 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.132+0000 7fb02e6c4640 1 -- 172.21.15.39:0/2172392371 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0280cc6f0 con 0x7fb0280c9a70 2023-05-16T13:54:58.139 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.132+0000 7fb024ff9640 1 -- 172.21.15.39:0/2172392371 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb01c024480 con 0x7fb0280c9a70 2023-05-16T13:54:58.140 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.132+0000 7fb024ff9640 1 --2- 172.21.15.39:0/2172392371 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fb014066280 0x7fb014068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:58.140 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.132+0000 7fb024ff9640 1 -- 172.21.15.39:0/2172392371 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fb01c084420 con 0x7fb0280c9a70 2023-05-16T13:54:58.140 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.132+0000 7fb027fff640 1 --2- 172.21.15.39:0/2172392371 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fb014066280 0x7fb014068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:58.140 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.132+0000 7fb027fff640 1 --2- 172.21.15.39:0/2172392371 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fb014066280 0x7fb014068730 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb0180b2000 tx=0x7fb0180aa070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:58.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.136+0000 7fb024ff9640 1 -- 172.21.15.39:0/2172392371 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fb01c051940 con 0x7fb0280c9a70 2023-05-16T13:54:58.296 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.288+0000 7fb02e6c4640 1 -- 172.21.15.39:0/2172392371 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb028073c90 con 0x7fb0280c9a70 2023-05-16T13:54:58.297 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.292+0000 7fb024ff9640 1 -- 172.21.15.39:0/2172392371 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb01c01f020 con 0x7fb0280c9a70 2023-05-16T13:54:58.297 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2023-05-16T13:54:58.299 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.292+0000 7fb02e6c4640 1 -- 172.21.15.39:0/2172392371 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fb014066280 msgr2=0x7fb014068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:58.299 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.292+0000 7fb02e6c4640 1 --2- 172.21.15.39:0/2172392371 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fb014066280 0x7fb014068730 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb0180b2000 tx=0x7fb0180aa070 comp rx=0 tx=0).stop 2023-05-16T13:54:58.299 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.292+0000 7fb02e6c4640 1 -- 172.21.15.39:0/2172392371 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb0280c9a70 msgr2=0x7fb0280c3b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:58.299 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.292+0000 7fb02e6c4640 1 --2- 172.21.15.39:0/2172392371 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb0280c9a70 0x7fb0280c3b60 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb01c00c7f0 tx=0x7fb01c00ccb0 comp rx=0 tx=0).stop 2023-05-16T13:54:58.299 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.292+0000 7fb02e6c4640 1 -- 172.21.15.39:0/2172392371 shutdown_connections 2023-05-16T13:54:58.300 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.292+0000 7fb02e6c4640 1 --2- 172.21.15.39:0/2172392371 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fb014066280 0x7fb014068730 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:58.300 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.292+0000 7fb02e6c4640 1 --2- 172.21.15.39:0/2172392371 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb028158e00 0x7fb0281f3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:58.300 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.292+0000 7fb02e6c4640 1 --2- 172.21.15.39:0/2172392371 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb0280c9a70 0x7fb0280c3b60 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:58.300 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.292+0000 7fb02e6c4640 1 --2- 172.21.15.39:0/2172392371 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb0280b0490 0x7fb0280c1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:58.300 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.292+0000 7fb02e6c4640 1 -- 172.21.15.39:0/2172392371 >> 172.21.15.39:0/2172392371 conn(0x7fb028069a50 msgr2=0x7fb028070420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:58.301 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.292+0000 7fb02e6c4640 1 -- 172.21.15.39:0/2172392371 shutdown_connections 2023-05-16T13:54:58.301 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.292+0000 7fb02e6c4640 1 -- 172.21.15.39:0/2172392371 wait complete. 2023-05-16T13:54:58.317 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-16T13:54:58.458 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.452+0000 7f2e7a5bc640 1 Processor -- start 2023-05-16T13:54:58.458 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.452+0000 7f2e7a5bc640 1 -- start start 2023-05-16T13:54:58.459 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.452+0000 7f2e7a5bc640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2e740b0710 0x7f2e7415d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:58.459 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.452+0000 7f2e7a5bc640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e7415de40 con 0x7f2e740b4030 2023-05-16T13:54:58.459 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.452+0000 7f2e7a5bc640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e740b0ae0 con 0x7f2e74071b70 2023-05-16T13:54:58.459 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.452+0000 7f2e7a5bc640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7415e910 con 0x7f2e740b0710 2023-05-16T13:54:58.460 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.452+0000 7f2e737fe640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f2e740b4030 0x7f2e74071460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:35680/0 (socket says 172.21.15.39:35680) 2023-05-16T13:54:58.460 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.452+0000 7f2e737fe640 1 -- 172.21.15.39:0/4085516690 learned_addr learned my addr 172.21.15.39:0/4085516690 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:58.461 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.452+0000 7f2e73fff640 1 --2- 172.21.15.39:0/4085516690 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2e740b0710 0x7f2e7415d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:58.461 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.452+0000 7f2e72ffd640 1 -- 172.21.15.39:0/4085516690 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1817352577 0 0) 0x7f2e7415de40 con 0x7f2e740b4030 2023-05-16T13:54:58.461 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.452+0000 7f2e72ffd640 1 -- 172.21.15.39:0/4085516690 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e5c003530 con 0x7f2e740b4030 2023-05-16T13:54:58.461 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.452+0000 7f2e72ffd640 1 -- 172.21.15.39:0/4085516690 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1432142245 0 0) 0x7f2e6c0014a0 con 0x7f2e74071b70 2023-05-16T13:54:58.461 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.452+0000 7f2e72ffd640 1 -- 172.21.15.39:0/4085516690 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e7415de40 con 0x7f2e74071b70 2023-05-16T13:54:58.461 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.452+0000 7f2e73fff640 1 -- 172.21.15.39:0/4085516690 >> v1:172.21.15.118:6789/0 conn(0x7f2e74071b70 legacy=0x7f2e740c91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:58.462 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.452+0000 7f2e73fff640 1 -- 172.21.15.39:0/4085516690 >> v1:172.21.15.39:6789/0 conn(0x7f2e740b4030 legacy=0x7f2e74071460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:58.462 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.452+0000 7f2e73fff640 1 -- 172.21.15.39:0/4085516690 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e7415e070 con 0x7f2e740b0710 2023-05-16T13:54:58.463 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.456+0000 7f2e73fff640 1 --2- 172.21.15.39:0/4085516690 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2e740b0710 0x7f2e7415d900 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2e640097f0 tx=0x7f2e6401c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d53a9f2aa2682cfe server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:58.463 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.456+0000 7f2e72ffd640 1 -- 172.21.15.39:0/4085516690 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e640aa640 con 0x7f2e740b0710 2023-05-16T13:54:58.463 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.456+0000 7f2e72ffd640 1 -- 172.21.15.39:0/4085516690 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e640aa7a0 con 0x7f2e740b0710 2023-05-16T13:54:58.463 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.456+0000 7f2e72ffd640 1 -- 172.21.15.39:0/4085516690 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e640aab10 con 0x7f2e740b0710 2023-05-16T13:54:58.464 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.456+0000 7f2e7a5bc640 1 -- 172.21.15.39:0/4085516690 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2e740b0710 msgr2=0x7f2e7415d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:58.464 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.456+0000 7f2e7a5bc640 1 --2- 172.21.15.39:0/4085516690 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2e740b0710 0x7f2e7415d900 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2e640097f0 tx=0x7f2e6401c4c0 comp rx=0 tx=0).stop 2023-05-16T13:54:58.465 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.456+0000 7f2e7a5bc640 1 -- 172.21.15.39:0/4085516690 shutdown_connections 2023-05-16T13:54:58.465 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.456+0000 7f2e7a5bc640 1 --2- 172.21.15.39:0/4085516690 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2e740b0710 0x7f2e7415d900 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:58.465 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.456+0000 7f2e7a5bc640 1 -- 172.21.15.39:0/4085516690 >> 172.21.15.39:0/4085516690 conn(0x7f2e74069a50 msgr2=0x7f2e74069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:58.465 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.456+0000 7f2e7a5bc640 1 -- 172.21.15.39:0/4085516690 shutdown_connections 2023-05-16T13:54:58.465 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.456+0000 7f2e7a5bc640 1 -- 172.21.15.39:0/4085516690 wait complete. 2023-05-16T13:54:58.466 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.460+0000 7f2e7a5bc640 1 Processor -- start 2023-05-16T13:54:58.466 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.460+0000 7f2e7a5bc640 1 -- start start 2023-05-16T13:54:58.467 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.460+0000 7f2e7a5bc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2e74071b70 0x7f2e7415c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:58.467 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.460+0000 7f2e7a5bc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e740b0710 0x7f2e741491e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:58.467 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.460+0000 7f2e7a5bc640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2e740b4030 0x7f2e740af7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:58.467 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.460+0000 7f2e7a5bc640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7415c070 con 0x7f2e740b0710 2023-05-16T13:54:58.467 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.460+0000 7f2e7a5bc640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7415c9d0 con 0x7f2e74071b70 2023-05-16T13:54:58.467 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.460+0000 7f2e7a5bc640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e74149720 con 0x7f2e740b4030 2023-05-16T13:54:58.468 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.460+0000 7f2e737fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e740b0710 0x7f2e741491e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:58.468 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.460+0000 7f2e737fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e740b0710 0x7f2e741491e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34808/0 (socket says 172.21.15.39:34808) 2023-05-16T13:54:58.468 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.460+0000 7f2e737fe640 1 -- 172.21.15.39:0/3894186329 learned_addr learned my addr 172.21.15.39:0/3894186329 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:58.469 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.460+0000 7f2e73fff640 1 --2- 172.21.15.39:0/3894186329 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2e74071b70 0x7f2e7415c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:58.469 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.460+0000 7f2e78b59640 1 --2- 172.21.15.39:0/3894186329 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2e740b4030 0x7f2e740af7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:58.469 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.460+0000 7f2e737fe640 1 -- 172.21.15.39:0/3894186329 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2e740b4030 msgr2=0x7f2e740af7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:58.470 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.460+0000 7f2e737fe640 1 --2- 172.21.15.39:0/3894186329 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2e740b4030 0x7f2e740af7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:58.470 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.460+0000 7f2e737fe640 1 -- 172.21.15.39:0/3894186329 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2e74071b70 msgr2=0x7f2e7415c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:58.470 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.460+0000 7f2e737fe640 1 --2- 172.21.15.39:0/3894186329 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2e74071b70 0x7f2e7415c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:58.470 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.460+0000 7f2e737fe640 1 -- 172.21.15.39:0/3894186329 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e64009420 con 0x7f2e740b0710 2023-05-16T13:54:58.470 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.460+0000 7f2e78b59640 1 --2- 172.21.15.39:0/3894186329 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2e740b4030 0x7f2e740af7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-16T13:54:58.470 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.460+0000 7f2e737fe640 1 --2- 172.21.15.39:0/3894186329 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e740b0710 0x7f2e741491e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2e6800c4f0 tx=0x7f2e6800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:58.470 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.460+0000 7f2e70ff9640 1 -- 172.21.15.39:0/3894186329 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e68005cf0 con 0x7f2e740b0710 2023-05-16T13:54:58.471 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.460+0000 7f2e70ff9640 1 -- 172.21.15.39:0/3894186329 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e68005e50 con 0x7f2e740b0710 2023-05-16T13:54:58.471 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.460+0000 7f2e7a5bc640 1 -- 172.21.15.39:0/3894186329 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e740ca0e0 con 0x7f2e740b0710 2023-05-16T13:54:58.471 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.460+0000 7f2e70ff9640 1 -- 172.21.15.39:0/3894186329 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e68007270 con 0x7f2e740b0710 2023-05-16T13:54:58.471 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.460+0000 7f2e7a5bc640 1 -- 172.21.15.39:0/3894186329 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e740c8ca0 con 0x7f2e740b0710 2023-05-16T13:54:58.471 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.464+0000 7f2e7a5bc640 1 -- 172.21.15.39:0/3894186329 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e740ca270 con 0x7f2e740b0710 2023-05-16T13:54:58.472 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.464+0000 7f2e70ff9640 1 -- 172.21.15.39:0/3894186329 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2e680073d0 con 0x7f2e740b0710 2023-05-16T13:54:58.472 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.464+0000 7f2e70ff9640 1 --2- 172.21.15.39:0/3894186329 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f2e60066280 0x7f2e60068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:58.472 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.464+0000 7f2e70ff9640 1 -- 172.21.15.39:0/3894186329 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f2e68083340 con 0x7f2e740b0710 2023-05-16T13:54:58.472 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.464+0000 7f2e73fff640 1 --2- 172.21.15.39:0/3894186329 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f2e60066280 0x7f2e60068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:58.473 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.464+0000 7f2e73fff640 1 --2- 172.21.15.39:0/3894186329 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f2e60066280 0x7f2e60068730 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2e640ae000 tx=0x7f2e640a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:58.474 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.468+0000 7f2e70ff9640 1 -- 172.21.15.39:0/3894186329 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f2e68050790 con 0x7f2e740b0710 2023-05-16T13:54:58.628 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.620+0000 7f2e7a5bc640 1 -- 172.21.15.39:0/3894186329 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2e7415c1b0 con 0x7f2e740b0710 2023-05-16T13:54:58.628 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.620+0000 7f2e70ff9640 1 -- 172.21.15.39:0/3894186329 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2e7415c1b0 con 0x7f2e740b0710 2023-05-16T13:54:58.629 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 8 2023-05-16T13:54:58.630 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.624+0000 7f2e7a5bc640 1 -- 172.21.15.39:0/3894186329 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f2e60066280 msgr2=0x7f2e60068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:58.631 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.624+0000 7f2e7a5bc640 1 --2- 172.21.15.39:0/3894186329 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f2e60066280 0x7f2e60068730 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2e640ae000 tx=0x7f2e640a7000 comp rx=0 tx=0).stop 2023-05-16T13:54:58.631 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.624+0000 7f2e7a5bc640 1 -- 172.21.15.39:0/3894186329 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e740b0710 msgr2=0x7f2e741491e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:58.631 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.624+0000 7f2e7a5bc640 1 --2- 172.21.15.39:0/3894186329 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e740b0710 0x7f2e741491e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2e6800c4f0 tx=0x7f2e6800c9b0 comp rx=0 tx=0).stop 2023-05-16T13:54:58.631 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.624+0000 7f2e7a5bc640 1 -- 172.21.15.39:0/3894186329 shutdown_connections 2023-05-16T13:54:58.631 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.624+0000 7f2e7a5bc640 1 --2- 172.21.15.39:0/3894186329 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f2e60066280 0x7f2e60068730 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:58.631 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.624+0000 7f2e7a5bc640 1 --2- 172.21.15.39:0/3894186329 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2e740b4030 0x7f2e740af7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:58.631 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.624+0000 7f2e7a5bc640 1 --2- 172.21.15.39:0/3894186329 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e740b0710 0x7f2e741491e0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:58.632 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.624+0000 7f2e7a5bc640 1 --2- 172.21.15.39:0/3894186329 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2e74071b70 0x7f2e7415c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:58.632 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.624+0000 7f2e7a5bc640 1 -- 172.21.15.39:0/3894186329 >> 172.21.15.39:0/3894186329 conn(0x7f2e74069a50 msgr2=0x7f2e74155d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:58.632 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.624+0000 7f2e7a5bc640 1 -- 172.21.15.39:0/3894186329 shutdown_connections 2023-05-16T13:54:58.632 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.624+0000 7f2e7a5bc640 1 -- 172.21.15.39:0/3894186329 wait complete. 2023-05-16T13:54:58.649 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-16T13:54:58.790 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.784+0000 7fafce8f9640 1 Processor -- start 2023-05-16T13:54:58.790 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.784+0000 7fafce8f9640 1 -- start start 2023-05-16T13:54:58.791 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.784+0000 7fafce8f9640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fafc8158e00 0x7fafc80c9530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:58.791 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.784+0000 7fafce8f9640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fafc80c9a70 0x7fafc80aff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:58.791 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.784+0000 7fafce8f9640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fafc80b0490 0x7fafc80caec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:58.791 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.784+0000 7fafce8f9640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafc80b0910 con 0x7fafc80b0490 2023-05-16T13:54:58.792 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.784+0000 7fafce8f9640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafc80ca030 con 0x7fafc80c9a70 2023-05-16T13:54:58.792 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.784+0000 7fafce8f9640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafc815c890 con 0x7fafc8158e00 2023-05-16T13:54:58.792 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.784+0000 7fafcce96640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fafc80b0490 0x7fafc80caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:58.792 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.784+0000 7fafcce96640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fafc80b0490 0x7fafc80caec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34814/0 (socket says 172.21.15.39:34814) 2023-05-16T13:54:58.792 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.784+0000 7fafcce96640 1 -- 172.21.15.39:0/4173700549 learned_addr learned my addr 172.21.15.39:0/4173700549 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:58.793 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.784+0000 7fafc77fe640 1 --2- 172.21.15.39:0/4173700549 >> v2:172.21.15.118:3300/0 conn(0x7fafc80c9a70 0x7fafc80aff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:58.793 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.784+0000 7fafc7fff640 1 --2- 172.21.15.39:0/4173700549 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fafc8158e00 0x7fafc80c9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:58.793 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.784+0000 7fafcce96640 1 -- 172.21.15.39:0/4173700549 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fafc8158e00 msgr2=0x7fafc80c9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:58.793 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.784+0000 7fafcce96640 1 --2- 172.21.15.39:0/4173700549 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fafc8158e00 0x7fafc80c9530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:58.793 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.784+0000 7fafcce96640 1 -- 172.21.15.39:0/4173700549 >> v2:172.21.15.118:3300/0 conn(0x7fafc80c9a70 msgr2=0x7fafc80aff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:58.793 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.784+0000 7fafcce96640 1 --2- 172.21.15.39:0/4173700549 >> v2:172.21.15.118:3300/0 conn(0x7fafc80c9a70 0x7fafc80aff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:58.794 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.784+0000 7fafcce96640 1 -- 172.21.15.39:0/4173700549 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc815cb70 con 0x7fafc80b0490 2023-05-16T13:54:58.794 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.788+0000 7fafcce96640 1 --2- 172.21.15.39:0/4173700549 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fafc80b0490 0x7fafc80caec0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fafc80cbfd0 tx=0x7fafc001f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adb89d47afde1b7 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:58.795 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.788+0000 7fafc6ffd640 1 -- 172.21.15.39:0/4173700549 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc00af400 con 0x7fafc80b0490 2023-05-16T13:54:58.795 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.788+0000 7fafc6ffd640 1 -- 172.21.15.39:0/4173700549 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafc00ab050 con 0x7fafc80b0490 2023-05-16T13:54:58.795 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.788+0000 7fafc6ffd640 1 -- 172.21.15.39:0/4173700549 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc00af780 con 0x7fafc80b0490 2023-05-16T13:54:58.796 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.788+0000 7fafce8f9640 1 -- 172.21.15.39:0/4173700549 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fafc80b0490 msgr2=0x7fafc80caec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:58.796 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.788+0000 7fafce8f9640 1 --2- 172.21.15.39:0/4173700549 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fafc80b0490 0x7fafc80caec0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fafc80cbfd0 tx=0x7fafc001f1c0 comp rx=0 tx=0).stop 2023-05-16T13:54:58.796 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.788+0000 7fafce8f9640 1 -- 172.21.15.39:0/4173700549 shutdown_connections 2023-05-16T13:54:58.796 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.788+0000 7fafce8f9640 1 --2- 172.21.15.39:0/4173700549 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fafc80b0490 0x7fafc80caec0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:58.796 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.788+0000 7fafce8f9640 1 --2- 172.21.15.39:0/4173700549 >> v2:172.21.15.118:3300/0 conn(0x7fafc80c9a70 0x7fafc80aff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:58.796 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.788+0000 7fafce8f9640 1 --2- 172.21.15.39:0/4173700549 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fafc8158e00 0x7fafc80c9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:58.796 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.788+0000 7fafce8f9640 1 -- 172.21.15.39:0/4173700549 >> 172.21.15.39:0/4173700549 conn(0x7fafc8069a50 msgr2=0x7fafc8069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:58.797 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.788+0000 7fafce8f9640 1 -- 172.21.15.39:0/4173700549 shutdown_connections 2023-05-16T13:54:58.797 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.788+0000 7fafce8f9640 1 -- 172.21.15.39:0/4173700549 wait complete. 2023-05-16T13:54:58.797 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.792+0000 7fafce8f9640 1 Processor -- start 2023-05-16T13:54:58.797 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.792+0000 7fafce8f9640 1 -- start start 2023-05-16T13:54:58.798 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.792+0000 7fafce8f9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fafc80b0490 0x7fafc81516b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:58.798 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.792+0000 7fafce8f9640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fafc80c9a70 0x7fafc80b3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:58.798 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.792+0000 7fafce8f9640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fafc8158e00 0x7fafc80c7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:58.798 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.792+0000 7fafce8f9640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc8151bf0 con 0x7fafc80b0490 2023-05-16T13:54:58.798 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.792+0000 7fafce8f9640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc81edc70 con 0x7fafc8158e00 2023-05-16T13:54:58.799 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.792+0000 7fafce8f9640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafc81ed340 con 0x7fafc80c9a70 2023-05-16T13:54:58.800 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.792+0000 7fafc7fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fafc80b0490 0x7fafc81516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:58.800 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.792+0000 7fafc7fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fafc80b0490 0x7fafc81516b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34816/0 (socket says 172.21.15.39:34816) 2023-05-16T13:54:58.800 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.792+0000 7fafc7fff640 1 -- 172.21.15.39:0/3733727244 learned_addr learned my addr 172.21.15.39:0/3733727244 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:58.800 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.792+0000 7fafcce96640 1 --2- 172.21.15.39:0/3733727244 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fafc8158e00 0x7fafc80c7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:58.800 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.792+0000 7fafc77fe640 1 --2- 172.21.15.39:0/3733727244 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fafc80c9a70 0x7fafc80b3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:58.801 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.792+0000 7fafc7fff640 1 -- 172.21.15.39:0/3733727244 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fafc80c9a70 msgr2=0x7fafc80b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:58.801 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.792+0000 7fafc7fff640 1 --2- 172.21.15.39:0/3733727244 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fafc80c9a70 0x7fafc80b3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:58.801 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.792+0000 7fafc7fff640 1 -- 172.21.15.39:0/3733727244 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fafc8158e00 msgr2=0x7fafc80c7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:58.801 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.792+0000 7fafc7fff640 1 --2- 172.21.15.39:0/3733727244 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fafc8158e00 0x7fafc80c7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:58.801 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.792+0000 7fafc7fff640 1 -- 172.21.15.39:0/3733727244 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc0009b30 con 0x7fafc80b0490 2023-05-16T13:54:58.801 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.792+0000 7fafcce96640 1 --2- 172.21.15.39:0/3733727244 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fafc8158e00 0x7fafc80c7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:54:58.801 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.792+0000 7fafc7fff640 1 --2- 172.21.15.39:0/3733727244 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fafc80b0490 0x7fafc81516b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fafb800d800 tx=0x7fafb800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:58.801 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.792+0000 7fafc4ff9640 1 -- 172.21.15.39:0/3733727244 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb800b6c0 con 0x7fafc80b0490 2023-05-16T13:54:58.802 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.792+0000 7fafc4ff9640 1 -- 172.21.15.39:0/3733727244 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafb800b820 con 0x7fafc80b0490 2023-05-16T13:54:58.802 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.792+0000 7fafc4ff9640 1 -- 172.21.15.39:0/3733727244 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb800bb90 con 0x7fafc80b0490 2023-05-16T13:54:58.802 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.792+0000 7fafce8f9640 1 -- 172.21.15.39:0/3733727244 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafc815d130 con 0x7fafc80b0490 2023-05-16T13:54:58.802 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.792+0000 7fafce8f9640 1 -- 172.21.15.39:0/3733727244 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafc815ce50 con 0x7fafc80b0490 2023-05-16T13:54:58.803 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.796+0000 7fafce8f9640 1 -- 172.21.15.39:0/3733727244 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafc81eda50 con 0x7fafc80b0490 2023-05-16T13:54:58.803 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.796+0000 7fafc4ff9640 1 -- 172.21.15.39:0/3733727244 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fafb800bcf0 con 0x7fafc80b0490 2023-05-16T13:54:58.803 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.796+0000 7fafc4ff9640 1 --2- 172.21.15.39:0/3733727244 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fafb40662b0 0x7fafb4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:58.803 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.796+0000 7fafc4ff9640 1 -- 172.21.15.39:0/3733727244 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fafb8084220 con 0x7fafc80b0490 2023-05-16T13:54:58.803 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.796+0000 7fafc77fe640 1 --2- 172.21.15.39:0/3733727244 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fafb40662b0 0x7fafb4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:58.803 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.796+0000 7fafc77fe640 1 --2- 172.21.15.39:0/3733727244 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fafb40662b0 0x7fafb4068760 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fafc81f0540 tx=0x7fafbc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:58.806 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.800+0000 7fafc4ff9640 1 -- 172.21.15.39:0/3733727244 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fafb8051650 con 0x7fafc80b0490 2023-05-16T13:54:58.961 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.956+0000 7fafce8f9640 1 -- 172.21.15.39:0/3733727244 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fafc80cc700 con 0x7fafc80b0490 2023-05-16T13:54:58.962 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.956+0000 7fafc4ff9640 1 -- 172.21.15.39:0/3733727244 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fafb8054c70 con 0x7fafc80b0490 2023-05-16T13:54:58.962 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2023-05-16T13:54:58.964 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.956+0000 7fafce8f9640 1 -- 172.21.15.39:0/3733727244 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fafb40662b0 msgr2=0x7fafb4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:58.964 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.956+0000 7fafce8f9640 1 --2- 172.21.15.39:0/3733727244 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fafb40662b0 0x7fafb4068760 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fafc81f0540 tx=0x7fafbc008040 comp rx=0 tx=0).stop 2023-05-16T13:54:58.964 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.956+0000 7fafce8f9640 1 -- 172.21.15.39:0/3733727244 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fafc80b0490 msgr2=0x7fafc81516b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:58.965 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.956+0000 7fafce8f9640 1 --2- 172.21.15.39:0/3733727244 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fafc80b0490 0x7fafc81516b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fafb800d800 tx=0x7fafb800dcc0 comp rx=0 tx=0).stop 2023-05-16T13:54:58.965 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.956+0000 7fafce8f9640 1 -- 172.21.15.39:0/3733727244 shutdown_connections 2023-05-16T13:54:58.965 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.956+0000 7fafce8f9640 1 --2- 172.21.15.39:0/3733727244 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fafb40662b0 0x7fafb4068760 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:58.965 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.956+0000 7fafce8f9640 1 --2- 172.21.15.39:0/3733727244 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fafc80c9a70 0x7fafc80b3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:58.965 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.956+0000 7fafce8f9640 1 --2- 172.21.15.39:0/3733727244 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fafc8158e00 0x7fafc80c7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:58.965 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.956+0000 7fafce8f9640 1 --2- 172.21.15.39:0/3733727244 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fafc80b0490 0x7fafc81516b0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:58.965 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.956+0000 7fafce8f9640 1 -- 172.21.15.39:0/3733727244 >> 172.21.15.39:0/3733727244 conn(0x7fafc8069a50 msgr2=0x7fafc80cee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:58.966 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.956+0000 7fafce8f9640 1 -- 172.21.15.39:0/3733727244 shutdown_connections 2023-05-16T13:54:58.966 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:58.956+0000 7fafce8f9640 1 -- 172.21.15.39:0/3733727244 wait complete. 2023-05-16T13:54:58.982 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-16T13:54:59.124 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.116+0000 7f5282e74640 1 Processor -- start 2023-05-16T13:54:59.124 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.116+0000 7f5282e74640 1 -- start start 2023-05-16T13:54:59.125 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.120+0000 7f5282e74640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f527c158e00 0x7f527c0c9530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:59.125 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.120+0000 7f5282e74640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f527c0ca030 con 0x7f527c0b0660 2023-05-16T13:54:59.125 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.120+0000 7f5282e74640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f527c15c890 con 0x7f527c0c9a70 2023-05-16T13:54:59.125 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.120+0000 7f5282e74640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f527c15cb70 con 0x7f527c158e00 2023-05-16T13:54:59.127 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.120+0000 7f5281411640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f527c0b0660 0x7f527c070420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:35688/0 (socket says 172.21.15.39:35688) 2023-05-16T13:54:59.127 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.120+0000 7f5281411640 1 -- 172.21.15.39:0/2443337516 learned_addr learned my addr 172.21.15.39:0/2443337516 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:59.127 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.120+0000 7f5280c10640 1 --2- 172.21.15.39:0/2443337516 >> v2:172.21.15.118:3300/0 conn(0x7f527c158e00 0x7f527c0c9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:59.127 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.120+0000 7f527b7fe640 1 -- 172.21.15.39:0/2443337516 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2177569801 0 0) 0x7f527c0ca030 con 0x7f527c0b0660 2023-05-16T13:54:59.128 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.120+0000 7f527b7fe640 1 -- 172.21.15.39:0/2443337516 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f526c003530 con 0x7f527c0b0660 2023-05-16T13:54:59.128 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.120+0000 7f527b7fe640 1 -- 172.21.15.39:0/2443337516 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 686382761 0 0) 0x7f527c15c890 con 0x7f527c0c9a70 2023-05-16T13:54:59.128 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.120+0000 7f527b7fe640 1 -- 172.21.15.39:0/2443337516 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f527c0ca030 con 0x7f527c0c9a70 2023-05-16T13:54:59.128 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.120+0000 7f527b7fe640 1 -- 172.21.15.39:0/2443337516 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1693902675 0 0) 0x7f526c003530 con 0x7f527c0b0660 2023-05-16T13:54:59.128 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.120+0000 7f527b7fe640 1 -- 172.21.15.39:0/2443337516 >> v2:172.21.15.118:3300/0 conn(0x7f527c158e00 msgr2=0x7f527c0c9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:59.128 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.120+0000 7f527b7fe640 1 --2- 172.21.15.39:0/2443337516 >> v2:172.21.15.118:3300/0 conn(0x7f527c158e00 0x7f527c0c9530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:59.128 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.120+0000 7f527b7fe640 1 -- 172.21.15.39:0/2443337516 >> v1:172.21.15.118:6789/0 conn(0x7f527c0c9a70 legacy=0x7f527c0aff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:59.129 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.120+0000 7f527b7fe640 1 -- 172.21.15.39:0/2443337516 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f527c15ce50 con 0x7f527c0b0660 2023-05-16T13:54:59.129 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.120+0000 7f527b7fe640 1 -- 172.21.15.39:0/2443337516 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1738805496 0 0) 0x7f5274001a20 con 0x7f527c0b0660 2023-05-16T13:54:59.129 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.120+0000 7f527b7fe640 1 -- 172.21.15.39:0/2443337516 >> v1:172.21.15.39:6789/0 conn(0x7f527c0b0660 legacy=0x7f527c070420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:59.129 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.120+0000 7f527b7fe640 1 --2- 172.21.15.39:0/2443337516 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f526c003b10 0x7f526c003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:59.129 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.120+0000 7f527b7fe640 1 --2- 172.21.15.39:0/2443337516 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f526c0047d0 0x7f526c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:59.129 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.120+0000 7f527b7fe640 1 --2- 172.21.15.39:0/2443337516 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f526c005180 0x7f526c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:59.129 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.120+0000 7f527b7fe640 1 -- 172.21.15.39:0/2443337516 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f527c15cb70 con 0x7f526c005180 2023-05-16T13:54:59.129 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.120+0000 7f527b7fe640 1 -- 172.21.15.39:0/2443337516 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f526c00e190 con 0x7f526c003b10 2023-05-16T13:54:59.130 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.120+0000 7f527b7fe640 1 -- 172.21.15.39:0/2443337516 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f526c00e320 con 0x7f526c0047d0 2023-05-16T13:54:59.130 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.120+0000 7f5281411640 1 --2- 172.21.15.39:0/2443337516 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f526c005180 0x7f526c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:59.130 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.120+0000 7f5280c10640 1 --2- 172.21.15.39:0/2443337516 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f526c003b10 0x7f526c003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:59.130 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.120+0000 7f527bfff640 1 --2- 172.21.15.39:0/2443337516 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f526c0047d0 0x7f526c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:59.130 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.120+0000 7f5280c10640 1 -- 172.21.15.39:0/2443337516 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f526c0047d0 msgr2=0x7f526c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:59.130 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.120+0000 7f5280c10640 1 --2- 172.21.15.39:0/2443337516 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f526c0047d0 0x7f526c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:59.130 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.120+0000 7f5280c10640 1 -- 172.21.15.39:0/2443337516 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f526c005180 msgr2=0x7f526c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:59.130 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.120+0000 7f5280c10640 1 --2- 172.21.15.39:0/2443337516 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f526c005180 0x7f526c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:59.131 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.120+0000 7f5280c10640 1 -- 172.21.15.39:0/2443337516 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f526c003530 con 0x7f526c003b10 2023-05-16T13:54:59.131 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.120+0000 7f5281411640 1 -- 172.21.15.39:0/2443337516 reap_dead start 2023-05-16T13:54:59.132 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.124+0000 7f5280c10640 1 --2- 172.21.15.39:0/2443337516 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f526c003b10 0x7f526c003f00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5270009ae0 tx=0x7f527001ca50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8dedf9e4cdacc853 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:59.132 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.124+0000 7f527b7fe640 1 -- 172.21.15.39:0/2443337516 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52700a5640 con 0x7f526c003b10 2023-05-16T13:54:59.132 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.124+0000 7f527b7fe640 1 -- 172.21.15.39:0/2443337516 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52700a57a0 con 0x7f526c003b10 2023-05-16T13:54:59.132 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.124+0000 7f527b7fe640 1 -- 172.21.15.39:0/2443337516 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52700a5b50 con 0x7f526c003b10 2023-05-16T13:54:59.132 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.124+0000 7f5282e74640 1 -- 172.21.15.39:0/2443337516 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f526c003b10 msgr2=0x7f526c003f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:59.132 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.124+0000 7f5282e74640 1 --2- 172.21.15.39:0/2443337516 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f526c003b10 0x7f526c003f00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5270009ae0 tx=0x7f527001ca50 comp rx=0 tx=0).stop 2023-05-16T13:54:59.132 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.124+0000 7f5282e74640 1 -- 172.21.15.39:0/2443337516 shutdown_connections 2023-05-16T13:54:59.133 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.124+0000 7f5282e74640 1 --2- 172.21.15.39:0/2443337516 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f526c003b10 0x7f526c003f00 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:59.133 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.124+0000 7f5282e74640 1 -- 172.21.15.39:0/2443337516 >> 172.21.15.39:0/2443337516 conn(0x7f527c069a50 msgr2=0x7f527c069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:59.133 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.124+0000 7f5282e74640 1 -- 172.21.15.39:0/2443337516 shutdown_connections 2023-05-16T13:54:59.133 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.124+0000 7f5282e74640 1 -- 172.21.15.39:0/2443337516 wait complete. 2023-05-16T13:54:59.134 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.128+0000 7f5282e74640 1 Processor -- start 2023-05-16T13:54:59.134 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.128+0000 7f5282e74640 1 -- start start 2023-05-16T13:54:59.134 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.128+0000 7f5282e74640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f526c003b10 0x7f527c14db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:59.134 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.128+0000 7f5282e74640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f527c0c6d80 0x7f527c0c71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:59.135 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.128+0000 7f5282e74640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f527c150930 0x7f527c150da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:59.135 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.128+0000 7f5282e74640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f527c0c7730 con 0x7f527c150930 2023-05-16T13:54:59.135 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.128+0000 7f5282e74640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f527c1512e0 con 0x7f526c003b10 2023-05-16T13:54:59.135 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.128+0000 7f5282e74640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f527c0c6010 con 0x7f527c0c6d80 2023-05-16T13:54:59.135 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.128+0000 7f5281411640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f527c150930 0x7f527c150da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:59.135 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.128+0000 7f5281411640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f527c150930 0x7f527c150da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34836/0 (socket says 172.21.15.39:34836) 2023-05-16T13:54:59.135 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.128+0000 7f5281411640 1 -- 172.21.15.39:0/1592522747 learned_addr learned my addr 172.21.15.39:0/1592522747 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:59.135 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.128+0000 7f5280c10640 1 --2- 172.21.15.39:0/1592522747 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f526c003b10 0x7f527c14db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:59.136 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.128+0000 7f527bfff640 1 --2- 172.21.15.39:0/1592522747 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f527c0c6d80 0x7f527c0c71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:59.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.128+0000 7f5281411640 1 -- 172.21.15.39:0/1592522747 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f527c0c6d80 msgr2=0x7f527c0c71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:59.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.128+0000 7f5281411640 1 --2- 172.21.15.39:0/1592522747 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f527c0c6d80 0x7f527c0c71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:59.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.128+0000 7f5281411640 1 -- 172.21.15.39:0/1592522747 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f526c003b10 msgr2=0x7f527c14db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:59.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.128+0000 7f5281411640 1 --2- 172.21.15.39:0/1592522747 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f526c003b10 0x7f527c14db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:59.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.128+0000 7f5281411640 1 -- 172.21.15.39:0/1592522747 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f527c0cc730 con 0x7f527c150930 2023-05-16T13:54:59.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.128+0000 7f5281411640 1 --2- 172.21.15.39:0/1592522747 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f527c150930 0x7f527c150da0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f5274002240 tx=0x7f5274007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:59.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.128+0000 7f52797fa640 1 -- 172.21.15.39:0/1592522747 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5274012560 con 0x7f527c150930 2023-05-16T13:54:59.138 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.128+0000 7f52797fa640 1 -- 172.21.15.39:0/1592522747 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52740126e0 con 0x7f527c150930 2023-05-16T13:54:59.138 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.128+0000 7f52797fa640 1 -- 172.21.15.39:0/1592522747 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5274012a90 con 0x7f527c150930 2023-05-16T13:54:59.138 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.128+0000 7f5282e74640 1 -- 172.21.15.39:0/1592522747 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f527c15d130 con 0x7f527c150930 2023-05-16T13:54:59.138 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.128+0000 7f5282e74640 1 -- 172.21.15.39:0/1592522747 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f527c15d650 con 0x7f527c150930 2023-05-16T13:54:59.138 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.128+0000 7f5282e74640 1 -- 172.21.15.39:0/1592522747 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f527c0c6180 con 0x7f527c150930 2023-05-16T13:54:59.139 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.132+0000 7f52797fa640 1 -- 172.21.15.39:0/1592522747 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5274012bf0 con 0x7f527c150930 2023-05-16T13:54:59.139 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.132+0000 7f52797fa640 1 --2- 172.21.15.39:0/1592522747 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f5260066280 0x7f5260068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:59.139 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.132+0000 7f52797fa640 1 -- 172.21.15.39:0/1592522747 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f5274083ba0 con 0x7f527c150930 2023-05-16T13:54:59.139 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.132+0000 7f5280c10640 1 --2- 172.21.15.39:0/1592522747 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f5260066280 0x7f5260068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:59.139 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.132+0000 7f5280c10640 1 --2- 172.21.15.39:0/1592522747 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f5260066280 0x7f5260068730 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f52700af000 tx=0x7f52700046d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:59.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.136+0000 7f52797fa640 1 -- 172.21.15.39:0/1592522747 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f5274050ff0 con 0x7f527c150930 2023-05-16T13:54:59.297 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.292+0000 7f5282e74640 1 -- 172.21.15.39:0/1592522747 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f527c073c90 con 0x7f527c150930 2023-05-16T13:54:59.298 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.292+0000 7f52797fa640 1 -- 172.21.15.39:0/1592522747 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5274054610 con 0x7f527c150930 2023-05-16T13:54:59.298 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 64 2023-05-16T13:54:59.299 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.292+0000 7f5282e74640 1 -- 172.21.15.39:0/1592522747 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f5260066280 msgr2=0x7f5260068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:59.300 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.292+0000 7f5282e74640 1 --2- 172.21.15.39:0/1592522747 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f5260066280 0x7f5260068730 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f52700af000 tx=0x7f52700046d0 comp rx=0 tx=0).stop 2023-05-16T13:54:59.300 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.292+0000 7f5282e74640 1 -- 172.21.15.39:0/1592522747 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f527c150930 msgr2=0x7f527c150da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:59.300 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.292+0000 7f5282e74640 1 --2- 172.21.15.39:0/1592522747 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f527c150930 0x7f527c150da0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f5274002240 tx=0x7f5274007750 comp rx=0 tx=0).stop 2023-05-16T13:54:59.300 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.292+0000 7f5282e74640 1 -- 172.21.15.39:0/1592522747 shutdown_connections 2023-05-16T13:54:59.300 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.292+0000 7f5282e74640 1 --2- 172.21.15.39:0/1592522747 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f5260066280 0x7f5260068730 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:59.300 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.292+0000 7f5282e74640 1 --2- 172.21.15.39:0/1592522747 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f527c0c6d80 0x7f527c0c71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:59.301 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.292+0000 7f5282e74640 1 --2- 172.21.15.39:0/1592522747 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f527c150930 0x7f527c150da0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:59.301 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.292+0000 7f5282e74640 1 --2- 172.21.15.39:0/1592522747 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f526c003b10 0x7f527c14db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:59.301 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.292+0000 7f5282e74640 1 -- 172.21.15.39:0/1592522747 >> 172.21.15.39:0/1592522747 conn(0x7f527c069a50 msgr2=0x7f527c069e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:59.301 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.292+0000 7f5282e74640 1 -- 172.21.15.39:0/1592522747 shutdown_connections 2023-05-16T13:54:59.301 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.292+0000 7f5282e74640 1 -- 172.21.15.39:0/1592522747 wait complete. 2023-05-16T13:54:59.319 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-16T13:54:59.458 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.452+0000 7f51f1490640 1 Processor -- start 2023-05-16T13:54:59.458 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.452+0000 7f51f1490640 1 -- start start 2023-05-16T13:54:59.459 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.452+0000 7f51f1490640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f51ec06e730 0x7f51ec160440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:59.459 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.452+0000 7f51f1490640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51ec15c370 0x7f51ec15c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:59.459 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.452+0000 7f51f1490640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51ec15ffb0 con 0x7f51ec156490 2023-05-16T13:54:59.459 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.452+0000 7f51f1490640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51ec0d12a0 con 0x7f51ec06e730 2023-05-16T13:54:59.459 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.452+0000 7f51f1490640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec15cd50 con 0x7f51ec15c370 2023-05-16T13:54:59.459 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.452+0000 7f51ebfff640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f51ec156490 0x7f51ec06e020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:35702/0 (socket says 172.21.15.39:35702) 2023-05-16T13:54:59.460 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.452+0000 7f51ebfff640 1 -- 172.21.15.39:0/2872023772 learned_addr learned my addr 172.21.15.39:0/2872023772 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:59.460 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.452+0000 7f51f0c8f640 1 --2- 172.21.15.39:0/2872023772 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51ec15c370 0x7f51ec15c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:59.461 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.452+0000 7f51eb7fe640 1 --2- 172.21.15.39:0/2872023772 >> v2:172.21.15.118:3300/0 conn(0x7f51ec06e730 0x7f51ec160440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:59.461 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.452+0000 7f51eaffd640 1 -- 172.21.15.39:0/2872023772 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1329200038 0 0) 0x7f51ec15ffb0 con 0x7f51ec156490 2023-05-16T13:54:59.461 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.452+0000 7f51eaffd640 1 -- 172.21.15.39:0/2872023772 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51d4003530 con 0x7f51ec156490 2023-05-16T13:54:59.461 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.452+0000 7f51f0c8f640 1 -- 172.21.15.39:0/2872023772 >> v2:172.21.15.118:3300/0 conn(0x7f51ec06e730 msgr2=0x7f51ec160440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:59.461 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.452+0000 7f51f0c8f640 1 --2- 172.21.15.39:0/2872023772 >> v2:172.21.15.118:3300/0 conn(0x7f51ec06e730 0x7f51ec160440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:59.461 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.452+0000 7f51f0c8f640 1 -- 172.21.15.39:0/2872023772 >> v1:172.21.15.39:6789/0 conn(0x7f51ec156490 legacy=0x7f51ec06e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:59.461 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.452+0000 7f51f0c8f640 1 -- 172.21.15.39:0/2872023772 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ec156860 con 0x7f51ec15c370 2023-05-16T13:54:59.462 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.452+0000 7f51eb7fe640 1 --2- 172.21.15.39:0/2872023772 >> v2:172.21.15.118:3300/0 conn(0x7f51ec06e730 0x7f51ec160440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-16T13:54:59.462 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.456+0000 7f51f0c8f640 1 --2- 172.21.15.39:0/2872023772 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51ec15c370 0x7f51ec15c810 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f51e4009d90 tx=0x7f51e401c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b5b459b1d010f2a server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:59.463 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.456+0000 7f51eaffd640 1 -- 172.21.15.39:0/2872023772 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e40a59e0 con 0x7f51ec15c370 2023-05-16T13:54:59.463 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.456+0000 7f51eaffd640 1 -- 172.21.15.39:0/2872023772 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51e40a5b40 con 0x7f51ec15c370 2023-05-16T13:54:59.463 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.456+0000 7f51eaffd640 1 -- 172.21.15.39:0/2872023772 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e40ad440 con 0x7f51ec15c370 2023-05-16T13:54:59.464 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.456+0000 7f51f1490640 1 -- 172.21.15.39:0/2872023772 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51ec15c370 msgr2=0x7f51ec15c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:59.464 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.456+0000 7f51f1490640 1 --2- 172.21.15.39:0/2872023772 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51ec15c370 0x7f51ec15c810 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f51e4009d90 tx=0x7f51e401c920 comp rx=0 tx=0).stop 2023-05-16T13:54:59.464 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.456+0000 7f51f1490640 1 -- 172.21.15.39:0/2872023772 shutdown_connections 2023-05-16T13:54:59.464 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.456+0000 7f51f1490640 1 --2- 172.21.15.39:0/2872023772 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51ec15c370 0x7f51ec15c810 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:59.464 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.456+0000 7f51f1490640 1 --2- 172.21.15.39:0/2872023772 >> v2:172.21.15.118:3300/0 conn(0x7f51ec06e730 0x7f51ec160440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:59.464 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.456+0000 7f51f1490640 1 -- 172.21.15.39:0/2872023772 >> 172.21.15.39:0/2872023772 conn(0x7f51ec065690 msgr2=0x7f51ec065a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:59.465 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.456+0000 7f51f1490640 1 -- 172.21.15.39:0/2872023772 shutdown_connections 2023-05-16T13:54:59.465 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.456+0000 7f51f1490640 1 -- 172.21.15.39:0/2872023772 wait complete. 2023-05-16T13:54:59.465 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.460+0000 7f51f1490640 1 Processor -- start 2023-05-16T13:54:59.465 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.460+0000 7f51f1490640 1 -- start start 2023-05-16T13:54:59.467 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.460+0000 7f51f1490640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51ec06e730 0x7f51ec14eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:59.468 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.460+0000 7f51f1490640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51ec156490 0x7f51ec0afd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:59.468 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.460+0000 7f51f1490640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51ec15c370 0x7f51ec0b0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:59.468 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.460+0000 7f51f1490640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec153a00 con 0x7f51ec156490 2023-05-16T13:54:59.468 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.460+0000 7f51f1490640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec0c6390 con 0x7f51ec15c370 2023-05-16T13:54:59.468 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.460+0000 7f51f1490640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec153c50 con 0x7f51ec06e730 2023-05-16T13:54:59.468 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.460+0000 7f51eb7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51ec156490 0x7f51ec0afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:59.468 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.460+0000 7f51eb7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51ec156490 0x7f51ec0afd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34838/0 (socket says 172.21.15.39:34838) 2023-05-16T13:54:59.468 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.460+0000 7f51eb7fe640 1 -- 172.21.15.39:0/2753495182 learned_addr learned my addr 172.21.15.39:0/2753495182 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:59.469 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.460+0000 7f51f0c8f640 1 --2- 172.21.15.39:0/2753495182 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51ec15c370 0x7f51ec0b0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:59.469 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.460+0000 7f51ebfff640 1 --2- 172.21.15.39:0/2753495182 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51ec06e730 0x7f51ec14eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:59.469 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.460+0000 7f51eb7fe640 1 -- 172.21.15.39:0/2753495182 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51ec06e730 msgr2=0x7f51ec14eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:59.469 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.460+0000 7f51eb7fe640 1 --2- 172.21.15.39:0/2753495182 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51ec06e730 0x7f51ec14eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:59.469 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.460+0000 7f51eb7fe640 1 -- 172.21.15.39:0/2753495182 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51ec15c370 msgr2=0x7f51ec0b0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:59.469 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.460+0000 7f51eb7fe640 1 --2- 172.21.15.39:0/2753495182 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51ec15c370 0x7f51ec0b0290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:59.469 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.460+0000 7f51eb7fe640 1 -- 172.21.15.39:0/2753495182 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e0009420 con 0x7f51ec156490 2023-05-16T13:54:59.470 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.460+0000 7f51f0c8f640 1 --2- 172.21.15.39:0/2753495182 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51ec15c370 0x7f51ec0b0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:54:59.470 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.460+0000 7f51ebfff640 1 --2- 172.21.15.39:0/2753495182 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51ec06e730 0x7f51ec14eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:54:59.470 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.460+0000 7f51eb7fe640 1 --2- 172.21.15.39:0/2753495182 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51ec156490 0x7f51ec0afd50 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f51e000e960 tx=0x7f51e000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:59.471 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.460+0000 7f51e8ff9640 1 -- 172.21.15.39:0/2753495182 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e000ca00 con 0x7f51ec156490 2023-05-16T13:54:59.471 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.460+0000 7f51e8ff9640 1 -- 172.21.15.39:0/2753495182 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51e000cb60 con 0x7f51ec156490 2023-05-16T13:54:59.471 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.460+0000 7f51e8ff9640 1 -- 172.21.15.39:0/2753495182 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e0013470 con 0x7f51ec156490 2023-05-16T13:54:59.471 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.460+0000 7f51f1490640 1 -- 172.21.15.39:0/2753495182 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51e4009a70 con 0x7f51ec156490 2023-05-16T13:54:59.471 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.460+0000 7f51f1490640 1 -- 172.21.15.39:0/2753495182 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51ec15f960 con 0x7f51ec156490 2023-05-16T13:54:59.471 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.464+0000 7f51f1490640 1 -- 172.21.15.39:0/2753495182 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51ec15d230 con 0x7f51ec156490 2023-05-16T13:54:59.472 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.464+0000 7f51e8ff9640 1 -- 172.21.15.39:0/2753495182 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f51e00135d0 con 0x7f51ec156490 2023-05-16T13:54:59.472 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.464+0000 7f51e8ff9640 1 --2- 172.21.15.39:0/2753495182 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f51d8066280 0x7f51d8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:59.472 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.464+0000 7f51e8ff9640 1 -- 172.21.15.39:0/2753495182 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f51e0084480 con 0x7f51ec156490 2023-05-16T13:54:59.472 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.464+0000 7f51ebfff640 1 --2- 172.21.15.39:0/2753495182 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f51d8066280 0x7f51d8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:59.472 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.464+0000 7f51ebfff640 1 --2- 172.21.15.39:0/2753495182 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f51d8066280 0x7f51d8068730 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f51dc0011f0 tx=0x7f51dc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:59.474 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.468+0000 7f51e8ff9640 1 -- 172.21.15.39:0/2753495182 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f51e0051820 con 0x7f51ec156490 2023-05-16T13:54:59.640 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.632+0000 7f51f1490640 1 -- 172.21.15.39:0/2753495182 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f51ec15fc40 con 0x7f51ec156490 2023-05-16T13:54:59.640 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.632+0000 7f51e8ff9640 1 -- 172.21.15.39:0/2753495182 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f51e0054e40 con 0x7f51ec156490 2023-05-16T13:54:59.640 INFO:teuthology.orchestra.run.smithi039.stderr:listed 0 entries 2023-05-16T13:54:59.642 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.636+0000 7f51f1490640 1 -- 172.21.15.39:0/2753495182 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f51d8066280 msgr2=0x7f51d8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:59.642 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.636+0000 7f51f1490640 1 --2- 172.21.15.39:0/2753495182 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f51d8066280 0x7f51d8068730 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f51dc0011f0 tx=0x7f51dc009040 comp rx=0 tx=0).stop 2023-05-16T13:54:59.642 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.636+0000 7f51f1490640 1 -- 172.21.15.39:0/2753495182 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51ec156490 msgr2=0x7f51ec0afd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:59.642 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.636+0000 7f51f1490640 1 --2- 172.21.15.39:0/2753495182 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51ec156490 0x7f51ec0afd50 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f51e000e960 tx=0x7f51e000ee20 comp rx=0 tx=0).stop 2023-05-16T13:54:59.643 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.636+0000 7f51f1490640 1 -- 172.21.15.39:0/2753495182 shutdown_connections 2023-05-16T13:54:59.643 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.636+0000 7f51f1490640 1 --2- 172.21.15.39:0/2753495182 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51ec15c370 0x7f51ec0b0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:59.643 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.636+0000 7f51f1490640 1 --2- 172.21.15.39:0/2753495182 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51ec156490 0x7f51ec0afd50 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:59.643 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.636+0000 7f51f1490640 1 --2- 172.21.15.39:0/2753495182 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f51d8066280 0x7f51d8068730 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:59.643 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.636+0000 7f51f1490640 1 --2- 172.21.15.39:0/2753495182 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51ec06e730 0x7f51ec14eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:59.643 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.636+0000 7f51f1490640 1 -- 172.21.15.39:0/2753495182 >> 172.21.15.39:0/2753495182 conn(0x7f51ec065690 msgr2=0x7f51ec06df00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:59.643 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.636+0000 7f51f1490640 1 -- 172.21.15.39:0/2753495182 shutdown_connections 2023-05-16T13:54:59.643 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.636+0000 7f51f1490640 1 -- 172.21.15.39:0/2753495182 wait complete. 2023-05-16T13:54:59.661 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi118.front.sepia.ceph.com... 2023-05-16T13:54:59.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:59.662 DEBUG:teuthology.orchestra.run.smithi118:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-05-16T13:54:59.693 INFO:teuthology.orchestra.run:waiting for 300 2023-05-16T13:54:59.693 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi118.front.sepia.ceph.com 2023-05-16T13:54:59.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:54:59.694 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-05-16T13:54:59.750 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-05-16T13:54:59.751 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-16T13:54:59.759 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-05-16T13:54:59.759 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-16T13:54:59.808 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-16T13:54:59.986 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.980+0000 7f2c8d70a640 1 Processor -- start 2023-05-16T13:54:59.986 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.980+0000 7f2c8d70a640 1 -- start start 2023-05-16T13:54:59.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.980+0000 7f2c8d70a640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2c880b5670 0x7f2c880b42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:59.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.980+0000 7f2c8d70a640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c880b5b10 0x7f2c880b47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:59.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.980+0000 7f2c8d70a640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c880ce150 con 0x7f2c8815c470 2023-05-16T13:54:59.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.980+0000 7f2c8d70a640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c880cd890 con 0x7f2c880b5670 2023-05-16T13:54:59.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.980+0000 7f2c8d70a640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c880cdb00 con 0x7f2c880b5b10 2023-05-16T13:54:59.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.980+0000 7f2c877fe640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c880b5b10 0x7f2c880b47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:59.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.980+0000 7f2c86ffd640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f2c8815c470 0x7f2c880d0720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.39:48340/0 (socket says 172.21.15.39:48340) 2023-05-16T13:54:59.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.980+0000 7f2c86ffd640 1 -- 172.21.15.39:0/281363157 learned_addr learned my addr 172.21.15.39:0/281363157 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:54:59.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.980+0000 7f2c7e7fc640 1 --2- 172.21.15.39:0/281363157 >> v2:172.21.15.118:3300/0 conn(0x7f2c880b5670 0x7f2c880b42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:59.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.980+0000 7f2c867fc640 1 -- 172.21.15.39:0/281363157 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3957236928 0 0) 0x7f2c880ce150 con 0x7f2c8815c470 2023-05-16T13:54:59.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.980+0000 7f2c867fc640 1 -- 172.21.15.39:0/281363157 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c74003530 con 0x7f2c8815c470 2023-05-16T13:54:59.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.980+0000 7f2c7e7fc640 1 -- 172.21.15.39:0/281363157 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c880b5b10 msgr2=0x7f2c880b47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:54:59.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.980+0000 7f2c7e7fc640 1 --2- 172.21.15.39:0/281363157 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c880b5b10 0x7f2c880b47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:59.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.980+0000 7f2c7e7fc640 1 -- 172.21.15.39:0/281363157 >> v1:172.21.15.118:6789/0 conn(0x7f2c8815c470 legacy=0x7f2c880d0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:59.990 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.980+0000 7f2c7e7fc640 1 -- 172.21.15.39:0/281363157 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c880cdde0 con 0x7f2c880b5670 2023-05-16T13:54:59.990 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.980+0000 7f2c877fe640 1 --2- 172.21.15.39:0/281363157 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c880b5b10 0x7f2c880b47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-16T13:54:59.991 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.984+0000 7f2c7e7fc640 1 --2- 172.21.15.39:0/281363157 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c880b5670 0x7f2c880b42a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2c700097c0 tx=0x7f2c7001c420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e45d3a23b7ea83 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:59.991 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.984+0000 7f2c867fc640 1 -- 172.21.15.39:0/281363157 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c700ac620 con 0x7f2c880b5670 2023-05-16T13:54:59.991 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.984+0000 7f2c867fc640 1 -- 172.21.15.39:0/281363157 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c700ac780 con 0x7f2c880b5670 2023-05-16T13:54:59.992 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.984+0000 7f2c867fc640 1 -- 172.21.15.39:0/281363157 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c700acb10 con 0x7f2c880b5670 2023-05-16T13:54:59.992 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.984+0000 7f2c8d70a640 1 -- 172.21.15.39:0/281363157 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c880b5670 msgr2=0x7f2c880b42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:59.992 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.984+0000 7f2c8d70a640 1 --2- 172.21.15.39:0/281363157 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c880b5670 0x7f2c880b42a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2c700097c0 tx=0x7f2c7001c420 comp rx=0 tx=0).stop 2023-05-16T13:54:59.993 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.984+0000 7f2c8d70a640 1 -- 172.21.15.39:0/281363157 shutdown_connections 2023-05-16T13:54:59.993 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.984+0000 7f2c8d70a640 1 --2- 172.21.15.39:0/281363157 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c880b5b10 0x7f2c880b47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:59.993 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.984+0000 7f2c8d70a640 1 --2- 172.21.15.39:0/281363157 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c880b5670 0x7f2c880b42a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:59.993 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.984+0000 7f2c8d70a640 1 -- 172.21.15.39:0/281363157 >> 172.21.15.39:0/281363157 conn(0x7f2c8809bae0 msgr2=0x7f2c880d2820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:54:59.993 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.984+0000 7f2c8d70a640 1 -- 172.21.15.39:0/281363157 shutdown_connections 2023-05-16T13:54:59.993 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.984+0000 7f2c8d70a640 1 -- 172.21.15.39:0/281363157 wait complete. 2023-05-16T13:54:59.994 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.988+0000 7f2c8d70a640 1 Processor -- start 2023-05-16T13:54:59.994 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.988+0000 7f2c8d70a640 1 -- start start 2023-05-16T13:54:59.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.988+0000 7f2c8d70a640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c880b5670 0x7f2c8815bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:59.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.988+0000 7f2c8d70a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c880b5b10 0x7f2c880c7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:59.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.988+0000 7f2c8d70a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c8815c470 0x7f2c88153780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:54:59.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.988+0000 7f2c8d70a640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c8815c320 con 0x7f2c880b5b10 2023-05-16T13:54:59.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.988+0000 7f2c8d70a640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c880c84e0 con 0x7f2c8815c470 2023-05-16T13:54:59.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.988+0000 7f2c8d70a640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c8815b0b0 con 0x7f2c880b5670 2023-05-16T13:54:59.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.988+0000 7f2c7e7fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c880b5b10 0x7f2c880c7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:59.997 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.988+0000 7f2c7e7fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c880b5b10 0x7f2c880c7fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34852/0 (socket says 172.21.15.39:34852) 2023-05-16T13:54:59.997 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.988+0000 7f2c7e7fc640 1 -- 172.21.15.39:0/3504651984 learned_addr learned my addr 172.21.15.39:0/3504651984 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:54:59.997 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.988+0000 7f2c877fe640 1 --2- 172.21.15.39:0/3504651984 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c8815c470 0x7f2c88153780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:59.997 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.988+0000 7f2c86ffd640 1 --2- 172.21.15.39:0/3504651984 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c880b5670 0x7f2c8815bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:54:59.997 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.988+0000 7f2c7e7fc640 1 -- 172.21.15.39:0/3504651984 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c880b5670 msgr2=0x7f2c8815bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:59.997 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.988+0000 7f2c7e7fc640 1 --2- 172.21.15.39:0/3504651984 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c880b5670 0x7f2c8815bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:59.997 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.988+0000 7f2c7e7fc640 1 -- 172.21.15.39:0/3504651984 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c8815c470 msgr2=0x7f2c88153780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:54:59.997 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.988+0000 7f2c7e7fc640 1 --2- 172.21.15.39:0/3504651984 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c8815c470 0x7f2c88153780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:54:59.998 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.988+0000 7f2c7e7fc640 1 -- 172.21.15.39:0/3504651984 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c80009420 con 0x7f2c880b5b10 2023-05-16T13:54:59.998 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.988+0000 7f2c877fe640 1 --2- 172.21.15.39:0/3504651984 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c8815c470 0x7f2c88153780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:54:59.999 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.988+0000 7f2c7e7fc640 1 --2- 172.21.15.39:0/3504651984 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c880b5b10 0x7f2c880c7fa0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2c700af040 tx=0x7f2c70019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:54:59.999 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.988+0000 7f2c7ffff640 1 -- 172.21.15.39:0/3504651984 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c700ac620 con 0x7f2c880b5b10 2023-05-16T13:54:59.999 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.988+0000 7f2c7ffff640 1 -- 172.21.15.39:0/3504651984 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c700b5410 con 0x7f2c880b5b10 2023-05-16T13:54:59.999 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.988+0000 7f2c8d70a640 1 -- 172.21.15.39:0/3504651984 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c70009420 con 0x7f2c880b5b10 2023-05-16T13:54:59.999 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.988+0000 7f2c7ffff640 1 -- 172.21.15.39:0/3504651984 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c700b57a0 con 0x7f2c880b5b10 2023-05-16T13:54:59.999 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.992+0000 7f2c8d70a640 1 -- 172.21.15.39:0/3504651984 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c880b5060 con 0x7f2c880b5b10 2023-05-16T13:54:59.999 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.992+0000 7f2c8d70a640 1 -- 172.21.15.39:0/3504651984 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c880d0ee0 con 0x7f2c880b5b10 2023-05-16T13:55:00.000 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.992+0000 7f2c7ffff640 1 -- 172.21.15.39:0/3504651984 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2c700b3040 con 0x7f2c880b5b10 2023-05-16T13:55:00.000 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.992+0000 7f2c7ffff640 1 --2- 172.21.15.39:0/3504651984 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f2c68066280 0x7f2c68068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:00.000 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.992+0000 7f2c7ffff640 1 -- 172.21.15.39:0/3504651984 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f2c7011db50 con 0x7f2c880b5b10 2023-05-16T13:55:00.001 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.992+0000 7f2c86ffd640 1 --2- 172.21.15.39:0/3504651984 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f2c68066280 0x7f2c68068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:00.001 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.992+0000 7f2c86ffd640 1 --2- 172.21.15.39:0/3504651984 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f2c68066280 0x7f2c68068730 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2c780015c0 tx=0x7f2c78009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:00.003 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:54:59.996+0000 7f2c7ffff640 1 -- 172.21.15.39:0/3504651984 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f2c700eaf90 con 0x7f2c880b5b10 2023-05-16T13:55:00.177 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.172+0000 7f2c8d70a640 1 -- 172.21.15.39:0/3504651984 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2c880b51f0 con 0x7f2c880b5b10 2023-05-16T13:55:00.178 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.172+0000 7f2c7ffff640 1 -- 172.21.15.39:0/3504651984 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18375 (secure 0 0 0) 0x7f2c700b1090 con 0x7f2c880b5b10 2023-05-16T13:55:00.178 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:55:00.178 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":26,"fsid":"9c1e210b-c515-4ea4-a065-397956895c68","created":"2023-05-16T13:53:48.955290+0000","modified":"2023-05-16T13:54:56.831431+0000","last_up_change":"2023-05-16T13:54:01.722051+0000","last_in_change":"2023-05-16T13:53:52.331336+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-16T13:54:00.885009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-16T13:54:08.327895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-16T13:54:12.864823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-16T13:54:14.180225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4ce0f0ba-c4bf-4405-8c95-d2e9a62878ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6809","nonce":3462013698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6811","nonce":3462013698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6815","nonce":3462013698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6813","nonce":3462013698}]},"public_addr":"172.21.15.39:6809/3462013698","cluster_addr":"172.21.15.39:6811/3462013698","heartbeat_back_addr":"172.21.15.39:6815/3462013698","heartbeat_front_addr":"172.21.15.39:6813/3462013698","state":["exists","up"]},{"osd":1,"uuid":"53fdc1ac-2473-472d-af32-2760fdf6e476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6801","nonce":2829970892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6803","nonce":2829970892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6807","nonce":2829970892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6805","nonce":2829970892}]},"public_addr":"172.21.15.39:6801/2829970892","cluster_addr":"172.21.15.39:6803/2829970892","heartbeat_back_addr":"172.21.15.39:6807/2829970892","heartbeat_front_addr":"172.21.15.39:6805/2829970892","state":["exists","up"]},{"osd":2,"uuid":"0b92d770-7030-42fa-a19f-4f7f1ac113c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6817","nonce":3888067413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6819","nonce":3888067413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6823","nonce":3888067413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6821","nonce":3888067413}]},"public_addr":"172.21.15.39:6817/3888067413","cluster_addr":"172.21.15.39:6819/3888067413","heartbeat_back_addr":"172.21.15.39:6823/3888067413","heartbeat_front_addr":"172.21.15.39:6821/3888067413","state":["exists","up"]},{"osd":3,"uuid":"000d9506-cbb2-4017-b875-deca579860ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6825","nonce":405003958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6827","nonce":405003958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6831","nonce":405003958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6829","nonce":405003958}]},"public_addr":"172.21.15.39:6825/405003958","cluster_addr":"172.21.15.39:6827/405003958","heartbeat_back_addr":"172.21.15.39:6831/405003958","heartbeat_front_addr":"172.21.15.39:6829/405003958","state":["exists","up"]},{"osd":4,"uuid":"70f0dacb-e960-40c5-bf6a-183e52bbe2ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6801","nonce":3895278838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6805","nonce":3895278838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6813","nonce":3895278838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6809","nonce":3895278838}]},"public_addr":"172.21.15.118:6801/3895278838","cluster_addr":"172.21.15.118:6805/3895278838","heartbeat_back_addr":"172.21.15.118:6813/3895278838","heartbeat_front_addr":"172.21.15.118:6809/3895278838","state":["exists","up"]},{"osd":5,"uuid":"756feb54-c3ae-4a2a-8f74-85c291ba707c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6804","nonce":3513592808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6808","nonce":3513592808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6815","nonce":3513592808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6812","nonce":3513592808}]},"public_addr":"172.21.15.118:6804/3513592808","cluster_addr":"172.21.15.118:6808/3513592808","heartbeat_back_addr":"172.21.15.118:6815/3513592808","heartbeat_front_addr":"172.21.15.118:6812/3513592808","state":["exists","up"]},{"osd":6,"uuid":"c4a982c1-f497-4b0f-8a23-c77372e4621e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6824","nonce":1863656053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6827","nonce":1863656053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6831","nonce":1863656053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6829","nonce":1863656053}]},"public_addr":"172.21.15.118:6824/1863656053","cluster_addr":"172.21.15.118:6827/1863656053","heartbeat_back_addr":"172.21.15.118:6831/1863656053","heartbeat_front_addr":"172.21.15.118:6829/1863656053","state":["exists","up"]},{"osd":7,"uuid":"6f2888aa-a7ac-4e26-9159-e31817934f44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6817","nonce":3636642904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6819","nonce":3636642904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6825","nonce":3636642904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6821","nonce":3636642904}]},"public_addr":"172.21.15.118:6817/3636642904","cluster_addr":"172.21.15.118:6819/3636642904","heartbeat_back_addr":"172.21.15.118:6825/3636642904","heartbeat_front_addr":"172.21.15.118:6821/3636642904","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.717636+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.724036+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.739144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:58.079275+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:58.073921+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.930466+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.987813+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.941098+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.24","mappings":[{"from":1,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-16T13:55:00.180 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.172+0000 7f2c8d70a640 1 -- 172.21.15.39:0/3504651984 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f2c68066280 msgr2=0x7f2c68068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:00.180 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.172+0000 7f2c8d70a640 1 --2- 172.21.15.39:0/3504651984 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f2c68066280 0x7f2c68068730 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2c780015c0 tx=0x7f2c78009040 comp rx=0 tx=0).stop 2023-05-16T13:55:00.180 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.172+0000 7f2c8d70a640 1 -- 172.21.15.39:0/3504651984 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c880b5b10 msgr2=0x7f2c880c7fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:00.180 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.172+0000 7f2c8d70a640 1 --2- 172.21.15.39:0/3504651984 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c880b5b10 0x7f2c880c7fa0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2c700af040 tx=0x7f2c70019220 comp rx=0 tx=0).stop 2023-05-16T13:55:00.180 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.172+0000 7f2c8d70a640 1 -- 172.21.15.39:0/3504651984 shutdown_connections 2023-05-16T13:55:00.180 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.172+0000 7f2c8d70a640 1 --2- 172.21.15.39:0/3504651984 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c8815c470 0x7f2c88153780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:00.181 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.172+0000 7f2c8d70a640 1 --2- 172.21.15.39:0/3504651984 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c880b5b10 0x7f2c880c7fa0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:00.181 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.172+0000 7f2c8d70a640 1 --2- 172.21.15.39:0/3504651984 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f2c68066280 0x7f2c68068730 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:00.181 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.172+0000 7f2c8d70a640 1 --2- 172.21.15.39:0/3504651984 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c880b5670 0x7f2c8815bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:00.181 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.172+0000 7f2c8d70a640 1 -- 172.21.15.39:0/3504651984 >> 172.21.15.39:0/3504651984 conn(0x7f2c8809bae0 msgr2=0x7f2c880ccdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:00.181 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.172+0000 7f2c8d70a640 1 -- 172.21.15.39:0/3504651984 shutdown_connections 2023-05-16T13:55:00.182 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.172+0000 7f2c8d70a640 1 -- 172.21.15.39:0/3504651984 wait complete. 2023-05-16T13:55:00.199 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-16T13:54:00.885009+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-16T13:54:08.327895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-16T13:54:12.864823+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-16T13:54:14.180225+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-16T13:55:00.200 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-16T13:55:00.341 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.336+0000 7fc1eacf9640 1 Processor -- start 2023-05-16T13:55:00.341 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.336+0000 7fc1eacf9640 1 -- start start 2023-05-16T13:55:00.342 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.336+0000 7fc1eacf9640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc1e40b10a0 0x7fc1e40d2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:00.342 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.336+0000 7fc1eacf9640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc1e40d2ed0 0x7fc1e40d0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:00.342 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.336+0000 7fc1eacf9640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1e40d0db0 con 0x7fc1e40d0950 2023-05-16T13:55:00.342 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.336+0000 7fc1eacf9640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1e406c610 con 0x7fc1e40b10a0 2023-05-16T13:55:00.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.336+0000 7fc1eacf9640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e406caa0 con 0x7fc1e40d2ed0 2023-05-16T13:55:00.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.336+0000 7fc1e8a95640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc1e40b10a0 0x7fc1e40d2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:00.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.336+0000 7fc1e8a95640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc1e40b10a0 0x7fc1e40d2990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34860/0 (socket says 172.21.15.39:34860) 2023-05-16T13:55:00.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.336+0000 7fc1e8a95640 1 -- 172.21.15.39:0/74162614 learned_addr learned my addr 172.21.15.39:0/74162614 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:00.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.336+0000 7fc1e3fff640 1 --2- 172.21.15.39:0/74162614 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc1e40d2ed0 0x7fc1e40d0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:00.344 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.336+0000 7fc1e8a95640 1 -- 172.21.15.39:0/74162614 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc1e40d2ed0 msgr2=0x7fc1e40d0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:00.344 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.336+0000 7fc1e8a95640 1 --2- 172.21.15.39:0/74162614 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc1e40d2ed0 0x7fc1e40d0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:00.344 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.336+0000 7fc1e8a95640 1 -- 172.21.15.39:0/74162614 >> v1:172.21.15.118:6789/0 conn(0x7fc1e40d0950 legacy=0x7fc1e415faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:00.344 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.336+0000 7fc1e8a95640 1 -- 172.21.15.39:0/74162614 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e406ba00 con 0x7fc1e40b10a0 2023-05-16T13:55:00.345 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.340+0000 7fc1e8a95640 1 --2- 172.21.15.39:0/74162614 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc1e40b10a0 0x7fc1e40d2990 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc1d8009870 tx=0x7fc1d801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=205e5b1523e2b792 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:00.346 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.340+0000 7fc1e37fe640 1 -- 172.21.15.39:0/74162614 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d80a7070 con 0x7fc1e40b10a0 2023-05-16T13:55:00.346 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.340+0000 7fc1e37fe640 1 -- 172.21.15.39:0/74162614 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1d80ab430 con 0x7fc1e40b10a0 2023-05-16T13:55:00.346 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.340+0000 7fc1e37fe640 1 -- 172.21.15.39:0/74162614 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d80ab7c0 con 0x7fc1e40b10a0 2023-05-16T13:55:00.347 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.340+0000 7fc1eacf9640 1 -- 172.21.15.39:0/74162614 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc1e40b10a0 msgr2=0x7fc1e40d2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:00.347 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.340+0000 7fc1eacf9640 1 --2- 172.21.15.39:0/74162614 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc1e40b10a0 0x7fc1e40d2990 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc1d8009870 tx=0x7fc1d801c510 comp rx=0 tx=0).stop 2023-05-16T13:55:00.347 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.340+0000 7fc1eacf9640 1 -- 172.21.15.39:0/74162614 shutdown_connections 2023-05-16T13:55:00.347 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.340+0000 7fc1eacf9640 1 --2- 172.21.15.39:0/74162614 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc1e40d2ed0 0x7fc1e40d0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:00.347 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.340+0000 7fc1eacf9640 1 --2- 172.21.15.39:0/74162614 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc1e40b10a0 0x7fc1e40d2990 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:00.347 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.340+0000 7fc1eacf9640 1 -- 172.21.15.39:0/74162614 >> 172.21.15.39:0/74162614 conn(0x7fc1e409bba0 msgr2=0x7fc1e4089fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:00.348 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.340+0000 7fc1eacf9640 1 -- 172.21.15.39:0/74162614 shutdown_connections 2023-05-16T13:55:00.348 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.340+0000 7fc1eacf9640 1 -- 172.21.15.39:0/74162614 wait complete. 2023-05-16T13:55:00.348 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.340+0000 7fc1eacf9640 1 Processor -- start 2023-05-16T13:55:00.348 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.340+0000 7fc1eacf9640 1 -- start start 2023-05-16T13:55:00.349 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.344+0000 7fc1eacf9640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc1e40b10a0 0x7fc1e415c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:00.349 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.344+0000 7fc1eacf9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc1e40d0950 0x7fc1e4165310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:00.350 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.344+0000 7fc1eacf9640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc1e40d2ed0 0x7fc1e409da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:00.350 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.344+0000 7fc1eacf9640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e409fb50 con 0x7fc1e40d0950 2023-05-16T13:55:00.350 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.344+0000 7fc1eacf9640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e409fe30 con 0x7fc1e40b10a0 2023-05-16T13:55:00.350 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.344+0000 7fc1eacf9640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e40a0110 con 0x7fc1e40d2ed0 2023-05-16T13:55:00.351 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.344+0000 7fc1e3fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc1e40d0950 0x7fc1e4165310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:00.351 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.344+0000 7fc1e3fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc1e40d0950 0x7fc1e4165310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34862/0 (socket says 172.21.15.39:34862) 2023-05-16T13:55:00.351 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.344+0000 7fc1e3fff640 1 -- 172.21.15.39:0/2197792094 learned_addr learned my addr 172.21.15.39:0/2197792094 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:00.352 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.344+0000 7fc1e8a95640 1 --2- 172.21.15.39:0/2197792094 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc1e40b10a0 0x7fc1e415c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:00.353 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.344+0000 7fc1e9296640 1 --2- 172.21.15.39:0/2197792094 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc1e40d2ed0 0x7fc1e409da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:00.353 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.344+0000 7fc1e3fff640 1 -- 172.21.15.39:0/2197792094 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc1e40d2ed0 msgr2=0x7fc1e409da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:00.353 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.344+0000 7fc1e3fff640 1 --2- 172.21.15.39:0/2197792094 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc1e40d2ed0 0x7fc1e409da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:00.353 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.344+0000 7fc1e3fff640 1 -- 172.21.15.39:0/2197792094 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc1e40b10a0 msgr2=0x7fc1e415c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:00.353 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.344+0000 7fc1e3fff640 1 --2- 172.21.15.39:0/2197792094 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc1e40b10a0 0x7fc1e415c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:00.353 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.344+0000 7fc1e3fff640 1 -- 172.21.15.39:0/2197792094 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d80094d0 con 0x7fc1e40d0950 2023-05-16T13:55:00.353 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.344+0000 7fc1e3fff640 1 --2- 172.21.15.39:0/2197792094 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc1e40d0950 0x7fc1e4165310 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fc1d000e930 tx=0x7fc1d000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:00.354 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.344+0000 7fc1e17fa640 1 -- 172.21.15.39:0/2197792094 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d0009690 con 0x7fc1e40d0950 2023-05-16T13:55:00.354 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.344+0000 7fc1e17fa640 1 -- 172.21.15.39:0/2197792094 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1d000ca00 con 0x7fc1e40d0950 2023-05-16T13:55:00.354 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.344+0000 7fc1e17fa640 1 -- 172.21.15.39:0/2197792094 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d000cd70 con 0x7fc1e40d0950 2023-05-16T13:55:00.354 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.344+0000 7fc1eacf9640 1 -- 172.21.15.39:0/2197792094 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1e40b1470 con 0x7fc1e40d0950 2023-05-16T13:55:00.354 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.344+0000 7fc1eacf9640 1 -- 172.21.15.39:0/2197792094 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1e406c2a0 con 0x7fc1e40d0950 2023-05-16T13:55:00.354 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.344+0000 7fc1eacf9640 1 -- 172.21.15.39:0/2197792094 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1e40b04a0 con 0x7fc1e40d0950 2023-05-16T13:55:00.354 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.348+0000 7fc1e17fa640 1 -- 172.21.15.39:0/2197792094 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc1d0013470 con 0x7fc1e40d0950 2023-05-16T13:55:00.355 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.348+0000 7fc1e17fa640 1 --2- 172.21.15.39:0/2197792094 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc1c8066280 0x7fc1c8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:00.355 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.348+0000 7fc1e17fa640 1 -- 172.21.15.39:0/2197792094 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fc1d00840d0 con 0x7fc1e40d0950 2023-05-16T13:55:00.355 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.348+0000 7fc1e8a95640 1 --2- 172.21.15.39:0/2197792094 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc1c8066280 0x7fc1c8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:00.356 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.348+0000 7fc1e8a95640 1 --2- 172.21.15.39:0/2197792094 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc1c8066280 0x7fc1c8068730 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc1d80af000 tx=0x7fc1d8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:00.358 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.352+0000 7fc1e17fa640 1 -- 172.21.15.39:0/2197792094 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fc1d0051530 con 0x7fc1e40d0950 2023-05-16T13:55:00.510 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.504+0000 7fc1eacf9640 1 -- 172.21.15.39:0/2197792094 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc1e4073c90 con 0x7fc1e40d0950 2023-05-16T13:55:00.511 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.504+0000 7fc1e17fa640 1 -- 172.21.15.39:0/2197792094 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc1d0054b50 con 0x7fc1e40d0950 2023-05-16T13:55:00.512 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2023-05-16T13:55:00.513 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.508+0000 7fc1eacf9640 1 -- 172.21.15.39:0/2197792094 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc1c8066280 msgr2=0x7fc1c8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:00.513 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.508+0000 7fc1eacf9640 1 --2- 172.21.15.39:0/2197792094 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc1c8066280 0x7fc1c8068730 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc1d80af000 tx=0x7fc1d8008040 comp rx=0 tx=0).stop 2023-05-16T13:55:00.513 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.508+0000 7fc1eacf9640 1 -- 172.21.15.39:0/2197792094 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc1e40d0950 msgr2=0x7fc1e4165310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:00.513 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.508+0000 7fc1eacf9640 1 --2- 172.21.15.39:0/2197792094 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc1e40d0950 0x7fc1e4165310 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fc1d000e930 tx=0x7fc1d000edf0 comp rx=0 tx=0).stop 2023-05-16T13:55:00.513 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.508+0000 7fc1eacf9640 1 -- 172.21.15.39:0/2197792094 shutdown_connections 2023-05-16T13:55:00.514 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.508+0000 7fc1eacf9640 1 --2- 172.21.15.39:0/2197792094 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc1c8066280 0x7fc1c8068730 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:00.514 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.508+0000 7fc1eacf9640 1 --2- 172.21.15.39:0/2197792094 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc1e40d2ed0 0x7fc1e409da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:00.514 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.508+0000 7fc1eacf9640 1 --2- 172.21.15.39:0/2197792094 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc1e40d0950 0x7fc1e4165310 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:00.514 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.508+0000 7fc1eacf9640 1 --2- 172.21.15.39:0/2197792094 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc1e40b10a0 0x7fc1e415c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:00.514 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.508+0000 7fc1eacf9640 1 -- 172.21.15.39:0/2197792094 >> 172.21.15.39:0/2197792094 conn(0x7fc1e409bba0 msgr2=0x7fc1e4089fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:00.514 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.508+0000 7fc1eacf9640 1 -- 172.21.15.39:0/2197792094 shutdown_connections 2023-05-16T13:55:00.514 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.508+0000 7fc1eacf9640 1 -- 172.21.15.39:0/2197792094 wait complete. 2023-05-16T13:55:00.532 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-16T13:55:00.672 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.664+0000 7f235759e640 1 Processor -- start 2023-05-16T13:55:00.672 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.664+0000 7f235759e640 1 -- start start 2023-05-16T13:55:00.673 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.668+0000 7f235759e640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f23580b03e0 0x7f2358156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:00.673 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.668+0000 7f235759e640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23580c9c50 con 0x7f23580cb740 2023-05-16T13:55:00.673 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.668+0000 7f235759e640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23580c98b0 con 0x7f23580b3ed0 2023-05-16T13:55:00.674 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.668+0000 7f235759e640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f235806cb10 con 0x7f23580b03e0 2023-05-16T13:55:00.674 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.668+0000 7f2356d9d640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f23580b03e0 0x7f2358156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:00.674 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.668+0000 7f2356d9d640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f23580b03e0 0x7f2358156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34524/0 (socket says 172.21.15.39:34524) 2023-05-16T13:55:00.674 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.668+0000 7f2356d9d640 1 -- 172.21.15.39:0/1424132497 learned_addr learned my addr 172.21.15.39:0/1424132497 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:00.674 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.668+0000 7f235659c640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f23580cb740 0x7f235806c2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:51006/0 (socket says 172.21.15.39:51006) 2023-05-16T13:55:00.675 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.668+0000 7f2356d9d640 1 -- 172.21.15.39:0/1424132497 >> v1:172.21.15.118:6789/0 conn(0x7f23580b3ed0 legacy=0x7f23580afcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:00.675 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.668+0000 7f2356d9d640 1 -- 172.21.15.39:0/1424132497 >> v1:172.21.15.39:6789/0 conn(0x7f23580cb740 legacy=0x7f235806c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:00.675 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.668+0000 7f2356d9d640 1 -- 172.21.15.39:0/1424132497 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23580cbb10 con 0x7f23580b03e0 2023-05-16T13:55:00.675 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.668+0000 7f2355d9b640 1 -- 172.21.15.39:0/1424132497 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2798335467 0 0) 0x7f23580c9c50 con 0x7f23580cb740 2023-05-16T13:55:00.676 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.668+0000 7f2356d9d640 1 --2- 172.21.15.39:0/1424132497 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f23580b03e0 0x7f2358156e90 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2350009e50 tx=0x7f235001c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83d642fdc039688d server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:00.676 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.668+0000 7f2355d9b640 1 -- 172.21.15.39:0/1424132497 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23500a5640 con 0x7f23580b03e0 2023-05-16T13:55:00.677 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.668+0000 7f2355d9b640 1 -- 172.21.15.39:0/1424132497 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23500a57a0 con 0x7f23580b03e0 2023-05-16T13:55:00.677 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.668+0000 7f2355d9b640 1 -- 172.21.15.39:0/1424132497 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23500a5b30 con 0x7f23580b03e0 2023-05-16T13:55:00.678 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.672+0000 7f235759e640 1 -- 172.21.15.39:0/1424132497 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f23580b03e0 msgr2=0x7f2358156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:00.678 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.672+0000 7f235759e640 1 --2- 172.21.15.39:0/1424132497 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f23580b03e0 0x7f2358156e90 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2350009e50 tx=0x7f235001c980 comp rx=0 tx=0).stop 2023-05-16T13:55:00.678 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.672+0000 7f235759e640 1 -- 172.21.15.39:0/1424132497 shutdown_connections 2023-05-16T13:55:00.678 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.672+0000 7f235759e640 1 --2- 172.21.15.39:0/1424132497 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f23580b03e0 0x7f2358156e90 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:00.678 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.672+0000 7f235759e640 1 -- 172.21.15.39:0/1424132497 >> 172.21.15.39:0/1424132497 conn(0x7f2358069a50 msgr2=0x7f2358069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:00.678 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.672+0000 7f235759e640 1 -- 172.21.15.39:0/1424132497 shutdown_connections 2023-05-16T13:55:00.678 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.672+0000 7f235759e640 1 -- 172.21.15.39:0/1424132497 wait complete. 2023-05-16T13:55:00.679 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.672+0000 7f235759e640 1 Processor -- start 2023-05-16T13:55:00.679 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.672+0000 7f235759e640 1 -- start start 2023-05-16T13:55:00.680 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.672+0000 7f235759e640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f23580b03e0 0x7f2358150070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:00.681 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.672+0000 7f235759e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f23580b3ed0 0x7f23580cd090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:00.681 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.672+0000 7f235759e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23580cb740 0x7f2358152a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:00.681 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.672+0000 7f235759e640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2358150d10 con 0x7f23580b3ed0 2023-05-16T13:55:00.681 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.672+0000 7f235759e640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23580cd5d0 con 0x7f23580cb740 2023-05-16T13:55:00.681 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.672+0000 7f235759e640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23580b1590 con 0x7f23580b03e0 2023-05-16T13:55:00.682 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.672+0000 7f234ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f23580b3ed0 0x7f23580cd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:00.682 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.672+0000 7f234ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f23580b3ed0 0x7f23580cd090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34530/0 (socket says 172.21.15.39:34530) 2023-05-16T13:55:00.682 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.672+0000 7f234ffff640 1 -- 172.21.15.39:0/2456884105 learned_addr learned my addr 172.21.15.39:0/2456884105 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:00.682 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.672+0000 7f2356d9d640 1 --2- 172.21.15.39:0/2456884105 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23580cb740 0x7f2358152a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:00.682 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.672+0000 7f235659c640 1 --2- 172.21.15.39:0/2456884105 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f23580b03e0 0x7f2358150070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:00.682 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.676+0000 7f234ffff640 1 -- 172.21.15.39:0/2456884105 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f23580b03e0 msgr2=0x7f2358150070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:00.682 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.676+0000 7f234ffff640 1 --2- 172.21.15.39:0/2456884105 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f23580b03e0 0x7f2358150070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:00.683 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.676+0000 7f234ffff640 1 -- 172.21.15.39:0/2456884105 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23580cb740 msgr2=0x7f2358152a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:00.683 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.676+0000 7f234ffff640 1 --2- 172.21.15.39:0/2456884105 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23580cb740 0x7f2358152a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:00.683 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.676+0000 7f234ffff640 1 -- 172.21.15.39:0/2456884105 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2350009b30 con 0x7f23580b3ed0 2023-05-16T13:55:00.683 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.676+0000 7f235659c640 1 --2- 172.21.15.39:0/2456884105 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f23580b03e0 0x7f2358150070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:55:00.683 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.676+0000 7f234ffff640 1 --2- 172.21.15.39:0/2456884105 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f23580b3ed0 0x7f23580cd090 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f234000c3f0 tx=0x7f234000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:00.684 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.676+0000 7f234effd640 1 -- 172.21.15.39:0/2456884105 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23400052d0 con 0x7f23580b3ed0 2023-05-16T13:55:00.684 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.676+0000 7f234effd640 1 -- 172.21.15.39:0/2456884105 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2340005430 con 0x7f23580b3ed0 2023-05-16T13:55:00.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.676+0000 7f235759e640 1 -- 172.21.15.39:0/2456884105 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f235815ac20 con 0x7f23580b3ed0 2023-05-16T13:55:00.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.676+0000 7f234effd640 1 -- 172.21.15.39:0/2456884105 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2340003840 con 0x7f23580b3ed0 2023-05-16T13:55:00.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.676+0000 7f235759e640 1 -- 172.21.15.39:0/2456884105 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f235815a940 con 0x7f23580b3ed0 2023-05-16T13:55:00.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.676+0000 7f235759e640 1 -- 172.21.15.39:0/2456884105 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2358167b10 con 0x7f23580b3ed0 2023-05-16T13:55:00.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.676+0000 7f234effd640 1 -- 172.21.15.39:0/2456884105 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f23400039a0 con 0x7f23580b3ed0 2023-05-16T13:55:00.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.676+0000 7f234effd640 1 --2- 172.21.15.39:0/2456884105 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f2338066280 0x7f2338068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:00.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.676+0000 7f234effd640 1 -- 172.21.15.39:0/2456884105 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f23400832a0 con 0x7f23580b3ed0 2023-05-16T13:55:00.686 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.676+0000 7f235659c640 1 --2- 172.21.15.39:0/2456884105 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f2338066280 0x7f2338068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:00.686 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.680+0000 7f235659c640 1 --2- 172.21.15.39:0/2456884105 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f2338066280 0x7f2338068730 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2348000f70 tx=0x7f2348007c60 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:00.688 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.680+0000 7f234effd640 1 -- 172.21.15.39:0/2456884105 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f23400506f0 con 0x7f23580b3ed0 2023-05-16T13:55:00.841 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.836+0000 7f235759e640 1 -- 172.21.15.39:0/2456884105 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f235804ed70 con 0x7f23580b3ed0 2023-05-16T13:55:00.841 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.836+0000 7f234effd640 1 -- 172.21.15.39:0/2456884105 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2340053d10 con 0x7f23580b3ed0 2023-05-16T13:55:00.841 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 8 2023-05-16T13:55:00.844 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.836+0000 7f235759e640 1 -- 172.21.15.39:0/2456884105 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f2338066280 msgr2=0x7f2338068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:00.844 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.836+0000 7f235759e640 1 --2- 172.21.15.39:0/2456884105 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f2338066280 0x7f2338068730 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2348000f70 tx=0x7f2348007c60 comp rx=0 tx=0).stop 2023-05-16T13:55:00.844 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.836+0000 7f235759e640 1 -- 172.21.15.39:0/2456884105 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f23580b3ed0 msgr2=0x7f23580cd090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:00.844 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.836+0000 7f235759e640 1 --2- 172.21.15.39:0/2456884105 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f23580b3ed0 0x7f23580cd090 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f234000c3f0 tx=0x7f234000c8b0 comp rx=0 tx=0).stop 2023-05-16T13:55:00.844 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.836+0000 7f235759e640 1 -- 172.21.15.39:0/2456884105 shutdown_connections 2023-05-16T13:55:00.845 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.836+0000 7f235759e640 1 --2- 172.21.15.39:0/2456884105 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23580cb740 0x7f2358152a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:00.845 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.836+0000 7f235759e640 1 --2- 172.21.15.39:0/2456884105 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f23580b3ed0 0x7f23580cd090 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:00.845 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.836+0000 7f235759e640 1 --2- 172.21.15.39:0/2456884105 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f2338066280 0x7f2338068730 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:00.845 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.836+0000 7f235759e640 1 --2- 172.21.15.39:0/2456884105 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f23580b03e0 0x7f2358150070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:00.845 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.836+0000 7f235759e640 1 -- 172.21.15.39:0/2456884105 >> 172.21.15.39:0/2456884105 conn(0x7f2358069a50 msgr2=0x7f235806c090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:00.845 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.836+0000 7f235759e640 1 -- 172.21.15.39:0/2456884105 shutdown_connections 2023-05-16T13:55:00.845 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:00.836+0000 7f235759e640 1 -- 172.21.15.39:0/2456884105 wait complete. 2023-05-16T13:55:00.863 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-16T13:55:01.062 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.056+0000 7fa3840c4640 1 Processor -- start 2023-05-16T13:55:01.062 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.056+0000 7fa3840c4640 1 -- start start 2023-05-16T13:55:01.063 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.056+0000 7fa3840c4640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa37c0d0410 0x7fa37c0d07e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:01.063 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.056+0000 7fa3840c4640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa37c0d3210 con 0x7fa37c0af490 2023-05-16T13:55:01.064 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.056+0000 7fa3840c4640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa37c0d0d20 con 0x7fa37c06b620 2023-05-16T13:55:01.064 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.056+0000 7fa3840c4640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa37c15c620 con 0x7fa37c0d0410 2023-05-16T13:55:01.065 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.056+0000 7fa382661640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fa37c0af490 0x7fa37c0af930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:51020/0 (socket says 172.21.15.39:51020) 2023-05-16T13:55:01.065 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.056+0000 7fa382661640 1 -- 172.21.15.39:0/1789119423 learned_addr learned my addr 172.21.15.39:0/1789119423 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:55:01.065 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.056+0000 7fa381e60640 1 --2- 172.21.15.39:0/1789119423 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa37c0d0410 0x7fa37c0d07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:01.065 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.056+0000 7fa380e5e640 1 -- 172.21.15.39:0/1789119423 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1231238807 0 0) 0x7fa37c0d3210 con 0x7fa37c0af490 2023-05-16T13:55:01.065 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.056+0000 7fa380e5e640 1 -- 172.21.15.39:0/1789119423 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa368003530 con 0x7fa37c0af490 2023-05-16T13:55:01.065 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.056+0000 7fa380e5e640 1 -- 172.21.15.39:0/1789119423 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1254572959 0 0) 0x7fa37c0d0d20 con 0x7fa37c06b620 2023-05-16T13:55:01.065 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.056+0000 7fa380e5e640 1 -- 172.21.15.39:0/1789119423 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa37c0d3210 con 0x7fa37c06b620 2023-05-16T13:55:01.066 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.056+0000 7fa381e60640 1 -- 172.21.15.39:0/1789119423 >> v1:172.21.15.118:6789/0 conn(0x7fa37c06b620 legacy=0x7fa37c0d2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:01.066 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.056+0000 7fa381e60640 1 -- 172.21.15.39:0/1789119423 >> v1:172.21.15.39:6789/0 conn(0x7fa37c0af490 legacy=0x7fa37c0af930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:01.066 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.056+0000 7fa381e60640 1 -- 172.21.15.39:0/1789119423 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa37c06bb20 con 0x7fa37c0d0410 2023-05-16T13:55:01.067 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.060+0000 7fa381e60640 1 --2- 172.21.15.39:0/1789119423 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa37c0d0410 0x7fa37c0d07e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa3780097f0 tx=0x7fa37801ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3111b1c63d4e524 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:01.068 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.060+0000 7fa380e5e640 1 -- 172.21.15.39:0/1789119423 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3780a89b0 con 0x7fa37c0d0410 2023-05-16T13:55:01.068 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.060+0000 7fa380e5e640 1 -- 172.21.15.39:0/1789119423 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3780a8b10 con 0x7fa37c0d0410 2023-05-16T13:55:01.068 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.060+0000 7fa380e5e640 1 -- 172.21.15.39:0/1789119423 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3780a8ea0 con 0x7fa37c0d0410 2023-05-16T13:55:01.069 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.060+0000 7fa3840c4640 1 -- 172.21.15.39:0/1789119423 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa37c0d0410 msgr2=0x7fa37c0d07e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:01.069 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.060+0000 7fa3840c4640 1 --2- 172.21.15.39:0/1789119423 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa37c0d0410 0x7fa37c0d07e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa3780097f0 tx=0x7fa37801ecb0 comp rx=0 tx=0).stop 2023-05-16T13:55:01.069 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.060+0000 7fa3840c4640 1 -- 172.21.15.39:0/1789119423 shutdown_connections 2023-05-16T13:55:01.069 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.060+0000 7fa3840c4640 1 --2- 172.21.15.39:0/1789119423 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa37c0d0410 0x7fa37c0d07e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:01.069 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.060+0000 7fa3840c4640 1 -- 172.21.15.39:0/1789119423 >> 172.21.15.39:0/1789119423 conn(0x7fa37c09bba0 msgr2=0x7fa37c089fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:01.070 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.064+0000 7fa3840c4640 1 -- 172.21.15.39:0/1789119423 shutdown_connections 2023-05-16T13:55:01.070 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.064+0000 7fa3840c4640 1 -- 172.21.15.39:0/1789119423 wait complete. 2023-05-16T13:55:01.070 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.064+0000 7fa3840c4640 1 Processor -- start 2023-05-16T13:55:01.070 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.064+0000 7fa3840c4640 1 -- start start 2023-05-16T13:55:01.071 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.064+0000 7fa3840c4640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa37c06b620 0x7fa37c0c7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:01.072 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.064+0000 7fa3840c4640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa37c0af490 0x7fa37c0c8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:01.072 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.064+0000 7fa3840c4640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa37c0d0410 0x7fa37c1550a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:01.072 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.064+0000 7fa3840c4640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa37c0c8b40 con 0x7fa37c0d0410 2023-05-16T13:55:01.072 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.064+0000 7fa3840c4640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa37c0c7f30 con 0x7fa37c06b620 2023-05-16T13:55:01.072 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.064+0000 7fa3840c4640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa37c0c8210 con 0x7fa37c0af490 2023-05-16T13:55:01.072 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.064+0000 7fa382661640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa37c0d0410 0x7fa37c1550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:01.072 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.064+0000 7fa382661640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa37c0d0410 0x7fa37c1550a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34532/0 (socket says 172.21.15.39:34532) 2023-05-16T13:55:01.073 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.064+0000 7fa382661640 1 -- 172.21.15.39:0/3232507749 learned_addr learned my addr 172.21.15.39:0/3232507749 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:01.073 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.064+0000 7fa38165f640 1 --2- 172.21.15.39:0/3232507749 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa37c0af490 0x7fa37c0c8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:01.073 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.064+0000 7fa381e60640 1 --2- 172.21.15.39:0/3232507749 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa37c06b620 0x7fa37c0c7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:01.074 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.064+0000 7fa382661640 1 -- 172.21.15.39:0/3232507749 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa37c0af490 msgr2=0x7fa37c0c8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:01.074 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.064+0000 7fa382661640 1 --2- 172.21.15.39:0/3232507749 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa37c0af490 0x7fa37c0c8fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:01.074 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.064+0000 7fa382661640 1 -- 172.21.15.39:0/3232507749 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa37c06b620 msgr2=0x7fa37c0c7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:01.074 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.064+0000 7fa382661640 1 --2- 172.21.15.39:0/3232507749 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa37c06b620 0x7fa37c0c7950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:01.074 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.064+0000 7fa382661640 1 -- 172.21.15.39:0/3232507749 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa378009420 con 0x7fa37c0d0410 2023-05-16T13:55:01.074 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.064+0000 7fa382661640 1 --2- 172.21.15.39:0/3232507749 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa37c0d0410 0x7fa37c1550a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa37400caa0 tx=0x7fa37400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:01.075 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.068+0000 7fa3727fc640 1 -- 172.21.15.39:0/3232507749 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37400ac00 con 0x7fa37c0d0410 2023-05-16T13:55:01.075 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.068+0000 7fa3727fc640 1 -- 172.21.15.39:0/3232507749 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa37400ad80 con 0x7fa37c0d0410 2023-05-16T13:55:01.075 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.068+0000 7fa3840c4640 1 -- 172.21.15.39:0/3232507749 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa37c06c0e0 con 0x7fa37c0d0410 2023-05-16T13:55:01.075 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.068+0000 7fa3727fc640 1 -- 172.21.15.39:0/3232507749 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa374012640 con 0x7fa37c0d0410 2023-05-16T13:55:01.075 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.068+0000 7fa3840c4640 1 -- 172.21.15.39:0/3232507749 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa37c06be00 con 0x7fa37c0d0410 2023-05-16T13:55:01.075 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.068+0000 7fa3840c4640 1 -- 172.21.15.39:0/3232507749 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa37c06c3c0 con 0x7fa37c0d0410 2023-05-16T13:55:01.076 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.068+0000 7fa3727fc640 1 -- 172.21.15.39:0/3232507749 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa374007070 con 0x7fa37c0d0410 2023-05-16T13:55:01.076 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.068+0000 7fa3727fc640 1 --2- 172.21.15.39:0/3232507749 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fa360066280 0x7fa360068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:01.076 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.068+0000 7fa3727fc640 1 -- 172.21.15.39:0/3232507749 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fa374083c70 con 0x7fa37c0d0410 2023-05-16T13:55:01.076 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.068+0000 7fa381e60640 1 --2- 172.21.15.39:0/3232507749 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fa360066280 0x7fa360068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:01.077 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.068+0000 7fa381e60640 1 --2- 172.21.15.39:0/3232507749 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fa360066280 0x7fa360068730 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa3780b2000 tx=0x7fa3780aa070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:01.079 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.072+0000 7fa3727fc640 1 -- 172.21.15.39:0/3232507749 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fa374051150 con 0x7fa37c0d0410 2023-05-16T13:55:01.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.228+0000 7fa3840c4640 1 -- 172.21.15.39:0/3232507749 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa37c073c90 con 0x7fa37c0d0410 2023-05-16T13:55:01.233 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.228+0000 7fa3727fc640 1 -- 172.21.15.39:0/3232507749 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa374054770 con 0x7fa37c0d0410 2023-05-16T13:55:01.233 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2023-05-16T13:55:01.235 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.228+0000 7fa3840c4640 1 -- 172.21.15.39:0/3232507749 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fa360066280 msgr2=0x7fa360068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:01.235 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.228+0000 7fa3840c4640 1 --2- 172.21.15.39:0/3232507749 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fa360066280 0x7fa360068730 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa3780b2000 tx=0x7fa3780aa070 comp rx=0 tx=0).stop 2023-05-16T13:55:01.236 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.228+0000 7fa3840c4640 1 -- 172.21.15.39:0/3232507749 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa37c0d0410 msgr2=0x7fa37c1550a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:01.236 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.228+0000 7fa3840c4640 1 --2- 172.21.15.39:0/3232507749 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa37c0d0410 0x7fa37c1550a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa37400caa0 tx=0x7fa37400cf60 comp rx=0 tx=0).stop 2023-05-16T13:55:01.236 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.228+0000 7fa3840c4640 1 -- 172.21.15.39:0/3232507749 shutdown_connections 2023-05-16T13:55:01.236 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.228+0000 7fa3840c4640 1 --2- 172.21.15.39:0/3232507749 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fa360066280 0x7fa360068730 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:01.236 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.228+0000 7fa3840c4640 1 --2- 172.21.15.39:0/3232507749 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa37c0af490 0x7fa37c0c8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:01.236 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.228+0000 7fa3840c4640 1 --2- 172.21.15.39:0/3232507749 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa37c0d0410 0x7fa37c1550a0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:01.237 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.228+0000 7fa3840c4640 1 --2- 172.21.15.39:0/3232507749 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa37c06b620 0x7fa37c0c7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:01.237 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.228+0000 7fa3840c4640 1 -- 172.21.15.39:0/3232507749 >> 172.21.15.39:0/3232507749 conn(0x7fa37c09bba0 msgr2=0x7fa37c0b01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:01.237 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.228+0000 7fa3840c4640 1 -- 172.21.15.39:0/3232507749 shutdown_connections 2023-05-16T13:55:01.237 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.228+0000 7fa3840c4640 1 -- 172.21.15.39:0/3232507749 wait complete. 2023-05-16T13:55:01.254 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-16T13:55:01.398 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.392+0000 7f32ff0c4640 1 Processor -- start 2023-05-16T13:55:01.399 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.392+0000 7f32ff0c4640 1 -- start start 2023-05-16T13:55:01.399 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.392+0000 7f32ff0c4640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f32f80718a0 0x7f32f8071d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:01.400 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.392+0000 7f32ff0c4640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32f8160b40 con 0x7f32f8069a50 2023-05-16T13:55:01.400 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.392+0000 7f32ff0c4640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32f80cee40 con 0x7f32f80cb0f0 2023-05-16T13:55:01.400 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.392+0000 7f32ff0c4640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32f80cd490 con 0x7f32f80718a0 2023-05-16T13:55:01.400 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.392+0000 7f32fd661640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f32f8069a50 0x7f32f80cbe60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:51030/0 (socket says 172.21.15.39:51030) 2023-05-16T13:55:01.400 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.392+0000 7f32fd661640 1 -- 172.21.15.39:0/2180616180 learned_addr learned my addr 172.21.15.39:0/2180616180 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:55:01.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.392+0000 7f32f7fff640 1 --2- 172.21.15.39:0/2180616180 >> v2:172.21.15.118:3300/0 conn(0x7f32f80718a0 0x7f32f8071d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:01.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.392+0000 7f32f77fe640 1 -- 172.21.15.39:0/2180616180 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2708690700 0 0) 0x7f32f8160b40 con 0x7f32f8069a50 2023-05-16T13:55:01.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.392+0000 7f32f77fe640 1 -- 172.21.15.39:0/2180616180 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32e8003530 con 0x7f32f8069a50 2023-05-16T13:55:01.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.392+0000 7f32f77fe640 1 -- 172.21.15.39:0/2180616180 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4035883985 0 0) 0x7f32e8003530 con 0x7f32f8069a50 2023-05-16T13:55:01.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.392+0000 7f32f77fe640 1 -- 172.21.15.39:0/2180616180 >> v2:172.21.15.118:3300/0 conn(0x7f32f80718a0 msgr2=0x7f32f8071d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:01.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.392+0000 7f32f77fe640 1 --2- 172.21.15.39:0/2180616180 >> v2:172.21.15.118:3300/0 conn(0x7f32f80718a0 0x7f32f8071d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:01.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.396+0000 7f32f77fe640 1 -- 172.21.15.39:0/2180616180 >> v1:172.21.15.118:6789/0 conn(0x7f32f80cb0f0 legacy=0x7f32f8160430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:01.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.396+0000 7f32f77fe640 1 -- 172.21.15.39:0/2180616180 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32f80cf120 con 0x7f32f8069a50 2023-05-16T13:55:01.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.396+0000 7f32f77fe640 1 -- 172.21.15.39:0/2180616180 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1738805496 0 0) 0x7f32f0001a00 con 0x7f32f8069a50 2023-05-16T13:55:01.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.396+0000 7f32f77fe640 1 -- 172.21.15.39:0/2180616180 >> v1:172.21.15.39:6789/0 conn(0x7f32f8069a50 legacy=0x7f32f80cbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:01.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.396+0000 7f32f77fe640 1 --2- 172.21.15.39:0/2180616180 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f32e80039b0 0x7f32e8003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:01.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.396+0000 7f32f77fe640 1 --2- 172.21.15.39:0/2180616180 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f32e80043a0 0x7f32e8004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:01.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.396+0000 7f32f77fe640 1 --2- 172.21.15.39:0/2180616180 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32e8005070 0x7f32e800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:01.404 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.396+0000 7f32f77fe640 1 -- 172.21.15.39:0/2180616180 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32f80cd490 con 0x7f32e8005070 2023-05-16T13:55:01.404 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.396+0000 7f32f77fe640 1 -- 172.21.15.39:0/2180616180 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e800bfb0 con 0x7f32e80039b0 2023-05-16T13:55:01.404 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.396+0000 7f32f77fe640 1 -- 172.21.15.39:0/2180616180 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32e800c170 con 0x7f32e80043a0 2023-05-16T13:55:01.404 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.396+0000 7f32fd661640 1 --2- 172.21.15.39:0/2180616180 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32e8005070 0x7f32e800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:01.404 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.396+0000 7f32fce60640 1 --2- 172.21.15.39:0/2180616180 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f32e80039b0 0x7f32e8003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:01.404 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.396+0000 7f32f7fff640 1 --2- 172.21.15.39:0/2180616180 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f32e80043a0 0x7f32e8004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:01.404 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.396+0000 7f32fd661640 1 -- 172.21.15.39:0/2180616180 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f32e80043a0 msgr2=0x7f32e8004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:01.404 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.396+0000 7f32fd661640 1 --2- 172.21.15.39:0/2180616180 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f32e80043a0 0x7f32e8004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:01.405 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.396+0000 7f32fd661640 1 -- 172.21.15.39:0/2180616180 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f32e80039b0 msgr2=0x7f32e8003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:01.405 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.396+0000 7f32fd661640 1 --2- 172.21.15.39:0/2180616180 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f32e80039b0 0x7f32e8003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:01.405 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.396+0000 7f32fd661640 1 -- 172.21.15.39:0/2180616180 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32e8003530 con 0x7f32e8005070 2023-05-16T13:55:01.405 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.396+0000 7f32f7fff640 1 --2- 172.21.15.39:0/2180616180 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f32e80043a0 0x7f32e8004870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:55:01.406 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.396+0000 7f32fd661640 1 -- 172.21.15.39:0/2180616180 reap_dead start 2023-05-16T13:55:01.406 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.396+0000 7f32fd661640 1 --2- 172.21.15.39:0/2180616180 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32e8005070 0x7f32e800b990 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f32f000a830 tx=0x7f32f001faa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a8da3ab27b47c27 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:01.407 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.396+0000 7f32f77fe640 1 -- 172.21.15.39:0/2180616180 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f00af070 con 0x7f32e8005070 2023-05-16T13:55:01.407 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.396+0000 7f32f77fe640 1 -- 172.21.15.39:0/2180616180 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32f00aa4d0 con 0x7f32e8005070 2023-05-16T13:55:01.407 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.396+0000 7f32f77fe640 1 -- 172.21.15.39:0/2180616180 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f00aa8a0 con 0x7f32e8005070 2023-05-16T13:55:01.407 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.400+0000 7f32ff0c4640 1 -- 172.21.15.39:0/2180616180 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32e8005070 msgr2=0x7f32e800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:01.407 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.400+0000 7f32ff0c4640 1 --2- 172.21.15.39:0/2180616180 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32e8005070 0x7f32e800b990 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f32f000a830 tx=0x7f32f001faa0 comp rx=0 tx=0).stop 2023-05-16T13:55:01.407 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.400+0000 7f32ff0c4640 1 -- 172.21.15.39:0/2180616180 shutdown_connections 2023-05-16T13:55:01.407 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.400+0000 7f32ff0c4640 1 --2- 172.21.15.39:0/2180616180 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32e8005070 0x7f32e800b990 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:01.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.400+0000 7f32ff0c4640 1 -- 172.21.15.39:0/2180616180 >> 172.21.15.39:0/2180616180 conn(0x7f32f806ce40 msgr2=0x7f32f806d240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:01.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.400+0000 7f32ff0c4640 1 -- 172.21.15.39:0/2180616180 shutdown_connections 2023-05-16T13:55:01.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.400+0000 7f32ff0c4640 1 -- 172.21.15.39:0/2180616180 wait complete. 2023-05-16T13:55:01.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.400+0000 7f32ff0c4640 1 Processor -- start 2023-05-16T13:55:01.409 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.400+0000 7f32ff0c4640 1 -- start start 2023-05-16T13:55:01.409 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.400+0000 7f32ff0c4640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32e8005070 0x7f32f80b1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:01.410 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.400+0000 7f32ff0c4640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f32f80b0440 0x7f32f80c5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:01.410 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.400+0000 7f32ff0c4640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f32f80b3c50 0x7f32f81576f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:01.410 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.400+0000 7f32ff0c4640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32f80b1ea0 con 0x7f32e8005070 2023-05-16T13:55:01.410 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.400+0000 7f32ff0c4640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32f80c5b70 con 0x7f32f80b0440 2023-05-16T13:55:01.410 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.400+0000 7f32ff0c4640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32f80b08c0 con 0x7f32f80b3c50 2023-05-16T13:55:01.410 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.400+0000 7f32fce60640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32e8005070 0x7f32f80b1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:01.410 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.400+0000 7f32fce60640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32e8005070 0x7f32f80b1960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34542/0 (socket says 172.21.15.39:34542) 2023-05-16T13:55:01.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.400+0000 7f32fce60640 1 -- 172.21.15.39:0/4162945890 learned_addr learned my addr 172.21.15.39:0/4162945890 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:01.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.400+0000 7f32fd661640 1 --2- 172.21.15.39:0/4162945890 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f32f80b3c50 0x7f32f81576f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:01.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.400+0000 7f32f7fff640 1 --2- 172.21.15.39:0/4162945890 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f32f80b0440 0x7f32f80c5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:01.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.400+0000 7f32fce60640 1 -- 172.21.15.39:0/4162945890 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f32f80b3c50 msgr2=0x7f32f81576f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:01.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.400+0000 7f32fce60640 1 --2- 172.21.15.39:0/4162945890 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f32f80b3c50 0x7f32f81576f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:01.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.400+0000 7f32fce60640 1 -- 172.21.15.39:0/4162945890 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f32f80b0440 msgr2=0x7f32f80c5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:01.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.400+0000 7f32fce60640 1 --2- 172.21.15.39:0/4162945890 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f32f80b0440 0x7f32f80c5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:01.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.400+0000 7f32fce60640 1 -- 172.21.15.39:0/4162945890 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32f815fc30 con 0x7f32e8005070 2023-05-16T13:55:01.412 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.404+0000 7f32fce60640 1 --2- 172.21.15.39:0/4162945890 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32e8005070 0x7f32f80b1960 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f32ec00f7f0 tx=0x7f32ec00fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:01.412 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.404+0000 7f32f57fa640 1 -- 172.21.15.39:0/4162945890 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32ec00fea0 con 0x7f32e8005070 2023-05-16T13:55:01.412 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.404+0000 7f32f57fa640 1 -- 172.21.15.39:0/4162945890 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32ec0052e0 con 0x7f32e8005070 2023-05-16T13:55:01.412 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.404+0000 7f32f57fa640 1 -- 172.21.15.39:0/4162945890 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32ec00d970 con 0x7f32e8005070 2023-05-16T13:55:01.412 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.404+0000 7f32ff0c4640 1 -- 172.21.15.39:0/4162945890 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32f80cf400 con 0x7f32e8005070 2023-05-16T13:55:01.412 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.404+0000 7f32ff0c4640 1 -- 172.21.15.39:0/4162945890 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32f815ff10 con 0x7f32e8005070 2023-05-16T13:55:01.413 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.404+0000 7f32ff0c4640 1 -- 172.21.15.39:0/4162945890 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32f8073c90 con 0x7f32e8005070 2023-05-16T13:55:01.413 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.404+0000 7f32f57fa640 1 -- 172.21.15.39:0/4162945890 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f32ec00dad0 con 0x7f32e8005070 2023-05-16T13:55:01.413 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.404+0000 7f32f57fa640 1 --2- 172.21.15.39:0/4162945890 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f32dc066280 0x7f32dc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:01.413 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.404+0000 7f32f57fa640 1 -- 172.21.15.39:0/4162945890 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f32ec083d10 con 0x7f32e8005070 2023-05-16T13:55:01.414 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.404+0000 7f32f7fff640 1 --2- 172.21.15.39:0/4162945890 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f32dc066280 0x7f32dc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:01.414 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.408+0000 7f32f7fff640 1 --2- 172.21.15.39:0/4162945890 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f32dc066280 0x7f32dc068730 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f32f815f700 tx=0x7f32e4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:01.415 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.408+0000 7f32f57fa640 1 -- 172.21.15.39:0/4162945890 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f32ec089020 con 0x7f32e8005070 2023-05-16T13:55:01.570 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.564+0000 7f32ff0c4640 1 -- 172.21.15.39:0/4162945890 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f32f80c5f60 con 0x7f32e8005070 2023-05-16T13:55:01.570 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.564+0000 7f32f57fa640 1 -- 172.21.15.39:0/4162945890 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f32f80c5f60 con 0x7f32e8005070 2023-05-16T13:55:01.570 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 64 2023-05-16T13:55:01.572 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.564+0000 7f32ff0c4640 1 -- 172.21.15.39:0/4162945890 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f32dc066280 msgr2=0x7f32dc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:01.572 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.564+0000 7f32ff0c4640 1 --2- 172.21.15.39:0/4162945890 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f32dc066280 0x7f32dc068730 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f32f815f700 tx=0x7f32e4008040 comp rx=0 tx=0).stop 2023-05-16T13:55:01.572 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.564+0000 7f32ff0c4640 1 -- 172.21.15.39:0/4162945890 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32e8005070 msgr2=0x7f32f80b1960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:01.573 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.564+0000 7f32ff0c4640 1 --2- 172.21.15.39:0/4162945890 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32e8005070 0x7f32f80b1960 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f32ec00f7f0 tx=0x7f32ec00fcb0 comp rx=0 tx=0).stop 2023-05-16T13:55:01.573 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.564+0000 7f32ff0c4640 1 -- 172.21.15.39:0/4162945890 shutdown_connections 2023-05-16T13:55:01.573 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.564+0000 7f32ff0c4640 1 --2- 172.21.15.39:0/4162945890 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f32dc066280 0x7f32dc068730 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:01.573 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.564+0000 7f32ff0c4640 1 --2- 172.21.15.39:0/4162945890 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f32f80b3c50 0x7f32f81576f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:01.573 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.564+0000 7f32ff0c4640 1 --2- 172.21.15.39:0/4162945890 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f32f80b0440 0x7f32f80c5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:01.573 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.564+0000 7f32ff0c4640 1 --2- 172.21.15.39:0/4162945890 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32e8005070 0x7f32f80b1960 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:01.573 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.564+0000 7f32ff0c4640 1 -- 172.21.15.39:0/4162945890 >> 172.21.15.39:0/4162945890 conn(0x7f32f806ce40 msgr2=0x7f32f8160330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:01.573 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.564+0000 7f32ff0c4640 1 -- 172.21.15.39:0/4162945890 shutdown_connections 2023-05-16T13:55:01.574 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.564+0000 7f32ff0c4640 1 -- 172.21.15.39:0/4162945890 wait complete. 2023-05-16T13:55:01.591 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-16T13:55:01.729 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.724+0000 7fc64f318640 1 Processor -- start 2023-05-16T13:55:01.729 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.724+0000 7fc64f318640 1 -- start start 2023-05-16T13:55:01.730 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.724+0000 7fc64f318640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc6480cb2f0 0x7fc6480c9470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:01.730 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.724+0000 7fc64f318640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6480cda10 con 0x7fc64815d2c0 2023-05-16T13:55:01.731 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.724+0000 7fc64f318640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6480cce90 con 0x7fc648158e90 2023-05-16T13:55:01.731 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.724+0000 7fc64f318640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc648159260 con 0x7fc6480cb2f0 2023-05-16T13:55:01.731 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.724+0000 7fc64c8b3640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fc64815d2c0 0x7fc6480cabe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:51032/0 (socket says 172.21.15.39:51032) 2023-05-16T13:55:01.731 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.724+0000 7fc64c8b3640 1 -- 172.21.15.39:0/3512383775 learned_addr learned my addr 172.21.15.39:0/3512383775 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:55:01.732 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.724+0000 7fc64d8b5640 1 --2- 172.21.15.39:0/3512383775 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc6480cb2f0 0x7fc6480c9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:01.732 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.724+0000 7fc63ffff640 1 -- 172.21.15.39:0/3512383775 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4019442756 0 0) 0x7fc6480cda10 con 0x7fc64815d2c0 2023-05-16T13:55:01.732 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.724+0000 7fc63ffff640 1 -- 172.21.15.39:0/3512383775 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc634005740 con 0x7fc64815d2c0 2023-05-16T13:55:01.732 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.724+0000 7fc63ffff640 1 -- 172.21.15.39:0/3512383775 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1362539153 0 0) 0x7fc6480cce90 con 0x7fc648158e90 2023-05-16T13:55:01.732 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.724+0000 7fc63ffff640 1 -- 172.21.15.39:0/3512383775 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6480cda10 con 0x7fc648158e90 2023-05-16T13:55:01.733 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.724+0000 7fc63ffff640 1 -- 172.21.15.39:0/3512383775 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2193954925 0 0) 0x7fc634005740 con 0x7fc64815d2c0 2023-05-16T13:55:01.733 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.724+0000 7fc64d8b5640 1 -- 172.21.15.39:0/3512383775 >> v1:172.21.15.118:6789/0 conn(0x7fc648158e90 legacy=0x7fc6480704b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:01.733 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.724+0000 7fc64d8b5640 1 -- 172.21.15.39:0/3512383775 >> v1:172.21.15.39:6789/0 conn(0x7fc64815d2c0 legacy=0x7fc6480cabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:01.733 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.724+0000 7fc64d8b5640 1 -- 172.21.15.39:0/3512383775 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6480cd170 con 0x7fc6480cb2f0 2023-05-16T13:55:01.734 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.728+0000 7fc64d8b5640 1 --2- 172.21.15.39:0/3512383775 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc6480cb2f0 0x7fc6480c9470 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc640009dc0 tx=0x7fc64001c7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1154f9e9fe734f12 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:01.734 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.728+0000 7fc63ffff640 1 -- 172.21.15.39:0/3512383775 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc638001680 con 0x7fc6480cb2f0 2023-05-16T13:55:01.735 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.728+0000 7fc63ffff640 1 -- 172.21.15.39:0/3512383775 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6400a5610 con 0x7fc6480cb2f0 2023-05-16T13:55:01.735 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.728+0000 7fc63ffff640 1 -- 172.21.15.39:0/3512383775 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6400a59a0 con 0x7fc6480cb2f0 2023-05-16T13:55:01.735 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.728+0000 7fc64f318640 1 -- 172.21.15.39:0/3512383775 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc6480cb2f0 msgr2=0x7fc6480c9470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:01.736 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.728+0000 7fc64f318640 1 --2- 172.21.15.39:0/3512383775 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc6480cb2f0 0x7fc6480c9470 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc640009dc0 tx=0x7fc64001c7d0 comp rx=0 tx=0).stop 2023-05-16T13:55:01.736 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.728+0000 7fc64f318640 1 -- 172.21.15.39:0/3512383775 shutdown_connections 2023-05-16T13:55:01.736 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.728+0000 7fc64f318640 1 --2- 172.21.15.39:0/3512383775 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc6480cb2f0 0x7fc6480c9470 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:01.736 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.728+0000 7fc64f318640 1 -- 172.21.15.39:0/3512383775 >> 172.21.15.39:0/3512383775 conn(0x7fc648069a50 msgr2=0x7fc648069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:01.736 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.728+0000 7fc64f318640 1 -- 172.21.15.39:0/3512383775 shutdown_connections 2023-05-16T13:55:01.736 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.728+0000 7fc64f318640 1 -- 172.21.15.39:0/3512383775 wait complete. 2023-05-16T13:55:01.737 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.732+0000 7fc64f318640 1 Processor -- start 2023-05-16T13:55:01.737 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.732+0000 7fc64f318640 1 -- start start 2023-05-16T13:55:01.738 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.732+0000 7fc64f318640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6480cb2f0 0x7fc64814e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:01.738 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.732+0000 7fc64f318640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc648158e90 0x7fc6480c73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:01.738 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.732+0000 7fc64f318640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc64815d2c0 0x7fc64815a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:01.738 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.732+0000 7fc64f318640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6480b33c0 con 0x7fc6480cb2f0 2023-05-16T13:55:01.739 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.732+0000 7fc64f318640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc648150300 con 0x7fc648158e90 2023-05-16T13:55:01.739 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.732+0000 7fc64f318640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6480c7da0 con 0x7fc64815d2c0 2023-05-16T13:55:01.739 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.732+0000 7fc64d0b4640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6480cb2f0 0x7fc64814e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:01.739 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.732+0000 7fc64d0b4640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6480cb2f0 0x7fc64814e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34544/0 (socket says 172.21.15.39:34544) 2023-05-16T13:55:01.739 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.732+0000 7fc64d0b4640 1 -- 172.21.15.39:0/1455213403 learned_addr learned my addr 172.21.15.39:0/1455213403 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:01.740 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.732+0000 7fc64d0b4640 1 -- 172.21.15.39:0/1455213403 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc64815d2c0 msgr2=0x7fc64815a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:01.740 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.732+0000 7fc64d0b4640 1 --2- 172.21.15.39:0/1455213403 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc64815d2c0 0x7fc64815a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:01.741 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.732+0000 7fc64d0b4640 1 -- 172.21.15.39:0/1455213403 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc648158e90 msgr2=0x7fc6480c73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:01.741 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.732+0000 7fc64c8b3640 1 --2- 172.21.15.39:0/1455213403 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc648158e90 0x7fc6480c73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:01.741 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.732+0000 7fc64d0b4640 1 --2- 172.21.15.39:0/1455213403 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc648158e90 0x7fc6480c73a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:01.741 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.732+0000 7fc64d0b4640 1 -- 172.21.15.39:0/1455213403 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc640009a70 con 0x7fc6480cb2f0 2023-05-16T13:55:01.741 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.732+0000 7fc64c8b3640 1 --2- 172.21.15.39:0/1455213403 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc648158e90 0x7fc6480c73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-16T13:55:01.741 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.732+0000 7fc64d0b4640 1 --2- 172.21.15.39:0/1455213403 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6480cb2f0 0x7fc64814e2d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc64400c490 tx=0x7fc64400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:01.741 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.732+0000 7fc63dffb640 1 -- 172.21.15.39:0/1455213403 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6440052d0 con 0x7fc6480cb2f0 2023-05-16T13:55:01.742 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.732+0000 7fc63dffb640 1 -- 172.21.15.39:0/1455213403 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc644005430 con 0x7fc6480cb2f0 2023-05-16T13:55:01.742 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.732+0000 7fc64f318640 1 -- 172.21.15.39:0/1455213403 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc64815d740 con 0x7fc6480cb2f0 2023-05-16T13:55:01.742 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.732+0000 7fc63dffb640 1 -- 172.21.15.39:0/1455213403 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc644012870 con 0x7fc6480cb2f0 2023-05-16T13:55:01.742 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.732+0000 7fc64f318640 1 -- 172.21.15.39:0/1455213403 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6480c8e10 con 0x7fc6480cb2f0 2023-05-16T13:55:01.742 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.732+0000 7fc64f318640 1 -- 172.21.15.39:0/1455213403 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc648073c90 con 0x7fc6480cb2f0 2023-05-16T13:55:01.743 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.736+0000 7fc63dffb640 1 -- 172.21.15.39:0/1455213403 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc6440129d0 con 0x7fc6480cb2f0 2023-05-16T13:55:01.743 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.736+0000 7fc63dffb640 1 --2- 172.21.15.39:0/1455213403 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc62c066280 0x7fc62c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:01.743 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.736+0000 7fc63dffb640 1 -- 172.21.15.39:0/1455213403 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fc6440839e0 con 0x7fc6480cb2f0 2023-05-16T13:55:01.743 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.736+0000 7fc64c8b3640 1 --2- 172.21.15.39:0/1455213403 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc62c066280 0x7fc62c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:01.743 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.736+0000 7fc64c8b3640 1 --2- 172.21.15.39:0/1455213403 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc62c066280 0x7fc62c068730 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc6380011f0 tx=0x7fc638009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:01.746 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.740+0000 7fc63dffb640 1 -- 172.21.15.39:0/1455213403 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fc644050d80 con 0x7fc6480cb2f0 2023-05-16T13:55:01.913 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.908+0000 7fc64f318640 1 -- 172.21.15.39:0/1455213403 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc6480cabb0 con 0x7fc6480cb2f0 2023-05-16T13:55:01.913 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.908+0000 7fc63dffb640 1 -- 172.21.15.39:0/1455213403 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc6440543a0 con 0x7fc6480cb2f0 2023-05-16T13:55:01.914 INFO:teuthology.orchestra.run.smithi039.stderr:listed 0 entries 2023-05-16T13:55:01.916 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.908+0000 7fc64f318640 1 -- 172.21.15.39:0/1455213403 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc62c066280 msgr2=0x7fc62c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:01.916 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.908+0000 7fc64f318640 1 --2- 172.21.15.39:0/1455213403 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc62c066280 0x7fc62c068730 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc6380011f0 tx=0x7fc638009040 comp rx=0 tx=0).stop 2023-05-16T13:55:01.916 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.908+0000 7fc64f318640 1 -- 172.21.15.39:0/1455213403 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6480cb2f0 msgr2=0x7fc64814e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:01.916 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.908+0000 7fc64f318640 1 --2- 172.21.15.39:0/1455213403 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6480cb2f0 0x7fc64814e2d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc64400c490 tx=0x7fc64400c950 comp rx=0 tx=0).stop 2023-05-16T13:55:01.916 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.908+0000 7fc64f318640 1 -- 172.21.15.39:0/1455213403 shutdown_connections 2023-05-16T13:55:01.916 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.908+0000 7fc64f318640 1 --2- 172.21.15.39:0/1455213403 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc62c066280 0x7fc62c068730 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:01.916 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.908+0000 7fc64f318640 1 --2- 172.21.15.39:0/1455213403 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc64815d2c0 0x7fc64815a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:01.917 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.908+0000 7fc64f318640 1 --2- 172.21.15.39:0/1455213403 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc648158e90 0x7fc6480c73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:01.917 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.908+0000 7fc64f318640 1 --2- 172.21.15.39:0/1455213403 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6480cb2f0 0x7fc64814e2d0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:01.917 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.908+0000 7fc64f318640 1 -- 172.21.15.39:0/1455213403 >> 172.21.15.39:0/1455213403 conn(0x7fc648069a50 msgr2=0x7fc6480adec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:01.917 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.908+0000 7fc64f318640 1 -- 172.21.15.39:0/1455213403 shutdown_connections 2023-05-16T13:55:01.917 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:01.908+0000 7fc64f318640 1 -- 172.21.15.39:0/1455213403 wait complete. 2023-05-16T13:55:01.934 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-05-16T13:55:01.934 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-16T13:55:01.942 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-16T13:55:02.124 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.116+0000 7f37f51f0640 1 Processor -- start 2023-05-16T13:55:02.125 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.116+0000 7f37f51f0640 1 -- start start 2023-05-16T13:55:02.126 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.120+0000 7f37f51f0640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f37f0158bf0 0x7f37f015d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:02.126 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.120+0000 7f37f51f0640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f37f00cb4c0 0x7f37f00ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:02.126 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.120+0000 7f37f51f0640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37f015d6a0 con 0x7f37f00703b0 2023-05-16T13:55:02.126 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.120+0000 7f37f51f0640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37f0070870 con 0x7f37f00cb4c0 2023-05-16T13:55:02.126 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.120+0000 7f37f51f0640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37f0070b50 con 0x7f37f0158bf0 2023-05-16T13:55:02.127 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.120+0000 7f37ef59e640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f37f00cb4c0 0x7f37f00ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:02.127 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.120+0000 7f37ef59e640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f37f00cb4c0 0x7f37f00ccda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34546/0 (socket says 172.21.15.39:34546) 2023-05-16T13:55:02.127 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.120+0000 7f37e7fff640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f37f00703b0 0x7f37f00cadb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:51036/0 (socket says 172.21.15.39:51036) 2023-05-16T13:55:02.127 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.120+0000 7f37ef59e640 1 -- 172.21.15.39:0/3176684275 learned_addr learned my addr 172.21.15.39:0/3176684275 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:02.127 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.120+0000 7f37eed9d640 1 --2- 172.21.15.39:0/3176684275 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f37f0158bf0 0x7f37f015d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:02.128 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.120+0000 7f37ef59e640 1 -- 172.21.15.39:0/3176684275 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f37f0158bf0 msgr2=0x7f37f015d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:02.128 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.120+0000 7f37ef59e640 1 --2- 172.21.15.39:0/3176684275 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f37f0158bf0 0x7f37f015d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:02.128 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.120+0000 7f37ef59e640 1 -- 172.21.15.39:0/3176684275 >> v1:172.21.15.39:6789/0 conn(0x7f37f00703b0 legacy=0x7f37f00cadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:02.128 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.120+0000 7f37ee59c640 1 -- 172.21.15.39:0/3176684275 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1554316436 0 0) 0x7f37d8001120 con 0x7f37f00703b0 2023-05-16T13:55:02.128 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.120+0000 7f37ef59e640 1 -- 172.21.15.39:0/3176684275 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37f0070e30 con 0x7f37f00cb4c0 2023-05-16T13:55:02.129 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.124+0000 7f37ef59e640 1 --2- 172.21.15.39:0/3176684275 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f37f00cb4c0 0x7f37f00ccda0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f37e8009e50 tx=0x7f37e801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13eac1eae317a503 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:02.129 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.124+0000 7f37ee59c640 1 -- 172.21.15.39:0/3176684275 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e80a5810 con 0x7f37f00cb4c0 2023-05-16T13:55:02.130 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.124+0000 7f37ee59c640 1 -- 172.21.15.39:0/3176684275 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37e80a5970 con 0x7f37f00cb4c0 2023-05-16T13:55:02.130 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.124+0000 7f37ee59c640 1 -- 172.21.15.39:0/3176684275 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e80a5d00 con 0x7f37f00cb4c0 2023-05-16T13:55:02.131 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.124+0000 7f37f51f0640 1 -- 172.21.15.39:0/3176684275 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f37f00cb4c0 msgr2=0x7f37f00ccda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:02.131 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.124+0000 7f37f51f0640 1 --2- 172.21.15.39:0/3176684275 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f37f00cb4c0 0x7f37f00ccda0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f37e8009e50 tx=0x7f37e801c950 comp rx=0 tx=0).stop 2023-05-16T13:55:02.131 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.124+0000 7f37f51f0640 1 -- 172.21.15.39:0/3176684275 shutdown_connections 2023-05-16T13:55:02.131 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.124+0000 7f37f51f0640 1 --2- 172.21.15.39:0/3176684275 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f37f00cb4c0 0x7f37f00ccda0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:02.132 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.124+0000 7f37f51f0640 1 --2- 172.21.15.39:0/3176684275 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f37f0158bf0 0x7f37f015d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:02.132 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.124+0000 7f37f51f0640 1 -- 172.21.15.39:0/3176684275 >> 172.21.15.39:0/3176684275 conn(0x7f37f0069a50 msgr2=0x7f37f0069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:02.132 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.124+0000 7f37f51f0640 1 -- 172.21.15.39:0/3176684275 shutdown_connections 2023-05-16T13:55:02.132 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.124+0000 7f37f51f0640 1 -- 172.21.15.39:0/3176684275 wait complete. 2023-05-16T13:55:02.133 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.124+0000 7f37f51f0640 1 Processor -- start 2023-05-16T13:55:02.133 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.124+0000 7f37f51f0640 1 -- start start 2023-05-16T13:55:02.133 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.128+0000 7f37f51f0640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f37f00703b0 0x7f37f014aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:02.134 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.128+0000 7f37f51f0640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37f00cb4c0 0x7f37f0161c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:02.134 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.128+0000 7f37f51f0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f37f0158bf0 0x7f37f014f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:02.134 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.128+0000 7f37f51f0640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37f01561f0 con 0x7f37f0158bf0 2023-05-16T13:55:02.134 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.128+0000 7f37f51f0640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37f01564d0 con 0x7f37f00cb4c0 2023-05-16T13:55:02.134 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.128+0000 7f37f51f0640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37f01625c0 con 0x7f37f00703b0 2023-05-16T13:55:02.134 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.128+0000 7f37ef59e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f37f0158bf0 0x7f37f014f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:02.135 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.128+0000 7f37ef59e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f37f0158bf0 0x7f37f014f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34562/0 (socket says 172.21.15.39:34562) 2023-05-16T13:55:02.135 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.128+0000 7f37ef59e640 1 -- 172.21.15.39:0/4283708660 learned_addr learned my addr 172.21.15.39:0/4283708660 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:02.135 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.128+0000 7f37eed9d640 1 --2- 172.21.15.39:0/4283708660 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f37f00703b0 0x7f37f014aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:02.135 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.128+0000 7f37e7fff640 1 --2- 172.21.15.39:0/4283708660 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37f00cb4c0 0x7f37f0161c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:02.136 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.128+0000 7f37ef59e640 1 -- 172.21.15.39:0/4283708660 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f37f00703b0 msgr2=0x7f37f014aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:02.136 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.128+0000 7f37ef59e640 1 --2- 172.21.15.39:0/4283708660 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f37f00703b0 0x7f37f014aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:02.136 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.128+0000 7f37ef59e640 1 -- 172.21.15.39:0/4283708660 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37f00cb4c0 msgr2=0x7f37f0161c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:02.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.128+0000 7f37ef59e640 1 --2- 172.21.15.39:0/4283708660 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37f00cb4c0 0x7f37f0161c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:02.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.128+0000 7f37ef59e640 1 -- 172.21.15.39:0/4283708660 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37e8009b30 con 0x7f37f0158bf0 2023-05-16T13:55:02.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.128+0000 7f37e7fff640 1 --2- 172.21.15.39:0/4283708660 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37f00cb4c0 0x7f37f0161c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:55:02.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.128+0000 7f37ef59e640 1 --2- 172.21.15.39:0/4283708660 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f37f0158bf0 0x7f37f014f740 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f37e801a580 tx=0x7f37e80196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:02.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.128+0000 7f37e77fe640 1 -- 172.21.15.39:0/4283708660 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e80b8670 con 0x7f37f0158bf0 2023-05-16T13:55:02.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.128+0000 7f37e77fe640 1 -- 172.21.15.39:0/4283708660 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37e80b87d0 con 0x7f37f0158bf0 2023-05-16T13:55:02.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.128+0000 7f37f51f0640 1 -- 172.21.15.39:0/4283708660 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37f00ad950 con 0x7f37f0158bf0 2023-05-16T13:55:02.138 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.128+0000 7f37e77fe640 1 -- 172.21.15.39:0/4283708660 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e80b8b80 con 0x7f37f0158bf0 2023-05-16T13:55:02.138 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.128+0000 7f37f51f0640 1 -- 172.21.15.39:0/4283708660 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37f0158fc0 con 0x7f37f0158bf0 2023-05-16T13:55:02.138 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.128+0000 7f37f51f0640 1 -- 172.21.15.39:0/4283708660 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37f00cdaf0 con 0x7f37f0158bf0 2023-05-16T13:55:02.138 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.128+0000 7f37e77fe640 1 -- 172.21.15.39:0/4283708660 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f37e80b8ce0 con 0x7f37f0158bf0 2023-05-16T13:55:02.139 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.132+0000 7f37e77fe640 1 --2- 172.21.15.39:0/4283708660 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f37d0066280 0x7f37d0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:02.139 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.132+0000 7f37e77fe640 1 -- 172.21.15.39:0/4283708660 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f37e811f410 con 0x7f37f0158bf0 2023-05-16T13:55:02.139 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.132+0000 7f37eed9d640 1 --2- 172.21.15.39:0/4283708660 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f37d0066280 0x7f37d0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:02.139 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.132+0000 7f37eed9d640 1 --2- 172.21.15.39:0/4283708660 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f37d0066280 0x7f37d0068730 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f37f0150470 tx=0x7f37e0009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:02.141 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.136+0000 7f37e77fe640 1 -- 172.21.15.39:0/4283708660 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f37e80ec730 con 0x7f37f0158bf0 2023-05-16T13:55:02.297 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.292+0000 7f37f51f0640 1 -- 172.21.15.39:0/4283708660 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f37f0156640 con 0x7f37f0158bf0 2023-05-16T13:55:02.298 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.292+0000 7f37e77fe640 1 -- 172.21.15.39:0/4283708660 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18375 (secure 0 0 0) 0x7f37e80efd50 con 0x7f37f0158bf0 2023-05-16T13:55:02.299 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:55:02.299 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":26,"fsid":"9c1e210b-c515-4ea4-a065-397956895c68","created":"2023-05-16T13:53:48.955290+0000","modified":"2023-05-16T13:54:56.831431+0000","last_up_change":"2023-05-16T13:54:01.722051+0000","last_in_change":"2023-05-16T13:53:52.331336+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-16T13:54:00.885009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-16T13:54:08.327895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-16T13:54:12.864823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-16T13:54:14.180225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4ce0f0ba-c4bf-4405-8c95-d2e9a62878ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6809","nonce":3462013698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6811","nonce":3462013698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6815","nonce":3462013698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6813","nonce":3462013698}]},"public_addr":"172.21.15.39:6809/3462013698","cluster_addr":"172.21.15.39:6811/3462013698","heartbeat_back_addr":"172.21.15.39:6815/3462013698","heartbeat_front_addr":"172.21.15.39:6813/3462013698","state":["exists","up"]},{"osd":1,"uuid":"53fdc1ac-2473-472d-af32-2760fdf6e476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6801","nonce":2829970892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6803","nonce":2829970892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6807","nonce":2829970892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6805","nonce":2829970892}]},"public_addr":"172.21.15.39:6801/2829970892","cluster_addr":"172.21.15.39:6803/2829970892","heartbeat_back_addr":"172.21.15.39:6807/2829970892","heartbeat_front_addr":"172.21.15.39:6805/2829970892","state":["exists","up"]},{"osd":2,"uuid":"0b92d770-7030-42fa-a19f-4f7f1ac113c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6817","nonce":3888067413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6819","nonce":3888067413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6823","nonce":3888067413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6821","nonce":3888067413}]},"public_addr":"172.21.15.39:6817/3888067413","cluster_addr":"172.21.15.39:6819/3888067413","heartbeat_back_addr":"172.21.15.39:6823/3888067413","heartbeat_front_addr":"172.21.15.39:6821/3888067413","state":["exists","up"]},{"osd":3,"uuid":"000d9506-cbb2-4017-b875-deca579860ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6825","nonce":405003958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6827","nonce":405003958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6831","nonce":405003958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6829","nonce":405003958}]},"public_addr":"172.21.15.39:6825/405003958","cluster_addr":"172.21.15.39:6827/405003958","heartbeat_back_addr":"172.21.15.39:6831/405003958","heartbeat_front_addr":"172.21.15.39:6829/405003958","state":["exists","up"]},{"osd":4,"uuid":"70f0dacb-e960-40c5-bf6a-183e52bbe2ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6801","nonce":3895278838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6805","nonce":3895278838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6813","nonce":3895278838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6809","nonce":3895278838}]},"public_addr":"172.21.15.118:6801/3895278838","cluster_addr":"172.21.15.118:6805/3895278838","heartbeat_back_addr":"172.21.15.118:6813/3895278838","heartbeat_front_addr":"172.21.15.118:6809/3895278838","state":["exists","up"]},{"osd":5,"uuid":"756feb54-c3ae-4a2a-8f74-85c291ba707c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6804","nonce":3513592808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6808","nonce":3513592808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6815","nonce":3513592808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6812","nonce":3513592808}]},"public_addr":"172.21.15.118:6804/3513592808","cluster_addr":"172.21.15.118:6808/3513592808","heartbeat_back_addr":"172.21.15.118:6815/3513592808","heartbeat_front_addr":"172.21.15.118:6812/3513592808","state":["exists","up"]},{"osd":6,"uuid":"c4a982c1-f497-4b0f-8a23-c77372e4621e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6824","nonce":1863656053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6827","nonce":1863656053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6831","nonce":1863656053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6829","nonce":1863656053}]},"public_addr":"172.21.15.118:6824/1863656053","cluster_addr":"172.21.15.118:6827/1863656053","heartbeat_back_addr":"172.21.15.118:6831/1863656053","heartbeat_front_addr":"172.21.15.118:6829/1863656053","state":["exists","up"]},{"osd":7,"uuid":"6f2888aa-a7ac-4e26-9159-e31817934f44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6817","nonce":3636642904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6819","nonce":3636642904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6825","nonce":3636642904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6821","nonce":3636642904}]},"public_addr":"172.21.15.118:6817/3636642904","cluster_addr":"172.21.15.118:6819/3636642904","heartbeat_back_addr":"172.21.15.118:6825/3636642904","heartbeat_front_addr":"172.21.15.118:6821/3636642904","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.717636+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.724036+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.739144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:58.079275+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:58.073921+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.930466+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.987813+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.941098+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.24","mappings":[{"from":1,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-16T13:55:02.300 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.292+0000 7f37f51f0640 1 -- 172.21.15.39:0/4283708660 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f37d0066280 msgr2=0x7f37d0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:02.301 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.292+0000 7f37f51f0640 1 --2- 172.21.15.39:0/4283708660 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f37d0066280 0x7f37d0068730 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f37f0150470 tx=0x7f37e0009190 comp rx=0 tx=0).stop 2023-05-16T13:55:02.301 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.292+0000 7f37f51f0640 1 -- 172.21.15.39:0/4283708660 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f37f0158bf0 msgr2=0x7f37f014f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:02.301 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.292+0000 7f37f51f0640 1 --2- 172.21.15.39:0/4283708660 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f37f0158bf0 0x7f37f014f740 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f37e801a580 tx=0x7f37e80196f0 comp rx=0 tx=0).stop 2023-05-16T13:55:02.301 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.292+0000 7f37f51f0640 1 -- 172.21.15.39:0/4283708660 shutdown_connections 2023-05-16T13:55:02.301 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.292+0000 7f37f51f0640 1 --2- 172.21.15.39:0/4283708660 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f37f0158bf0 0x7f37f014f740 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:02.301 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.292+0000 7f37f51f0640 1 --2- 172.21.15.39:0/4283708660 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37f00cb4c0 0x7f37f0161c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:02.301 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.292+0000 7f37f51f0640 1 --2- 172.21.15.39:0/4283708660 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f37d0066280 0x7f37d0068730 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:02.302 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.292+0000 7f37f51f0640 1 --2- 172.21.15.39:0/4283708660 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f37f00703b0 0x7f37f014aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:02.302 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.292+0000 7f37f51f0640 1 -- 172.21.15.39:0/4283708660 >> 172.21.15.39:0/4283708660 conn(0x7f37f0069a50 msgr2=0x7f37f0069e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:02.302 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.292+0000 7f37f51f0640 1 -- 172.21.15.39:0/4283708660 shutdown_connections 2023-05-16T13:55:02.302 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.292+0000 7f37f51f0640 1 -- 172.21.15.39:0/4283708660 wait complete. 2023-05-16T13:55:02.319 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-16T13:54:00.885009+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-16T13:54:08.327895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-16T13:54:12.864823+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-16T13:54:14.180225+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-16T13:55:02.320 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-16T13:55:02.460 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.452+0000 7f340ef60640 1 Processor -- start 2023-05-16T13:55:02.460 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.452+0000 7f340ef60640 1 -- start start 2023-05-16T13:55:02.461 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.456+0000 7f340ef60640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f34080aff50 0x7f34080b0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:02.461 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.456+0000 7f340ef60640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34080b08c0 con 0x7f3408070420 2023-05-16T13:55:02.461 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.456+0000 7f340ef60640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34080ca030 con 0x7f3408158e00 2023-05-16T13:55:02.461 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.456+0000 7f340ef60640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f340815c890 con 0x7f34080aff50 2023-05-16T13:55:02.461 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.456+0000 7f340d4fd640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f3408070420 0x7f3408070880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:51046/0 (socket says 172.21.15.39:51046) 2023-05-16T13:55:02.462 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.456+0000 7f340d4fd640 1 -- 172.21.15.39:0/3884071612 learned_addr learned my addr 172.21.15.39:0/3884071612 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:55:02.462 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.456+0000 7f3407fff640 1 --2- 172.21.15.39:0/3884071612 >> v2:172.21.15.118:3300/0 conn(0x7f34080aff50 0x7f34080b0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:02.463 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.456+0000 7f34077fe640 1 -- 172.21.15.39:0/3884071612 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 608822456 0 0) 0x7f34080b08c0 con 0x7f3408070420 2023-05-16T13:55:02.463 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.456+0000 7f34077fe640 1 -- 172.21.15.39:0/3884071612 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33f8003530 con 0x7f3408070420 2023-05-16T13:55:02.463 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.456+0000 7f3407fff640 1 -- 172.21.15.39:0/3884071612 >> v1:172.21.15.118:6789/0 conn(0x7f3408158e00 legacy=0x7f34080c9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:02.463 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.456+0000 7f3407fff640 1 -- 172.21.15.39:0/3884071612 >> v1:172.21.15.39:6789/0 conn(0x7f3408070420 legacy=0x7f3408070880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:02.463 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.456+0000 7f3407fff640 1 -- 172.21.15.39:0/3884071612 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f340815cb70 con 0x7f34080aff50 2023-05-16T13:55:02.464 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.460+0000 7f3407fff640 1 --2- 172.21.15.39:0/3884071612 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34080aff50 0x7f34080b0380 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f33f40097c0 tx=0x7f33f401ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d24a20d8b861cb9 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:02.465 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.460+0000 7f34077fe640 1 -- 172.21.15.39:0/3884071612 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f40a8970 con 0x7f34080aff50 2023-05-16T13:55:02.465 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.460+0000 7f34077fe640 1 -- 172.21.15.39:0/3884071612 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33f40a8ad0 con 0x7f34080aff50 2023-05-16T13:55:02.465 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.460+0000 7f34077fe640 1 -- 172.21.15.39:0/3884071612 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f40a8e60 con 0x7f34080aff50 2023-05-16T13:55:02.466 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.460+0000 7f340ef60640 1 -- 172.21.15.39:0/3884071612 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34080aff50 msgr2=0x7f34080b0380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:02.466 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.460+0000 7f340ef60640 1 --2- 172.21.15.39:0/3884071612 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34080aff50 0x7f34080b0380 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f33f40097c0 tx=0x7f33f401ec70 comp rx=0 tx=0).stop 2023-05-16T13:55:02.466 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.460+0000 7f340ef60640 1 -- 172.21.15.39:0/3884071612 shutdown_connections 2023-05-16T13:55:02.467 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.460+0000 7f340ef60640 1 --2- 172.21.15.39:0/3884071612 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f34080aff50 0x7f34080b0380 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:02.467 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.460+0000 7f340ef60640 1 -- 172.21.15.39:0/3884071612 >> 172.21.15.39:0/3884071612 conn(0x7f3408069a50 msgr2=0x7f3408069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:02.467 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.460+0000 7f340ef60640 1 -- 172.21.15.39:0/3884071612 shutdown_connections 2023-05-16T13:55:02.467 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.460+0000 7f340ef60640 1 -- 172.21.15.39:0/3884071612 wait complete. 2023-05-16T13:55:02.467 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.460+0000 7f340ef60640 1 Processor -- start 2023-05-16T13:55:02.468 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.460+0000 7f340ef60640 1 -- start start 2023-05-16T13:55:02.469 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.460+0000 7f340ef60640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3408070420 0x7f3408148260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:02.469 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.464+0000 7f340ef60640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f34080aff50 0x7f34080b3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:02.469 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.464+0000 7f340ef60640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3408158e00 0x7f34080b1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:02.470 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.464+0000 7f340ef60640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34081487a0 con 0x7f3408070420 2023-05-16T13:55:02.470 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.464+0000 7f340ef60640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34080b3ea0 con 0x7f3408158e00 2023-05-16T13:55:02.470 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.464+0000 7f340ef60640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34080b40f0 con 0x7f34080aff50 2023-05-16T13:55:02.470 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.464+0000 7f340ccfc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3408070420 0x7f3408148260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:02.470 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.464+0000 7f340ccfc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3408070420 0x7f3408148260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34568/0 (socket says 172.21.15.39:34568) 2023-05-16T13:55:02.470 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.464+0000 7f340ccfc640 1 -- 172.21.15.39:0/1651413873 learned_addr learned my addr 172.21.15.39:0/1651413873 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:02.470 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.464+0000 7f340d4fd640 1 --2- 172.21.15.39:0/1651413873 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3408158e00 0x7f34080b1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:02.471 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.464+0000 7f3407fff640 1 --2- 172.21.15.39:0/1651413873 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f34080aff50 0x7f34080b3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:02.471 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.464+0000 7f340ccfc640 1 -- 172.21.15.39:0/1651413873 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f34080aff50 msgr2=0x7f34080b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:02.471 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.464+0000 7f340ccfc640 1 --2- 172.21.15.39:0/1651413873 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f34080aff50 0x7f34080b3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:02.471 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.464+0000 7f340ccfc640 1 -- 172.21.15.39:0/1651413873 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3408158e00 msgr2=0x7f34080b1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:02.471 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.464+0000 7f340ccfc640 1 --2- 172.21.15.39:0/1651413873 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3408158e00 0x7f34080b1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:02.471 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.464+0000 7f340ccfc640 1 -- 172.21.15.39:0/1651413873 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f4009420 con 0x7f3408070420 2023-05-16T13:55:02.472 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.464+0000 7f340ccfc640 1 --2- 172.21.15.39:0/1651413873 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3408070420 0x7f3408148260 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f33fc00c3f0 tx=0x7f33fc00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:02.472 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.464+0000 7f34057fa640 1 -- 172.21.15.39:0/1651413873 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33fc0052d0 con 0x7f3408070420 2023-05-16T13:55:02.473 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.464+0000 7f34057fa640 1 -- 172.21.15.39:0/1651413873 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33fc005430 con 0x7f3408070420 2023-05-16T13:55:02.473 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.464+0000 7f340ef60640 1 -- 172.21.15.39:0/1651413873 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f340815d130 con 0x7f3408070420 2023-05-16T13:55:02.473 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.464+0000 7f34057fa640 1 -- 172.21.15.39:0/1651413873 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33fc003840 con 0x7f3408070420 2023-05-16T13:55:02.473 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.464+0000 7f340ef60640 1 -- 172.21.15.39:0/1651413873 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f340815ce50 con 0x7f3408070420 2023-05-16T13:55:02.473 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.464+0000 7f340ef60640 1 -- 172.21.15.39:0/1651413873 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34080cc730 con 0x7f3408070420 2023-05-16T13:55:02.473 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.464+0000 7f34057fa640 1 -- 172.21.15.39:0/1651413873 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f33fc0039a0 con 0x7f3408070420 2023-05-16T13:55:02.474 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.468+0000 7f34057fa640 1 --2- 172.21.15.39:0/1651413873 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f33ec066280 0x7f33ec068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:02.474 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.468+0000 7f34057fa640 1 -- 172.21.15.39:0/1651413873 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f33fc083270 con 0x7f3408070420 2023-05-16T13:55:02.474 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.468+0000 7f3407fff640 1 --2- 172.21.15.39:0/1651413873 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f33ec066280 0x7f33ec068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:02.474 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.468+0000 7f3407fff640 1 --2- 172.21.15.39:0/1651413873 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f33ec066280 0x7f33ec068730 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f33f40b2000 tx=0x7f33f4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:02.477 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.472+0000 7f34057fa640 1 -- 172.21.15.39:0/1651413873 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f33fc050760 con 0x7f3408070420 2023-05-16T13:55:02.630 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.624+0000 7f340ef60640 1 -- 172.21.15.39:0/1651413873 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3408073c90 con 0x7f3408070420 2023-05-16T13:55:02.631 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.624+0000 7f34057fa640 1 -- 172.21.15.39:0/1651413873 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f33fc053d80 con 0x7f3408070420 2023-05-16T13:55:02.631 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2023-05-16T13:55:02.633 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.624+0000 7f340ef60640 1 -- 172.21.15.39:0/1651413873 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f33ec066280 msgr2=0x7f33ec068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:02.633 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.624+0000 7f340ef60640 1 --2- 172.21.15.39:0/1651413873 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f33ec066280 0x7f33ec068730 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f33f40b2000 tx=0x7f33f4008040 comp rx=0 tx=0).stop 2023-05-16T13:55:02.633 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.624+0000 7f340ef60640 1 -- 172.21.15.39:0/1651413873 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3408070420 msgr2=0x7f3408148260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:02.633 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.628+0000 7f340ef60640 1 --2- 172.21.15.39:0/1651413873 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3408070420 0x7f3408148260 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f33fc00c3f0 tx=0x7f33fc00c8b0 comp rx=0 tx=0).stop 2023-05-16T13:55:02.634 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.628+0000 7f340ef60640 1 -- 172.21.15.39:0/1651413873 shutdown_connections 2023-05-16T13:55:02.634 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.628+0000 7f340ef60640 1 --2- 172.21.15.39:0/1651413873 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f33ec066280 0x7f33ec068730 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:02.634 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.628+0000 7f340ef60640 1 --2- 172.21.15.39:0/1651413873 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f34080aff50 0x7f34080b3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:02.634 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.628+0000 7f340ef60640 1 --2- 172.21.15.39:0/1651413873 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3408158e00 0x7f34080b1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:02.634 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.628+0000 7f340ef60640 1 --2- 172.21.15.39:0/1651413873 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3408070420 0x7f3408148260 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:02.634 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.628+0000 7f340ef60640 1 -- 172.21.15.39:0/1651413873 >> 172.21.15.39:0/1651413873 conn(0x7f3408069a50 msgr2=0x7f3408157fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:02.634 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.628+0000 7f340ef60640 1 -- 172.21.15.39:0/1651413873 shutdown_connections 2023-05-16T13:55:02.635 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.628+0000 7f340ef60640 1 -- 172.21.15.39:0/1651413873 wait complete. 2023-05-16T13:55:02.651 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-16T13:55:02.792 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.784+0000 7fa7e5420640 1 Processor -- start 2023-05-16T13:55:02.792 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.784+0000 7fa7e5420640 1 -- start start 2023-05-16T13:55:02.793 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.788+0000 7fa7e5420640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa7e00cc720 0x7fa7e006c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:02.793 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.788+0000 7fa7e5420640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7e006c930 con 0x7fa7e015fa90 2023-05-16T13:55:02.794 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.788+0000 7fa7e5420640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7e00b2030 con 0x7fa7e00cce20 2023-05-16T13:55:02.794 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.788+0000 7fa7e5420640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e006cc10 con 0x7fa7e00cc720 2023-05-16T13:55:02.794 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.788+0000 7fa7df7fe640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fa7e015fa90 0x7fa7e015ff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:51050/0 (socket says 172.21.15.39:51050) 2023-05-16T13:55:02.794 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.788+0000 7fa7df7fe640 1 -- 172.21.15.39:0/1968397677 learned_addr learned my addr 172.21.15.39:0/1968397677 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:55:02.794 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.788+0000 7fa7d7fff640 1 --2- 172.21.15.39:0/1968397677 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa7e00cc720 0x7fa7e006c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:02.795 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.788+0000 7fa7de7fc640 1 -- 172.21.15.39:0/1968397677 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4246721648 0 0) 0x7fa7e006c930 con 0x7fa7e015fa90 2023-05-16T13:55:02.795 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.788+0000 7fa7de7fc640 1 -- 172.21.15.39:0/1968397677 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7cc003530 con 0x7fa7e015fa90 2023-05-16T13:55:02.795 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.788+0000 7fa7de7fc640 1 -- 172.21.15.39:0/1968397677 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3017845328 0 0) 0x7fa7e00b2030 con 0x7fa7e00cce20 2023-05-16T13:55:02.795 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.788+0000 7fa7de7fc640 1 -- 172.21.15.39:0/1968397677 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7e006c930 con 0x7fa7e00cce20 2023-05-16T13:55:02.796 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.788+0000 7fa7d7fff640 1 -- 172.21.15.39:0/1968397677 >> v1:172.21.15.118:6789/0 conn(0x7fa7e00cce20 legacy=0x7fa7e00cd1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:02.796 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.788+0000 7fa7d7fff640 1 -- 172.21.15.39:0/1968397677 >> v1:172.21.15.39:6789/0 conn(0x7fa7e015fa90 legacy=0x7fa7e015ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:02.796 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.788+0000 7fa7d7fff640 1 -- 172.21.15.39:0/1968397677 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e00b2310 con 0x7fa7e00cc720 2023-05-16T13:55:02.797 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.792+0000 7fa7d7fff640 1 --2- 172.21.15.39:0/1968397677 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa7e00cc720 0x7fa7e006c030 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa7c80097f0 tx=0x7fa7c801c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f004219d7e83408 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:02.797 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.792+0000 7fa7de7fc640 1 -- 172.21.15.39:0/1968397677 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c80ac600 con 0x7fa7e00cc720 2023-05-16T13:55:02.797 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.792+0000 7fa7de7fc640 1 -- 172.21.15.39:0/1968397677 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c80a8050 con 0x7fa7e00cc720 2023-05-16T13:55:02.798 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.792+0000 7fa7de7fc640 1 -- 172.21.15.39:0/1968397677 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c80ac980 con 0x7fa7e00cc720 2023-05-16T13:55:02.798 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.792+0000 7fa7e5420640 1 -- 172.21.15.39:0/1968397677 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa7e00cc720 msgr2=0x7fa7e006c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:02.799 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.792+0000 7fa7e5420640 1 --2- 172.21.15.39:0/1968397677 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa7e00cc720 0x7fa7e006c030 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa7c80097f0 tx=0x7fa7c801c490 comp rx=0 tx=0).stop 2023-05-16T13:55:02.799 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.792+0000 7fa7e5420640 1 -- 172.21.15.39:0/1968397677 shutdown_connections 2023-05-16T13:55:02.799 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.792+0000 7fa7e5420640 1 --2- 172.21.15.39:0/1968397677 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa7e00cc720 0x7fa7e006c030 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:02.799 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.792+0000 7fa7e5420640 1 -- 172.21.15.39:0/1968397677 >> 172.21.15.39:0/1968397677 conn(0x7fa7e006dd10 msgr2=0x7fa7e006e110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:02.799 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.792+0000 7fa7e5420640 1 -- 172.21.15.39:0/1968397677 shutdown_connections 2023-05-16T13:55:02.799 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.792+0000 7fa7e5420640 1 -- 172.21.15.39:0/1968397677 wait complete. 2023-05-16T13:55:02.800 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.792+0000 7fa7e5420640 1 Processor -- start 2023-05-16T13:55:02.800 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.792+0000 7fa7e5420640 1 -- start start 2023-05-16T13:55:02.801 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.796+0000 7fa7e5420640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa7e00cc720 0x7fa7e0157a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:02.801 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.796+0000 7fa7e5420640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa7e00cce20 0x7fa7e0158e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:02.801 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.796+0000 7fa7e5420640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7e015fa90 0x7fa7e01f4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:02.802 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.796+0000 7fa7e5420640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e01f5780 con 0x7fa7e015fa90 2023-05-16T13:55:02.802 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.796+0000 7fa7e5420640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e01f5a60 con 0x7fa7e00cc720 2023-05-16T13:55:02.802 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.796+0000 7fa7e5420640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e0158360 con 0x7fa7e00cce20 2023-05-16T13:55:02.802 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.796+0000 7fa7df7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7e015fa90 0x7fa7e01f4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:02.802 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.796+0000 7fa7deffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa7e00cc720 0x7fa7e0157a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:02.802 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.796+0000 7fa7deffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa7e00cc720 0x7fa7e0157a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.39:41532/0 (socket says 172.21.15.39:41532) 2023-05-16T13:55:02.802 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.796+0000 7fa7deffd640 1 -- 172.21.15.39:0/819236505 learned_addr learned my addr 172.21.15.39:0/819236505 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:02.803 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.796+0000 7fa7d7fff640 1 --2- 172.21.15.39:0/819236505 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa7e00cce20 0x7fa7e0158e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:02.803 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.796+0000 7fa7df7fe640 1 -- 172.21.15.39:0/819236505 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa7e00cce20 msgr2=0x7fa7e0158e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:02.804 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.796+0000 7fa7df7fe640 1 --2- 172.21.15.39:0/819236505 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa7e00cce20 0x7fa7e0158e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:02.804 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.796+0000 7fa7df7fe640 1 -- 172.21.15.39:0/819236505 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa7e00cc720 msgr2=0x7fa7e0157a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:02.804 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.796+0000 7fa7df7fe640 1 --2- 172.21.15.39:0/819236505 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa7e00cc720 0x7fa7e0157a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:02.804 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.796+0000 7fa7df7fe640 1 -- 172.21.15.39:0/819236505 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7c8009420 con 0x7fa7e015fa90 2023-05-16T13:55:02.804 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.796+0000 7fa7deffd640 1 --2- 172.21.15.39:0/819236505 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa7e00cc720 0x7fa7e0157a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-16T13:55:02.805 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.796+0000 7fa7df7fe640 1 --2- 172.21.15.39:0/819236505 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7e015fa90 0x7fa7e01f4b40 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa7d800ca70 tx=0x7fa7d800cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:02.805 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.796+0000 7fa7d77fe640 1 -- 172.21.15.39:0/819236505 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d800abd0 con 0x7fa7e015fa90 2023-05-16T13:55:02.805 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.796+0000 7fa7d77fe640 1 -- 172.21.15.39:0/819236505 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7d800ad30 con 0x7fa7e015fa90 2023-05-16T13:55:02.805 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.796+0000 7fa7e5420640 1 -- 172.21.15.39:0/819236505 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7e006c700 con 0x7fa7e015fa90 2023-05-16T13:55:02.805 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.796+0000 7fa7d77fe640 1 -- 172.21.15.39:0/819236505 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d8012600 con 0x7fa7e015fa90 2023-05-16T13:55:02.805 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.796+0000 7fa7e5420640 1 -- 172.21.15.39:0/819236505 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7e006c570 con 0x7fa7e015fa90 2023-05-16T13:55:02.805 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.796+0000 7fa7e5420640 1 -- 172.21.15.39:0/819236505 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7e00b2b10 con 0x7fa7e015fa90 2023-05-16T13:55:02.806 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.796+0000 7fa7d77fe640 1 -- 172.21.15.39:0/819236505 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa7d8007070 con 0x7fa7e015fa90 2023-05-16T13:55:02.806 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.800+0000 7fa7d77fe640 1 --2- 172.21.15.39:0/819236505 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fa7c00662b0 0x7fa7c0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:02.806 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.800+0000 7fa7d77fe640 1 -- 172.21.15.39:0/819236505 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fa7d8083bc0 con 0x7fa7e015fa90 2023-05-16T13:55:02.807 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.800+0000 7fa7deffd640 1 --2- 172.21.15.39:0/819236505 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fa7c00662b0 0x7fa7c0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:02.807 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.800+0000 7fa7deffd640 1 --2- 172.21.15.39:0/819236505 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fa7c00662b0 0x7fa7c0068760 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa7d00011f0 tx=0x7fa7d0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:02.809 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.804+0000 7fa7d77fe640 1 -- 172.21.15.39:0/819236505 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fa7d8051010 con 0x7fa7e015fa90 2023-05-16T13:55:02.971 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.964+0000 7fa7e5420640 1 -- 172.21.15.39:0/819236505 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa7e004ed20 con 0x7fa7e015fa90 2023-05-16T13:55:02.972 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.964+0000 7fa7d77fe640 1 -- 172.21.15.39:0/819236505 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa7d8054630 con 0x7fa7e015fa90 2023-05-16T13:55:02.972 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 8 2023-05-16T13:55:02.974 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.968+0000 7fa7e5420640 1 -- 172.21.15.39:0/819236505 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fa7c00662b0 msgr2=0x7fa7c0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:02.974 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.968+0000 7fa7e5420640 1 --2- 172.21.15.39:0/819236505 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fa7c00662b0 0x7fa7c0068760 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa7d00011f0 tx=0x7fa7d0009040 comp rx=0 tx=0).stop 2023-05-16T13:55:02.974 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.968+0000 7fa7e5420640 1 -- 172.21.15.39:0/819236505 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7e015fa90 msgr2=0x7fa7e01f4b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:02.975 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.968+0000 7fa7e5420640 1 --2- 172.21.15.39:0/819236505 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7e015fa90 0x7fa7e01f4b40 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa7d800ca70 tx=0x7fa7d800cf30 comp rx=0 tx=0).stop 2023-05-16T13:55:02.975 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.968+0000 7fa7e5420640 1 -- 172.21.15.39:0/819236505 shutdown_connections 2023-05-16T13:55:02.975 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.968+0000 7fa7e5420640 1 --2- 172.21.15.39:0/819236505 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fa7c00662b0 0x7fa7c0068760 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:02.975 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.968+0000 7fa7e5420640 1 --2- 172.21.15.39:0/819236505 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa7e00cce20 0x7fa7e0158e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:02.975 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.968+0000 7fa7e5420640 1 --2- 172.21.15.39:0/819236505 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7e015fa90 0x7fa7e01f4b40 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:02.975 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.968+0000 7fa7e5420640 1 --2- 172.21.15.39:0/819236505 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa7e00cc720 0x7fa7e0157a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:02.975 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.968+0000 7fa7e5420640 1 -- 172.21.15.39:0/819236505 >> 172.21.15.39:0/819236505 conn(0x7fa7e006dd10 msgr2=0x7fa7e006b890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:02.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.968+0000 7fa7e5420640 1 -- 172.21.15.39:0/819236505 shutdown_connections 2023-05-16T13:55:02.976 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:02.968+0000 7fa7e5420640 1 -- 172.21.15.39:0/819236505 wait complete. 2023-05-16T13:55:02.992 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-16T13:55:03.133 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.128+0000 7fccea7e1640 1 Processor -- start 2023-05-16T13:55:03.134 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.128+0000 7fccea7e1640 1 -- start start 2023-05-16T13:55:03.134 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.128+0000 7fccea7e1640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcce40aff50 0x7fcce40b0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:03.135 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.128+0000 7fccea7e1640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fcce4070420 0x7fcce40708a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:03.135 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.128+0000 7fccea7e1640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcce40b08c0 con 0x7fcce4158e00 2023-05-16T13:55:03.135 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.128+0000 7fccea7e1640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcce40ca030 con 0x7fcce4070420 2023-05-16T13:55:03.135 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.128+0000 7fccea7e1640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcce415c890 con 0x7fcce40aff50 2023-05-16T13:55:03.136 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.128+0000 7fcce37fe640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcce40aff50 0x7fcce40b0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:03.136 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.128+0000 7fcce37fe640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcce40aff50 0x7fcce40b0380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.39:40980/0 (socket says 172.21.15.39:40980) 2023-05-16T13:55:03.136 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.128+0000 7fcce37fe640 1 -- 172.21.15.39:0/888563796 learned_addr learned my addr 172.21.15.39:0/888563796 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:03.136 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.128+0000 7fcce8d7e640 1 --2- 172.21.15.39:0/888563796 >> v2:172.21.15.118:3300/0 conn(0x7fcce4070420 0x7fcce40708a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:03.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.128+0000 7fcce37fe640 1 -- 172.21.15.39:0/888563796 >> v2:172.21.15.118:3300/0 conn(0x7fcce4070420 msgr2=0x7fcce40708a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:03.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.128+0000 7fcce37fe640 1 --2- 172.21.15.39:0/888563796 >> v2:172.21.15.118:3300/0 conn(0x7fcce4070420 0x7fcce40708a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:03.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.128+0000 7fcce37fe640 1 -- 172.21.15.39:0/888563796 >> v1:172.21.15.118:6789/0 conn(0x7fcce4158e00 legacy=0x7fcce40c9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:03.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.128+0000 7fcce37fe640 1 -- 172.21.15.39:0/888563796 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce415cb70 con 0x7fcce40aff50 2023-05-16T13:55:03.138 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.132+0000 7fcce37fe640 1 --2- 172.21.15.39:0/888563796 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcce40aff50 0x7fcce40b0380 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fccd8009870 tx=0x7fccd801ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e0771df1d6cb9f9 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:03.139 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.132+0000 7fcce2ffd640 1 -- 172.21.15.39:0/888563796 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd80a8a30 con 0x7fcce40aff50 2023-05-16T13:55:03.139 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.132+0000 7fcce2ffd640 1 -- 172.21.15.39:0/888563796 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccd80a8b90 con 0x7fcce40aff50 2023-05-16T13:55:03.139 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.132+0000 7fcce2ffd640 1 -- 172.21.15.39:0/888563796 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd80b0440 con 0x7fcce40aff50 2023-05-16T13:55:03.140 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.132+0000 7fccea7e1640 1 -- 172.21.15.39:0/888563796 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcce40aff50 msgr2=0x7fcce40b0380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:03.140 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.132+0000 7fccea7e1640 1 --2- 172.21.15.39:0/888563796 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcce40aff50 0x7fcce40b0380 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fccd8009870 tx=0x7fccd801ed30 comp rx=0 tx=0).stop 2023-05-16T13:55:03.140 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.132+0000 7fccea7e1640 1 -- 172.21.15.39:0/888563796 shutdown_connections 2023-05-16T13:55:03.141 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.132+0000 7fccea7e1640 1 --2- 172.21.15.39:0/888563796 >> v2:172.21.15.118:3300/0 conn(0x7fcce4070420 0x7fcce40708a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:03.141 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.132+0000 7fccea7e1640 1 --2- 172.21.15.39:0/888563796 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcce40aff50 0x7fcce40b0380 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:03.141 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.132+0000 7fccea7e1640 1 -- 172.21.15.39:0/888563796 >> 172.21.15.39:0/888563796 conn(0x7fcce4069a50 msgr2=0x7fcce4069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:03.141 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.132+0000 7fccea7e1640 1 -- 172.21.15.39:0/888563796 shutdown_connections 2023-05-16T13:55:03.141 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.132+0000 7fccea7e1640 1 -- 172.21.15.39:0/888563796 wait complete. 2023-05-16T13:55:03.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.136+0000 7fccea7e1640 1 Processor -- start 2023-05-16T13:55:03.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.136+0000 7fccea7e1640 1 -- start start 2023-05-16T13:55:03.143 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.136+0000 7fccea7e1640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcce4070420 0x7fcce40c6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:03.143 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.136+0000 7fccea7e1640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcce40aff50 0x7fcce4152dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:03.143 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.136+0000 7fccea7e1640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcce4158e00 0x7fcce40cb310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:03.143 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.136+0000 7fccea7e1640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce40c6570 con 0x7fcce40aff50 2023-05-16T13:55:03.143 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.136+0000 7fccea7e1640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce40c5960 con 0x7fcce4070420 2023-05-16T13:55:03.144 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.136+0000 7fccea7e1640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcce40c5c40 con 0x7fcce4158e00 2023-05-16T13:55:03.144 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.136+0000 7fcce37fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcce40aff50 0x7fcce4152dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:03.144 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.136+0000 7fcce37fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcce40aff50 0x7fcce4152dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34592/0 (socket says 172.21.15.39:34592) 2023-05-16T13:55:03.144 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.136+0000 7fcce37fe640 1 -- 172.21.15.39:0/1742400714 learned_addr learned my addr 172.21.15.39:0/1742400714 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:03.144 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.136+0000 7fcce3fff640 1 --2- 172.21.15.39:0/1742400714 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcce4070420 0x7fcce40c6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:03.144 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.136+0000 7fcce8d7e640 1 --2- 172.21.15.39:0/1742400714 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcce4158e00 0x7fcce40cb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:03.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.136+0000 7fcce37fe640 1 -- 172.21.15.39:0/1742400714 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcce4158e00 msgr2=0x7fcce40cb310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:03.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.136+0000 7fcce37fe640 1 --2- 172.21.15.39:0/1742400714 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcce4158e00 0x7fcce40cb310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:03.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.136+0000 7fcce37fe640 1 -- 172.21.15.39:0/1742400714 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcce4070420 msgr2=0x7fcce40c6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:03.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.136+0000 7fcce37fe640 1 --2- 172.21.15.39:0/1742400714 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcce4070420 0x7fcce40c6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:03.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.136+0000 7fcce37fe640 1 -- 172.21.15.39:0/1742400714 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd80094d0 con 0x7fcce40aff50 2023-05-16T13:55:03.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.136+0000 7fcce37fe640 1 --2- 172.21.15.39:0/1742400714 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcce40aff50 0x7fcce4152dd0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fccd80b3040 tx=0x7fccd801bad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:03.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.136+0000 7fcce0ff9640 1 -- 172.21.15.39:0/1742400714 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd80b0dd0 con 0x7fcce40aff50 2023-05-16T13:55:03.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.136+0000 7fcce0ff9640 1 -- 172.21.15.39:0/1742400714 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccd80bb460 con 0x7fcce40aff50 2023-05-16T13:55:03.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.136+0000 7fcce0ff9640 1 -- 172.21.15.39:0/1742400714 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd80bb810 con 0x7fcce40aff50 2023-05-16T13:55:03.147 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.136+0000 7fccea7e1640 1 -- 172.21.15.39:0/1742400714 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcce415d130 con 0x7fcce40aff50 2023-05-16T13:55:03.147 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.136+0000 7fccea7e1640 1 -- 172.21.15.39:0/1742400714 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcce415ce50 con 0x7fcce40aff50 2023-05-16T13:55:03.147 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.140+0000 7fccea7e1640 1 -- 172.21.15.39:0/1742400714 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcce40cc730 con 0x7fcce40aff50 2023-05-16T13:55:03.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.140+0000 7fcce0ff9640 1 -- 172.21.15.39:0/1742400714 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fccd80b83f0 con 0x7fcce40aff50 2023-05-16T13:55:03.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.140+0000 7fcce0ff9640 1 --2- 172.21.15.39:0/1742400714 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fccd0066280 0x7fccd0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:03.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.140+0000 7fcce0ff9640 1 -- 172.21.15.39:0/1742400714 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fccd8121500 con 0x7fcce40aff50 2023-05-16T13:55:03.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.140+0000 7fcce3fff640 1 --2- 172.21.15.39:0/1742400714 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fccd0066280 0x7fccd0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:03.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.140+0000 7fcce3fff640 1 --2- 172.21.15.39:0/1742400714 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fccd0066280 0x7fccd0068730 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fccd4007fd0 tx=0x7fccd4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:03.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.144+0000 7fcce0ff9640 1 -- 172.21.15.39:0/1742400714 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fccd80ee9e0 con 0x7fcce40aff50 2023-05-16T13:55:03.307 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.300+0000 7fccea7e1640 1 -- 172.21.15.39:0/1742400714 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcce4073c90 con 0x7fcce40aff50 2023-05-16T13:55:03.308 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.300+0000 7fcce0ff9640 1 -- 172.21.15.39:0/1742400714 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fccd80f2000 con 0x7fcce40aff50 2023-05-16T13:55:03.308 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2023-05-16T13:55:03.310 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.304+0000 7fccea7e1640 1 -- 172.21.15.39:0/1742400714 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fccd0066280 msgr2=0x7fccd0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:03.310 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.304+0000 7fccea7e1640 1 --2- 172.21.15.39:0/1742400714 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fccd0066280 0x7fccd0068730 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fccd4007fd0 tx=0x7fccd4009040 comp rx=0 tx=0).stop 2023-05-16T13:55:03.310 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.304+0000 7fccea7e1640 1 -- 172.21.15.39:0/1742400714 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcce40aff50 msgr2=0x7fcce4152dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:03.310 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.304+0000 7fccea7e1640 1 --2- 172.21.15.39:0/1742400714 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcce40aff50 0x7fcce4152dd0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fccd80b3040 tx=0x7fccd801bad0 comp rx=0 tx=0).stop 2023-05-16T13:55:03.310 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.304+0000 7fccea7e1640 1 -- 172.21.15.39:0/1742400714 shutdown_connections 2023-05-16T13:55:03.311 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.304+0000 7fccea7e1640 1 --2- 172.21.15.39:0/1742400714 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fccd0066280 0x7fccd0068730 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:03.311 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.304+0000 7fccea7e1640 1 --2- 172.21.15.39:0/1742400714 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcce4158e00 0x7fcce40cb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:03.311 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.304+0000 7fccea7e1640 1 --2- 172.21.15.39:0/1742400714 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcce40aff50 0x7fcce4152dd0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:03.311 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.304+0000 7fccea7e1640 1 --2- 172.21.15.39:0/1742400714 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcce4070420 0x7fcce40c6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:03.311 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.304+0000 7fccea7e1640 1 -- 172.21.15.39:0/1742400714 >> 172.21.15.39:0/1742400714 conn(0x7fcce4069a50 msgr2=0x7fcce40af4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:03.311 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.304+0000 7fccea7e1640 1 -- 172.21.15.39:0/1742400714 shutdown_connections 2023-05-16T13:55:03.311 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.304+0000 7fccea7e1640 1 -- 172.21.15.39:0/1742400714 wait complete. 2023-05-16T13:55:03.329 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-16T13:55:03.470 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.464+0000 7fac02a74640 1 Processor -- start 2023-05-16T13:55:03.470 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.464+0000 7fac02a74640 1 -- start start 2023-05-16T13:55:03.471 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.464+0000 7fac02a74640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fabfc158e00 0x7fabfc0c9530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:03.471 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.464+0000 7fac02a74640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fabfc0c9a70 0x7fabfc0aff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:03.471 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.464+0000 7fac02a74640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fabfc0b0490 0x7fabfc0caec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:03.472 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.464+0000 7fac02a74640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabfc0b0910 con 0x7fabfc0b0490 2023-05-16T13:55:03.472 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.464+0000 7fac02a74640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabfc0ca030 con 0x7fabfc0c9a70 2023-05-16T13:55:03.472 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.464+0000 7fac02a74640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabfc15c890 con 0x7fabfc158e00 2023-05-16T13:55:03.472 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.464+0000 7fac01011640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fabfc0b0490 0x7fabfc0caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:03.472 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.464+0000 7fac01011640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fabfc0b0490 0x7fabfc0caec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34604/0 (socket says 172.21.15.39:34604) 2023-05-16T13:55:03.472 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.464+0000 7fac01011640 1 -- 172.21.15.39:0/1802688187 learned_addr learned my addr 172.21.15.39:0/1802688187 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:03.472 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.464+0000 7fabfbfff640 1 --2- 172.21.15.39:0/1802688187 >> v2:172.21.15.118:3300/0 conn(0x7fabfc0c9a70 0x7fabfc0aff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:03.473 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.464+0000 7fac00810640 1 --2- 172.21.15.39:0/1802688187 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fabfc158e00 0x7fabfc0c9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:03.473 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.464+0000 7fac01011640 1 -- 172.21.15.39:0/1802688187 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fabfc158e00 msgr2=0x7fabfc0c9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:03.473 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.464+0000 7fac01011640 1 --2- 172.21.15.39:0/1802688187 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fabfc158e00 0x7fabfc0c9530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:03.474 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.464+0000 7fac01011640 1 -- 172.21.15.39:0/1802688187 >> v2:172.21.15.118:3300/0 conn(0x7fabfc0c9a70 msgr2=0x7fabfc0aff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:03.474 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.464+0000 7fac01011640 1 --2- 172.21.15.39:0/1802688187 >> v2:172.21.15.118:3300/0 conn(0x7fabfc0c9a70 0x7fabfc0aff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:03.474 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.464+0000 7fac01011640 1 -- 172.21.15.39:0/1802688187 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabfc15cb70 con 0x7fabfc0b0490 2023-05-16T13:55:03.474 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.468+0000 7fac01011640 1 --2- 172.21.15.39:0/1802688187 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fabfc0b0490 0x7fabfc0caec0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fabfc0cbfd0 tx=0x7fabf401f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5543d847dd4abadf server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:03.475 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.468+0000 7fabfb7fe640 1 -- 172.21.15.39:0/1802688187 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf40af400 con 0x7fabfc0b0490 2023-05-16T13:55:03.475 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.468+0000 7fabfb7fe640 1 -- 172.21.15.39:0/1802688187 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabf40ab050 con 0x7fabfc0b0490 2023-05-16T13:55:03.475 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.468+0000 7fabfb7fe640 1 -- 172.21.15.39:0/1802688187 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf40af780 con 0x7fabfc0b0490 2023-05-16T13:55:03.476 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.468+0000 7fac02a74640 1 -- 172.21.15.39:0/1802688187 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fabfc0b0490 msgr2=0x7fabfc0caec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:03.476 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.468+0000 7fac02a74640 1 --2- 172.21.15.39:0/1802688187 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fabfc0b0490 0x7fabfc0caec0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fabfc0cbfd0 tx=0x7fabf401f1c0 comp rx=0 tx=0).stop 2023-05-16T13:55:03.476 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.468+0000 7fac02a74640 1 -- 172.21.15.39:0/1802688187 shutdown_connections 2023-05-16T13:55:03.476 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.468+0000 7fac02a74640 1 --2- 172.21.15.39:0/1802688187 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fabfc0b0490 0x7fabfc0caec0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:03.476 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.468+0000 7fac02a74640 1 --2- 172.21.15.39:0/1802688187 >> v2:172.21.15.118:3300/0 conn(0x7fabfc0c9a70 0x7fabfc0aff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:03.476 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.468+0000 7fac02a74640 1 --2- 172.21.15.39:0/1802688187 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fabfc158e00 0x7fabfc0c9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:03.477 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.468+0000 7fac02a74640 1 -- 172.21.15.39:0/1802688187 >> 172.21.15.39:0/1802688187 conn(0x7fabfc069a50 msgr2=0x7fabfc069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:03.477 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.468+0000 7fac02a74640 1 -- 172.21.15.39:0/1802688187 shutdown_connections 2023-05-16T13:55:03.477 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.468+0000 7fac02a74640 1 -- 172.21.15.39:0/1802688187 wait complete. 2023-05-16T13:55:03.477 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.472+0000 7fac02a74640 1 Processor -- start 2023-05-16T13:55:03.478 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.472+0000 7fac02a74640 1 -- start start 2023-05-16T13:55:03.479 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.472+0000 7fac02a74640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabfc0b0490 0x7fabfc0accc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:03.479 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.472+0000 7fac02a74640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fabfc0c9a70 0x7fabfc157510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:03.479 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.472+0000 7fac02a74640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fabfc158e00 0x7fabfc0b12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:03.479 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.472+0000 7fac02a74640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabfc0ad200 con 0x7fabfc0c9a70 2023-05-16T13:55:03.479 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.472+0000 7fac02a74640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabfc0abc20 con 0x7fabfc0b0490 2023-05-16T13:55:03.479 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.472+0000 7fac02a74640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabfc0abf00 con 0x7fabfc158e00 2023-05-16T13:55:03.480 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.472+0000 7fabfbfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fabfc0c9a70 0x7fabfc157510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:03.480 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.472+0000 7fabfbfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fabfc0c9a70 0x7fabfc157510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34612/0 (socket says 172.21.15.39:34612) 2023-05-16T13:55:03.480 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.472+0000 7fabfbfff640 1 -- 172.21.15.39:0/2241235845 learned_addr learned my addr 172.21.15.39:0/2241235845 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:03.480 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.472+0000 7fac00810640 1 --2- 172.21.15.39:0/2241235845 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabfc0b0490 0x7fabfc0accc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:03.480 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.472+0000 7fac01011640 1 --2- 172.21.15.39:0/2241235845 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fabfc158e00 0x7fabfc0b12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:03.480 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.472+0000 7fabfbfff640 1 -- 172.21.15.39:0/2241235845 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fabfc158e00 msgr2=0x7fabfc0b12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:03.481 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.472+0000 7fabfbfff640 1 --2- 172.21.15.39:0/2241235845 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fabfc158e00 0x7fabfc0b12e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:03.481 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.472+0000 7fabfbfff640 1 -- 172.21.15.39:0/2241235845 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabfc0b0490 msgr2=0x7fabfc0accc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:03.481 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.472+0000 7fabfbfff640 1 --2- 172.21.15.39:0/2241235845 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabfc0b0490 0x7fabfc0accc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:03.481 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.472+0000 7fabfbfff640 1 -- 172.21.15.39:0/2241235845 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf4009b30 con 0x7fabfc0c9a70 2023-05-16T13:55:03.482 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.472+0000 7fabfbfff640 1 --2- 172.21.15.39:0/2241235845 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fabfc0c9a70 0x7fabfc157510 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fabe800e870 tx=0x7fabe800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:03.482 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.472+0000 7fabf97fa640 1 -- 172.21.15.39:0/2241235845 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe800ee60 con 0x7fabfc0c9a70 2023-05-16T13:55:03.482 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.472+0000 7fabf97fa640 1 -- 172.21.15.39:0/2241235845 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabe800c940 con 0x7fabfc0c9a70 2023-05-16T13:55:03.482 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.472+0000 7fac02a74640 1 -- 172.21.15.39:0/2241235845 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabfc15d130 con 0x7fabfc0c9a70 2023-05-16T13:55:03.483 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.472+0000 7fabf97fa640 1 -- 172.21.15.39:0/2241235845 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe800ccf0 con 0x7fabfc0c9a70 2023-05-16T13:55:03.483 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.472+0000 7fac02a74640 1 -- 172.21.15.39:0/2241235845 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabfc15ce50 con 0x7fabfc0c9a70 2023-05-16T13:55:03.483 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.472+0000 7fac02a74640 1 -- 172.21.15.39:0/2241235845 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabfc0cc730 con 0x7fabfc0c9a70 2023-05-16T13:55:03.483 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.476+0000 7fabf97fa640 1 -- 172.21.15.39:0/2241235845 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fabe8013470 con 0x7fabfc0c9a70 2023-05-16T13:55:03.483 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.476+0000 7fabf97fa640 1 --2- 172.21.15.39:0/2241235845 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fabe00662b0 0x7fabe0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:03.484 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.476+0000 7fabf97fa640 1 -- 172.21.15.39:0/2241235845 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fabe8083cf0 con 0x7fabfc0c9a70 2023-05-16T13:55:03.484 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.476+0000 7fac00810640 1 --2- 172.21.15.39:0/2241235845 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fabe00662b0 0x7fabe0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:03.484 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.476+0000 7fac00810640 1 --2- 172.21.15.39:0/2241235845 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fabe00662b0 0x7fabe0068760 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fabf0009b60 tx=0x7fabf0009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:03.486 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.480+0000 7fabf97fa640 1 -- 172.21.15.39:0/2241235845 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fabe80511d0 con 0x7fabfc0c9a70 2023-05-16T13:55:03.638 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.632+0000 7fac02a74640 1 -- 172.21.15.39:0/2241235845 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fabfc073c90 con 0x7fabfc0c9a70 2023-05-16T13:55:03.639 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.632+0000 7fabf97fa640 1 -- 172.21.15.39:0/2241235845 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fabe80547f0 con 0x7fabfc0c9a70 2023-05-16T13:55:03.639 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 64 2023-05-16T13:55:03.640 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.632+0000 7fac02a74640 1 -- 172.21.15.39:0/2241235845 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fabe00662b0 msgr2=0x7fabe0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:03.641 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.632+0000 7fac02a74640 1 --2- 172.21.15.39:0/2241235845 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fabe00662b0 0x7fabe0068760 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fabf0009b60 tx=0x7fabf0009190 comp rx=0 tx=0).stop 2023-05-16T13:55:03.641 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.632+0000 7fac02a74640 1 -- 172.21.15.39:0/2241235845 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fabfc0c9a70 msgr2=0x7fabfc157510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:03.641 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.632+0000 7fac02a74640 1 --2- 172.21.15.39:0/2241235845 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fabfc0c9a70 0x7fabfc157510 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fabe800e870 tx=0x7fabe800ed30 comp rx=0 tx=0).stop 2023-05-16T13:55:03.641 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.632+0000 7fac02a74640 1 -- 172.21.15.39:0/2241235845 shutdown_connections 2023-05-16T13:55:03.641 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.632+0000 7fac02a74640 1 --2- 172.21.15.39:0/2241235845 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fabe00662b0 0x7fabe0068760 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:03.641 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.632+0000 7fac02a74640 1 --2- 172.21.15.39:0/2241235845 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fabfc158e00 0x7fabfc0b12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:03.642 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.632+0000 7fac02a74640 1 --2- 172.21.15.39:0/2241235845 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fabfc0c9a70 0x7fabfc157510 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:03.642 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.632+0000 7fac02a74640 1 --2- 172.21.15.39:0/2241235845 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabfc0b0490 0x7fabfc0accc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:03.642 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.632+0000 7fac02a74640 1 -- 172.21.15.39:0/2241235845 >> 172.21.15.39:0/2241235845 conn(0x7fabfc069a50 msgr2=0x7fabfc0708d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:03.642 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.632+0000 7fac02a74640 1 -- 172.21.15.39:0/2241235845 shutdown_connections 2023-05-16T13:55:03.642 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.632+0000 7fac02a74640 1 -- 172.21.15.39:0/2241235845 wait complete. 2023-05-16T13:55:03.659 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-16T13:55:03.798 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.792+0000 7fe23a8f2640 1 Processor -- start 2023-05-16T13:55:03.798 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.792+0000 7fe23a8f2640 1 -- start start 2023-05-16T13:55:03.799 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.792+0000 7fe23a8f2640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fe234158e90 0x7fe2340704b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:03.799 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.792+0000 7fe23a8f2640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe23415d2c0 0x7fe2340cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:03.800 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.792+0000 7fe23a8f2640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2340cda10 con 0x7fe2340cb120 2023-05-16T13:55:03.800 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.792+0000 7fe23a8f2640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe234159260 con 0x7fe234158e90 2023-05-16T13:55:03.800 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.792+0000 7fe23a8f2640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2340709f0 con 0x7fe23415d2c0 2023-05-16T13:55:03.800 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.792+0000 7fe233fff640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fe234158e90 0x7fe2340704b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:03.800 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.792+0000 7fe233fff640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fe234158e90 0x7fe2340704b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34616/0 (socket says 172.21.15.39:34616) 2023-05-16T13:55:03.800 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.792+0000 7fe233fff640 1 -- 172.21.15.39:0/3792129527 learned_addr learned my addr 172.21.15.39:0/3792129527 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:03.801 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.792+0000 7fe2337fe640 1 --2- 172.21.15.39:0/3792129527 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe23415d2c0 0x7fe2340cabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:03.801 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.792+0000 7fe233fff640 1 -- 172.21.15.39:0/3792129527 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe23415d2c0 msgr2=0x7fe2340cabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:03.801 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.792+0000 7fe233fff640 1 --2- 172.21.15.39:0/3792129527 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe23415d2c0 0x7fe2340cabe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:03.801 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.792+0000 7fe233fff640 1 -- 172.21.15.39:0/3792129527 >> v1:172.21.15.118:6789/0 conn(0x7fe2340cb120 legacy=0x7fe2340c9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:03.802 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.792+0000 7fe233fff640 1 -- 172.21.15.39:0/3792129527 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2340cce90 con 0x7fe234158e90 2023-05-16T13:55:03.802 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.796+0000 7fe233fff640 1 --2- 172.21.15.39:0/3792129527 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe234158e90 0x7fe2340704b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe224009870 tx=0x7fe22401e690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=196670ff436fc410 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:03.803 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.796+0000 7fe232ffd640 1 -- 172.21.15.39:0/3792129527 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2240a8620 con 0x7fe234158e90 2023-05-16T13:55:03.803 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.796+0000 7fe232ffd640 1 -- 172.21.15.39:0/3792129527 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2240a8780 con 0x7fe234158e90 2023-05-16T13:55:03.803 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.796+0000 7fe232ffd640 1 -- 172.21.15.39:0/3792129527 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2240a8b10 con 0x7fe234158e90 2023-05-16T13:55:03.804 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.796+0000 7fe23a8f2640 1 -- 172.21.15.39:0/3792129527 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe234158e90 msgr2=0x7fe2340704b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:03.804 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.796+0000 7fe23a8f2640 1 --2- 172.21.15.39:0/3792129527 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe234158e90 0x7fe2340704b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe224009870 tx=0x7fe22401e690 comp rx=0 tx=0).stop 2023-05-16T13:55:03.804 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.796+0000 7fe23a8f2640 1 -- 172.21.15.39:0/3792129527 shutdown_connections 2023-05-16T13:55:03.805 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.796+0000 7fe23a8f2640 1 --2- 172.21.15.39:0/3792129527 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe23415d2c0 0x7fe2340cabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:03.805 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.796+0000 7fe23a8f2640 1 --2- 172.21.15.39:0/3792129527 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe234158e90 0x7fe2340704b0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:03.805 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.796+0000 7fe23a8f2640 1 -- 172.21.15.39:0/3792129527 >> 172.21.15.39:0/3792129527 conn(0x7fe234069a50 msgr2=0x7fe234069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:03.805 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.796+0000 7fe23a8f2640 1 -- 172.21.15.39:0/3792129527 shutdown_connections 2023-05-16T13:55:03.805 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.796+0000 7fe23a8f2640 1 -- 172.21.15.39:0/3792129527 wait complete. 2023-05-16T13:55:03.806 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.800+0000 7fe23a8f2640 1 Processor -- start 2023-05-16T13:55:03.806 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.800+0000 7fe23a8f2640 1 -- start start 2023-05-16T13:55:03.807 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.800+0000 7fe23a8f2640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2340cb120 0x7fe23414d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:03.807 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.800+0000 7fe23a8f2640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe234158e90 0x7fe2341593a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:03.807 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.800+0000 7fe23a8f2640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe23415d2c0 0x7fe23414c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:03.807 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.800+0000 7fe23a8f2640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2341598e0 con 0x7fe23415d2c0 2023-05-16T13:55:03.807 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.800+0000 7fe23a8f2640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe23414bcc0 con 0x7fe234158e90 2023-05-16T13:55:03.807 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.800+0000 7fe23a8f2640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe23414c690 con 0x7fe2340cb120 2023-05-16T13:55:03.808 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.800+0000 7fe238e8f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe23415d2c0 0x7fe23414c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:03.808 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.800+0000 7fe238e8f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe23415d2c0 0x7fe23414c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34626/0 (socket says 172.21.15.39:34626) 2023-05-16T13:55:03.808 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.800+0000 7fe238e8f640 1 -- 172.21.15.39:0/2119287377 learned_addr learned my addr 172.21.15.39:0/2119287377 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:03.808 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.800+0000 7fe2337fe640 1 --2- 172.21.15.39:0/2119287377 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe234158e90 0x7fe2341593a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:03.808 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.800+0000 7fe233fff640 1 --2- 172.21.15.39:0/2119287377 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2340cb120 0x7fe23414d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:03.809 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.800+0000 7fe238e8f640 1 -- 172.21.15.39:0/2119287377 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2340cb120 msgr2=0x7fe23414d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:03.809 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.800+0000 7fe238e8f640 1 --2- 172.21.15.39:0/2119287377 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2340cb120 0x7fe23414d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:03.809 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.800+0000 7fe238e8f640 1 -- 172.21.15.39:0/2119287377 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe234158e90 msgr2=0x7fe2341593a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:03.810 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.800+0000 7fe238e8f640 1 --2- 172.21.15.39:0/2119287377 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe234158e90 0x7fe2341593a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:03.810 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.800+0000 7fe238e8f640 1 -- 172.21.15.39:0/2119287377 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2240094d0 con 0x7fe23415d2c0 2023-05-16T13:55:03.810 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.800+0000 7fe238e8f640 1 --2- 172.21.15.39:0/2119287377 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe23415d2c0 0x7fe23414c150 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe22c00c770 tx=0x7fe22c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:03.810 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.800+0000 7fe230ff9640 1 -- 172.21.15.39:0/2119287377 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe22c003b80 con 0x7fe23415d2c0 2023-05-16T13:55:03.810 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.800+0000 7fe230ff9640 1 -- 172.21.15.39:0/2119287377 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe22c003ce0 con 0x7fe23415d2c0 2023-05-16T13:55:03.810 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.800+0000 7fe230ff9640 1 -- 172.21.15.39:0/2119287377 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe22c00aa90 con 0x7fe23415d2c0 2023-05-16T13:55:03.810 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.800+0000 7fe23a8f2640 1 -- 172.21.15.39:0/2119287377 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2340cb520 con 0x7fe23415d2c0 2023-05-16T13:55:03.811 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.800+0000 7fe23a8f2640 1 -- 172.21.15.39:0/2119287377 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2340cd730 con 0x7fe23415d2c0 2023-05-16T13:55:03.811 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.804+0000 7fe23a8f2640 1 -- 172.21.15.39:0/2119287377 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2340c8e10 con 0x7fe23415d2c0 2023-05-16T13:55:03.811 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.804+0000 7fe230ff9640 1 -- 172.21.15.39:0/2119287377 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe22c00abf0 con 0x7fe23415d2c0 2023-05-16T13:55:03.812 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.804+0000 7fe230ff9640 1 --2- 172.21.15.39:0/2119287377 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fe220066280 0x7fe220068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:03.812 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.804+0000 7fe230ff9640 1 -- 172.21.15.39:0/2119287377 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fe22c083b00 con 0x7fe23415d2c0 2023-05-16T13:55:03.812 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.804+0000 7fe233fff640 1 --2- 172.21.15.39:0/2119287377 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fe220066280 0x7fe220068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:03.812 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.804+0000 7fe233fff640 1 --2- 172.21.15.39:0/2119287377 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fe220066280 0x7fe220068730 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe2240b0000 tx=0x7fe2240b5040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:03.815 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.808+0000 7fe230ff9640 1 -- 172.21.15.39:0/2119287377 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fe22c085e60 con 0x7fe23415d2c0 2023-05-16T13:55:03.981 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.976+0000 7fe23a8f2640 1 -- 172.21.15.39:0/2119287377 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe23414be30 con 0x7fe23415d2c0 2023-05-16T13:55:03.981 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.976+0000 7fe230ff9640 1 -- 172.21.15.39:0/2119287377 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe22c050f50 con 0x7fe23415d2c0 2023-05-16T13:55:03.982 INFO:teuthology.orchestra.run.smithi039.stderr:listed 0 entries 2023-05-16T13:55:03.983 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.976+0000 7fe23a8f2640 1 -- 172.21.15.39:0/2119287377 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fe220066280 msgr2=0x7fe220068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:03.983 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.976+0000 7fe23a8f2640 1 --2- 172.21.15.39:0/2119287377 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fe220066280 0x7fe220068730 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe2240b0000 tx=0x7fe2240b5040 comp rx=0 tx=0).stop 2023-05-16T13:55:03.983 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.976+0000 7fe23a8f2640 1 -- 172.21.15.39:0/2119287377 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe23415d2c0 msgr2=0x7fe23414c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:03.984 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.976+0000 7fe23a8f2640 1 --2- 172.21.15.39:0/2119287377 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe23415d2c0 0x7fe23414c150 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe22c00c770 tx=0x7fe22c00cc30 comp rx=0 tx=0).stop 2023-05-16T13:55:03.984 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.976+0000 7fe23a8f2640 1 -- 172.21.15.39:0/2119287377 shutdown_connections 2023-05-16T13:55:03.984 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.976+0000 7fe23a8f2640 1 --2- 172.21.15.39:0/2119287377 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe23415d2c0 0x7fe23414c150 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:03.984 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.976+0000 7fe23a8f2640 1 --2- 172.21.15.39:0/2119287377 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe234158e90 0x7fe2341593a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:03.984 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.976+0000 7fe23a8f2640 1 --2- 172.21.15.39:0/2119287377 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fe220066280 0x7fe220068730 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:03.984 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.976+0000 7fe23a8f2640 1 --2- 172.21.15.39:0/2119287377 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2340cb120 0x7fe23414d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:03.984 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.976+0000 7fe23a8f2640 1 -- 172.21.15.39:0/2119287377 >> 172.21.15.39:0/2119287377 conn(0x7fe234069a50 msgr2=0x7fe2340716f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:03.985 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.976+0000 7fe23a8f2640 1 -- 172.21.15.39:0/2119287377 shutdown_connections 2023-05-16T13:55:03.985 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:03.976+0000 7fe23a8f2640 1 -- 172.21.15.39:0/2119287377 wait complete. 2023-05-16T13:55:04.002 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi039.front.sepia.ceph.com... 2023-05-16T13:55:04.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:55:04.003 DEBUG:teuthology.orchestra.run.smithi039:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-05-16T13:55:04.022 INFO:teuthology.orchestra.run:waiting for 300 2023-05-16T13:55:04.023 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi039.front.sepia.ceph.com 2023-05-16T13:55:04.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:55:04.023 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-05-16T13:55:04.072 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-05-16T13:55:04.072 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-16T13:55:04.081 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-05-16T13:55:04.081 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-16T13:55:04.132 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-16T13:55:04.270 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.264+0000 7fab3a325640 1 Processor -- start 2023-05-16T13:55:04.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.264+0000 7fab3a325640 1 -- start start 2023-05-16T13:55:04.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.264+0000 7fab3a325640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fab34145860 0x7fab3415cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:04.272 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.264+0000 7fab3a325640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fab3415faa0 0x7fab3406cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:04.272 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.264+0000 7fab3a325640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fab3406d300 0x7fab340703b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:04.272 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.264+0000 7fab3a325640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab34145c30 con 0x7fab3415faa0 2023-05-16T13:55:04.272 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.264+0000 7fab3a325640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab3406d720 con 0x7fab34145860 2023-05-16T13:55:04.272 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.264+0000 7fab3a325640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab34160060 con 0x7fab3406d300 2023-05-16T13:55:04.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.264+0000 7fab337fe640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fab3415faa0 0x7fab3406cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:04.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.264+0000 7fab337fe640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fab3415faa0 0x7fab3406cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34642/0 (socket says 172.21.15.39:34642) 2023-05-16T13:55:04.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.264+0000 7fab337fe640 1 -- 172.21.15.39:0/3549719482 learned_addr learned my addr 172.21.15.39:0/3549719482 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:04.274 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.264+0000 7fab33fff640 1 --2- 172.21.15.39:0/3549719482 >> v2:172.21.15.118:3300/0 conn(0x7fab34145860 0x7fab3415cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:04.274 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.264+0000 7fab388c2640 1 --2- 172.21.15.39:0/3549719482 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fab3406d300 0x7fab340703b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:04.274 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.264+0000 7fab337fe640 1 -- 172.21.15.39:0/3549719482 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fab3406d300 msgr2=0x7fab340703b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:04.274 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.264+0000 7fab337fe640 1 --2- 172.21.15.39:0/3549719482 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fab3406d300 0x7fab340703b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:04.274 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.264+0000 7fab337fe640 1 -- 172.21.15.39:0/3549719482 >> v2:172.21.15.118:3300/0 conn(0x7fab34145860 msgr2=0x7fab3415cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:04.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.264+0000 7fab337fe640 1 --2- 172.21.15.39:0/3549719482 >> v2:172.21.15.118:3300/0 conn(0x7fab34145860 0x7fab3415cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:04.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.264+0000 7fab337fe640 1 -- 172.21.15.39:0/3549719482 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab34160340 con 0x7fab3415faa0 2023-05-16T13:55:04.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.264+0000 7fab388c2640 1 --2- 172.21.15.39:0/3549719482 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fab3406d300 0x7fab340703b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-16T13:55:04.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.268+0000 7fab337fe640 1 --2- 172.21.15.39:0/3549719482 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab3415faa0 0x7fab3406cdc0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fab34071950 tx=0x7fab2801c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fc7b0731f04e09c server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:04.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.268+0000 7fab32ffd640 1 -- 172.21.15.39:0/3549719482 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab280ab600 con 0x7fab3415faa0 2023-05-16T13:55:04.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.268+0000 7fab32ffd640 1 -- 172.21.15.39:0/3549719482 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab280a7050 con 0x7fab3415faa0 2023-05-16T13:55:04.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.268+0000 7fab32ffd640 1 -- 172.21.15.39:0/3549719482 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab280ab980 con 0x7fab3415faa0 2023-05-16T13:55:04.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.268+0000 7fab3a325640 1 -- 172.21.15.39:0/3549719482 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab3415faa0 msgr2=0x7fab3406cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:04.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.268+0000 7fab3a325640 1 --2- 172.21.15.39:0/3549719482 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab3415faa0 0x7fab3406cdc0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fab34071950 tx=0x7fab2801c240 comp rx=0 tx=0).stop 2023-05-16T13:55:04.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.268+0000 7fab3a325640 1 -- 172.21.15.39:0/3549719482 shutdown_connections 2023-05-16T13:55:04.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.268+0000 7fab3a325640 1 --2- 172.21.15.39:0/3549719482 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fab3406d300 0x7fab340703b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:04.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.268+0000 7fab3a325640 1 --2- 172.21.15.39:0/3549719482 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab3415faa0 0x7fab3406cdc0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:04.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.268+0000 7fab3a325640 1 --2- 172.21.15.39:0/3549719482 >> v2:172.21.15.118:3300/0 conn(0x7fab34145860 0x7fab3415cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:04.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.268+0000 7fab3a325640 1 -- 172.21.15.39:0/3549719482 >> 172.21.15.39:0/3549719482 conn(0x7fab340cb6d0 msgr2=0x7fab340cbad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:04.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.268+0000 7fab3a325640 1 -- 172.21.15.39:0/3549719482 shutdown_connections 2023-05-16T13:55:04.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.268+0000 7fab3a325640 1 -- 172.21.15.39:0/3549719482 wait complete. 2023-05-16T13:55:04.279 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.272+0000 7fab3a325640 1 Processor -- start 2023-05-16T13:55:04.279 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.272+0000 7fab3a325640 1 -- start start 2023-05-16T13:55:04.279 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.272+0000 7fab3a325640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab3406d300 0x7fab3413d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:04.279 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.272+0000 7fab3a325640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab34145860 0x7fab341599d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:04.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.272+0000 7fab3a325640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fab3415faa0 0x7fab3413c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:04.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.272+0000 7fab3a325640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab340b1800 con 0x7fab34145860 2023-05-16T13:55:04.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.272+0000 7fab3a325640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab340b0f60 con 0x7fab3406d300 2023-05-16T13:55:04.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.272+0000 7fab3a325640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab340b1240 con 0x7fab3415faa0 2023-05-16T13:55:04.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.272+0000 7fab337fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab34145860 0x7fab341599d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:04.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.272+0000 7fab337fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab34145860 0x7fab341599d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34652/0 (socket says 172.21.15.39:34652) 2023-05-16T13:55:04.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.272+0000 7fab337fe640 1 -- 172.21.15.39:0/1613100495 learned_addr learned my addr 172.21.15.39:0/1613100495 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:04.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.272+0000 7fab33fff640 1 --2- 172.21.15.39:0/1613100495 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab3406d300 0x7fab3413d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:04.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.272+0000 7fab388c2640 1 --2- 172.21.15.39:0/1613100495 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fab3415faa0 0x7fab3413c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:04.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.272+0000 7fab337fe640 1 -- 172.21.15.39:0/1613100495 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fab3415faa0 msgr2=0x7fab3413c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:04.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.272+0000 7fab337fe640 1 --2- 172.21.15.39:0/1613100495 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fab3415faa0 0x7fab3413c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:04.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.272+0000 7fab337fe640 1 -- 172.21.15.39:0/1613100495 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab3406d300 msgr2=0x7fab3413d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:04.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.272+0000 7fab337fe640 1 --2- 172.21.15.39:0/1613100495 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab3406d300 0x7fab3413d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:04.283 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.272+0000 7fab337fe640 1 -- 172.21.15.39:0/1613100495 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab280094d0 con 0x7fab34145860 2023-05-16T13:55:04.283 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.272+0000 7fab388c2640 1 --2- 172.21.15.39:0/1613100495 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fab3415faa0 0x7fab3413c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:55:04.283 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.272+0000 7fab337fe640 1 --2- 172.21.15.39:0/1613100495 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab34145860 0x7fab341599d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fab2801a8f0 tx=0x7fab28018fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:04.283 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.272+0000 7fab30ff9640 1 -- 172.21.15.39:0/1613100495 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab280b4620 con 0x7fab34145860 2023-05-16T13:55:04.283 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.272+0000 7fab30ff9640 1 -- 172.21.15.39:0/1613100495 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab280a4e90 con 0x7fab34145860 2023-05-16T13:55:04.283 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.272+0000 7fab3a325640 1 -- 172.21.15.39:0/1613100495 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab34069f70 con 0x7fab34145860 2023-05-16T13:55:04.283 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.272+0000 7fab30ff9640 1 -- 172.21.15.39:0/1613100495 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab280b49c0 con 0x7fab34145860 2023-05-16T13:55:04.283 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.272+0000 7fab3a325640 1 -- 172.21.15.39:0/1613100495 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab34069a50 con 0x7fab34145860 2023-05-16T13:55:04.284 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.276+0000 7fab3a325640 1 -- 172.21.15.39:0/1613100495 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab3406a100 con 0x7fab34145860 2023-05-16T13:55:04.284 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.276+0000 7fab30ff9640 1 -- 172.21.15.39:0/1613100495 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fab280b2070 con 0x7fab34145860 2023-05-16T13:55:04.284 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.276+0000 7fab30ff9640 1 --2- 172.21.15.39:0/1613100495 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fab200662b0 0x7fab20068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:04.285 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.276+0000 7fab30ff9640 1 -- 172.21.15.39:0/1613100495 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fab2811cdc0 con 0x7fab34145860 2023-05-16T13:55:04.285 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.276+0000 7fab33fff640 1 --2- 172.21.15.39:0/1613100495 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fab200662b0 0x7fab20068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:04.285 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.276+0000 7fab33fff640 1 --2- 172.21.15.39:0/1613100495 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fab200662b0 0x7fab20068760 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fab341f8200 tx=0x7fab24008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:04.287 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.280+0000 7fab30ff9640 1 -- 172.21.15.39:0/1613100495 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fab280ea330 con 0x7fab34145860 2023-05-16T13:55:04.441 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.436+0000 7fab3a325640 1 -- 172.21.15.39:0/1613100495 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fab34073c90 con 0x7fab34145860 2023-05-16T13:55:04.442 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.436+0000 7fab30ff9640 1 -- 172.21.15.39:0/1613100495 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18375 (secure 0 0 0) 0x7fab280b0090 con 0x7fab34145860 2023-05-16T13:55:04.443 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:55:04.443 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":26,"fsid":"9c1e210b-c515-4ea4-a065-397956895c68","created":"2023-05-16T13:53:48.955290+0000","modified":"2023-05-16T13:54:56.831431+0000","last_up_change":"2023-05-16T13:54:01.722051+0000","last_in_change":"2023-05-16T13:53:52.331336+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-16T13:54:00.885009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-16T13:54:08.327895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-16T13:54:12.864823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-16T13:54:14.180225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4ce0f0ba-c4bf-4405-8c95-d2e9a62878ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6809","nonce":3462013698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6811","nonce":3462013698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6815","nonce":3462013698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6813","nonce":3462013698}]},"public_addr":"172.21.15.39:6809/3462013698","cluster_addr":"172.21.15.39:6811/3462013698","heartbeat_back_addr":"172.21.15.39:6815/3462013698","heartbeat_front_addr":"172.21.15.39:6813/3462013698","state":["exists","up"]},{"osd":1,"uuid":"53fdc1ac-2473-472d-af32-2760fdf6e476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6801","nonce":2829970892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6803","nonce":2829970892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6807","nonce":2829970892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6805","nonce":2829970892}]},"public_addr":"172.21.15.39:6801/2829970892","cluster_addr":"172.21.15.39:6803/2829970892","heartbeat_back_addr":"172.21.15.39:6807/2829970892","heartbeat_front_addr":"172.21.15.39:6805/2829970892","state":["exists","up"]},{"osd":2,"uuid":"0b92d770-7030-42fa-a19f-4f7f1ac113c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6817","nonce":3888067413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6819","nonce":3888067413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6823","nonce":3888067413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6821","nonce":3888067413}]},"public_addr":"172.21.15.39:6817/3888067413","cluster_addr":"172.21.15.39:6819/3888067413","heartbeat_back_addr":"172.21.15.39:6823/3888067413","heartbeat_front_addr":"172.21.15.39:6821/3888067413","state":["exists","up"]},{"osd":3,"uuid":"000d9506-cbb2-4017-b875-deca579860ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6825","nonce":405003958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6827","nonce":405003958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6831","nonce":405003958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6829","nonce":405003958}]},"public_addr":"172.21.15.39:6825/405003958","cluster_addr":"172.21.15.39:6827/405003958","heartbeat_back_addr":"172.21.15.39:6831/405003958","heartbeat_front_addr":"172.21.15.39:6829/405003958","state":["exists","up"]},{"osd":4,"uuid":"70f0dacb-e960-40c5-bf6a-183e52bbe2ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6801","nonce":3895278838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6805","nonce":3895278838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6813","nonce":3895278838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6809","nonce":3895278838}]},"public_addr":"172.21.15.118:6801/3895278838","cluster_addr":"172.21.15.118:6805/3895278838","heartbeat_back_addr":"172.21.15.118:6813/3895278838","heartbeat_front_addr":"172.21.15.118:6809/3895278838","state":["exists","up"]},{"osd":5,"uuid":"756feb54-c3ae-4a2a-8f74-85c291ba707c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6804","nonce":3513592808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6808","nonce":3513592808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6815","nonce":3513592808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6812","nonce":3513592808}]},"public_addr":"172.21.15.118:6804/3513592808","cluster_addr":"172.21.15.118:6808/3513592808","heartbeat_back_addr":"172.21.15.118:6815/3513592808","heartbeat_front_addr":"172.21.15.118:6812/3513592808","state":["exists","up"]},{"osd":6,"uuid":"c4a982c1-f497-4b0f-8a23-c77372e4621e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6824","nonce":1863656053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6827","nonce":1863656053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6831","nonce":1863656053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6829","nonce":1863656053}]},"public_addr":"172.21.15.118:6824/1863656053","cluster_addr":"172.21.15.118:6827/1863656053","heartbeat_back_addr":"172.21.15.118:6831/1863656053","heartbeat_front_addr":"172.21.15.118:6829/1863656053","state":["exists","up"]},{"osd":7,"uuid":"6f2888aa-a7ac-4e26-9159-e31817934f44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6817","nonce":3636642904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6819","nonce":3636642904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6825","nonce":3636642904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6821","nonce":3636642904}]},"public_addr":"172.21.15.118:6817/3636642904","cluster_addr":"172.21.15.118:6819/3636642904","heartbeat_back_addr":"172.21.15.118:6825/3636642904","heartbeat_front_addr":"172.21.15.118:6821/3636642904","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.717636+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.724036+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.739144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:58.079275+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:58.073921+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.930466+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.987813+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.941098+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.24","mappings":[{"from":1,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-16T13:55:04.445 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.436+0000 7fab3a325640 1 -- 172.21.15.39:0/1613100495 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fab200662b0 msgr2=0x7fab20068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:04.445 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.436+0000 7fab3a325640 1 --2- 172.21.15.39:0/1613100495 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fab200662b0 0x7fab20068760 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fab341f8200 tx=0x7fab24008040 comp rx=0 tx=0).stop 2023-05-16T13:55:04.445 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.436+0000 7fab3a325640 1 -- 172.21.15.39:0/1613100495 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab34145860 msgr2=0x7fab341599d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:04.445 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.436+0000 7fab3a325640 1 --2- 172.21.15.39:0/1613100495 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab34145860 0x7fab341599d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fab2801a8f0 tx=0x7fab28018fe0 comp rx=0 tx=0).stop 2023-05-16T13:55:04.445 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.436+0000 7fab3a325640 1 -- 172.21.15.39:0/1613100495 shutdown_connections 2023-05-16T13:55:04.445 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.436+0000 7fab3a325640 1 --2- 172.21.15.39:0/1613100495 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fab200662b0 0x7fab20068760 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:04.445 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.436+0000 7fab3a325640 1 --2- 172.21.15.39:0/1613100495 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fab3415faa0 0x7fab3413c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:04.446 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.436+0000 7fab3a325640 1 --2- 172.21.15.39:0/1613100495 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab34145860 0x7fab341599d0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:04.446 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.436+0000 7fab3a325640 1 --2- 172.21.15.39:0/1613100495 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab3406d300 0x7fab3413d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:04.446 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.436+0000 7fab3a325640 1 -- 172.21.15.39:0/1613100495 >> 172.21.15.39:0/1613100495 conn(0x7fab340cb6d0 msgr2=0x7fab340ce350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:04.446 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.440+0000 7fab3a325640 1 -- 172.21.15.39:0/1613100495 shutdown_connections 2023-05-16T13:55:04.446 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.440+0000 7fab3a325640 1 -- 172.21.15.39:0/1613100495 wait complete. 2023-05-16T13:55:04.464 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-16T13:54:00.885009+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-16T13:54:08.327895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-16T13:54:12.864823+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-16T13:54:14.180225+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-16T13:55:04.464 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-16T13:55:04.605 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.600+0000 7fc6a618f640 1 Processor -- start 2023-05-16T13:55:04.605 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.600+0000 7fc6a618f640 1 -- start start 2023-05-16T13:55:04.606 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.600+0000 7fc6a618f640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc6a0158e00 0x7fc6a00c9530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:04.606 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.600+0000 7fc6a618f640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6a00ca030 con 0x7fc6a00b0660 2023-05-16T13:55:04.607 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.600+0000 7fc6a618f640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6a015c890 con 0x7fc6a00c9a70 2023-05-16T13:55:04.607 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.600+0000 7fc6a618f640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a015cb70 con 0x7fc6a0158e00 2023-05-16T13:55:04.608 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.600+0000 7fc69ffff640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fc6a00b0660 0x7fc6a0070420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:51054/0 (socket says 172.21.15.39:51054) 2023-05-16T13:55:04.608 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.600+0000 7fc69ffff640 1 -- 172.21.15.39:0/2177005266 learned_addr learned my addr 172.21.15.39:0/2177005266 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:55:04.608 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.600+0000 7fc69f7fe640 1 --2- 172.21.15.39:0/2177005266 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc6a0158e00 0x7fc6a00c9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:04.608 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.600+0000 7fc69e7fc640 1 -- 172.21.15.39:0/2177005266 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4269181337 0 0) 0x7fc6a00ca030 con 0x7fc6a00b0660 2023-05-16T13:55:04.608 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.600+0000 7fc69e7fc640 1 -- 172.21.15.39:0/2177005266 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc688005740 con 0x7fc6a00b0660 2023-05-16T13:55:04.609 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.600+0000 7fc69e7fc640 1 -- 172.21.15.39:0/2177005266 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 56113095 0 0) 0x7fc6a015c890 con 0x7fc6a00c9a70 2023-05-16T13:55:04.609 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.600+0000 7fc69e7fc640 1 -- 172.21.15.39:0/2177005266 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6a00ca030 con 0x7fc6a00c9a70 2023-05-16T13:55:04.609 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.600+0000 7fc69f7fe640 1 -- 172.21.15.39:0/2177005266 >> v1:172.21.15.118:6789/0 conn(0x7fc6a00c9a70 legacy=0x7fc6a00aff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:04.609 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.600+0000 7fc69f7fe640 1 -- 172.21.15.39:0/2177005266 >> v1:172.21.15.39:6789/0 conn(0x7fc6a00b0660 legacy=0x7fc6a0070420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:04.609 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.600+0000 7fc69f7fe640 1 -- 172.21.15.39:0/2177005266 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a015ce50 con 0x7fc6a0158e00 2023-05-16T13:55:04.610 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.604+0000 7fc69f7fe640 1 --2- 172.21.15.39:0/2177005266 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc6a0158e00 0x7fc6a00c9530 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc6900097f0 tx=0x7fc69001ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d56a1c1bfd11df7e server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:04.610 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.604+0000 7fc69e7fc640 1 -- 172.21.15.39:0/2177005266 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6900a89b0 con 0x7fc6a0158e00 2023-05-16T13:55:04.611 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.604+0000 7fc69e7fc640 1 -- 172.21.15.39:0/2177005266 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6900a8b10 con 0x7fc6a0158e00 2023-05-16T13:55:04.611 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.604+0000 7fc69e7fc640 1 -- 172.21.15.39:0/2177005266 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6900a8ea0 con 0x7fc6a0158e00 2023-05-16T13:55:04.611 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.604+0000 7fc6a618f640 1 -- 172.21.15.39:0/2177005266 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc6a0158e00 msgr2=0x7fc6a00c9530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:04.612 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.604+0000 7fc6a618f640 1 --2- 172.21.15.39:0/2177005266 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc6a0158e00 0x7fc6a00c9530 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc6900097f0 tx=0x7fc69001ecb0 comp rx=0 tx=0).stop 2023-05-16T13:55:04.612 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.604+0000 7fc6a618f640 1 -- 172.21.15.39:0/2177005266 shutdown_connections 2023-05-16T13:55:04.612 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.604+0000 7fc6a618f640 1 --2- 172.21.15.39:0/2177005266 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc6a0158e00 0x7fc6a00c9530 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:04.612 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.604+0000 7fc6a618f640 1 -- 172.21.15.39:0/2177005266 >> 172.21.15.39:0/2177005266 conn(0x7fc6a0069a50 msgr2=0x7fc6a0069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:04.612 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.604+0000 7fc6a618f640 1 -- 172.21.15.39:0/2177005266 shutdown_connections 2023-05-16T13:55:04.612 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.604+0000 7fc6a618f640 1 -- 172.21.15.39:0/2177005266 wait complete. 2023-05-16T13:55:04.613 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.608+0000 7fc6a618f640 1 Processor -- start 2023-05-16T13:55:04.613 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.608+0000 7fc6a618f640 1 -- start start 2023-05-16T13:55:04.614 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.608+0000 7fc6a618f640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc6a00b0660 0x7fc6a0147c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:04.615 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.608+0000 7fc6a618f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6a00c9a70 0x7fc6a00c6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:04.615 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.608+0000 7fc6a618f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6a0158e00 0x7fc6a00c74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:04.615 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.608+0000 7fc6a618f640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a01570a0 con 0x7fc6a0158e00 2023-05-16T13:55:04.615 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.608+0000 7fc6a618f640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a0157380 con 0x7fc6a00c9a70 2023-05-16T13:55:04.615 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.608+0000 7fc6a618f640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a00c6770 con 0x7fc6a00b0660 2023-05-16T13:55:04.615 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.608+0000 7fc69ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6a0158e00 0x7fc6a00c74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:04.615 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.608+0000 7fc69ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6a0158e00 0x7fc6a00c74b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34654/0 (socket says 172.21.15.39:34654) 2023-05-16T13:55:04.615 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.608+0000 7fc69ffff640 1 -- 172.21.15.39:0/2463113837 learned_addr learned my addr 172.21.15.39:0/2463113837 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:04.617 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.608+0000 7fc69effd640 1 --2- 172.21.15.39:0/2463113837 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6a00c9a70 0x7fc6a00c6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:04.617 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.608+0000 7fc69f7fe640 1 --2- 172.21.15.39:0/2463113837 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc6a00b0660 0x7fc6a0147c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:04.617 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.608+0000 7fc69ffff640 1 -- 172.21.15.39:0/2463113837 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc6a00b0660 msgr2=0x7fc6a0147c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:04.617 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.608+0000 7fc69ffff640 1 --2- 172.21.15.39:0/2463113837 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc6a00b0660 0x7fc6a0147c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:04.617 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.608+0000 7fc69ffff640 1 -- 172.21.15.39:0/2463113837 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6a00c9a70 msgr2=0x7fc6a00c6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:04.617 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.608+0000 7fc69ffff640 1 --2- 172.21.15.39:0/2463113837 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6a00c9a70 0x7fc6a00c6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:04.618 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.608+0000 7fc69ffff640 1 -- 172.21.15.39:0/2463113837 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc690009420 con 0x7fc6a0158e00 2023-05-16T13:55:04.618 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.608+0000 7fc69effd640 1 --2- 172.21.15.39:0/2463113837 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6a00c9a70 0x7fc6a00c6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-16T13:55:04.618 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.608+0000 7fc69f7fe640 1 --2- 172.21.15.39:0/2463113837 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc6a00b0660 0x7fc6a0147c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-16T13:55:04.618 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.608+0000 7fc69ffff640 1 --2- 172.21.15.39:0/2463113837 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6a0158e00 0x7fc6a00c74b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc69800cb90 tx=0x7fc69800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:04.618 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.608+0000 7fc687fff640 1 -- 172.21.15.39:0/2463113837 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69800ace0 con 0x7fc6a0158e00 2023-05-16T13:55:04.618 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.608+0000 7fc687fff640 1 -- 172.21.15.39:0/2463113837 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc69800ae40 con 0x7fc6a0158e00 2023-05-16T13:55:04.618 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.608+0000 7fc6a618f640 1 -- 172.21.15.39:0/2463113837 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6a00cc730 con 0x7fc6a0158e00 2023-05-16T13:55:04.618 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.608+0000 7fc687fff640 1 -- 172.21.15.39:0/2463113837 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc698012600 con 0x7fc6a0158e00 2023-05-16T13:55:04.619 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.608+0000 7fc6a618f640 1 -- 172.21.15.39:0/2463113837 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6a015d130 con 0x7fc6a0158e00 2023-05-16T13:55:04.619 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.608+0000 7fc6a618f640 1 -- 172.21.15.39:0/2463113837 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6a015d650 con 0x7fc6a0158e00 2023-05-16T13:55:04.619 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.612+0000 7fc687fff640 1 -- 172.21.15.39:0/2463113837 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc698007070 con 0x7fc6a0158e00 2023-05-16T13:55:04.620 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.612+0000 7fc687fff640 1 --2- 172.21.15.39:0/2463113837 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc68c066280 0x7fc68c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:04.620 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.612+0000 7fc687fff640 1 -- 172.21.15.39:0/2463113837 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fc698083d00 con 0x7fc6a0158e00 2023-05-16T13:55:04.620 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.612+0000 7fc69f7fe640 1 --2- 172.21.15.39:0/2463113837 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc68c066280 0x7fc68c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:04.620 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.612+0000 7fc69f7fe640 1 --2- 172.21.15.39:0/2463113837 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc68c066280 0x7fc68c068730 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc6900b2000 tx=0x7fc6900aa070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:04.622 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.616+0000 7fc687fff640 1 -- 172.21.15.39:0/2463113837 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fc698051150 con 0x7fc6a0158e00 2023-05-16T13:55:04.777 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.772+0000 7fc6a618f640 1 -- 172.21.15.39:0/2463113837 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc6a00c65d0 con 0x7fc6a0158e00 2023-05-16T13:55:04.778 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.772+0000 7fc687fff640 1 -- 172.21.15.39:0/2463113837 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc6a00c65d0 con 0x7fc6a0158e00 2023-05-16T13:55:04.778 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2023-05-16T13:55:04.779 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.772+0000 7fc6a618f640 1 -- 172.21.15.39:0/2463113837 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc68c066280 msgr2=0x7fc68c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:04.779 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.772+0000 7fc6a618f640 1 --2- 172.21.15.39:0/2463113837 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc68c066280 0x7fc68c068730 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc6900b2000 tx=0x7fc6900aa070 comp rx=0 tx=0).stop 2023-05-16T13:55:04.780 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.772+0000 7fc6a618f640 1 -- 172.21.15.39:0/2463113837 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6a0158e00 msgr2=0x7fc6a00c74b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:04.780 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.772+0000 7fc6a618f640 1 --2- 172.21.15.39:0/2463113837 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6a0158e00 0x7fc6a00c74b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc69800cb90 tx=0x7fc69800a430 comp rx=0 tx=0).stop 2023-05-16T13:55:04.780 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.772+0000 7fc6a618f640 1 -- 172.21.15.39:0/2463113837 shutdown_connections 2023-05-16T13:55:04.780 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.772+0000 7fc6a618f640 1 --2- 172.21.15.39:0/2463113837 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6a0158e00 0x7fc6a00c74b0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:04.780 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.772+0000 7fc6a618f640 1 --2- 172.21.15.39:0/2463113837 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6a00c9a70 0x7fc6a00c6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:04.780 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.772+0000 7fc6a618f640 1 --2- 172.21.15.39:0/2463113837 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc68c066280 0x7fc68c068730 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:04.780 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.772+0000 7fc6a618f640 1 --2- 172.21.15.39:0/2463113837 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc6a00b0660 0x7fc6a0147c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:04.781 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.772+0000 7fc6a618f640 1 -- 172.21.15.39:0/2463113837 >> 172.21.15.39:0/2463113837 conn(0x7fc6a0069a50 msgr2=0x7fc6a00adf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:04.781 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.772+0000 7fc6a618f640 1 -- 172.21.15.39:0/2463113837 shutdown_connections 2023-05-16T13:55:04.781 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.772+0000 7fc6a618f640 1 -- 172.21.15.39:0/2463113837 wait complete. 2023-05-16T13:55:04.798 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-16T13:55:04.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.932+0000 7f176e18e640 1 Processor -- start 2023-05-16T13:55:04.940 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.932+0000 7f176e18e640 1 -- start start 2023-05-16T13:55:04.941 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.936+0000 7f176e18e640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f176806c5a0 0x7f17680d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:04.941 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.936+0000 7f176e18e640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f176815fd60 con 0x7f17680d2c20 2023-05-16T13:55:04.941 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.936+0000 7f176e18e640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f176815cc20 con 0x7f17680d2ff0 2023-05-16T13:55:04.941 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.936+0000 7f176e18e640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f176815cf00 con 0x7f176806c5a0 2023-05-16T13:55:04.942 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.936+0000 7f176d18c640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f17680d2c20 0x7f17681601f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:51060/0 (socket says 172.21.15.39:51060) 2023-05-16T13:55:04.942 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.936+0000 7f176d18c640 1 -- 172.21.15.39:0/3657956364 learned_addr learned my addr 172.21.15.39:0/3657956364 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:55:04.943 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.936+0000 7f176d98d640 1 --2- 172.21.15.39:0/3657956364 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f176806c5a0 0x7f17680d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:04.943 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.936+0000 7f175ffff640 1 -- 172.21.15.39:0/3657956364 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4015103191 0 0) 0x7f176815fd60 con 0x7f17680d2c20 2023-05-16T13:55:04.944 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.936+0000 7f175ffff640 1 -- 172.21.15.39:0/3657956364 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1754003530 con 0x7f17680d2c20 2023-05-16T13:55:04.944 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.936+0000 7f175ffff640 1 -- 172.21.15.39:0/3657956364 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2324956751 0 0) 0x7f176815cc20 con 0x7f17680d2ff0 2023-05-16T13:55:04.944 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.936+0000 7f175ffff640 1 -- 172.21.15.39:0/3657956364 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f176815fd60 con 0x7f17680d2ff0 2023-05-16T13:55:04.944 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.936+0000 7f176d98d640 1 -- 172.21.15.39:0/3657956364 >> v1:172.21.15.118:6789/0 conn(0x7f17680d2ff0 legacy=0x7f176815c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:04.945 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.936+0000 7f176d98d640 1 -- 172.21.15.39:0/3657956364 >> v1:172.21.15.39:6789/0 conn(0x7f17680d2c20 legacy=0x7f17681601f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:04.945 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.936+0000 7f176d98d640 1 -- 172.21.15.39:0/3657956364 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f176815f9f0 con 0x7f176806c5a0 2023-05-16T13:55:04.946 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.936+0000 7f176d98d640 1 --2- 172.21.15.39:0/3657956364 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f176806c5a0 0x7f17680d02a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1760009dc0 tx=0x7f176001c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60c60131cbda5851 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:04.946 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.940+0000 7f175ffff640 1 -- 172.21.15.39:0/3657956364 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17600a5720 con 0x7f176806c5a0 2023-05-16T13:55:04.946 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.940+0000 7f175ffff640 1 -- 172.21.15.39:0/3657956364 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17600a5880 con 0x7f176806c5a0 2023-05-16T13:55:04.946 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.940+0000 7f175ffff640 1 -- 172.21.15.39:0/3657956364 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17600a5c10 con 0x7f176806c5a0 2023-05-16T13:55:04.946 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.940+0000 7f176e18e640 1 -- 172.21.15.39:0/3657956364 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f176806c5a0 msgr2=0x7f17680d02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:04.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.940+0000 7f176e18e640 1 --2- 172.21.15.39:0/3657956364 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f176806c5a0 0x7f17680d02a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1760009dc0 tx=0x7f176001c970 comp rx=0 tx=0).stop 2023-05-16T13:55:04.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.940+0000 7f176e18e640 1 -- 172.21.15.39:0/3657956364 shutdown_connections 2023-05-16T13:55:04.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.940+0000 7f176e18e640 1 --2- 172.21.15.39:0/3657956364 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f176806c5a0 0x7f17680d02a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:04.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.940+0000 7f176e18e640 1 -- 172.21.15.39:0/3657956364 >> 172.21.15.39:0/3657956364 conn(0x7f1768089fe0 msgr2=0x7f176809ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:04.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.940+0000 7f176e18e640 1 -- 172.21.15.39:0/3657956364 shutdown_connections 2023-05-16T13:55:04.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.940+0000 7f176e18e640 1 -- 172.21.15.39:0/3657956364 wait complete. 2023-05-16T13:55:04.950 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.940+0000 7f176e18e640 1 Processor -- start 2023-05-16T13:55:04.950 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.940+0000 7f176e18e640 1 -- start start 2023-05-16T13:55:04.950 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.940+0000 7f176e18e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f176806c5a0 0x7f17680b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:04.950 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.940+0000 7f176e18e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17680d2c20 0x7f17680b41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:04.950 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.940+0000 7f176e18e640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f17680d2ff0 0x7f176814d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:04.950 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.940+0000 7f176e18e640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17681521a0 con 0x7f176806c5a0 2023-05-16T13:55:04.951 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.940+0000 7f176e18e640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f176814ec30 con 0x7f17680d2c20 2023-05-16T13:55:04.951 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.940+0000 7f176e18e640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1768155690 con 0x7f17680d2ff0 2023-05-16T13:55:04.951 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.940+0000 7f176d18c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f176806c5a0 0x7f17680b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:04.951 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.940+0000 7f176d18c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f176806c5a0 0x7f17680b3c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34670/0 (socket says 172.21.15.39:34670) 2023-05-16T13:55:04.951 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.940+0000 7f176d18c640 1 -- 172.21.15.39:0/992052212 learned_addr learned my addr 172.21.15.39:0/992052212 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:04.951 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.944+0000 7f176d98d640 1 --2- 172.21.15.39:0/992052212 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f17680d2ff0 0x7f176814d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:04.951 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.944+0000 7f176c98b640 1 --2- 172.21.15.39:0/992052212 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17680d2c20 0x7f17680b41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:04.951 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.944+0000 7f176d18c640 1 -- 172.21.15.39:0/992052212 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f17680d2ff0 msgr2=0x7f176814d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:04.952 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.944+0000 7f176d18c640 1 --2- 172.21.15.39:0/992052212 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f17680d2ff0 0x7f176814d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:04.952 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.944+0000 7f176d18c640 1 -- 172.21.15.39:0/992052212 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17680d2c20 msgr2=0x7f17680b41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:04.952 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.944+0000 7f176d18c640 1 --2- 172.21.15.39:0/992052212 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17680d2c20 0x7f17680b41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:04.952 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.944+0000 7f176d18c640 1 -- 172.21.15.39:0/992052212 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1760009a70 con 0x7f176806c5a0 2023-05-16T13:55:04.952 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.944+0000 7f176d98d640 1 --2- 172.21.15.39:0/992052212 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f17680d2ff0 0x7f176814d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-16T13:55:04.952 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.944+0000 7f176c98b640 1 --2- 172.21.15.39:0/992052212 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17680d2c20 0x7f17680b41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-16T13:55:04.953 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.944+0000 7f176d18c640 1 --2- 172.21.15.39:0/992052212 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f176806c5a0 0x7f17680b3c80 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f176400c4f0 tx=0x7f176400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:04.953 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.944+0000 7f175dffb640 1 -- 172.21.15.39:0/992052212 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1764005cf0 con 0x7f176806c5a0 2023-05-16T13:55:04.953 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.944+0000 7f175dffb640 1 -- 172.21.15.39:0/992052212 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1764005e50 con 0x7f176806c5a0 2023-05-16T13:55:04.953 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.944+0000 7f175dffb640 1 -- 172.21.15.39:0/992052212 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1764007270 con 0x7f176806c5a0 2023-05-16T13:55:04.953 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.944+0000 7f176e18e640 1 -- 172.21.15.39:0/992052212 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f176806b4b0 con 0x7f176806c5a0 2023-05-16T13:55:04.953 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.944+0000 7f176e18e640 1 -- 172.21.15.39:0/992052212 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f176806b320 con 0x7f176806c5a0 2023-05-16T13:55:04.954 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.944+0000 7f176e18e640 1 -- 172.21.15.39:0/992052212 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17680b12c0 con 0x7f176806c5a0 2023-05-16T13:55:04.954 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.944+0000 7f175dffb640 1 -- 172.21.15.39:0/992052212 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f17640073d0 con 0x7f176806c5a0 2023-05-16T13:55:04.954 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.944+0000 7f175dffb640 1 --2- 172.21.15.39:0/992052212 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f174c066280 0x7f174c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:04.954 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.948+0000 7f175dffb640 1 -- 172.21.15.39:0/992052212 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f17640832d0 con 0x7f176806c5a0 2023-05-16T13:55:04.955 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.948+0000 7f176c98b640 1 --2- 172.21.15.39:0/992052212 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f174c066280 0x7f174c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:04.955 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.948+0000 7f176c98b640 1 --2- 172.21.15.39:0/992052212 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f174c066280 0x7f174c068730 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f17680c9750 tx=0x7f1758009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:04.956 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:04.948+0000 7f175dffb640 1 -- 172.21.15.39:0/992052212 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f1764050730 con 0x7f176806c5a0 2023-05-16T13:55:05.109 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.104+0000 7f176e18e640 1 -- 172.21.15.39:0/992052212 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f17680cef50 con 0x7f176806c5a0 2023-05-16T13:55:05.110 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.104+0000 7f175dffb640 1 -- 172.21.15.39:0/992052212 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1764053d50 con 0x7f176806c5a0 2023-05-16T13:55:05.110 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 8 2023-05-16T13:55:05.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.104+0000 7f176e18e640 1 -- 172.21.15.39:0/992052212 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f174c066280 msgr2=0x7f174c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:05.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.104+0000 7f176e18e640 1 --2- 172.21.15.39:0/992052212 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f174c066280 0x7f174c068730 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f17680c9750 tx=0x7f1758009040 comp rx=0 tx=0).stop 2023-05-16T13:55:05.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.104+0000 7f176e18e640 1 -- 172.21.15.39:0/992052212 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f176806c5a0 msgr2=0x7f17680b3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:05.113 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.104+0000 7f176e18e640 1 --2- 172.21.15.39:0/992052212 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f176806c5a0 0x7f17680b3c80 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f176400c4f0 tx=0x7f176400c9b0 comp rx=0 tx=0).stop 2023-05-16T13:55:05.113 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.104+0000 7f176e18e640 1 -- 172.21.15.39:0/992052212 shutdown_connections 2023-05-16T13:55:05.113 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.104+0000 7f176e18e640 1 --2- 172.21.15.39:0/992052212 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f174c066280 0x7f174c068730 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:05.113 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.104+0000 7f176e18e640 1 --2- 172.21.15.39:0/992052212 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f17680d2ff0 0x7f176814d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:05.113 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.104+0000 7f176e18e640 1 --2- 172.21.15.39:0/992052212 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17680d2c20 0x7f17680b41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:05.113 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.104+0000 7f176e18e640 1 --2- 172.21.15.39:0/992052212 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f176806c5a0 0x7f17680b3c80 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:05.113 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.104+0000 7f176e18e640 1 -- 172.21.15.39:0/992052212 >> 172.21.15.39:0/992052212 conn(0x7f1768089fe0 msgr2=0x7f17680af2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:05.114 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.104+0000 7f176e18e640 1 -- 172.21.15.39:0/992052212 shutdown_connections 2023-05-16T13:55:05.114 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.104+0000 7f176e18e640 1 -- 172.21.15.39:0/992052212 wait complete. 2023-05-16T13:55:05.131 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-16T13:55:05.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.263+0000 7f31f2220640 1 Processor -- start 2023-05-16T13:55:05.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.263+0000 7f31f2220640 1 -- start start 2023-05-16T13:55:05.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.263+0000 7f31f2220640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f31ec0b4030 0x7f31ec15d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:05.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.263+0000 7f31f2220640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f31ec071b70 0x7f31ec0c91c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:05.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.263+0000 7f31f2220640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31ec15de40 con 0x7f31ec0b0710 2023-05-16T13:55:05.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.263+0000 7f31f2220640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31ec15e910 con 0x7f31ec071b70 2023-05-16T13:55:05.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.263+0000 7f31f2220640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31ec0b0ae0 con 0x7f31ec0b4030 2023-05-16T13:55:05.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.267+0000 7f31ebfff640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f31ec071b70 0x7f31ec0c91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:05.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.267+0000 7f31ebfff640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f31ec071b70 0x7f31ec0c91c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34674/0 (socket says 172.21.15.39:34674) 2023-05-16T13:55:05.274 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.267+0000 7f31ebfff640 1 -- 172.21.15.39:0/1118997029 learned_addr learned my addr 172.21.15.39:0/1118997029 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:05.274 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.267+0000 7f31eaffd640 1 --2- 172.21.15.39:0/1118997029 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f31ec0b4030 0x7f31ec15d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:05.274 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.267+0000 7f31ebfff640 1 -- 172.21.15.39:0/1118997029 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f31ec0b4030 msgr2=0x7f31ec15d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:05.274 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.267+0000 7f31ebfff640 1 --2- 172.21.15.39:0/1118997029 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f31ec0b4030 0x7f31ec15d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:05.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.267+0000 7f31ebfff640 1 -- 172.21.15.39:0/1118997029 >> v1:172.21.15.118:6789/0 conn(0x7f31ec0b0710 legacy=0x7f31ec071460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:05.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.267+0000 7f31ebfff640 1 -- 172.21.15.39:0/1118997029 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31ec15e070 con 0x7f31ec071b70 2023-05-16T13:55:05.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.267+0000 7f31ebfff640 1 --2- 172.21.15.39:0/1118997029 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f31ec071b70 0x7f31ec0c91c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f31e4009e50 tx=0x7f31e401ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e3c5fcd827b30c0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:05.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.267+0000 7f31ea7fc640 1 -- 172.21.15.39:0/1118997029 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e40a57f0 con 0x7f31ec071b70 2023-05-16T13:55:05.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.267+0000 7f31ea7fc640 1 -- 172.21.15.39:0/1118997029 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31e40a5950 con 0x7f31ec071b70 2023-05-16T13:55:05.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.267+0000 7f31ea7fc640 1 -- 172.21.15.39:0/1118997029 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e40a5ce0 con 0x7f31ec071b70 2023-05-16T13:55:05.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.267+0000 7f31f2220640 1 -- 172.21.15.39:0/1118997029 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f31ec071b70 msgr2=0x7f31ec0c91c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:05.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.267+0000 7f31f2220640 1 --2- 172.21.15.39:0/1118997029 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f31ec071b70 0x7f31ec0c91c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f31e4009e50 tx=0x7f31e401ca10 comp rx=0 tx=0).stop 2023-05-16T13:55:05.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.271+0000 7f31f2220640 1 -- 172.21.15.39:0/1118997029 shutdown_connections 2023-05-16T13:55:05.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.271+0000 7f31f2220640 1 --2- 172.21.15.39:0/1118997029 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f31ec071b70 0x7f31ec0c91c0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:05.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.271+0000 7f31f2220640 1 --2- 172.21.15.39:0/1118997029 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f31ec0b4030 0x7f31ec15d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:05.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.271+0000 7f31f2220640 1 -- 172.21.15.39:0/1118997029 >> 172.21.15.39:0/1118997029 conn(0x7f31ec069a50 msgr2=0x7f31ec069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:05.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.271+0000 7f31f2220640 1 -- 172.21.15.39:0/1118997029 shutdown_connections 2023-05-16T13:55:05.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.271+0000 7f31f2220640 1 -- 172.21.15.39:0/1118997029 wait complete. 2023-05-16T13:55:05.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.271+0000 7f31f2220640 1 Processor -- start 2023-05-16T13:55:05.279 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.271+0000 7f31f2220640 1 -- start start 2023-05-16T13:55:05.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.271+0000 7f31f2220640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f31ec071b70 0x7f31ec149230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:05.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.271+0000 7f31f2220640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31ec0b0710 0x7f31ec158960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:05.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.271+0000 7f31f2220640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f31ec0b4030 0x7f31ec1515c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:05.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.271+0000 7f31f2220640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31ec0ce0a0 con 0x7f31ec071b70 2023-05-16T13:55:05.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.271+0000 7f31f2220640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31ec150ef0 con 0x7f31ec0b0710 2023-05-16T13:55:05.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.271+0000 7f31f2220640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31ec151190 con 0x7f31ec0b4030 2023-05-16T13:55:05.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.271+0000 7f31eb7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f31ec071b70 0x7f31ec149230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:05.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.271+0000 7f31eb7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f31ec071b70 0x7f31ec149230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34680/0 (socket says 172.21.15.39:34680) 2023-05-16T13:55:05.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.271+0000 7f31eb7fe640 1 -- 172.21.15.39:0/689710325 learned_addr learned my addr 172.21.15.39:0/689710325 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:05.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.271+0000 7f31ebfff640 1 --2- 172.21.15.39:0/689710325 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f31ec0b4030 0x7f31ec1515c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:05.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.271+0000 7f31eaffd640 1 --2- 172.21.15.39:0/689710325 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31ec0b0710 0x7f31ec158960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:05.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.271+0000 7f31eb7fe640 1 -- 172.21.15.39:0/689710325 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f31ec0b4030 msgr2=0x7f31ec1515c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:05.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.271+0000 7f31eb7fe640 1 --2- 172.21.15.39:0/689710325 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f31ec0b4030 0x7f31ec1515c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:05.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.271+0000 7f31eb7fe640 1 -- 172.21.15.39:0/689710325 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31ec0b0710 msgr2=0x7f31ec158960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:05.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.271+0000 7f31eb7fe640 1 --2- 172.21.15.39:0/689710325 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31ec0b0710 0x7f31ec158960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:05.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.271+0000 7f31eb7fe640 1 -- 172.21.15.39:0/689710325 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e4009b30 con 0x7f31ec071b70 2023-05-16T13:55:05.283 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.271+0000 7f31ebfff640 1 --2- 172.21.15.39:0/689710325 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f31ec0b4030 0x7f31ec1515c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:55:05.283 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.271+0000 7f31eb7fe640 1 --2- 172.21.15.39:0/689710325 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f31ec071b70 0x7f31ec149230 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f31dc00c500 tx=0x7f31dc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:05.283 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.271+0000 7f31d3fff640 1 -- 172.21.15.39:0/689710325 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31dc005220 con 0x7f31ec071b70 2023-05-16T13:55:05.283 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.275+0000 7f31d3fff640 1 -- 172.21.15.39:0/689710325 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31dc005380 con 0x7f31ec071b70 2023-05-16T13:55:05.283 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.275+0000 7f31f2220640 1 -- 172.21.15.39:0/689710325 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31ec0c9f10 con 0x7f31ec071b70 2023-05-16T13:55:05.283 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.275+0000 7f31d3fff640 1 -- 172.21.15.39:0/689710325 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31dc007270 con 0x7f31ec071b70 2023-05-16T13:55:05.283 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.275+0000 7f31f2220640 1 -- 172.21.15.39:0/689710325 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31ec0c8ca0 con 0x7f31ec071b70 2023-05-16T13:55:05.284 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.275+0000 7f31f2220640 1 -- 172.21.15.39:0/689710325 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31ec0ca0a0 con 0x7f31ec071b70 2023-05-16T13:55:05.284 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.275+0000 7f31d3fff640 1 -- 172.21.15.39:0/689710325 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f31dc0073d0 con 0x7f31ec071b70 2023-05-16T13:55:05.284 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.275+0000 7f31d3fff640 1 --2- 172.21.15.39:0/689710325 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f31d8066280 0x7f31d8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:05.285 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.275+0000 7f31d3fff640 1 -- 172.21.15.39:0/689710325 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f31dc0835b0 con 0x7f31ec071b70 2023-05-16T13:55:05.285 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.275+0000 7f31eaffd640 1 --2- 172.21.15.39:0/689710325 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f31d8066280 0x7f31d8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:05.285 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.275+0000 7f31eaffd640 1 --2- 172.21.15.39:0/689710325 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f31d8066280 0x7f31d8068730 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f31ec0cb250 tx=0x7f31e0009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:05.288 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.279+0000 7f31d3fff640 1 -- 172.21.15.39:0/689710325 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f31dc050a00 con 0x7f31ec071b70 2023-05-16T13:55:05.440 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.431+0000 7f31f2220640 1 -- 172.21.15.39:0/689710325 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f31ec0ac2e0 con 0x7f31ec071b70 2023-05-16T13:55:05.441 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.431+0000 7f31d3fff640 1 -- 172.21.15.39:0/689710325 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f31ec0ac2e0 con 0x7f31ec071b70 2023-05-16T13:55:05.441 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2023-05-16T13:55:05.442 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.435+0000 7f31f2220640 1 -- 172.21.15.39:0/689710325 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f31d8066280 msgr2=0x7f31d8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:05.442 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.435+0000 7f31f2220640 1 --2- 172.21.15.39:0/689710325 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f31d8066280 0x7f31d8068730 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f31ec0cb250 tx=0x7f31e0009190 comp rx=0 tx=0).stop 2023-05-16T13:55:05.443 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.435+0000 7f31f2220640 1 -- 172.21.15.39:0/689710325 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f31ec071b70 msgr2=0x7f31ec149230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:05.443 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.435+0000 7f31f2220640 1 --2- 172.21.15.39:0/689710325 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f31ec071b70 0x7f31ec149230 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f31dc00c500 tx=0x7f31dc00c9c0 comp rx=0 tx=0).stop 2023-05-16T13:55:05.443 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.435+0000 7f31f2220640 1 -- 172.21.15.39:0/689710325 shutdown_connections 2023-05-16T13:55:05.443 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.435+0000 7f31f2220640 1 --2- 172.21.15.39:0/689710325 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f31d8066280 0x7f31d8068730 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:05.443 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.435+0000 7f31f2220640 1 --2- 172.21.15.39:0/689710325 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f31ec0b4030 0x7f31ec1515c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:05.443 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.435+0000 7f31f2220640 1 --2- 172.21.15.39:0/689710325 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31ec0b0710 0x7f31ec158960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:05.444 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.435+0000 7f31f2220640 1 --2- 172.21.15.39:0/689710325 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f31ec071b70 0x7f31ec149230 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:05.444 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.435+0000 7f31f2220640 1 -- 172.21.15.39:0/689710325 >> 172.21.15.39:0/689710325 conn(0x7f31ec069a50 msgr2=0x7f31ec156f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:05.444 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.435+0000 7f31f2220640 1 -- 172.21.15.39:0/689710325 shutdown_connections 2023-05-16T13:55:05.444 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.435+0000 7f31f2220640 1 -- 172.21.15.39:0/689710325 wait complete. 2023-05-16T13:55:05.461 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-16T13:55:05.601 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.591+0000 7ff75f8d1640 1 Processor -- start 2023-05-16T13:55:05.601 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.595+0000 7ff75f8d1640 1 -- start start 2023-05-16T13:55:05.602 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.595+0000 7ff75f8d1640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff75815c490 0x7ff7580ad300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:05.602 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.595+0000 7ff75f8d1640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff75806c690 0x7ff7580b0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:05.602 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.595+0000 7ff75f8d1640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff75806b520 con 0x7ff7580b1a70 2023-05-16T13:55:05.602 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.595+0000 7ff75f8d1640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7580cee10 con 0x7ff75806c690 2023-05-16T13:55:05.603 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.595+0000 7ff75f8d1640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7580ad840 con 0x7ff75815c490 2023-05-16T13:55:05.603 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.595+0000 7ff75d66d640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff75815c490 0x7ff7580ad300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:05.603 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.595+0000 7ff75ce6c640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7ff7580b1a70 0x7ff75806bf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.39:40594/0 (socket says 172.21.15.39:40594) 2023-05-16T13:55:05.604 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.595+0000 7ff75ce6c640 1 -- 172.21.15.39:0/1272966271 learned_addr learned my addr 172.21.15.39:0/1272966271 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:55:05.604 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.595+0000 7ff75de6e640 1 --2- 172.21.15.39:0/1272966271 >> v2:172.21.15.118:3300/0 conn(0x7ff75806c690 0x7ff7580b0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:05.604 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.595+0000 7ff75d66d640 1 -- 172.21.15.39:0/1272966271 >> v2:172.21.15.118:3300/0 conn(0x7ff75806c690 msgr2=0x7ff7580b0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:05.604 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.595+0000 7ff75d66d640 1 --2- 172.21.15.39:0/1272966271 >> v2:172.21.15.118:3300/0 conn(0x7ff75806c690 0x7ff7580b0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:05.604 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.595+0000 7ff74ffff640 1 -- 172.21.15.39:0/1272966271 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2695258862 0 0) 0x7ff75806b520 con 0x7ff7580b1a70 2023-05-16T13:55:05.604 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.595+0000 7ff75d66d640 1 -- 172.21.15.39:0/1272966271 >> v1:172.21.15.118:6789/0 conn(0x7ff7580b1a70 legacy=0x7ff75806bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:05.604 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.595+0000 7ff75d66d640 1 -- 172.21.15.39:0/1272966271 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff75806cb10 con 0x7ff75815c490 2023-05-16T13:55:05.605 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.599+0000 7ff75d66d640 1 --2- 172.21.15.39:0/1272966271 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff75815c490 0x7ff7580ad300 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff754009d90 tx=0x7ff75401c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71145c029af99c75 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:05.606 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.599+0000 7ff74ffff640 1 -- 172.21.15.39:0/1272966271 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7540a59e0 con 0x7ff75815c490 2023-05-16T13:55:05.606 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.599+0000 7ff74ffff640 1 -- 172.21.15.39:0/1272966271 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7540a5b40 con 0x7ff75815c490 2023-05-16T13:55:05.606 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.599+0000 7ff74ffff640 1 -- 172.21.15.39:0/1272966271 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7540ad440 con 0x7ff75815c490 2023-05-16T13:55:05.607 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.599+0000 7ff75f8d1640 1 -- 172.21.15.39:0/1272966271 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff75815c490 msgr2=0x7ff7580ad300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:05.607 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.599+0000 7ff75f8d1640 1 --2- 172.21.15.39:0/1272966271 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff75815c490 0x7ff7580ad300 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff754009d90 tx=0x7ff75401c920 comp rx=0 tx=0).stop 2023-05-16T13:55:05.607 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.599+0000 7ff75f8d1640 1 -- 172.21.15.39:0/1272966271 shutdown_connections 2023-05-16T13:55:05.607 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.599+0000 7ff75f8d1640 1 --2- 172.21.15.39:0/1272966271 >> v2:172.21.15.118:3300/0 conn(0x7ff75806c690 0x7ff7580b0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:05.608 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.599+0000 7ff75f8d1640 1 --2- 172.21.15.39:0/1272966271 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff75815c490 0x7ff7580ad300 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:05.608 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.599+0000 7ff75f8d1640 1 -- 172.21.15.39:0/1272966271 >> 172.21.15.39:0/1272966271 conn(0x7ff7580999a0 msgr2=0x7ff7580d0670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:05.608 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.599+0000 7ff75f8d1640 1 -- 172.21.15.39:0/1272966271 shutdown_connections 2023-05-16T13:55:05.608 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.599+0000 7ff75f8d1640 1 -- 172.21.15.39:0/1272966271 wait complete. 2023-05-16T13:55:05.609 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.599+0000 7ff75f8d1640 1 Processor -- start 2023-05-16T13:55:05.609 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.603+0000 7ff75f8d1640 1 -- start start 2023-05-16T13:55:05.610 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.603+0000 7ff75f8d1640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff75806c690 0x7ff758152a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:05.610 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.603+0000 7ff75f8d1640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff7580b1a70 0x7ff7580c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:05.610 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.603+0000 7ff75f8d1640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff75815c490 0x7ff7580c41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:05.610 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.603+0000 7ff75f8d1640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff758153300 con 0x7ff75815c490 2023-05-16T13:55:05.610 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.603+0000 7ff75f8d1640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7581535e0 con 0x7ff7580b1a70 2023-05-16T13:55:05.611 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.603+0000 7ff75f8d1640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7581538c0 con 0x7ff75806c690 2023-05-16T13:55:05.611 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.603+0000 7ff75de6e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff75815c490 0x7ff7580c41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:05.611 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.603+0000 7ff75de6e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff75815c490 0x7ff7580c41a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34690/0 (socket says 172.21.15.39:34690) 2023-05-16T13:55:05.611 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.603+0000 7ff75de6e640 1 -- 172.21.15.39:0/1736741003 learned_addr learned my addr 172.21.15.39:0/1736741003 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:05.611 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.603+0000 7ff75ce6c640 1 --2- 172.21.15.39:0/1736741003 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff7580b1a70 0x7ff7580c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:05.611 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.603+0000 7ff75d66d640 1 --2- 172.21.15.39:0/1736741003 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff75806c690 0x7ff758152a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:05.612 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.603+0000 7ff75de6e640 1 -- 172.21.15.39:0/1736741003 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff75806c690 msgr2=0x7ff758152a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:05.612 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.603+0000 7ff75de6e640 1 --2- 172.21.15.39:0/1736741003 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff75806c690 0x7ff758152a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:05.613 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.603+0000 7ff75de6e640 1 -- 172.21.15.39:0/1736741003 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff7580b1a70 msgr2=0x7ff7580c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:05.613 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.603+0000 7ff75de6e640 1 --2- 172.21.15.39:0/1736741003 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff7580b1a70 0x7ff7580c89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:05.613 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.603+0000 7ff75de6e640 1 -- 172.21.15.39:0/1736741003 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff754009a70 con 0x7ff75815c490 2023-05-16T13:55:05.613 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.603+0000 7ff75de6e640 1 --2- 172.21.15.39:0/1736741003 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff75815c490 0x7ff7580c41a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ff75000e7f0 tx=0x7ff75000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:05.613 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.603+0000 7ff74dffb640 1 -- 172.21.15.39:0/1736741003 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff750009530 con 0x7ff75815c490 2023-05-16T13:55:05.613 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.603+0000 7ff74dffb640 1 -- 172.21.15.39:0/1736741003 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff75000eea0 con 0x7ff75815c490 2023-05-16T13:55:05.613 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.603+0000 7ff74dffb640 1 -- 172.21.15.39:0/1736741003 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75000cb60 con 0x7ff75815c490 2023-05-16T13:55:05.614 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.603+0000 7ff75f8d1640 1 -- 172.21.15.39:0/1736741003 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff75806b780 con 0x7ff75815c490 2023-05-16T13:55:05.614 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.603+0000 7ff75f8d1640 1 -- 172.21.15.39:0/1736741003 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7580ceb30 con 0x7ff75815c490 2023-05-16T13:55:05.614 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.603+0000 7ff75f8d1640 1 -- 172.21.15.39:0/1736741003 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff75806ba60 con 0x7ff75815c490 2023-05-16T13:55:05.615 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.607+0000 7ff74dffb640 1 -- 172.21.15.39:0/1736741003 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff75000ccc0 con 0x7ff75815c490 2023-05-16T13:55:05.615 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.607+0000 7ff74dffb640 1 --2- 172.21.15.39:0/1736741003 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ff73c066280 0x7ff73c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:05.615 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.607+0000 7ff74dffb640 1 -- 172.21.15.39:0/1736741003 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7ff750083e30 con 0x7ff75815c490 2023-05-16T13:55:05.615 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.607+0000 7ff75d66d640 1 --2- 172.21.15.39:0/1736741003 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ff73c066280 0x7ff73c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:05.615 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.607+0000 7ff75d66d640 1 --2- 172.21.15.39:0/1736741003 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ff73c066280 0x7ff73c068730 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff7540af000 tx=0x7ff7540a7070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:05.618 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.611+0000 7ff74dffb640 1 -- 172.21.15.39:0/1736741003 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ff750051290 con 0x7ff75815c490 2023-05-16T13:55:05.770 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.763+0000 7ff75f8d1640 1 -- 172.21.15.39:0/1736741003 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff758073c90 con 0x7ff75815c490 2023-05-16T13:55:05.770 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.763+0000 7ff74dffb640 1 -- 172.21.15.39:0/1736741003 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff7500210a0 con 0x7ff75815c490 2023-05-16T13:55:05.771 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 64 2023-05-16T13:55:05.772 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.763+0000 7ff75f8d1640 1 -- 172.21.15.39:0/1736741003 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ff73c066280 msgr2=0x7ff73c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:05.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.763+0000 7ff75f8d1640 1 --2- 172.21.15.39:0/1736741003 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ff73c066280 0x7ff73c068730 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff7540af000 tx=0x7ff7540a7070 comp rx=0 tx=0).stop 2023-05-16T13:55:05.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.763+0000 7ff75f8d1640 1 -- 172.21.15.39:0/1736741003 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff75815c490 msgr2=0x7ff7580c41a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:05.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.763+0000 7ff75f8d1640 1 --2- 172.21.15.39:0/1736741003 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff75815c490 0x7ff7580c41a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ff75000e7f0 tx=0x7ff75000ecb0 comp rx=0 tx=0).stop 2023-05-16T13:55:05.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.763+0000 7ff75f8d1640 1 -- 172.21.15.39:0/1736741003 shutdown_connections 2023-05-16T13:55:05.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.763+0000 7ff75f8d1640 1 --2- 172.21.15.39:0/1736741003 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff75815c490 0x7ff7580c41a0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:05.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.763+0000 7ff75f8d1640 1 --2- 172.21.15.39:0/1736741003 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff7580b1a70 0x7ff7580c89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:05.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.763+0000 7ff75f8d1640 1 --2- 172.21.15.39:0/1736741003 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ff73c066280 0x7ff73c068730 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:05.774 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.763+0000 7ff75f8d1640 1 --2- 172.21.15.39:0/1736741003 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff75806c690 0x7ff758152a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:05.774 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.763+0000 7ff75f8d1640 1 -- 172.21.15.39:0/1736741003 >> 172.21.15.39:0/1736741003 conn(0x7ff7580999a0 msgr2=0x7ff7580d0ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:05.774 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.763+0000 7ff75f8d1640 1 -- 172.21.15.39:0/1736741003 shutdown_connections 2023-05-16T13:55:05.774 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.763+0000 7ff75f8d1640 1 -- 172.21.15.39:0/1736741003 wait complete. 2023-05-16T13:55:05.791 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-16T13:55:05.931 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.923+0000 7f2dc288c640 1 Processor -- start 2023-05-16T13:55:05.932 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.923+0000 7f2dc288c640 1 -- start start 2023-05-16T13:55:05.932 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.923+0000 7f2dc288c640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2dbc159d10 0x7f2dbc0d3000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:05.933 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.923+0000 7f2dc288c640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2dbc0d0470 0x7f2dbc0d08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:05.933 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.923+0000 7f2dc288c640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f2dbc0cf1c0 0x7f2dbc0cf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:05.933 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.923+0000 7f2dc288c640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dbc0d0e00 con 0x7f2dbc0cf1c0 2023-05-16T13:55:05.933 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.923+0000 7f2dc288c640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dbc0d2b70 con 0x7f2dbc0d0470 2023-05-16T13:55:05.933 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.923+0000 7f2dc288c640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dbc0cfb80 con 0x7f2dbc159d10 2023-05-16T13:55:05.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.927+0000 7f2dc0e29640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f2dbc0cf1c0 0x7f2dbc0cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:05.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.927+0000 7f2dc0e29640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f2dbc0cf1c0 0x7f2dbc0cf640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34696/0 (socket says 172.21.15.39:34696) 2023-05-16T13:55:05.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.927+0000 7f2dc0e29640 1 -- 172.21.15.39:0/2855600921 learned_addr learned my addr 172.21.15.39:0/2855600921 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:05.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.927+0000 7f2dbbfff640 1 --2- 172.21.15.39:0/2855600921 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2dbc159d10 0x7f2dbc0d3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:05.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.927+0000 7f2dbb7fe640 1 --2- 172.21.15.39:0/2855600921 >> v2:172.21.15.118:3300/0 conn(0x7f2dbc0d0470 0x7f2dbc0d08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:05.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.927+0000 7f2dc0e29640 1 -- 172.21.15.39:0/2855600921 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2dbc159d10 msgr2=0x7f2dbc0d3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:05.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.927+0000 7f2dc0e29640 1 --2- 172.21.15.39:0/2855600921 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2dbc159d10 0x7f2dbc0d3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:05.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.927+0000 7f2dc0e29640 1 -- 172.21.15.39:0/2855600921 >> v2:172.21.15.118:3300/0 conn(0x7f2dbc0d0470 msgr2=0x7f2dbc0d08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:05.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.927+0000 7f2dc0e29640 1 --2- 172.21.15.39:0/2855600921 >> v2:172.21.15.118:3300/0 conn(0x7f2dbc0d0470 0x7f2dbc0d08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:05.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.927+0000 7f2dc0e29640 1 -- 172.21.15.39:0/2855600921 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dbc0cfe10 con 0x7f2dbc0cf1c0 2023-05-16T13:55:05.936 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.927+0000 7f2dc0e29640 1 --2- 172.21.15.39:0/2855600921 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2dbc0cf1c0 0x7f2dbc0cf640 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc0733a0 tx=0x7f2db401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=191218c981eaa21d server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:05.936 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.927+0000 7f2dbaffd640 1 -- 172.21.15.39:0/2855600921 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db40a5740 con 0x7f2dbc0cf1c0 2023-05-16T13:55:05.937 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.927+0000 7f2dbaffd640 1 -- 172.21.15.39:0/2855600921 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2db40a58a0 con 0x7f2dbc0cf1c0 2023-05-16T13:55:05.937 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.927+0000 7f2dbaffd640 1 -- 172.21.15.39:0/2855600921 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db40a5c30 con 0x7f2dbc0cf1c0 2023-05-16T13:55:05.937 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.931+0000 7f2dc288c640 1 -- 172.21.15.39:0/2855600921 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2dbc0cf1c0 msgr2=0x7f2dbc0cf640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:05.938 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.931+0000 7f2dc288c640 1 --2- 172.21.15.39:0/2855600921 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2dbc0cf1c0 0x7f2dbc0cf640 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc0733a0 tx=0x7f2db401c9d0 comp rx=0 tx=0).stop 2023-05-16T13:55:05.938 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.931+0000 7f2dc288c640 1 -- 172.21.15.39:0/2855600921 shutdown_connections 2023-05-16T13:55:05.938 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.931+0000 7f2dc288c640 1 --2- 172.21.15.39:0/2855600921 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2dbc0cf1c0 0x7f2dbc0cf640 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:05.938 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.931+0000 7f2dc288c640 1 --2- 172.21.15.39:0/2855600921 >> v2:172.21.15.118:3300/0 conn(0x7f2dbc0d0470 0x7f2dbc0d08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:05.938 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.931+0000 7f2dc288c640 1 --2- 172.21.15.39:0/2855600921 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2dbc159d10 0x7f2dbc0d3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:05.938 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.931+0000 7f2dc288c640 1 -- 172.21.15.39:0/2855600921 >> 172.21.15.39:0/2855600921 conn(0x7f2dbc071aa0 msgr2=0x7f2dbc09bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:05.938 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.931+0000 7f2dc288c640 1 -- 172.21.15.39:0/2855600921 shutdown_connections 2023-05-16T13:55:05.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.931+0000 7f2dc288c640 1 -- 172.21.15.39:0/2855600921 wait complete. 2023-05-16T13:55:05.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.931+0000 7f2dc288c640 1 Processor -- start 2023-05-16T13:55:05.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.931+0000 7f2dc288c640 1 -- start start 2023-05-16T13:55:05.940 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.931+0000 7f2dc288c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2dbc0cf1c0 0x7f2dbc158f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:05.940 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.931+0000 7f2dc288c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2dbc0d0470 0x7f2dbc15b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:05.940 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.931+0000 7f2dc288c640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2dbc159d10 0x7f2dbc15bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:05.941 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.931+0000 7f2dc288c640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dbc15b440 con 0x7f2dbc0d0470 2023-05-16T13:55:05.941 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.931+0000 7f2dc288c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dbc0b7350 con 0x7f2dbc0cf1c0 2023-05-16T13:55:05.941 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.931+0000 7f2dc288c640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dbc0b62b0 con 0x7f2dbc159d10 2023-05-16T13:55:05.941 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.931+0000 7f2dbb7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2dbc0d0470 0x7f2dbc15b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:05.941 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.931+0000 7f2dbb7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2dbc0d0470 0x7f2dbc15b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34708/0 (socket says 172.21.15.39:34708) 2023-05-16T13:55:05.941 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.931+0000 7f2dbb7fe640 1 -- 172.21.15.39:0/4122592983 learned_addr learned my addr 172.21.15.39:0/4122592983 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:05.941 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.931+0000 7f2dbbfff640 1 --2- 172.21.15.39:0/4122592983 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2dbc0cf1c0 0x7f2dbc158f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:05.941 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.931+0000 7f2dc0e29640 1 --2- 172.21.15.39:0/4122592983 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2dbc159d10 0x7f2dbc15bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:05.942 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.935+0000 7f2dbb7fe640 1 -- 172.21.15.39:0/4122592983 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2dbc159d10 msgr2=0x7f2dbc15bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:05.943 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.935+0000 7f2dbb7fe640 1 --2- 172.21.15.39:0/4122592983 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2dbc159d10 0x7f2dbc15bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:05.943 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.935+0000 7f2dbb7fe640 1 -- 172.21.15.39:0/4122592983 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2dbc0cf1c0 msgr2=0x7f2dbc158f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:05.943 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.935+0000 7f2dbb7fe640 1 --2- 172.21.15.39:0/4122592983 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2dbc0cf1c0 0x7f2dbc158f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:05.943 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.935+0000 7f2dbb7fe640 1 -- 172.21.15.39:0/4122592983 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2db4009b30 con 0x7f2dbc0d0470 2023-05-16T13:55:05.943 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.935+0000 7f2dbb7fe640 1 --2- 172.21.15.39:0/4122592983 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2dbc0d0470 0x7f2dbc15b810 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f2db000e870 tx=0x7f2db000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:05.943 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.935+0000 7f2db8ff9640 1 -- 172.21.15.39:0/4122592983 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db000ee60 con 0x7f2dbc0d0470 2023-05-16T13:55:05.943 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.935+0000 7f2db8ff9640 1 -- 172.21.15.39:0/4122592983 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2db000c940 con 0x7f2dbc0d0470 2023-05-16T13:55:05.943 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.935+0000 7f2db8ff9640 1 -- 172.21.15.39:0/4122592983 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db000ccf0 con 0x7f2dbc0d0470 2023-05-16T13:55:05.944 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.935+0000 7f2dc288c640 1 -- 172.21.15.39:0/4122592983 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dbc0d3540 con 0x7f2dbc0d0470 2023-05-16T13:55:05.944 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.935+0000 7f2dc288c640 1 -- 172.21.15.39:0/4122592983 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dbc0d2800 con 0x7f2dbc0d0470 2023-05-16T13:55:05.944 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.935+0000 7f2dc288c640 1 -- 172.21.15.39:0/4122592983 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dbc073c90 con 0x7f2dbc0d0470 2023-05-16T13:55:05.944 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.935+0000 7f2db8ff9640 1 -- 172.21.15.39:0/4122592983 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2db0013470 con 0x7f2dbc0d0470 2023-05-16T13:55:05.945 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.935+0000 7f2db8ff9640 1 --2- 172.21.15.39:0/4122592983 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f2da8066280 0x7f2da8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:05.945 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.939+0000 7f2db8ff9640 1 -- 172.21.15.39:0/4122592983 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f2db0083ef0 con 0x7f2dbc0d0470 2023-05-16T13:55:05.945 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.939+0000 7f2dbbfff640 1 --2- 172.21.15.39:0/4122592983 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f2da8066280 0x7f2da8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:05.945 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.939+0000 7f2dbbfff640 1 --2- 172.21.15.39:0/4122592983 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f2da8066280 0x7f2da8068730 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2dac009ac0 tx=0x7f2dac009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:05.949 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:05.943+0000 7f2db8ff9640 1 -- 172.21.15.39:0/4122592983 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f2db00512b0 con 0x7f2dbc0d0470 2023-05-16T13:55:06.115 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.107+0000 7f2dc288c640 1 -- 172.21.15.39:0/4122592983 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2dbc0d36d0 con 0x7f2dbc0d0470 2023-05-16T13:55:06.116 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.107+0000 7f2db8ff9640 1 -- 172.21.15.39:0/4122592983 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2db0021080 con 0x7f2dbc0d0470 2023-05-16T13:55:06.116 INFO:teuthology.orchestra.run.smithi039.stderr:listed 0 entries 2023-05-16T13:55:06.118 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.111+0000 7f2dc288c640 1 -- 172.21.15.39:0/4122592983 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f2da8066280 msgr2=0x7f2da8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:06.118 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.111+0000 7f2dc288c640 1 --2- 172.21.15.39:0/4122592983 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f2da8066280 0x7f2da8068730 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2dac009ac0 tx=0x7f2dac009190 comp rx=0 tx=0).stop 2023-05-16T13:55:06.118 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.111+0000 7f2dc288c640 1 -- 172.21.15.39:0/4122592983 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2dbc0d0470 msgr2=0x7f2dbc15b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:06.118 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.111+0000 7f2dc288c640 1 --2- 172.21.15.39:0/4122592983 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2dbc0d0470 0x7f2dbc15b810 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f2db000e870 tx=0x7f2db000ed30 comp rx=0 tx=0).stop 2023-05-16T13:55:06.118 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.111+0000 7f2dc288c640 1 -- 172.21.15.39:0/4122592983 shutdown_connections 2023-05-16T13:55:06.118 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.111+0000 7f2dc288c640 1 --2- 172.21.15.39:0/4122592983 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f2da8066280 0x7f2da8068730 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:06.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.111+0000 7f2dc288c640 1 --2- 172.21.15.39:0/4122592983 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2dbc159d10 0x7f2dbc15bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:06.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.111+0000 7f2dc288c640 1 --2- 172.21.15.39:0/4122592983 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2dbc0d0470 0x7f2dbc15b810 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:06.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.111+0000 7f2dc288c640 1 --2- 172.21.15.39:0/4122592983 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2dbc0cf1c0 0x7f2dbc158f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:06.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.111+0000 7f2dc288c640 1 -- 172.21.15.39:0/4122592983 >> 172.21.15.39:0/4122592983 conn(0x7f2dbc071aa0 msgr2=0x7f2dbc15cb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:06.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.111+0000 7f2dc288c640 1 -- 172.21.15.39:0/4122592983 shutdown_connections 2023-05-16T13:55:06.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.111+0000 7f2dc288c640 1 -- 172.21.15.39:0/4122592983 wait complete. 2023-05-16T13:55:06.135 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T13:55:06.137 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-05-16T13:55:06.137 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-16T13:55:06.147 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-16T13:55:06.183 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T13:55:06.319 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.311+0000 7ff826b39640 1 Processor -- start 2023-05-16T13:55:06.320 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.311+0000 7ff826b39640 1 -- start start 2023-05-16T13:55:06.322 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.311+0000 7ff826b39640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7ff8200cb4c0 0x7ff82015d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:06.322 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.311+0000 7ff826b39640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff8200703b0 0x7ff8200ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:06.322 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.311+0000 7ff826b39640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff82015d6a0 con 0x7ff820158bf0 2023-05-16T13:55:06.322 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.311+0000 7ff826b39640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff820070870 con 0x7ff8200cb4c0 2023-05-16T13:55:06.323 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.311+0000 7ff826b39640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff820070b50 con 0x7ff8200703b0 2023-05-16T13:55:06.323 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.311+0000 7ff8248d5640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7ff820158bf0 0x7ff8200cadb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:51064/0 (socket says 172.21.15.39:51064) 2023-05-16T13:55:06.323 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.311+0000 7ff8248d5640 1 -- 172.21.15.39:0/4144274282 learned_addr learned my addr 172.21.15.39:0/4144274282 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:55:06.323 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.311+0000 7ff81ffff640 1 --2- 172.21.15.39:0/4144274282 >> v2:172.21.15.39:3300/0 conn(0x7ff8200cb4c0 0x7ff82015d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:06.324 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.315+0000 7ff8250d6640 1 --2- 172.21.15.39:0/4144274282 >> v2:172.21.15.118:3300/0 conn(0x7ff8200703b0 0x7ff8200ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:06.324 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.315+0000 7ff81ffff640 1 -- 172.21.15.39:0/4144274282 >> v2:172.21.15.118:3300/0 conn(0x7ff8200703b0 msgr2=0x7ff8200ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:06.325 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.315+0000 7ff81ffff640 1 --2- 172.21.15.39:0/4144274282 >> v2:172.21.15.118:3300/0 conn(0x7ff8200703b0 0x7ff8200ccda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:06.325 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.315+0000 7ff81ffff640 1 -- 172.21.15.39:0/4144274282 >> v1:172.21.15.39:6789/0 conn(0x7ff820158bf0 legacy=0x7ff8200cadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:06.325 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.315+0000 7ff81ffff640 1 -- 172.21.15.39:0/4144274282 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff820070e30 con 0x7ff8200cb4c0 2023-05-16T13:55:06.325 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.315+0000 7ff81f7fe640 1 -- 172.21.15.39:0/4144274282 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1100886779 0 0) 0x7ff814001120 con 0x7ff820158bf0 2023-05-16T13:55:06.327 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.315+0000 7ff81ffff640 1 --2- 172.21.15.39:0/4144274282 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff8200cb4c0 0x7ff82015d160 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff8200ce340 tx=0x7ff80c01c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ddc862cfa68304a server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:06.327 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.315+0000 7ff81f7fe640 1 -- 172.21.15.39:0/4144274282 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80c0ac600 con 0x7ff8200cb4c0 2023-05-16T13:55:06.327 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.315+0000 7ff81f7fe640 1 -- 172.21.15.39:0/4144274282 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff80c0a8050 con 0x7ff8200cb4c0 2023-05-16T13:55:06.327 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.315+0000 7ff81f7fe640 1 -- 172.21.15.39:0/4144274282 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80c0ac980 con 0x7ff8200cb4c0 2023-05-16T13:55:06.328 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.319+0000 7ff826b39640 1 -- 172.21.15.39:0/4144274282 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff8200cb4c0 msgr2=0x7ff82015d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:06.328 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.319+0000 7ff826b39640 1 --2- 172.21.15.39:0/4144274282 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff8200cb4c0 0x7ff82015d160 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff8200ce340 tx=0x7ff80c01c3a0 comp rx=0 tx=0).stop 2023-05-16T13:55:06.328 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.319+0000 7ff826b39640 1 -- 172.21.15.39:0/4144274282 shutdown_connections 2023-05-16T13:55:06.328 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.319+0000 7ff826b39640 1 --2- 172.21.15.39:0/4144274282 >> v2:172.21.15.118:3300/0 conn(0x7ff8200703b0 0x7ff8200ccda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:06.328 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.319+0000 7ff826b39640 1 --2- 172.21.15.39:0/4144274282 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff8200cb4c0 0x7ff82015d160 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:06.329 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.319+0000 7ff826b39640 1 -- 172.21.15.39:0/4144274282 >> 172.21.15.39:0/4144274282 conn(0x7ff820069a50 msgr2=0x7ff820069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:06.329 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.319+0000 7ff826b39640 1 -- 172.21.15.39:0/4144274282 shutdown_connections 2023-05-16T13:55:06.329 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.319+0000 7ff826b39640 1 -- 172.21.15.39:0/4144274282 wait complete. 2023-05-16T13:55:06.329 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.319+0000 7ff826b39640 1 Processor -- start 2023-05-16T13:55:06.329 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.319+0000 7ff826b39640 1 -- start start 2023-05-16T13:55:06.332 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.319+0000 7ff826b39640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff8200703b0 0x7ff8200c61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:06.332 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.319+0000 7ff826b39640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff8200cb4c0 0x7ff820069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:06.332 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.319+0000 7ff826b39640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff820158bf0 0x7ff82006a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:06.333 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.319+0000 7ff826b39640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8200b3090 con 0x7ff8200cb4c0 2023-05-16T13:55:06.333 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.319+0000 7ff826b39640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8200b3370 con 0x7ff820158bf0 2023-05-16T13:55:06.333 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.319+0000 7ff826b39640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8200b3650 con 0x7ff8200703b0 2023-05-16T13:55:06.333 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.319+0000 7ff81ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff8200cb4c0 0x7ff820069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:06.333 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.319+0000 7ff81ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff8200cb4c0 0x7ff820069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34720/0 (socket says 172.21.15.39:34720) 2023-05-16T13:55:06.334 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.319+0000 7ff81ffff640 1 -- 172.21.15.39:0/102942046 learned_addr learned my addr 172.21.15.39:0/102942046 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:06.334 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.319+0000 7ff8248d5640 1 --2- 172.21.15.39:0/102942046 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff8200703b0 0x7ff8200c61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:06.334 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.319+0000 7ff8250d6640 1 --2- 172.21.15.39:0/102942046 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff820158bf0 0x7ff82006a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:06.334 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.319+0000 7ff81ffff640 1 -- 172.21.15.39:0/102942046 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff8200703b0 msgr2=0x7ff8200c61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:06.335 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.319+0000 7ff81ffff640 1 --2- 172.21.15.39:0/102942046 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff8200703b0 0x7ff8200c61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:06.335 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.319+0000 7ff81ffff640 1 -- 172.21.15.39:0/102942046 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff820158bf0 msgr2=0x7ff82006a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:06.335 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.319+0000 7ff81ffff640 1 --2- 172.21.15.39:0/102942046 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff820158bf0 0x7ff82006a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:06.335 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.319+0000 7ff81ffff640 1 -- 172.21.15.39:0/102942046 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff80c009420 con 0x7ff8200cb4c0 2023-05-16T13:55:06.335 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.319+0000 7ff81ffff640 1 --2- 172.21.15.39:0/102942046 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff8200cb4c0 0x7ff820069e20 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7ff80c018fb0 tx=0x7ff80c01abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:06.336 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.323+0000 7ff81d7fa640 1 -- 172.21.15.39:0/102942046 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80c004230 con 0x7ff8200cb4c0 2023-05-16T13:55:06.336 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.323+0000 7ff81d7fa640 1 -- 172.21.15.39:0/102942046 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff80c004390 con 0x7ff8200cb4c0 2023-05-16T13:55:06.336 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.323+0000 7ff81d7fa640 1 -- 172.21.15.39:0/102942046 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80c003820 con 0x7ff8200cb4c0 2023-05-16T13:55:06.336 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.323+0000 7ff826b39640 1 -- 172.21.15.39:0/102942046 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8200ad950 con 0x7ff8200cb4c0 2023-05-16T13:55:06.337 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.323+0000 7ff826b39640 1 -- 172.21.15.39:0/102942046 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff820158fc0 con 0x7ff8200cb4c0 2023-05-16T13:55:06.337 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.323+0000 7ff826b39640 1 -- 172.21.15.39:0/102942046 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8200cdaf0 con 0x7ff8200cb4c0 2023-05-16T13:55:06.337 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.323+0000 7ff81d7fa640 1 -- 172.21.15.39:0/102942046 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff80c003980 con 0x7ff8200cb4c0 2023-05-16T13:55:06.337 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.323+0000 7ff81d7fa640 1 --2- 172.21.15.39:0/102942046 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ff804066280 0x7ff804068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:06.337 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.323+0000 7ff81d7fa640 1 -- 172.21.15.39:0/102942046 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7ff80c11ea10 con 0x7ff8200cb4c0 2023-05-16T13:55:06.338 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.323+0000 7ff8248d5640 1 --2- 172.21.15.39:0/102942046 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ff804066280 0x7ff804068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:06.338 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.323+0000 7ff8248d5640 1 --2- 172.21.15.39:0/102942046 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ff804066280 0x7ff804068730 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff814000f70 tx=0x7ff814007c10 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:06.339 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.327+0000 7ff81d7fa640 1 -- 172.21.15.39:0/102942046 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ff80c0ec000 con 0x7ff8200cb4c0 2023-05-16T13:55:06.492 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.483+0000 7ff826b39640 1 -- 172.21.15.39:0/102942046 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff8200c8840 con 0x7ff8200cb4c0 2023-05-16T13:55:06.493 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.487+0000 7ff81d7fa640 1 -- 172.21.15.39:0/102942046 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18375 (secure 0 0 0) 0x7ff80c006e20 con 0x7ff8200cb4c0 2023-05-16T13:55:06.494 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:55:06.494 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":26,"fsid":"9c1e210b-c515-4ea4-a065-397956895c68","created":"2023-05-16T13:53:48.955290+0000","modified":"2023-05-16T13:54:56.831431+0000","last_up_change":"2023-05-16T13:54:01.722051+0000","last_in_change":"2023-05-16T13:53:52.331336+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-16T13:54:00.885009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-16T13:54:08.327895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-16T13:54:12.864823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-16T13:54:14.180225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4ce0f0ba-c4bf-4405-8c95-d2e9a62878ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6809","nonce":3462013698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6811","nonce":3462013698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6815","nonce":3462013698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6813","nonce":3462013698}]},"public_addr":"172.21.15.39:6809/3462013698","cluster_addr":"172.21.15.39:6811/3462013698","heartbeat_back_addr":"172.21.15.39:6815/3462013698","heartbeat_front_addr":"172.21.15.39:6813/3462013698","state":["exists","up"]},{"osd":1,"uuid":"53fdc1ac-2473-472d-af32-2760fdf6e476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6801","nonce":2829970892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6803","nonce":2829970892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6807","nonce":2829970892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6805","nonce":2829970892}]},"public_addr":"172.21.15.39:6801/2829970892","cluster_addr":"172.21.15.39:6803/2829970892","heartbeat_back_addr":"172.21.15.39:6807/2829970892","heartbeat_front_addr":"172.21.15.39:6805/2829970892","state":["exists","up"]},{"osd":2,"uuid":"0b92d770-7030-42fa-a19f-4f7f1ac113c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6817","nonce":3888067413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6819","nonce":3888067413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6823","nonce":3888067413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6821","nonce":3888067413}]},"public_addr":"172.21.15.39:6817/3888067413","cluster_addr":"172.21.15.39:6819/3888067413","heartbeat_back_addr":"172.21.15.39:6823/3888067413","heartbeat_front_addr":"172.21.15.39:6821/3888067413","state":["exists","up"]},{"osd":3,"uuid":"000d9506-cbb2-4017-b875-deca579860ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6825","nonce":405003958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6827","nonce":405003958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6831","nonce":405003958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6829","nonce":405003958}]},"public_addr":"172.21.15.39:6825/405003958","cluster_addr":"172.21.15.39:6827/405003958","heartbeat_back_addr":"172.21.15.39:6831/405003958","heartbeat_front_addr":"172.21.15.39:6829/405003958","state":["exists","up"]},{"osd":4,"uuid":"70f0dacb-e960-40c5-bf6a-183e52bbe2ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6801","nonce":3895278838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6805","nonce":3895278838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6813","nonce":3895278838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6809","nonce":3895278838}]},"public_addr":"172.21.15.118:6801/3895278838","cluster_addr":"172.21.15.118:6805/3895278838","heartbeat_back_addr":"172.21.15.118:6813/3895278838","heartbeat_front_addr":"172.21.15.118:6809/3895278838","state":["exists","up"]},{"osd":5,"uuid":"756feb54-c3ae-4a2a-8f74-85c291ba707c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6804","nonce":3513592808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6808","nonce":3513592808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6815","nonce":3513592808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6812","nonce":3513592808}]},"public_addr":"172.21.15.118:6804/3513592808","cluster_addr":"172.21.15.118:6808/3513592808","heartbeat_back_addr":"172.21.15.118:6815/3513592808","heartbeat_front_addr":"172.21.15.118:6812/3513592808","state":["exists","up"]},{"osd":6,"uuid":"c4a982c1-f497-4b0f-8a23-c77372e4621e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6824","nonce":1863656053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6827","nonce":1863656053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6831","nonce":1863656053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6829","nonce":1863656053}]},"public_addr":"172.21.15.118:6824/1863656053","cluster_addr":"172.21.15.118:6827/1863656053","heartbeat_back_addr":"172.21.15.118:6831/1863656053","heartbeat_front_addr":"172.21.15.118:6829/1863656053","state":["exists","up"]},{"osd":7,"uuid":"6f2888aa-a7ac-4e26-9159-e31817934f44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6817","nonce":3636642904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6819","nonce":3636642904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6825","nonce":3636642904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6821","nonce":3636642904}]},"public_addr":"172.21.15.118:6817/3636642904","cluster_addr":"172.21.15.118:6819/3636642904","heartbeat_back_addr":"172.21.15.118:6825/3636642904","heartbeat_front_addr":"172.21.15.118:6821/3636642904","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.717636+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.724036+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.739144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:58.079275+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:58.073921+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.930466+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.987813+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.941098+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.24","mappings":[{"from":1,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-16T13:55:06.495 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.487+0000 7ff826b39640 1 -- 172.21.15.39:0/102942046 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ff804066280 msgr2=0x7ff804068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:06.496 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.487+0000 7ff826b39640 1 --2- 172.21.15.39:0/102942046 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ff804066280 0x7ff804068730 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff814000f70 tx=0x7ff814007c10 comp rx=0 tx=0).stop 2023-05-16T13:55:06.496 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.487+0000 7ff826b39640 1 -- 172.21.15.39:0/102942046 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff8200cb4c0 msgr2=0x7ff820069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:06.496 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.487+0000 7ff826b39640 1 --2- 172.21.15.39:0/102942046 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff8200cb4c0 0x7ff820069e20 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7ff80c018fb0 tx=0x7ff80c01abe0 comp rx=0 tx=0).stop 2023-05-16T13:55:06.496 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.487+0000 7ff826b39640 1 -- 172.21.15.39:0/102942046 shutdown_connections 2023-05-16T13:55:06.496 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.487+0000 7ff826b39640 1 --2- 172.21.15.39:0/102942046 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff820158bf0 0x7ff82006a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:06.497 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.487+0000 7ff826b39640 1 --2- 172.21.15.39:0/102942046 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff8200cb4c0 0x7ff820069e20 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:06.497 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.487+0000 7ff826b39640 1 --2- 172.21.15.39:0/102942046 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ff804066280 0x7ff804068730 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:06.497 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.487+0000 7ff826b39640 1 --2- 172.21.15.39:0/102942046 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff8200703b0 0x7ff8200c61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:06.497 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.487+0000 7ff826b39640 1 -- 172.21.15.39:0/102942046 >> 172.21.15.39:0/102942046 conn(0x7ff820069a50 msgr2=0x7ff8200cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:06.497 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.487+0000 7ff826b39640 1 -- 172.21.15.39:0/102942046 shutdown_connections 2023-05-16T13:55:06.497 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.487+0000 7ff826b39640 1 -- 172.21.15.39:0/102942046 wait complete. 2023-05-16T13:55:06.514 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-16T13:54:00.885009+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-16T13:54:08.327895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-16T13:54:12.864823+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-16T13:54:14.180225+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-16T13:55:06.515 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-16T13:55:06.655 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.647+0000 7f92cf455640 1 Processor -- start 2023-05-16T13:55:06.656 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.647+0000 7f92cf455640 1 -- start start 2023-05-16T13:55:06.657 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.651+0000 7f92cf455640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f92c806c5a0 0x7f92c806c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:06.657 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.651+0000 7f92cf455640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92c806ceb0 con 0x7f92c8070d10 2023-05-16T13:55:06.657 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.651+0000 7f92cf455640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92c8071330 con 0x7f92c81589f0 2023-05-16T13:55:06.657 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.651+0000 7f92cf455640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92c8071110 con 0x7f92c806c5a0 2023-05-16T13:55:06.657 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.651+0000 7f92cd1f1640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f92c806c5a0 0x7f92c806c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:06.657 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.651+0000 7f92cd9f2640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f92c8070d10 0x7f92c80ca1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:51066/0 (socket says 172.21.15.39:51066) 2023-05-16T13:55:06.658 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.651+0000 7f92cd1f1640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f92c806c5a0 0x7f92c806c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34732/0 (socket says 172.21.15.39:34732) 2023-05-16T13:55:06.658 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.651+0000 7f92cd9f2640 1 -- 172.21.15.39:0/875912471 learned_addr learned my addr 172.21.15.39:0/875912471 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:55:06.658 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.651+0000 7f92cd1f1640 1 -- 172.21.15.39:0/875912471 >> v1:172.21.15.118:6789/0 conn(0x7f92c81589f0 legacy=0x7f92c8070600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:06.658 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.651+0000 7f92cd1f1640 1 -- 172.21.15.39:0/875912471 >> v1:172.21.15.39:6789/0 conn(0x7f92c8070d10 legacy=0x7f92c80ca1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:06.659 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.651+0000 7f92cd1f1640 1 -- 172.21.15.39:0/875912471 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c80c96e0 con 0x7f92c806c5a0 2023-05-16T13:55:06.660 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.651+0000 7f92cd1f1640 1 --2- 172.21.15.39:0/875912471 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f92c806c5a0 0x7f92c806c970 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f92c40097c0 tx=0x7f92c401ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10610fe9e733aa18 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:06.661 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.651+0000 7f92bffff640 1 -- 172.21.15.39:0/875912471 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c40a8970 con 0x7f92c806c5a0 2023-05-16T13:55:06.662 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.651+0000 7f92bffff640 1 -- 172.21.15.39:0/875912471 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92c40a8ad0 con 0x7f92c806c5a0 2023-05-16T13:55:06.662 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.651+0000 7f92bffff640 1 -- 172.21.15.39:0/875912471 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c40a8e60 con 0x7f92c806c5a0 2023-05-16T13:55:06.662 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.655+0000 7f92cf455640 1 -- 172.21.15.39:0/875912471 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f92c806c5a0 msgr2=0x7f92c806c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:06.663 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.655+0000 7f92cf455640 1 --2- 172.21.15.39:0/875912471 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f92c806c5a0 0x7f92c806c970 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f92c40097c0 tx=0x7f92c401ec70 comp rx=0 tx=0).stop 2023-05-16T13:55:06.663 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.655+0000 7f92cf455640 1 -- 172.21.15.39:0/875912471 shutdown_connections 2023-05-16T13:55:06.663 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.655+0000 7f92cf455640 1 --2- 172.21.15.39:0/875912471 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f92c806c5a0 0x7f92c806c970 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:06.663 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.655+0000 7f92cf455640 1 -- 172.21.15.39:0/875912471 >> 172.21.15.39:0/875912471 conn(0x7f92c80b14a0 msgr2=0x7f92c80cec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:06.663 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.655+0000 7f92cf455640 1 -- 172.21.15.39:0/875912471 shutdown_connections 2023-05-16T13:55:06.663 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.655+0000 7f92cf455640 1 -- 172.21.15.39:0/875912471 wait complete. 2023-05-16T13:55:06.664 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.655+0000 7f92cf455640 1 Processor -- start 2023-05-16T13:55:06.665 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.655+0000 7f92cf455640 1 -- start start 2023-05-16T13:55:06.665 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.655+0000 7f92cf455640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f92c806c5a0 0x7f92c8149ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:06.665 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.655+0000 7f92cf455640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f92c8070d10 0x7f92c81f5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:06.665 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.655+0000 7f92cf455640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92c81589f0 0x7f92c8156510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:06.665 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.655+0000 7f92cf455640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c80cc340 con 0x7f92c806c5a0 2023-05-16T13:55:06.666 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.655+0000 7f92cf455640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c8154b50 con 0x7f92c81589f0 2023-05-16T13:55:06.666 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.655+0000 7f92cf455640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92c814a420 con 0x7f92c8070d10 2023-05-16T13:55:06.666 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.655+0000 7f92cd1f1640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f92c806c5a0 0x7f92c8149ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:06.666 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.655+0000 7f92cd1f1640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f92c806c5a0 0x7f92c8149ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34736/0 (socket says 172.21.15.39:34736) 2023-05-16T13:55:06.666 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.655+0000 7f92cd1f1640 1 -- 172.21.15.39:0/2285255029 learned_addr learned my addr 172.21.15.39:0/2285255029 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:06.667 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.655+0000 7f92cc9f0640 1 --2- 172.21.15.39:0/2285255029 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f92c8070d10 0x7f92c81f5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:06.667 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.655+0000 7f92cd9f2640 1 --2- 172.21.15.39:0/2285255029 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92c81589f0 0x7f92c8156510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:06.667 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.655+0000 7f92cd1f1640 1 -- 172.21.15.39:0/2285255029 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f92c8070d10 msgr2=0x7f92c81f5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:06.667 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.655+0000 7f92cd1f1640 1 --2- 172.21.15.39:0/2285255029 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f92c8070d10 0x7f92c81f5620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:06.667 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.655+0000 7f92cd1f1640 1 -- 172.21.15.39:0/2285255029 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92c81589f0 msgr2=0x7f92c8156510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:06.667 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.655+0000 7f92cd1f1640 1 --2- 172.21.15.39:0/2285255029 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92c81589f0 0x7f92c8156510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:06.667 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.659+0000 7f92cd1f1640 1 -- 172.21.15.39:0/2285255029 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c4009420 con 0x7f92c806c5a0 2023-05-16T13:55:06.668 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.659+0000 7f92cc9f0640 1 --2- 172.21.15.39:0/2285255029 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f92c8070d10 0x7f92c81f5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-16T13:55:06.668 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.659+0000 7f92cd9f2640 1 --2- 172.21.15.39:0/2285255029 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92c81589f0 0x7f92c8156510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-16T13:55:06.669 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.659+0000 7f92cd1f1640 1 --2- 172.21.15.39:0/2285255029 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f92c806c5a0 0x7f92c8149ee0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f92c40b3040 tx=0x7f92c401ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:06.669 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.659+0000 7f92bdffb640 1 -- 172.21.15.39:0/2285255029 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c40b9630 con 0x7f92c806c5a0 2023-05-16T13:55:06.669 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.659+0000 7f92bdffb640 1 -- 172.21.15.39:0/2285255029 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92c40b97b0 con 0x7f92c806c5a0 2023-05-16T13:55:06.669 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.659+0000 7f92cf455640 1 -- 172.21.15.39:0/2285255029 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92c80c9ca0 con 0x7f92c806c5a0 2023-05-16T13:55:06.669 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.659+0000 7f92bdffb640 1 -- 172.21.15.39:0/2285255029 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c40b9b60 con 0x7f92c806c5a0 2023-05-16T13:55:06.670 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.659+0000 7f92cf455640 1 -- 172.21.15.39:0/2285255029 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92c80c99c0 con 0x7f92c806c5a0 2023-05-16T13:55:06.670 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.659+0000 7f92cf455640 1 -- 172.21.15.39:0/2285255029 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92c80c93d0 con 0x7f92c806c5a0 2023-05-16T13:55:06.670 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.659+0000 7f92bdffb640 1 -- 172.21.15.39:0/2285255029 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f92c40b7040 con 0x7f92c806c5a0 2023-05-16T13:55:06.670 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.659+0000 7f92bdffb640 1 --2- 172.21.15.39:0/2285255029 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f92ac066280 0x7f92ac068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:06.670 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.659+0000 7f92bdffb640 1 -- 172.21.15.39:0/2285255029 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f92c4121e10 con 0x7f92c806c5a0 2023-05-16T13:55:06.670 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.663+0000 7f92cc9f0640 1 --2- 172.21.15.39:0/2285255029 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f92ac066280 0x7f92ac068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:06.671 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.663+0000 7f92cc9f0640 1 --2- 172.21.15.39:0/2285255029 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f92ac066280 0x7f92ac068730 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f92c80c2370 tx=0x7f92b8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:06.672 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.663+0000 7f92bdffb640 1 -- 172.21.15.39:0/2285255029 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f92c4125030 con 0x7f92c806c5a0 2023-05-16T13:55:06.824 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.815+0000 7f92cf455640 1 -- 172.21.15.39:0/2285255029 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f92c8073c90 con 0x7f92c806c5a0 2023-05-16T13:55:06.825 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.819+0000 7f92bdffb640 1 -- 172.21.15.39:0/2285255029 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f92c40b5070 con 0x7f92c806c5a0 2023-05-16T13:55:06.825 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2023-05-16T13:55:06.827 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.819+0000 7f92cf455640 1 -- 172.21.15.39:0/2285255029 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f92ac066280 msgr2=0x7f92ac068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:06.827 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.819+0000 7f92cf455640 1 --2- 172.21.15.39:0/2285255029 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f92ac066280 0x7f92ac068730 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f92c80c2370 tx=0x7f92b8009040 comp rx=0 tx=0).stop 2023-05-16T13:55:06.827 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.819+0000 7f92cf455640 1 -- 172.21.15.39:0/2285255029 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f92c806c5a0 msgr2=0x7f92c8149ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:06.827 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.819+0000 7f92cf455640 1 --2- 172.21.15.39:0/2285255029 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f92c806c5a0 0x7f92c8149ee0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f92c40b3040 tx=0x7f92c401ba10 comp rx=0 tx=0).stop 2023-05-16T13:55:06.827 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.819+0000 7f92cf455640 1 -- 172.21.15.39:0/2285255029 shutdown_connections 2023-05-16T13:55:06.827 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.819+0000 7f92cf455640 1 --2- 172.21.15.39:0/2285255029 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f92ac066280 0x7f92ac068730 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:06.828 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.819+0000 7f92cf455640 1 --2- 172.21.15.39:0/2285255029 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f92c8070d10 0x7f92c81f5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:06.828 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.819+0000 7f92cf455640 1 --2- 172.21.15.39:0/2285255029 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92c81589f0 0x7f92c8156510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:06.828 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.819+0000 7f92cf455640 1 --2- 172.21.15.39:0/2285255029 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f92c806c5a0 0x7f92c8149ee0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:06.828 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.819+0000 7f92cf455640 1 -- 172.21.15.39:0/2285255029 >> 172.21.15.39:0/2285255029 conn(0x7f92c80b14a0 msgr2=0x7f92c80cebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:06.828 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.819+0000 7f92cf455640 1 -- 172.21.15.39:0/2285255029 shutdown_connections 2023-05-16T13:55:06.828 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.819+0000 7f92cf455640 1 -- 172.21.15.39:0/2285255029 wait complete. 2023-05-16T13:55:06.845 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-16T13:55:06.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.979+0000 7fc8457a2640 1 Processor -- start 2023-05-16T13:55:06.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.979+0000 7fc8457a2640 1 -- start start 2023-05-16T13:55:06.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.983+0000 7fc8457a2640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc8400d0960 0x7fc8400b0430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:06.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.983+0000 7fc8457a2640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc84006b940 con 0x7fc8400b16a0 2023-05-16T13:55:06.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.983+0000 7fc8457a2640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc84006bc20 con 0x7fc8400cf7f0 2023-05-16T13:55:06.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.983+0000 7fc8457a2640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8400af240 con 0x7fc8400d0960 2023-05-16T13:55:06.990 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.983+0000 7fc83f7fe640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fc8400b16a0 0x7fc8400afd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:51078/0 (socket says 172.21.15.39:51078) 2023-05-16T13:55:06.990 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.983+0000 7fc83f7fe640 1 -- 172.21.15.39:0/3336886783 learned_addr learned my addr 172.21.15.39:0/3336886783 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:55:06.991 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.983+0000 7fc83effd640 1 -- 172.21.15.39:0/3336886783 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1992707419 0 0) 0x7fc84006b940 con 0x7fc8400b16a0 2023-05-16T13:55:06.991 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.983+0000 7fc844fa1640 1 --2- 172.21.15.39:0/3336886783 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc8400d0960 0x7fc8400b0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:06.992 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.983+0000 7fc83effd640 1 -- 172.21.15.39:0/3336886783 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc828003530 con 0x7fc8400b16a0 2023-05-16T13:55:06.992 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.983+0000 7fc83effd640 1 -- 172.21.15.39:0/3336886783 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1061562263 0 0) 0x7fc828003530 con 0x7fc8400b16a0 2023-05-16T13:55:06.992 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.983+0000 7fc83effd640 1 -- 172.21.15.39:0/3336886783 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc8400d0960 msgr2=0x7fc8400b0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:06.992 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.983+0000 7fc83effd640 1 --2- 172.21.15.39:0/3336886783 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc8400d0960 0x7fc8400b0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:06.992 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.983+0000 7fc83effd640 1 -- 172.21.15.39:0/3336886783 >> v1:172.21.15.118:6789/0 conn(0x7fc8400cf7f0 legacy=0x7fc8400d0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:06.992 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.983+0000 7fc83effd640 1 -- 172.21.15.39:0/3336886783 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8400af520 con 0x7fc8400b16a0 2023-05-16T13:55:06.992 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.983+0000 7fc83effd640 1 -- 172.21.15.39:0/3336886783 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1738805496 0 0) 0x7fc834001680 con 0x7fc8400b16a0 2023-05-16T13:55:06.993 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.983+0000 7fc83effd640 1 -- 172.21.15.39:0/3336886783 >> v1:172.21.15.39:6789/0 conn(0x7fc8400b16a0 legacy=0x7fc8400afd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:06.993 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.983+0000 7fc83effd640 1 --2- 172.21.15.39:0/3336886783 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc8400d0960 0x7fc8280039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:06.993 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.983+0000 7fc83effd640 1 --2- 172.21.15.39:0/3336886783 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc828003f30 0x7fc8280047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:06.993 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.983+0000 7fc83effd640 1 --2- 172.21.15.39:0/3336886783 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc828004d10 0x7fc828005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:06.993 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.983+0000 7fc83effd640 1 -- 172.21.15.39:0/3336886783 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8400af240 con 0x7fc828003f30 2023-05-16T13:55:06.993 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.983+0000 7fc83effd640 1 -- 172.21.15.39:0/3336886783 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc82800ba70 con 0x7fc828004d10 2023-05-16T13:55:06.993 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.983+0000 7fc83effd640 1 -- 172.21.15.39:0/3336886783 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc82800bc30 con 0x7fc8400d0960 2023-05-16T13:55:06.993 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.983+0000 7fc83f7fe640 1 --2- 172.21.15.39:0/3336886783 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc828003f30 0x7fc8280047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:06.994 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.983+0000 7fc83ffff640 1 --2- 172.21.15.39:0/3336886783 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc8400d0960 0x7fc8280039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:06.994 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.983+0000 7fc844fa1640 1 --2- 172.21.15.39:0/3336886783 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc828004d10 0x7fc828005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:06.994 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.983+0000 7fc83f7fe640 1 -- 172.21.15.39:0/3336886783 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc8400d0960 msgr2=0x7fc8280039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:06.994 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.983+0000 7fc83f7fe640 1 --2- 172.21.15.39:0/3336886783 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc8400d0960 0x7fc8280039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:06.994 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.983+0000 7fc83f7fe640 1 -- 172.21.15.39:0/3336886783 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc828004d10 msgr2=0x7fc828005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:06.994 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.983+0000 7fc83f7fe640 1 --2- 172.21.15.39:0/3336886783 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc828004d10 0x7fc828005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:06.994 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.983+0000 7fc83f7fe640 1 -- 172.21.15.39:0/3336886783 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc828003530 con 0x7fc828003f30 2023-05-16T13:55:06.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.987+0000 7fc83f7fe640 1 --2- 172.21.15.39:0/3336886783 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc828003f30 0x7fc8280047d0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc83400c210 tx=0x7fc83401f370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da7f848d69b42a04 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:06.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.987+0000 7fc83effd640 1 -- 172.21.15.39:0/3336886783 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc834005ae0 con 0x7fc828003f30 2023-05-16T13:55:06.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.987+0000 7fc83effd640 1 -- 172.21.15.39:0/3336886783 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8340ab070 con 0x7fc828003f30 2023-05-16T13:55:06.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.987+0000 7fc83effd640 1 -- 172.21.15.39:0/3336886783 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc834005ea0 con 0x7fc828003f30 2023-05-16T13:55:06.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.987+0000 7fc8457a2640 1 -- 172.21.15.39:0/3336886783 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc828003f30 msgr2=0x7fc8280047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:06.997 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.987+0000 7fc8457a2640 1 --2- 172.21.15.39:0/3336886783 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc828003f30 0x7fc8280047d0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc83400c210 tx=0x7fc83401f370 comp rx=0 tx=0).stop 2023-05-16T13:55:06.997 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.987+0000 7fc844fa1640 1 -- 172.21.15.39:0/3336886783 reap_dead start 2023-05-16T13:55:06.997 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.987+0000 7fc8457a2640 1 -- 172.21.15.39:0/3336886783 shutdown_connections 2023-05-16T13:55:06.998 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.987+0000 7fc8457a2640 1 -- 172.21.15.39:0/3336886783 >> 172.21.15.39:0/3336886783 conn(0x7fc840071aa0 msgr2=0x7fc84009b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:06.998 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.987+0000 7fc8457a2640 1 -- 172.21.15.39:0/3336886783 shutdown_connections 2023-05-16T13:55:06.998 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.987+0000 7fc8457a2640 1 -- 172.21.15.39:0/3336886783 wait complete. 2023-05-16T13:55:06.998 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.987+0000 7fc8457a2640 1 Processor -- start 2023-05-16T13:55:07.000 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.987+0000 7fc8457a2640 1 -- start start 2023-05-16T13:55:07.000 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.991+0000 7fc8457a2640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc828003f30 0x7fc8400b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:07.000 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.991+0000 7fc8457a2640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc8401e3cc0 0x7fc8400b7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:07.000 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.991+0000 7fc8457a2640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc840159280 0x7fc8401596f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:07.001 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.991+0000 7fc8457a2640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8401e4e70 con 0x7fc828003f30 2023-05-16T13:55:07.001 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.991+0000 7fc8457a2640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8401e4260 con 0x7fc840159280 2023-05-16T13:55:07.001 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.991+0000 7fc8457a2640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8401e4540 con 0x7fc8401e3cc0 2023-05-16T13:55:07.001 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.991+0000 7fc83ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc828003f30 0x7fc8400b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:07.001 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.991+0000 7fc83ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc828003f30 0x7fc8400b7110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34752/0 (socket says 172.21.15.39:34752) 2023-05-16T13:55:07.001 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.991+0000 7fc83ffff640 1 -- 172.21.15.39:0/3735520265 learned_addr learned my addr 172.21.15.39:0/3735520265 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:07.001 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.991+0000 7fc844fa1640 1 --2- 172.21.15.39:0/3735520265 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc840159280 0x7fc8401596f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:07.002 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.991+0000 7fc83f7fe640 1 --2- 172.21.15.39:0/3735520265 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc8401e3cc0 0x7fc8400b7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:07.002 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.991+0000 7fc83ffff640 1 -- 172.21.15.39:0/3735520265 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc8401e3cc0 msgr2=0x7fc8400b7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:07.002 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.991+0000 7fc83ffff640 1 --2- 172.21.15.39:0/3735520265 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc8401e3cc0 0x7fc8400b7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:07.002 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.991+0000 7fc83ffff640 1 -- 172.21.15.39:0/3735520265 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc840159280 msgr2=0x7fc8401596f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:07.002 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.991+0000 7fc83ffff640 1 --2- 172.21.15.39:0/3735520265 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc840159280 0x7fc8401596f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:07.002 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.991+0000 7fc83ffff640 1 -- 172.21.15.39:0/3735520265 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc84006b440 con 0x7fc828003f30 2023-05-16T13:55:07.002 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.991+0000 7fc844fa1640 1 --2- 172.21.15.39:0/3735520265 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc840159280 0x7fc8401596f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-16T13:55:07.002 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.991+0000 7fc83f7fe640 1 --2- 172.21.15.39:0/3735520265 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc8401e3cc0 0x7fc8400b7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-16T13:55:07.003 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.991+0000 7fc83ffff640 1 --2- 172.21.15.39:0/3735520265 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc828003f30 0x7fc8400b7110 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fc83000f820 tx=0x7fc83000fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:07.003 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.991+0000 7fc83cff9640 1 -- 172.21.15.39:0/3735520265 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8300050d0 con 0x7fc828003f30 2023-05-16T13:55:07.003 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.991+0000 7fc83cff9640 1 -- 172.21.15.39:0/3735520265 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc830005230 con 0x7fc828003f30 2023-05-16T13:55:07.003 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.991+0000 7fc8457a2640 1 -- 172.21.15.39:0/3735520265 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8400af800 con 0x7fc828003f30 2023-05-16T13:55:07.003 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.991+0000 7fc83cff9640 1 -- 172.21.15.39:0/3735520265 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83000d730 con 0x7fc828003f30 2023-05-16T13:55:07.003 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.991+0000 7fc8457a2640 1 -- 172.21.15.39:0/3735520265 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc84006b5d0 con 0x7fc828003f30 2023-05-16T13:55:07.003 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.991+0000 7fc8457a2640 1 -- 172.21.15.39:0/3735520265 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc840073190 con 0x7fc828003f30 2023-05-16T13:55:07.004 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.991+0000 7fc83cff9640 1 -- 172.21.15.39:0/3735520265 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc83000d890 con 0x7fc828003f30 2023-05-16T13:55:07.004 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.995+0000 7fc83cff9640 1 --2- 172.21.15.39:0/3735520265 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc82c066280 0x7fc82c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:07.004 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.995+0000 7fc83cff9640 1 -- 172.21.15.39:0/3735520265 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fc830083cb0 con 0x7fc828003f30 2023-05-16T13:55:07.004 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.995+0000 7fc83f7fe640 1 --2- 172.21.15.39:0/3735520265 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc82c066280 0x7fc82c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:07.005 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.995+0000 7fc83f7fe640 1 --2- 172.21.15.39:0/3735520265 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc82c066280 0x7fc82c068730 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc8340af000 tx=0x7fc8340aa000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:07.005 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:06.999+0000 7fc83cff9640 1 -- 172.21.15.39:0/3735520265 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fc830051180 con 0x7fc828003f30 2023-05-16T13:55:07.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.155+0000 7fc8457a2640 1 -- 172.21.15.39:0/3735520265 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc84004ed20 con 0x7fc828003f30 2023-05-16T13:55:07.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.155+0000 7fc83cff9640 1 -- 172.21.15.39:0/3735520265 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc8300547a0 con 0x7fc828003f30 2023-05-16T13:55:07.164 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 8 2023-05-16T13:55:07.165 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.159+0000 7fc8457a2640 1 -- 172.21.15.39:0/3735520265 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc82c066280 msgr2=0x7fc82c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:07.165 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.159+0000 7fc8457a2640 1 --2- 172.21.15.39:0/3735520265 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc82c066280 0x7fc82c068730 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc8340af000 tx=0x7fc8340aa000 comp rx=0 tx=0).stop 2023-05-16T13:55:07.165 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.159+0000 7fc8457a2640 1 -- 172.21.15.39:0/3735520265 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc828003f30 msgr2=0x7fc8400b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:07.165 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.159+0000 7fc8457a2640 1 --2- 172.21.15.39:0/3735520265 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc828003f30 0x7fc8400b7110 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fc83000f820 tx=0x7fc83000fce0 comp rx=0 tx=0).stop 2023-05-16T13:55:07.165 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.159+0000 7fc8457a2640 1 -- 172.21.15.39:0/3735520265 shutdown_connections 2023-05-16T13:55:07.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.159+0000 7fc8457a2640 1 --2- 172.21.15.39:0/3735520265 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc82c066280 0x7fc82c068730 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:07.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.159+0000 7fc8457a2640 1 --2- 172.21.15.39:0/3735520265 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc8401e3cc0 0x7fc8400b7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:07.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.159+0000 7fc8457a2640 1 --2- 172.21.15.39:0/3735520265 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc840159280 0x7fc8401596f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:07.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.159+0000 7fc8457a2640 1 --2- 172.21.15.39:0/3735520265 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc828003f30 0x7fc8400b7110 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:07.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.159+0000 7fc8457a2640 1 -- 172.21.15.39:0/3735520265 >> 172.21.15.39:0/3735520265 conn(0x7fc840071aa0 msgr2=0x7fc84015be90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:07.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.159+0000 7fc8457a2640 1 -- 172.21.15.39:0/3735520265 shutdown_connections 2023-05-16T13:55:07.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.159+0000 7fc8457a2640 1 -- 172.21.15.39:0/3735520265 wait complete. 2023-05-16T13:55:07.184 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-16T13:55:07.325 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.319+0000 7f2d0d7a2640 1 Processor -- start 2023-05-16T13:55:07.325 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.319+0000 7f2d0d7a2640 1 -- start start 2023-05-16T13:55:07.326 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.319+0000 7f2d0d7a2640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2d0815c230 0x7f2d080ce690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:07.326 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.319+0000 7f2d0d7a2640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2d0806a160 0x7f2d0806dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:07.326 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.319+0000 7f2d0d7a2640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d0815fcc0 con 0x7f2d080cebd0 2023-05-16T13:55:07.326 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.319+0000 7f2d0d7a2640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d0815ffa0 con 0x7f2d0815c230 2023-05-16T13:55:07.327 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.319+0000 7f2d0d7a2640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d08160280 con 0x7f2d0806a160 2023-05-16T13:55:07.327 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.319+0000 7f2d0cfa1640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2d0806a160 0x7f2d0806dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:07.328 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.319+0000 7f2d077fe640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f2d080cebd0 0x7f2d08069a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.39:40628/0 (socket says 172.21.15.39:40628) 2023-05-16T13:55:07.328 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.319+0000 7f2d0cfa1640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2d0806a160 0x7f2d0806dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.39:41196/0 (socket says 172.21.15.39:41196) 2023-05-16T13:55:07.328 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.319+0000 7f2d077fe640 1 -- 172.21.15.39:0/765127162 learned_addr learned my addr 172.21.15.39:0/765127162 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:55:07.328 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.319+0000 7f2d07fff640 1 --2- 172.21.15.39:0/765127162 >> v2:172.21.15.118:3300/0 conn(0x7f2d0815c230 0x7f2d080ce690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:07.328 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.319+0000 7f2d0cfa1640 1 -- 172.21.15.39:0/765127162 >> v2:172.21.15.118:3300/0 conn(0x7f2d0815c230 msgr2=0x7f2d080ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:07.328 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.319+0000 7f2d0cfa1640 1 --2- 172.21.15.39:0/765127162 >> v2:172.21.15.118:3300/0 conn(0x7f2d0815c230 0x7f2d080ce690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:07.328 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.319+0000 7f2d0cfa1640 1 -- 172.21.15.39:0/765127162 >> v1:172.21.15.118:6789/0 conn(0x7f2d080cebd0 legacy=0x7f2d08069a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:07.329 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.319+0000 7f2d06ffd640 1 -- 172.21.15.39:0/765127162 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 223801123 0 0) 0x7f2d0815fcc0 con 0x7f2d080cebd0 2023-05-16T13:55:07.329 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.319+0000 7f2d0cfa1640 1 -- 172.21.15.39:0/765127162 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d08160560 con 0x7f2d0806a160 2023-05-16T13:55:07.330 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.323+0000 7f2d0cfa1640 1 --2- 172.21.15.39:0/765127162 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2d0806a160 0x7f2d0806dfe0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2d00009d90 tx=0x7f2d0001c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74833b26d535ce08 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:07.330 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.323+0000 7f2d06ffd640 1 -- 172.21.15.39:0/765127162 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d000a59d0 con 0x7f2d0806a160 2023-05-16T13:55:07.330 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.323+0000 7f2d06ffd640 1 -- 172.21.15.39:0/765127162 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d000a5b30 con 0x7f2d0806a160 2023-05-16T13:55:07.331 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.323+0000 7f2d06ffd640 1 -- 172.21.15.39:0/765127162 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d000ad440 con 0x7f2d0806a160 2023-05-16T13:55:07.331 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.323+0000 7f2d0d7a2640 1 -- 172.21.15.39:0/765127162 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2d0806a160 msgr2=0x7f2d0806dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:07.331 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.323+0000 7f2d0d7a2640 1 --2- 172.21.15.39:0/765127162 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2d0806a160 0x7f2d0806dfe0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2d00009d90 tx=0x7f2d0001c970 comp rx=0 tx=0).stop 2023-05-16T13:55:07.332 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.323+0000 7f2d0d7a2640 1 -- 172.21.15.39:0/765127162 shutdown_connections 2023-05-16T13:55:07.332 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.323+0000 7f2d0d7a2640 1 --2- 172.21.15.39:0/765127162 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2d0806a160 0x7f2d0806dfe0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:07.332 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.323+0000 7f2d0d7a2640 1 --2- 172.21.15.39:0/765127162 >> v2:172.21.15.118:3300/0 conn(0x7f2d0815c230 0x7f2d080ce690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:07.332 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.323+0000 7f2d0d7a2640 1 -- 172.21.15.39:0/765127162 >> 172.21.15.39:0/765127162 conn(0x7f2d080cca00 msgr2=0x7f2d080cf350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:07.332 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.323+0000 7f2d0d7a2640 1 -- 172.21.15.39:0/765127162 shutdown_connections 2023-05-16T13:55:07.332 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.323+0000 7f2d0d7a2640 1 -- 172.21.15.39:0/765127162 wait complete. 2023-05-16T13:55:07.333 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.327+0000 7f2d0d7a2640 1 Processor -- start 2023-05-16T13:55:07.333 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.327+0000 7f2d0d7a2640 1 -- start start 2023-05-16T13:55:07.334 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.327+0000 7f2d0d7a2640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2d0806a160 0x7f2d080c5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:07.334 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.327+0000 7f2d0d7a2640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2d080cebd0 0x7f2d080c3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:07.334 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.327+0000 7f2d0d7a2640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2d0815c230 0x7f2d08153720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:07.335 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.327+0000 7f2d0d7a2640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d080c3930 con 0x7f2d0815c230 2023-05-16T13:55:07.335 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.327+0000 7f2d0d7a2640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d08153c60 con 0x7f2d080cebd0 2023-05-16T13:55:07.335 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.327+0000 7f2d0d7a2640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d080c3000 con 0x7f2d0806a160 2023-05-16T13:55:07.335 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.327+0000 7f2d0cfa1640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2d0815c230 0x7f2d08153720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:07.335 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.327+0000 7f2d07fff640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2d0806a160 0x7f2d080c5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:07.335 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.327+0000 7f2d07fff640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2d0806a160 0x7f2d080c5960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.39:41204/0 (socket says 172.21.15.39:41204) 2023-05-16T13:55:07.335 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.327+0000 7f2d07fff640 1 -- 172.21.15.39:0/444804341 learned_addr learned my addr 172.21.15.39:0/444804341 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:07.335 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.327+0000 7f2d077fe640 1 --2- 172.21.15.39:0/444804341 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2d080cebd0 0x7f2d080c3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:07.336 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.327+0000 7f2d0cfa1640 1 -- 172.21.15.39:0/444804341 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2d0806a160 msgr2=0x7f2d080c5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:07.337 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.327+0000 7f2d0cfa1640 1 --2- 172.21.15.39:0/444804341 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2d0806a160 0x7f2d080c5960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:07.337 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.327+0000 7f2d0cfa1640 1 -- 172.21.15.39:0/444804341 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2d080cebd0 msgr2=0x7f2d080c3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:07.337 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.327+0000 7f2d0cfa1640 1 --2- 172.21.15.39:0/444804341 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2d080cebd0 0x7f2d080c3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:07.337 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.327+0000 7f2d0cfa1640 1 -- 172.21.15.39:0/444804341 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d00009a70 con 0x7f2d0815c230 2023-05-16T13:55:07.337 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.327+0000 7f2d07fff640 1 --2- 172.21.15.39:0/444804341 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2d0806a160 0x7f2d080c5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-16T13:55:07.337 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.327+0000 7f2d077fe640 1 --2- 172.21.15.39:0/444804341 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2d080cebd0 0x7f2d080c3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-16T13:55:07.338 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.327+0000 7f2d0cfa1640 1 --2- 172.21.15.39:0/444804341 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2d0815c230 0x7f2d08153720 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f2d000ac000 tx=0x7f2d00019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:07.338 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.327+0000 7f2d04ff9640 1 -- 172.21.15.39:0/444804341 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d000aee20 con 0x7f2d0815c230 2023-05-16T13:55:07.338 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.327+0000 7f2d04ff9640 1 -- 172.21.15.39:0/444804341 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d00009410 con 0x7f2d0815c230 2023-05-16T13:55:07.338 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.327+0000 7f2d0d7a2640 1 -- 172.21.15.39:0/444804341 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d0806eec0 con 0x7f2d0815c230 2023-05-16T13:55:07.338 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.327+0000 7f2d04ff9640 1 -- 172.21.15.39:0/444804341 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d00003be0 con 0x7f2d0815c230 2023-05-16T13:55:07.338 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.327+0000 7f2d0d7a2640 1 -- 172.21.15.39:0/444804341 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d0806ed30 con 0x7f2d0815c230 2023-05-16T13:55:07.338 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.327+0000 7f2d0d7a2640 1 -- 172.21.15.39:0/444804341 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d0806f050 con 0x7f2d0815c230 2023-05-16T13:55:07.339 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.331+0000 7f2d04ff9640 1 -- 172.21.15.39:0/444804341 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2d000b4050 con 0x7f2d0815c230 2023-05-16T13:55:07.339 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.331+0000 7f2d04ff9640 1 --2- 172.21.15.39:0/444804341 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f2cf40662b0 0x7f2cf4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:07.339 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.331+0000 7f2d04ff9640 1 -- 172.21.15.39:0/444804341 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f2d0011dd80 con 0x7f2d0815c230 2023-05-16T13:55:07.339 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.331+0000 7f2d07fff640 1 --2- 172.21.15.39:0/444804341 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f2cf40662b0 0x7f2cf4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:07.340 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.331+0000 7f2d07fff640 1 --2- 172.21.15.39:0/444804341 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f2cf40662b0 0x7f2cf4068760 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2cf8009f70 tx=0x7f2cf8009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:07.342 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.335+0000 7f2d04ff9640 1 -- 172.21.15.39:0/444804341 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f2d000eb1d0 con 0x7f2d0815c230 2023-05-16T13:55:07.494 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.487+0000 7f2d0d7a2640 1 -- 172.21.15.39:0/444804341 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2d080c3140 con 0x7f2d0815c230 2023-05-16T13:55:07.494 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.487+0000 7f2d04ff9640 1 -- 172.21.15.39:0/444804341 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2d080c3140 con 0x7f2d0815c230 2023-05-16T13:55:07.495 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2023-05-16T13:55:07.496 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.487+0000 7f2d0d7a2640 1 -- 172.21.15.39:0/444804341 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f2cf40662b0 msgr2=0x7f2cf4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:07.496 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.487+0000 7f2d0d7a2640 1 --2- 172.21.15.39:0/444804341 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f2cf40662b0 0x7f2cf4068760 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2cf8009f70 tx=0x7f2cf8009190 comp rx=0 tx=0).stop 2023-05-16T13:55:07.496 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.487+0000 7f2d0d7a2640 1 -- 172.21.15.39:0/444804341 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2d0815c230 msgr2=0x7f2d08153720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:07.496 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.487+0000 7f2d0d7a2640 1 --2- 172.21.15.39:0/444804341 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2d0815c230 0x7f2d08153720 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f2d000ac000 tx=0x7f2d00019710 comp rx=0 tx=0).stop 2023-05-16T13:55:07.496 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.487+0000 7f2d0d7a2640 1 -- 172.21.15.39:0/444804341 shutdown_connections 2023-05-16T13:55:07.497 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.487+0000 7f2d0d7a2640 1 --2- 172.21.15.39:0/444804341 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2d0815c230 0x7f2d08153720 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:07.497 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.487+0000 7f2d0d7a2640 1 --2- 172.21.15.39:0/444804341 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2d080cebd0 0x7f2d080c3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:07.497 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.487+0000 7f2d0d7a2640 1 --2- 172.21.15.39:0/444804341 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f2cf40662b0 0x7f2cf4068760 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:07.497 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.487+0000 7f2d0d7a2640 1 --2- 172.21.15.39:0/444804341 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2d0806a160 0x7f2d080c5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:07.497 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.487+0000 7f2d0d7a2640 1 -- 172.21.15.39:0/444804341 >> 172.21.15.39:0/444804341 conn(0x7f2d080cca00 msgr2=0x7f2d08158880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:07.497 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.487+0000 7f2d0d7a2640 1 -- 172.21.15.39:0/444804341 shutdown_connections 2023-05-16T13:55:07.497 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.487+0000 7f2d0d7a2640 1 -- 172.21.15.39:0/444804341 wait complete. 2023-05-16T13:55:07.515 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-16T13:55:07.655 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.647+0000 7f99fcb52640 1 Processor -- start 2023-05-16T13:55:07.656 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.647+0000 7f99fcb52640 1 -- start start 2023-05-16T13:55:07.657 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.647+0000 7f99fcb52640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f99f8158e00 0x7f99f80c9530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:07.657 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.647+0000 7f99fcb52640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f99f80c9a70 0x7f99f80aff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:07.657 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.647+0000 7f99fcb52640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f99f80b0490 0x7f99f80caec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:07.657 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.647+0000 7f99fcb52640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99f80b0910 con 0x7f99f80b0490 2023-05-16T13:55:07.658 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.647+0000 7f99fcb52640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99f80ca030 con 0x7f99f8158e00 2023-05-16T13:55:07.658 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.647+0000 7f99fcb52640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99f815c890 con 0x7f99f80c9a70 2023-05-16T13:55:07.658 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.647+0000 7f99f6d9d640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f99f80b0490 0x7f99f80caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:07.658 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.651+0000 7f99f6d9d640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f99f80b0490 0x7f99f80caec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34772/0 (socket says 172.21.15.39:34772) 2023-05-16T13:55:07.658 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.651+0000 7f99f6d9d640 1 -- 172.21.15.39:0/3912986947 learned_addr learned my addr 172.21.15.39:0/3912986947 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:07.658 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.651+0000 7f99f659c640 1 --2- 172.21.15.39:0/3912986947 >> v2:172.21.15.118:3300/0 conn(0x7f99f8158e00 0x7f99f80c9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:07.659 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.651+0000 7f99f5d9b640 1 --2- 172.21.15.39:0/3912986947 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f99f80c9a70 0x7f99f80aff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:07.659 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.651+0000 7f99f6d9d640 1 -- 172.21.15.39:0/3912986947 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f99f80c9a70 msgr2=0x7f99f80aff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:07.659 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.651+0000 7f99f6d9d640 1 --2- 172.21.15.39:0/3912986947 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f99f80c9a70 0x7f99f80aff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:07.659 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.651+0000 7f99f6d9d640 1 -- 172.21.15.39:0/3912986947 >> v2:172.21.15.118:3300/0 conn(0x7f99f8158e00 msgr2=0x7f99f80c9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:07.659 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.651+0000 7f99f6d9d640 1 --2- 172.21.15.39:0/3912986947 >> v2:172.21.15.118:3300/0 conn(0x7f99f8158e00 0x7f99f80c9530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:07.659 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.651+0000 7f99f6d9d640 1 -- 172.21.15.39:0/3912986947 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f815cb70 con 0x7f99f80b0490 2023-05-16T13:55:07.659 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.651+0000 7f99f5d9b640 1 --2- 172.21.15.39:0/3912986947 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f99f80c9a70 0x7f99f80aff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-16T13:55:07.660 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.651+0000 7f99f6d9d640 1 --2- 172.21.15.39:0/3912986947 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99f80b0490 0x7f99f80caec0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f99f80cc450 tx=0x7f99f00213c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e362a1bab348eac9 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:07.660 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.651+0000 7f99f559a640 1 -- 172.21.15.39:0/3912986947 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f000b2d0 con 0x7f99f80b0490 2023-05-16T13:55:07.660 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.651+0000 7f99f559a640 1 -- 172.21.15.39:0/3912986947 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f00ad050 con 0x7f99f80b0490 2023-05-16T13:55:07.660 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.651+0000 7f99f559a640 1 -- 172.21.15.39:0/3912986947 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f0009820 con 0x7f99f80b0490 2023-05-16T13:55:07.661 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.651+0000 7f99fcb52640 1 -- 172.21.15.39:0/3912986947 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99f80b0490 msgr2=0x7f99f80caec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:07.661 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.651+0000 7f99fcb52640 1 --2- 172.21.15.39:0/3912986947 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99f80b0490 0x7f99f80caec0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f99f80cc450 tx=0x7f99f00213c0 comp rx=0 tx=0).stop 2023-05-16T13:55:07.662 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.655+0000 7f99fcb52640 1 -- 172.21.15.39:0/3912986947 shutdown_connections 2023-05-16T13:55:07.662 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.655+0000 7f99fcb52640 1 --2- 172.21.15.39:0/3912986947 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99f80b0490 0x7f99f80caec0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:07.662 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.655+0000 7f99fcb52640 1 --2- 172.21.15.39:0/3912986947 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f99f80c9a70 0x7f99f80aff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:07.662 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.655+0000 7f99fcb52640 1 --2- 172.21.15.39:0/3912986947 >> v2:172.21.15.118:3300/0 conn(0x7f99f8158e00 0x7f99f80c9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:07.662 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.655+0000 7f99fcb52640 1 -- 172.21.15.39:0/3912986947 >> 172.21.15.39:0/3912986947 conn(0x7f99f8069a50 msgr2=0x7f99f8069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:07.662 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.655+0000 7f99fcb52640 1 -- 172.21.15.39:0/3912986947 shutdown_connections 2023-05-16T13:55:07.662 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.655+0000 7f99fcb52640 1 -- 172.21.15.39:0/3912986947 wait complete. 2023-05-16T13:55:07.663 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.655+0000 7f99fcb52640 1 Processor -- start 2023-05-16T13:55:07.663 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.655+0000 7f99fcb52640 1 -- start start 2023-05-16T13:55:07.664 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.655+0000 7f99fcb52640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99f80b0490 0x7f99f8149960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:07.664 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.655+0000 7f99fcb52640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f99f80c9a70 0x7f99f8151e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:07.665 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.655+0000 7f99fcb52640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99f8158e00 0x7f99f80aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:07.665 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.655+0000 7f99fcb52640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f8149ea0 con 0x7f99f80b0490 2023-05-16T13:55:07.665 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.655+0000 7f99fcb52640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f80cd1a0 con 0x7f99f8158e00 2023-05-16T13:55:07.665 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.655+0000 7f99fcb52640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99f80cd480 con 0x7f99f80c9a70 2023-05-16T13:55:07.665 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.655+0000 7f99f659c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99f80b0490 0x7f99f8149960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:07.665 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.655+0000 7f99f659c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99f80b0490 0x7f99f8149960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34776/0 (socket says 172.21.15.39:34776) 2023-05-16T13:55:07.665 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.655+0000 7f99f659c640 1 -- 172.21.15.39:0/1167494855 learned_addr learned my addr 172.21.15.39:0/1167494855 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:07.665 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.655+0000 7f99f5d9b640 1 --2- 172.21.15.39:0/1167494855 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f99f80c9a70 0x7f99f8151e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:07.666 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.655+0000 7f99f6d9d640 1 --2- 172.21.15.39:0/1167494855 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99f8158e00 0x7f99f80aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:07.666 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.655+0000 7f99f659c640 1 -- 172.21.15.39:0/1167494855 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f99f80c9a70 msgr2=0x7f99f8151e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:07.666 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.655+0000 7f99f659c640 1 --2- 172.21.15.39:0/1167494855 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f99f80c9a70 0x7f99f8151e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:07.666 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.655+0000 7f99f659c640 1 -- 172.21.15.39:0/1167494855 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99f8158e00 msgr2=0x7f99f80aebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:07.666 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.655+0000 7f99f659c640 1 --2- 172.21.15.39:0/1167494855 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99f8158e00 0x7f99f80aebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:07.666 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.655+0000 7f99f659c640 1 -- 172.21.15.39:0/1167494855 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f000bd40 con 0x7f99f80b0490 2023-05-16T13:55:07.667 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.659+0000 7f99f659c640 1 --2- 172.21.15.39:0/1167494855 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99f80b0490 0x7f99f8149960 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f99e800d800 tx=0x7f99e800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:07.667 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.659+0000 7f99e6ffd640 1 -- 172.21.15.39:0/1167494855 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e800b6c0 con 0x7f99f80b0490 2023-05-16T13:55:07.667 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.659+0000 7f99e6ffd640 1 -- 172.21.15.39:0/1167494855 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99e800b820 con 0x7f99f80b0490 2023-05-16T13:55:07.668 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.659+0000 7f99e6ffd640 1 -- 172.21.15.39:0/1167494855 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e800bb90 con 0x7f99f80b0490 2023-05-16T13:55:07.668 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.659+0000 7f99fcb52640 1 -- 172.21.15.39:0/1167494855 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99f815d130 con 0x7f99f80b0490 2023-05-16T13:55:07.668 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.659+0000 7f99fcb52640 1 -- 172.21.15.39:0/1167494855 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99f815ce50 con 0x7f99f80b0490 2023-05-16T13:55:07.668 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.659+0000 7f99fcb52640 1 -- 172.21.15.39:0/1167494855 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99f80cc730 con 0x7f99f80b0490 2023-05-16T13:55:07.668 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.659+0000 7f99e6ffd640 1 -- 172.21.15.39:0/1167494855 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f99e800bcf0 con 0x7f99f80b0490 2023-05-16T13:55:07.669 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.659+0000 7f99e6ffd640 1 --2- 172.21.15.39:0/1167494855 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f99d8066280 0x7f99d8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:07.669 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.659+0000 7f99e6ffd640 1 -- 172.21.15.39:0/1167494855 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f99e8084180 con 0x7f99f80b0490 2023-05-16T13:55:07.669 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.659+0000 7f99f5d9b640 1 --2- 172.21.15.39:0/1167494855 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f99d8066280 0x7f99d8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:07.669 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.659+0000 7f99f5d9b640 1 --2- 172.21.15.39:0/1167494855 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f99d8066280 0x7f99d8068730 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f99f8158630 tx=0x7f99ec008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:07.671 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.663+0000 7f99e6ffd640 1 -- 172.21.15.39:0/1167494855 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f99e80550f0 con 0x7f99f80b0490 2023-05-16T13:55:07.828 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.815+0000 7f99fcb52640 1 -- 172.21.15.39:0/1167494855 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f99f8073c90 con 0x7f99f80b0490 2023-05-16T13:55:07.829 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.819+0000 7f99e6ffd640 1 -- 172.21.15.39:0/1167494855 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f99e8054c80 con 0x7f99f80b0490 2023-05-16T13:55:07.829 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 64 2023-05-16T13:55:07.830 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.819+0000 7f99fcb52640 1 -- 172.21.15.39:0/1167494855 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f99d8066280 msgr2=0x7f99d8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:07.830 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.819+0000 7f99fcb52640 1 --2- 172.21.15.39:0/1167494855 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f99d8066280 0x7f99d8068730 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f99f8158630 tx=0x7f99ec008040 comp rx=0 tx=0).stop 2023-05-16T13:55:07.830 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.819+0000 7f99fcb52640 1 -- 172.21.15.39:0/1167494855 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99f80b0490 msgr2=0x7f99f8149960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:07.830 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.819+0000 7f99fcb52640 1 --2- 172.21.15.39:0/1167494855 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99f80b0490 0x7f99f8149960 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f99e800d800 tx=0x7f99e800dcc0 comp rx=0 tx=0).stop 2023-05-16T13:55:07.831 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.819+0000 7f99fcb52640 1 -- 172.21.15.39:0/1167494855 shutdown_connections 2023-05-16T13:55:07.831 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.819+0000 7f99fcb52640 1 --2- 172.21.15.39:0/1167494855 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f99d8066280 0x7f99d8068730 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:07.831 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.819+0000 7f99fcb52640 1 --2- 172.21.15.39:0/1167494855 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f99f80c9a70 0x7f99f8151e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:07.831 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.819+0000 7f99fcb52640 1 --2- 172.21.15.39:0/1167494855 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99f8158e00 0x7f99f80aebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:07.831 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.819+0000 7f99fcb52640 1 --2- 172.21.15.39:0/1167494855 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99f80b0490 0x7f99f8149960 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:07.831 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.819+0000 7f99fcb52640 1 -- 172.21.15.39:0/1167494855 >> 172.21.15.39:0/1167494855 conn(0x7f99f8069a50 msgr2=0x7f99f80ad020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:07.831 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.819+0000 7f99fcb52640 1 -- 172.21.15.39:0/1167494855 shutdown_connections 2023-05-16T13:55:07.832 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.819+0000 7f99fcb52640 1 -- 172.21.15.39:0/1167494855 wait complete. 2023-05-16T13:55:07.846 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-16T13:55:07.986 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.979+0000 7fc432c41640 1 Processor -- start 2023-05-16T13:55:07.986 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.979+0000 7fc432c41640 1 -- start start 2023-05-16T13:55:07.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.979+0000 7fc432c41640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc42c0cef50 0x7fc42c06eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:07.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.979+0000 7fc432c41640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc42c15cc80 con 0x7fc42c0b1460 2023-05-16T13:55:07.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.979+0000 7fc432c41640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc42c06f4d0 con 0x7fc42c15d110 2023-05-16T13:55:07.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.979+0000 7fc432c41640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc42c15c440 con 0x7fc42c0cef50 2023-05-16T13:55:07.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.979+0000 7fc4309dd640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fc42c0b1460 0x7fc42c0ce840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:51082/0 (socket says 172.21.15.39:51082) 2023-05-16T13:55:07.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.979+0000 7fc4309dd640 1 -- 172.21.15.39:0/2534189885 learned_addr learned my addr 172.21.15.39:0/2534189885 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:55:07.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.979+0000 7fc4311de640 1 --2- 172.21.15.39:0/2534189885 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc42c0cef50 0x7fc42c06eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:07.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.979+0000 7fc42b7fe640 1 -- 172.21.15.39:0/2534189885 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 753279083 0 0) 0x7fc42c15cc80 con 0x7fc42c0b1460 2023-05-16T13:55:07.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.979+0000 7fc42b7fe640 1 -- 172.21.15.39:0/2534189885 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc41c003530 con 0x7fc42c0b1460 2023-05-16T13:55:07.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.979+0000 7fc42b7fe640 1 -- 172.21.15.39:0/2534189885 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2729412907 0 0) 0x7fc42c06f4d0 con 0x7fc42c15d110 2023-05-16T13:55:07.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.979+0000 7fc42b7fe640 1 -- 172.21.15.39:0/2534189885 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc42c15cc80 con 0x7fc42c15d110 2023-05-16T13:55:07.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.979+0000 7fc4311de640 1 -- 172.21.15.39:0/2534189885 >> v1:172.21.15.118:6789/0 conn(0x7fc42c15d110 legacy=0x7fc42c06e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:07.990 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.979+0000 7fc4311de640 1 -- 172.21.15.39:0/2534189885 >> v1:172.21.15.39:6789/0 conn(0x7fc42c0b1460 legacy=0x7fc42c0ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:07.990 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.979+0000 7fc4311de640 1 -- 172.21.15.39:0/2534189885 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc42c15c630 con 0x7fc42c0cef50 2023-05-16T13:55:07.991 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.983+0000 7fc4311de640 1 --2- 172.21.15.39:0/2534189885 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc42c0cef50 0x7fc42c06eeb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc424009dc0 tx=0x7fc42401c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a12b05b19a5c2c51 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:07.991 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.983+0000 7fc42b7fe640 1 -- 172.21.15.39:0/2534189885 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4240a5940 con 0x7fc42c0cef50 2023-05-16T13:55:07.992 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.983+0000 7fc42b7fe640 1 -- 172.21.15.39:0/2534189885 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4240a5aa0 con 0x7fc42c0cef50 2023-05-16T13:55:07.992 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.983+0000 7fc42b7fe640 1 -- 172.21.15.39:0/2534189885 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4240a5e10 con 0x7fc42c0cef50 2023-05-16T13:55:07.992 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.983+0000 7fc432c41640 1 -- 172.21.15.39:0/2534189885 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc42c0cef50 msgr2=0x7fc42c06eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:07.993 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.983+0000 7fc432c41640 1 --2- 172.21.15.39:0/2534189885 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc42c0cef50 0x7fc42c06eeb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc424009dc0 tx=0x7fc42401c970 comp rx=0 tx=0).stop 2023-05-16T13:55:07.993 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.983+0000 7fc432c41640 1 -- 172.21.15.39:0/2534189885 shutdown_connections 2023-05-16T13:55:07.993 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.983+0000 7fc432c41640 1 --2- 172.21.15.39:0/2534189885 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc42c0cef50 0x7fc42c06eeb0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:07.993 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.983+0000 7fc432c41640 1 -- 172.21.15.39:0/2534189885 >> 172.21.15.39:0/2534189885 conn(0x7fc42c0cf4d0 msgr2=0x7fc42c0cf8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:07.993 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.983+0000 7fc432c41640 1 -- 172.21.15.39:0/2534189885 shutdown_connections 2023-05-16T13:55:07.993 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.983+0000 7fc432c41640 1 -- 172.21.15.39:0/2534189885 wait complete. 2023-05-16T13:55:07.994 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.987+0000 7fc432c41640 1 Processor -- start 2023-05-16T13:55:07.994 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.987+0000 7fc432c41640 1 -- start start 2023-05-16T13:55:07.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.987+0000 7fc432c41640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc42c0b1460 0x7fc42c14f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:07.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.987+0000 7fc432c41640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc42c0cef50 0x7fc42c149660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:07.995 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.987+0000 7fc432c41640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc42c15d110 0x7fc42c158870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:07.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.987+0000 7fc432c41640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc42c149ba0 con 0x7fc42c0b1460 2023-05-16T13:55:07.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.987+0000 7fc432c41640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc42c14fb90 con 0x7fc42c15d110 2023-05-16T13:55:07.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.987+0000 7fc432c41640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc42c15a080 con 0x7fc42c0cef50 2023-05-16T13:55:07.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.987+0000 7fc4309dd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc42c0b1460 0x7fc42c14f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:07.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.987+0000 7fc4309dd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc42c0b1460 0x7fc42c14f5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34786/0 (socket says 172.21.15.39:34786) 2023-05-16T13:55:07.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.987+0000 7fc4309dd640 1 -- 172.21.15.39:0/4107512152 learned_addr learned my addr 172.21.15.39:0/4107512152 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:07.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.987+0000 7fc42bfff640 1 --2- 172.21.15.39:0/4107512152 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc42c0cef50 0x7fc42c149660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:07.996 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.987+0000 7fc4311de640 1 --2- 172.21.15.39:0/4107512152 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc42c15d110 0x7fc42c158870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:07.997 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.987+0000 7fc4309dd640 1 -- 172.21.15.39:0/4107512152 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc42c0cef50 msgr2=0x7fc42c149660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:07.998 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.987+0000 7fc4309dd640 1 --2- 172.21.15.39:0/4107512152 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc42c0cef50 0x7fc42c149660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:07.998 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.987+0000 7fc4309dd640 1 -- 172.21.15.39:0/4107512152 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc42c15d110 msgr2=0x7fc42c158870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:07.998 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.987+0000 7fc4309dd640 1 --2- 172.21.15.39:0/4107512152 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc42c15d110 0x7fc42c158870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:07.998 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.987+0000 7fc4309dd640 1 -- 172.21.15.39:0/4107512152 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc424009a70 con 0x7fc42c0b1460 2023-05-16T13:55:07.998 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.987+0000 7fc4309dd640 1 --2- 172.21.15.39:0/4107512152 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc42c0b1460 0x7fc42c14f5b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fc42000c420 tx=0x7fc42000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:07.998 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.987+0000 7fc4297fa640 1 -- 172.21.15.39:0/4107512152 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc420005cf0 con 0x7fc42c0b1460 2023-05-16T13:55:07.998 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.987+0000 7fc4297fa640 1 -- 172.21.15.39:0/4107512152 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc420005e50 con 0x7fc42c0b1460 2023-05-16T13:55:07.999 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.987+0000 7fc4297fa640 1 -- 172.21.15.39:0/4107512152 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc420007310 con 0x7fc42c0b1460 2023-05-16T13:55:07.999 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.987+0000 7fc432c41640 1 -- 172.21.15.39:0/4107512152 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc42c159ac0 con 0x7fc42c0b1460 2023-05-16T13:55:07.999 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.987+0000 7fc432c41640 1 -- 172.21.15.39:0/4107512152 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc42c159930 con 0x7fc42c0b1460 2023-05-16T13:55:07.999 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.991+0000 7fc432c41640 1 -- 172.21.15.39:0/4107512152 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc42c159c50 con 0x7fc42c0b1460 2023-05-16T13:55:08.000 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.991+0000 7fc4297fa640 1 -- 172.21.15.39:0/4107512152 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc420007470 con 0x7fc42c0b1460 2023-05-16T13:55:08.000 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.991+0000 7fc4297fa640 1 --2- 172.21.15.39:0/4107512152 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc410066280 0x7fc410068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:08.000 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.991+0000 7fc4297fa640 1 -- 172.21.15.39:0/4107512152 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fc420083420 con 0x7fc42c0b1460 2023-05-16T13:55:08.000 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.991+0000 7fc42bfff640 1 --2- 172.21.15.39:0/4107512152 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc410066280 0x7fc410068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:08.000 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.991+0000 7fc42bfff640 1 --2- 172.21.15.39:0/4107512152 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc410066280 0x7fc410068730 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc418007fd0 tx=0x7fc418009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:08.002 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:07.995+0000 7fc4297fa640 1 -- 172.21.15.39:0/4107512152 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fc4200507c0 con 0x7fc42c0b1460 2023-05-16T13:55:08.170 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.163+0000 7fc432c41640 1 -- 172.21.15.39:0/4107512152 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc42c073c90 con 0x7fc42c0b1460 2023-05-16T13:55:08.171 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.163+0000 7fc4297fa640 1 -- 172.21.15.39:0/4107512152 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc420053de0 con 0x7fc42c0b1460 2023-05-16T13:55:08.171 INFO:teuthology.orchestra.run.smithi039.stderr:listed 0 entries 2023-05-16T13:55:08.173 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.167+0000 7fc432c41640 1 -- 172.21.15.39:0/4107512152 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc410066280 msgr2=0x7fc410068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:08.173 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.167+0000 7fc432c41640 1 --2- 172.21.15.39:0/4107512152 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc410066280 0x7fc410068730 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc418007fd0 tx=0x7fc418009040 comp rx=0 tx=0).stop 2023-05-16T13:55:08.174 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.167+0000 7fc432c41640 1 -- 172.21.15.39:0/4107512152 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc42c0b1460 msgr2=0x7fc42c14f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:08.174 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.167+0000 7fc432c41640 1 --2- 172.21.15.39:0/4107512152 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc42c0b1460 0x7fc42c14f5b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fc42000c420 tx=0x7fc42000c8e0 comp rx=0 tx=0).stop 2023-05-16T13:55:08.174 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.167+0000 7fc432c41640 1 -- 172.21.15.39:0/4107512152 shutdown_connections 2023-05-16T13:55:08.174 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.167+0000 7fc432c41640 1 --2- 172.21.15.39:0/4107512152 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc410066280 0x7fc410068730 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:08.174 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.167+0000 7fc432c41640 1 --2- 172.21.15.39:0/4107512152 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc42c0cef50 0x7fc42c149660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:08.174 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.167+0000 7fc432c41640 1 --2- 172.21.15.39:0/4107512152 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc42c15d110 0x7fc42c158870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:08.175 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.167+0000 7fc432c41640 1 --2- 172.21.15.39:0/4107512152 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc42c0b1460 0x7fc42c14f5b0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:08.175 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.167+0000 7fc432c41640 1 -- 172.21.15.39:0/4107512152 >> 172.21.15.39:0/4107512152 conn(0x7fc42c0cf4d0 msgr2=0x7fc42c15e220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:08.175 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.167+0000 7fc432c41640 1 -- 172.21.15.39:0/4107512152 shutdown_connections 2023-05-16T13:55:08.175 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.167+0000 7fc432c41640 1 -- 172.21.15.39:0/4107512152 wait complete. 2023-05-16T13:55:08.192 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi118.front.sepia.ceph.com... 2023-05-16T13:55:08.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:55:08.193 DEBUG:teuthology.orchestra.run.smithi118:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2023-05-16T13:55:08.214 INFO:teuthology.orchestra.run:waiting for 300 2023-05-16T13:55:08.215 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi118.front.sepia.ceph.com 2023-05-16T13:55:08.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:55:08.215 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-05-16T13:55:08.264 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-05-16T13:55:08.265 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-16T13:55:08.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.395+0000 7ff7d876d640 1 Processor -- start 2023-05-16T13:55:08.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.395+0000 7ff7d876d640 1 -- start start 2023-05-16T13:55:08.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.395+0000 7ff7d876d640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff7d015c470 0x7ff7d00d0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:08.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.395+0000 7ff7d876d640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7d00ce150 con 0x7ff7d00b49b0 2023-05-16T13:55:08.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.395+0000 7ff7d876d640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7d00cd890 con 0x7ff7d00b5670 2023-05-16T13:55:08.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.395+0000 7ff7d876d640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7d00d0c60 con 0x7ff7d015c470 2023-05-16T13:55:08.404 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.395+0000 7ff7d6d0a640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7ff7d00b49b0 0x7ff7d00ce5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:51086/0 (socket says 172.21.15.39:51086) 2023-05-16T13:55:08.404 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.395+0000 7ff7d6d0a640 1 -- 172.21.15.39:0/2402087625 learned_addr learned my addr 172.21.15.39:0/2402087625 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:55:08.405 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.395+0000 7ff7d6509640 1 --2- 172.21.15.39:0/2402087625 >> v2:172.21.15.118:3300/0 conn(0x7ff7d015c470 0x7ff7d00d0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:08.405 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.395+0000 7ff7d5507640 1 -- 172.21.15.39:0/2402087625 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3403110651 0 0) 0x7ff7d00ce150 con 0x7ff7d00b49b0 2023-05-16T13:55:08.405 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.395+0000 7ff7d5507640 1 -- 172.21.15.39:0/2402087625 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7bc003530 con 0x7ff7d00b49b0 2023-05-16T13:55:08.405 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.395+0000 7ff7d5507640 1 -- 172.21.15.39:0/2402087625 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4109162704 0 0) 0x7ff7d00cd890 con 0x7ff7d00b5670 2023-05-16T13:55:08.405 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.395+0000 7ff7d5507640 1 -- 172.21.15.39:0/2402087625 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7d00ce150 con 0x7ff7d00b5670 2023-05-16T13:55:08.405 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.395+0000 7ff7d5507640 1 -- 172.21.15.39:0/2402087625 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2910296114 0 0) 0x7ff7bc003530 con 0x7ff7d00b49b0 2023-05-16T13:55:08.405 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.395+0000 7ff7d6509640 1 -- 172.21.15.39:0/2402087625 >> v1:172.21.15.118:6789/0 conn(0x7ff7d00b5670 legacy=0x7ff7d00b42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:08.406 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.395+0000 7ff7d6509640 1 -- 172.21.15.39:0/2402087625 >> v1:172.21.15.39:6789/0 conn(0x7ff7d00b49b0 legacy=0x7ff7d00ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:08.406 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.395+0000 7ff7d6509640 1 -- 172.21.15.39:0/2402087625 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7d00cdb00 con 0x7ff7d015c470 2023-05-16T13:55:08.407 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.399+0000 7ff7d6509640 1 --2- 172.21.15.39:0/2402087625 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff7d015c470 0x7ff7d00d0720 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc0097a0 tx=0x7ff7cc01c350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13894b49e736f715 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:08.407 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.399+0000 7ff7d5507640 1 -- 172.21.15.39:0/2402087625 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c8001a00 con 0x7ff7d015c470 2023-05-16T13:55:08.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.399+0000 7ff7d5507640 1 -- 172.21.15.39:0/2402087625 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7cc0a7050 con 0x7ff7d015c470 2023-05-16T13:55:08.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.399+0000 7ff7d5507640 1 -- 172.21.15.39:0/2402087625 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7cc0ab600 con 0x7ff7d015c470 2023-05-16T13:55:08.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.399+0000 7ff7d876d640 1 -- 172.21.15.39:0/2402087625 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff7d015c470 msgr2=0x7ff7d00d0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:08.409 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.399+0000 7ff7d876d640 1 --2- 172.21.15.39:0/2402087625 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff7d015c470 0x7ff7d00d0720 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc0097a0 tx=0x7ff7cc01c350 comp rx=0 tx=0).stop 2023-05-16T13:55:08.409 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.399+0000 7ff7d876d640 1 -- 172.21.15.39:0/2402087625 shutdown_connections 2023-05-16T13:55:08.409 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.399+0000 7ff7d876d640 1 --2- 172.21.15.39:0/2402087625 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff7d015c470 0x7ff7d00d0720 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:08.409 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.399+0000 7ff7d876d640 1 -- 172.21.15.39:0/2402087625 >> 172.21.15.39:0/2402087625 conn(0x7ff7d009bae0 msgr2=0x7ff7d00d2820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:08.409 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.399+0000 7ff7d876d640 1 -- 172.21.15.39:0/2402087625 shutdown_connections 2023-05-16T13:55:08.409 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.399+0000 7ff7d876d640 1 -- 172.21.15.39:0/2402087625 wait complete. 2023-05-16T13:55:08.410 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.403+0000 7ff7d876d640 1 Processor -- start 2023-05-16T13:55:08.410 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.403+0000 7ff7d876d640 1 -- start start 2023-05-16T13:55:08.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.403+0000 7ff7d876d640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff7d00b49b0 0x7ff7d01f5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:08.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.403+0000 7ff7d876d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff7d00b5670 0x7ff7d014dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:08.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.403+0000 7ff7d876d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff7d015c470 0x7ff7d014a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:08.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.403+0000 7ff7d876d640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d01f92d0 con 0x7ff7d00b5670 2023-05-16T13:55:08.412 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.403+0000 7ff7d876d640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d014e170 con 0x7ff7d015c470 2023-05-16T13:55:08.412 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.403+0000 7ff7d876d640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d014aaf0 con 0x7ff7d00b49b0 2023-05-16T13:55:08.412 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.403+0000 7ff7d5d08640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff7d00b5670 0x7ff7d014dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:08.412 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.403+0000 7ff7d5d08640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff7d00b5670 0x7ff7d014dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34802/0 (socket says 172.21.15.39:34802) 2023-05-16T13:55:08.412 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.403+0000 7ff7d5d08640 1 -- 172.21.15.39:0/3258094790 learned_addr learned my addr 172.21.15.39:0/3258094790 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:08.413 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.403+0000 7ff7d6d0a640 1 --2- 172.21.15.39:0/3258094790 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff7d015c470 0x7ff7d014a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:08.413 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.403+0000 7ff7d6509640 1 --2- 172.21.15.39:0/3258094790 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff7d00b49b0 0x7ff7d01f5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:08.413 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.403+0000 7ff7d5d08640 1 -- 172.21.15.39:0/3258094790 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff7d00b49b0 msgr2=0x7ff7d01f5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:08.414 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.403+0000 7ff7d5d08640 1 --2- 172.21.15.39:0/3258094790 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff7d00b49b0 0x7ff7d01f5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:08.414 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.403+0000 7ff7d5d08640 1 -- 172.21.15.39:0/3258094790 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff7d015c470 msgr2=0x7ff7d014a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:08.414 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.403+0000 7ff7d5d08640 1 --2- 172.21.15.39:0/3258094790 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff7d015c470 0x7ff7d014a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:08.414 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.403+0000 7ff7d5d08640 1 -- 172.21.15.39:0/3258094790 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7cc0093b0 con 0x7ff7d00b5670 2023-05-16T13:55:08.414 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.403+0000 7ff7d5d08640 1 --2- 172.21.15.39:0/3258094790 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff7d00b5670 0x7ff7d014dc30 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7ff7c000c4c0 tx=0x7ff7c000c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:08.414 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.403+0000 7ff7c6ffd640 1 -- 172.21.15.39:0/3258094790 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c00052d0 con 0x7ff7d00b5670 2023-05-16T13:55:08.414 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.403+0000 7ff7c6ffd640 1 -- 172.21.15.39:0/3258094790 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c0005430 con 0x7ff7d00b5670 2023-05-16T13:55:08.415 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.403+0000 7ff7c6ffd640 1 -- 172.21.15.39:0/3258094790 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c0012870 con 0x7ff7d00b5670 2023-05-16T13:55:08.415 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.403+0000 7ff7d876d640 1 -- 172.21.15.39:0/3258094790 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7d00d0ee0 con 0x7ff7d00b5670 2023-05-16T13:55:08.415 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.403+0000 7ff7d876d640 1 -- 172.21.15.39:0/3258094790 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7d009bf70 con 0x7ff7d00b5670 2023-05-16T13:55:08.415 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.407+0000 7ff7d876d640 1 -- 172.21.15.39:0/3258094790 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7d01f9410 con 0x7ff7d00b5670 2023-05-16T13:55:08.415 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.407+0000 7ff7c6ffd640 1 -- 172.21.15.39:0/3258094790 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff7c00129d0 con 0x7ff7d00b5670 2023-05-16T13:55:08.416 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.407+0000 7ff7c6ffd640 1 --2- 172.21.15.39:0/3258094790 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ff7b4066280 0x7ff7b4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:08.416 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.407+0000 7ff7c6ffd640 1 -- 172.21.15.39:0/3258094790 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7ff7c00838d0 con 0x7ff7d00b5670 2023-05-16T13:55:08.416 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.407+0000 7ff7d6509640 1 --2- 172.21.15.39:0/3258094790 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ff7b4066280 0x7ff7b4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:08.416 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.407+0000 7ff7d6509640 1 --2- 172.21.15.39:0/3258094790 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ff7b4066280 0x7ff7b4068730 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc0ad000 tx=0x7ff7cc0a6000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:08.419 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.411+0000 7ff7c6ffd640 1 -- 172.21.15.39:0/3258094790 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ff7c0050da0 con 0x7ff7d00b5670 2023-05-16T13:55:08.607 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.599+0000 7ff7d876d640 1 -- 172.21.15.39:0/3258094790 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff7d0073c90 con 0x7ff7d00b5670 2023-05-16T13:55:08.608 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.599+0000 7ff7c6ffd640 1 -- 172.21.15.39:0/3258094790 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4668 (secure 0 0 0) 0x7ff7c00543c0 con 0x7ff7d00b5670 2023-05-16T13:55:08.609 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:55:08.609 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2374269620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":2374269620},{"type":"v1","addr":"172.21.15.118:6835","nonce":2374269620}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/3803055359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3803055359},{"type":"v1","addr":"172.21.15.118:6833","nonce":3803055359}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4308,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6836/3259535605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":3259535605},{"type":"v1","addr":"172.21.15.39:6836","nonce":3259535605}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-16T13:54:15.191894+0000","modified":"2023-05-16T13:54:18.210603+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4311},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4311":{"gid":4311,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.39:6837/616280162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6835","nonce":616280162},{"type":"v1","addr":"172.21.15.39:6837","nonce":616280162}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-16T13:55:08.609 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 8 2023-05-16T13:55:08.610 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.603+0000 7ff7d876d640 1 -- 172.21.15.39:0/3258094790 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ff7b4066280 msgr2=0x7ff7b4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:08.610 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.603+0000 7ff7d876d640 1 --2- 172.21.15.39:0/3258094790 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ff7b4066280 0x7ff7b4068730 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc0ad000 tx=0x7ff7cc0a6000 comp rx=0 tx=0).stop 2023-05-16T13:55:08.610 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.603+0000 7ff7d876d640 1 -- 172.21.15.39:0/3258094790 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff7d00b5670 msgr2=0x7ff7d014dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:08.611 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.603+0000 7ff7d876d640 1 --2- 172.21.15.39:0/3258094790 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff7d00b5670 0x7ff7d014dc30 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7ff7c000c4c0 tx=0x7ff7c000c980 comp rx=0 tx=0).stop 2023-05-16T13:55:08.611 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.603+0000 7ff7d876d640 1 -- 172.21.15.39:0/3258094790 shutdown_connections 2023-05-16T13:55:08.611 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.603+0000 7ff7d876d640 1 --2- 172.21.15.39:0/3258094790 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff7d015c470 0x7ff7d014a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:08.611 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.603+0000 7ff7d876d640 1 --2- 172.21.15.39:0/3258094790 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff7d00b5670 0x7ff7d014dc30 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:08.611 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.603+0000 7ff7d876d640 1 --2- 172.21.15.39:0/3258094790 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ff7b4066280 0x7ff7b4068730 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:08.611 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.603+0000 7ff7d876d640 1 --2- 172.21.15.39:0/3258094790 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff7d00b49b0 0x7ff7d01f5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:08.611 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.603+0000 7ff7d876d640 1 -- 172.21.15.39:0/3258094790 >> 172.21.15.39:0/3258094790 conn(0x7ff7d009bae0 msgr2=0x7ff7d00cc230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:08.612 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.603+0000 7ff7d876d640 1 -- 172.21.15.39:0/3258094790 shutdown_connections 2023-05-16T13:55:08.612 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.603+0000 7ff7d876d640 1 -- 172.21.15.39:0/3258094790 wait complete. 2023-05-16T13:55:08.629 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-16T13:55:08.767 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.759+0000 7f47be1a2640 1 Processor -- start 2023-05-16T13:55:08.768 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.759+0000 7f47be1a2640 1 -- start start 2023-05-16T13:55:08.769 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.763+0000 7f47be1a2640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f47b80cfed0 0x7f47b80cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:08.769 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.763+0000 7f47be1a2640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47b80cbf80 con 0x7f47b806e060 2023-05-16T13:55:08.769 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.763+0000 7f47be1a2640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47b8159ff0 con 0x7f47b8159c20 2023-05-16T13:55:08.769 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.763+0000 7f47be1a2640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47b806eb10 con 0x7f47b80cfed0 2023-05-16T13:55:08.769 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.763+0000 7f47bc99f640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f47b80cfed0 0x7f47b80cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:08.770 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.763+0000 7f47bd9a1640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f47b806e060 0x7f47b80d0340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:51098/0 (socket says 172.21.15.39:51098) 2023-05-16T13:55:08.770 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.763+0000 7f47bc99f640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f47b80cfed0 0x7f47b80cf1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34810/0 (socket says 172.21.15.39:34810) 2023-05-16T13:55:08.770 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.763+0000 7f47bd9a1640 1 -- 172.21.15.39:0/2717269228 learned_addr learned my addr 172.21.15.39:0/2717269228 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:55:08.770 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.763+0000 7f47bc99f640 1 -- 172.21.15.39:0/2717269228 >> v1:172.21.15.118:6789/0 conn(0x7f47b8159c20 legacy=0x7f47b80cf7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:08.770 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.763+0000 7f47bc99f640 1 -- 172.21.15.39:0/2717269228 >> v1:172.21.15.39:6789/0 conn(0x7f47b806e060 legacy=0x7f47b80d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:08.771 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.763+0000 7f47bc99f640 1 -- 172.21.15.39:0/2717269228 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b806e550 con 0x7f47b80cfed0 2023-05-16T13:55:08.771 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.763+0000 7f47affff640 1 -- 172.21.15.39:0/2717269228 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2977576754 0 0) 0x7f47b80cbf80 con 0x7f47b806e060 2023-05-16T13:55:08.772 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.763+0000 7f47bc99f640 1 --2- 172.21.15.39:0/2717269228 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f47b80cfed0 0x7f47b80cf1e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f47a80097c0 tx=0x7f47a801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac2042b6c3796a00 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:08.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.763+0000 7f47affff640 1 -- 172.21.15.39:0/2717269228 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a80ab650 con 0x7f47b80cfed0 2023-05-16T13:55:08.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.763+0000 7f47affff640 1 -- 172.21.15.39:0/2717269228 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a80ab7b0 con 0x7f47b80cfed0 2023-05-16T13:55:08.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.763+0000 7f47affff640 1 -- 172.21.15.39:0/2717269228 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a80abb40 con 0x7f47b80cfed0 2023-05-16T13:55:08.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.767+0000 7f47be1a2640 1 -- 172.21.15.39:0/2717269228 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f47b80cfed0 msgr2=0x7f47b80cf1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:08.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.767+0000 7f47be1a2640 1 --2- 172.21.15.39:0/2717269228 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f47b80cfed0 0x7f47b80cf1e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f47a80097c0 tx=0x7f47a801c450 comp rx=0 tx=0).stop 2023-05-16T13:55:08.774 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.767+0000 7f47be1a2640 1 -- 172.21.15.39:0/2717269228 shutdown_connections 2023-05-16T13:55:08.774 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.767+0000 7f47be1a2640 1 --2- 172.21.15.39:0/2717269228 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f47b80cfed0 0x7f47b80cf1e0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:08.774 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.767+0000 7f47be1a2640 1 -- 172.21.15.39:0/2717269228 >> 172.21.15.39:0/2717269228 conn(0x7f47b8065690 msgr2=0x7f47b8065a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:08.774 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.767+0000 7f47be1a2640 1 -- 172.21.15.39:0/2717269228 shutdown_connections 2023-05-16T13:55:08.774 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.767+0000 7f47be1a2640 1 -- 172.21.15.39:0/2717269228 wait complete. 2023-05-16T13:55:08.775 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.767+0000 7f47be1a2640 1 Processor -- start 2023-05-16T13:55:08.775 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.767+0000 7f47be1a2640 1 -- start start 2023-05-16T13:55:08.776 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.767+0000 7f47be1a2640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47b806e060 0x7f47b8152430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:08.776 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.767+0000 7f47be1a2640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f47b80cfed0 0x7f47b80c6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:08.776 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.767+0000 7f47be1a2640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f47b8159c20 0x7f47b8161b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:08.776 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.767+0000 7f47be1a2640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b8153560 con 0x7f47b80cfed0 2023-05-16T13:55:08.776 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.767+0000 7f47be1a2640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b80c5550 con 0x7f47b806e060 2023-05-16T13:55:08.776 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.767+0000 7f47be1a2640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47b80c60d0 con 0x7f47b8159c20 2023-05-16T13:55:08.777 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.767+0000 7f47bc99f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f47b80cfed0 0x7f47b80c6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:08.778 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.767+0000 7f47bc99f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f47b80cfed0 0x7f47b80c6560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34818/0 (socket says 172.21.15.39:34818) 2023-05-16T13:55:08.778 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.767+0000 7f47bc99f640 1 -- 172.21.15.39:0/2581126437 learned_addr learned my addr 172.21.15.39:0/2581126437 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:08.778 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.767+0000 7f47bd1a0640 1 --2- 172.21.15.39:0/2581126437 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47b806e060 0x7f47b8152430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:08.778 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.767+0000 7f47bc99f640 1 -- 172.21.15.39:0/2581126437 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f47b8159c20 msgr2=0x7f47b8161b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:08.778 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.767+0000 7f47bc99f640 1 --2- 172.21.15.39:0/2581126437 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f47b8159c20 0x7f47b8161b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:08.778 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.767+0000 7f47bc99f640 1 -- 172.21.15.39:0/2581126437 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47b806e060 msgr2=0x7f47b8152430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:08.778 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.767+0000 7f47bc99f640 1 --2- 172.21.15.39:0/2581126437 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47b806e060 0x7f47b8152430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:08.779 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.767+0000 7f47bc99f640 1 -- 172.21.15.39:0/2581126437 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a8009420 con 0x7f47b80cfed0 2023-05-16T13:55:08.779 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.767+0000 7f47bd1a0640 1 --2- 172.21.15.39:0/2581126437 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47b806e060 0x7f47b8152430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-16T13:55:08.779 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.771+0000 7f47bc99f640 1 --2- 172.21.15.39:0/2581126437 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f47b80cfed0 0x7f47b80c6560 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f47a80097c0 tx=0x7f47a801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:08.779 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.771+0000 7f47adffb640 1 -- 172.21.15.39:0/2581126437 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a8004220 con 0x7f47b80cfed0 2023-05-16T13:55:08.779 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.771+0000 7f47adffb640 1 -- 172.21.15.39:0/2581126437 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a80b9070 con 0x7f47b80cfed0 2023-05-16T13:55:08.779 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.771+0000 7f47adffb640 1 -- 172.21.15.39:0/2581126437 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a8003620 con 0x7f47b80cfed0 2023-05-16T13:55:08.779 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.771+0000 7f47be1a2640 1 -- 172.21.15.39:0/2581126437 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47b80b6170 con 0x7f47b80cfed0 2023-05-16T13:55:08.779 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.771+0000 7f47be1a2640 1 -- 172.21.15.39:0/2581126437 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47b80cc500 con 0x7f47b80cfed0 2023-05-16T13:55:08.780 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.771+0000 7f47be1a2640 1 -- 172.21.15.39:0/2581126437 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47b8167780 con 0x7f47b80cfed0 2023-05-16T13:55:08.780 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.771+0000 7f47adffb640 1 -- 172.21.15.39:0/2581126437 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f47a8003780 con 0x7f47b80cfed0 2023-05-16T13:55:08.780 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.771+0000 7f47adffb640 1 --2- 172.21.15.39:0/2581126437 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f479c066280 0x7f479c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:08.781 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.771+0000 7f47adffb640 1 -- 172.21.15.39:0/2581126437 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f47a80bb070 con 0x7f47b80cfed0 2023-05-16T13:55:08.781 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.771+0000 7f47bd1a0640 1 --2- 172.21.15.39:0/2581126437 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f479c066280 0x7f479c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:08.781 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.775+0000 7f47bd1a0640 1 --2- 172.21.15.39:0/2581126437 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f479c066280 0x7f479c068730 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f47b4000f70 tx=0x7f47b4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:08.784 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.775+0000 7f47adffb640 1 -- 172.21.15.39:0/2581126437 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f47a80ebd10 con 0x7f47b80cfed0 2023-05-16T13:55:08.941 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.935+0000 7f47be1a2640 1 -- 172.21.15.39:0/2581126437 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f47b80d1260 con 0x7f47b80cfed0 2023-05-16T13:55:08.942 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.935+0000 7f47adffb640 1 -- 172.21.15.39:0/2581126437 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18375 (secure 0 0 0) 0x7f47b80d1260 con 0x7f47b80cfed0 2023-05-16T13:55:08.943 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:55:08.943 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":26,"fsid":"9c1e210b-c515-4ea4-a065-397956895c68","created":"2023-05-16T13:53:48.955290+0000","modified":"2023-05-16T13:54:56.831431+0000","last_up_change":"2023-05-16T13:54:01.722051+0000","last_in_change":"2023-05-16T13:53:52.331336+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-16T13:54:00.885009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-16T13:54:08.327895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-16T13:54:12.864823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-16T13:54:14.180225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4ce0f0ba-c4bf-4405-8c95-d2e9a62878ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6809","nonce":3462013698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6811","nonce":3462013698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6815","nonce":3462013698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6813","nonce":3462013698}]},"public_addr":"172.21.15.39:6809/3462013698","cluster_addr":"172.21.15.39:6811/3462013698","heartbeat_back_addr":"172.21.15.39:6815/3462013698","heartbeat_front_addr":"172.21.15.39:6813/3462013698","state":["exists","up"]},{"osd":1,"uuid":"53fdc1ac-2473-472d-af32-2760fdf6e476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6801","nonce":2829970892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6803","nonce":2829970892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6807","nonce":2829970892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6805","nonce":2829970892}]},"public_addr":"172.21.15.39:6801/2829970892","cluster_addr":"172.21.15.39:6803/2829970892","heartbeat_back_addr":"172.21.15.39:6807/2829970892","heartbeat_front_addr":"172.21.15.39:6805/2829970892","state":["exists","up"]},{"osd":2,"uuid":"0b92d770-7030-42fa-a19f-4f7f1ac113c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6817","nonce":3888067413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6819","nonce":3888067413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6823","nonce":3888067413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6821","nonce":3888067413}]},"public_addr":"172.21.15.39:6817/3888067413","cluster_addr":"172.21.15.39:6819/3888067413","heartbeat_back_addr":"172.21.15.39:6823/3888067413","heartbeat_front_addr":"172.21.15.39:6821/3888067413","state":["exists","up"]},{"osd":3,"uuid":"000d9506-cbb2-4017-b875-deca579860ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6825","nonce":405003958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6827","nonce":405003958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6831","nonce":405003958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6829","nonce":405003958}]},"public_addr":"172.21.15.39:6825/405003958","cluster_addr":"172.21.15.39:6827/405003958","heartbeat_back_addr":"172.21.15.39:6831/405003958","heartbeat_front_addr":"172.21.15.39:6829/405003958","state":["exists","up"]},{"osd":4,"uuid":"70f0dacb-e960-40c5-bf6a-183e52bbe2ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6801","nonce":3895278838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6805","nonce":3895278838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6813","nonce":3895278838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6809","nonce":3895278838}]},"public_addr":"172.21.15.118:6801/3895278838","cluster_addr":"172.21.15.118:6805/3895278838","heartbeat_back_addr":"172.21.15.118:6813/3895278838","heartbeat_front_addr":"172.21.15.118:6809/3895278838","state":["exists","up"]},{"osd":5,"uuid":"756feb54-c3ae-4a2a-8f74-85c291ba707c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6804","nonce":3513592808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6808","nonce":3513592808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6815","nonce":3513592808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6812","nonce":3513592808}]},"public_addr":"172.21.15.118:6804/3513592808","cluster_addr":"172.21.15.118:6808/3513592808","heartbeat_back_addr":"172.21.15.118:6815/3513592808","heartbeat_front_addr":"172.21.15.118:6812/3513592808","state":["exists","up"]},{"osd":6,"uuid":"c4a982c1-f497-4b0f-8a23-c77372e4621e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6824","nonce":1863656053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6827","nonce":1863656053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6831","nonce":1863656053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6829","nonce":1863656053}]},"public_addr":"172.21.15.118:6824/1863656053","cluster_addr":"172.21.15.118:6827/1863656053","heartbeat_back_addr":"172.21.15.118:6831/1863656053","heartbeat_front_addr":"172.21.15.118:6829/1863656053","state":["exists","up"]},{"osd":7,"uuid":"6f2888aa-a7ac-4e26-9159-e31817934f44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6817","nonce":3636642904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6819","nonce":3636642904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6825","nonce":3636642904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6821","nonce":3636642904}]},"public_addr":"172.21.15.118:6817/3636642904","cluster_addr":"172.21.15.118:6819/3636642904","heartbeat_back_addr":"172.21.15.118:6825/3636642904","heartbeat_front_addr":"172.21.15.118:6821/3636642904","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.717636+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.724036+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.739144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:58.079275+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:58.073921+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.930466+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.987813+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.941098+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.24","mappings":[{"from":1,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-16T13:55:08.944 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.935+0000 7f47be1a2640 1 -- 172.21.15.39:0/2581126437 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f479c066280 msgr2=0x7f479c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:08.945 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.935+0000 7f47be1a2640 1 --2- 172.21.15.39:0/2581126437 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f479c066280 0x7f479c068730 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f47b4000f70 tx=0x7f47b4009040 comp rx=0 tx=0).stop 2023-05-16T13:55:08.945 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.935+0000 7f47be1a2640 1 -- 172.21.15.39:0/2581126437 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f47b80cfed0 msgr2=0x7f47b80c6560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:08.945 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.935+0000 7f47be1a2640 1 --2- 172.21.15.39:0/2581126437 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f47b80cfed0 0x7f47b80c6560 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f47a80097c0 tx=0x7f47a801ac90 comp rx=0 tx=0).stop 2023-05-16T13:55:08.945 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.935+0000 7f47be1a2640 1 -- 172.21.15.39:0/2581126437 shutdown_connections 2023-05-16T13:55:08.945 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.935+0000 7f47be1a2640 1 --2- 172.21.15.39:0/2581126437 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f479c066280 0x7f479c068730 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:08.945 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.935+0000 7f47be1a2640 1 --2- 172.21.15.39:0/2581126437 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f47b8159c20 0x7f47b8161b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:08.945 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.935+0000 7f47be1a2640 1 --2- 172.21.15.39:0/2581126437 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f47b80cfed0 0x7f47b80c6560 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:08.946 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.935+0000 7f47be1a2640 1 --2- 172.21.15.39:0/2581126437 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f47b806e060 0x7f47b8152430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:08.946 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.935+0000 7f47be1a2640 1 -- 172.21.15.39:0/2581126437 >> 172.21.15.39:0/2581126437 conn(0x7f47b8065690 msgr2=0x7f47b80b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:08.946 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.939+0000 7f47be1a2640 1 -- 172.21.15.39:0/2581126437 shutdown_connections 2023-05-16T13:55:08.946 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:08.939+0000 7f47be1a2640 1 -- 172.21.15.39:0/2581126437 wait complete. 2023-05-16T13:55:08.963 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-16T13:54:00.885009+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-16T13:54:08.327895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-16T13:54:12.864823+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-16T13:54:14.180225+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-16T13:55:08.964 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-16T13:55:09.105 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.099+0000 7fd3e97a6640 1 Processor -- start 2023-05-16T13:55:09.105 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.099+0000 7fd3e97a6640 1 -- start start 2023-05-16T13:55:09.106 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.099+0000 7fd3e97a6640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd3e4158e00 0x7fd3e40c9530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:09.106 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.099+0000 7fd3e97a6640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd3e40c9a70 0x7fd3e40aff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:09.106 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.099+0000 7fd3e97a6640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3e40ca030 con 0x7fd3e40b0490 2023-05-16T13:55:09.106 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.099+0000 7fd3e97a6640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3e40b0910 con 0x7fd3e4158e00 2023-05-16T13:55:09.107 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.099+0000 7fd3e97a6640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e415c890 con 0x7fd3e40c9a70 2023-05-16T13:55:09.107 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.099+0000 7fd3e2ffd640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd3e4158e00 0x7fd3e40c9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:09.107 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.099+0000 7fd3e2ffd640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd3e4158e00 0x7fd3e40c9530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34822/0 (socket says 172.21.15.39:34822) 2023-05-16T13:55:09.107 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.099+0000 7fd3e2ffd640 1 -- 172.21.15.39:0/1743912462 learned_addr learned my addr 172.21.15.39:0/1743912462 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:09.107 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.099+0000 7fd3e27fc640 1 --2- 172.21.15.39:0/1743912462 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd3e40c9a70 0x7fd3e40aff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:09.108 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.099+0000 7fd3e2ffd640 1 -- 172.21.15.39:0/1743912462 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd3e40c9a70 msgr2=0x7fd3e40aff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:09.108 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.099+0000 7fd3e2ffd640 1 --2- 172.21.15.39:0/1743912462 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd3e40c9a70 0x7fd3e40aff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:09.108 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.099+0000 7fd3e2ffd640 1 -- 172.21.15.39:0/1743912462 >> v1:172.21.15.118:6789/0 conn(0x7fd3e40b0490 legacy=0x7fd3e40caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:09.108 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.099+0000 7fd3e2ffd640 1 -- 172.21.15.39:0/1743912462 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3e415cb70 con 0x7fd3e4158e00 2023-05-16T13:55:09.108 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.099+0000 7fd3e27fc640 1 --2- 172.21.15.39:0/1743912462 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd3e40c9a70 0x7fd3e40aff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:55:09.109 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.103+0000 7fd3e2ffd640 1 --2- 172.21.15.39:0/1743912462 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd3e4158e00 0x7fd3e40c9530 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd3d4009870 tx=0x7fd3d4020f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c3b64faedd9fcf1 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:09.110 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.103+0000 7fd3e1ffb640 1 -- 172.21.15.39:0/1743912462 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d40aac40 con 0x7fd3e4158e00 2023-05-16T13:55:09.110 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.103+0000 7fd3e1ffb640 1 -- 172.21.15.39:0/1743912462 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3d40aada0 con 0x7fd3e4158e00 2023-05-16T13:55:09.110 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.103+0000 7fd3e1ffb640 1 -- 172.21.15.39:0/1743912462 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d40b2660 con 0x7fd3e4158e00 2023-05-16T13:55:09.111 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.103+0000 7fd3e97a6640 1 -- 172.21.15.39:0/1743912462 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd3e4158e00 msgr2=0x7fd3e40c9530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:09.111 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.103+0000 7fd3e97a6640 1 --2- 172.21.15.39:0/1743912462 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd3e4158e00 0x7fd3e40c9530 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd3d4009870 tx=0x7fd3d4020f40 comp rx=0 tx=0).stop 2023-05-16T13:55:09.111 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.103+0000 7fd3e97a6640 1 -- 172.21.15.39:0/1743912462 shutdown_connections 2023-05-16T13:55:09.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.103+0000 7fd3e97a6640 1 --2- 172.21.15.39:0/1743912462 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd3e40c9a70 0x7fd3e40aff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:09.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.103+0000 7fd3e97a6640 1 --2- 172.21.15.39:0/1743912462 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd3e4158e00 0x7fd3e40c9530 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:09.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.103+0000 7fd3e97a6640 1 -- 172.21.15.39:0/1743912462 >> 172.21.15.39:0/1743912462 conn(0x7fd3e4069a50 msgr2=0x7fd3e4069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:09.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.103+0000 7fd3e97a6640 1 -- 172.21.15.39:0/1743912462 shutdown_connections 2023-05-16T13:55:09.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.103+0000 7fd3e97a6640 1 -- 172.21.15.39:0/1743912462 wait complete. 2023-05-16T13:55:09.113 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.103+0000 7fd3e97a6640 1 Processor -- start 2023-05-16T13:55:09.113 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.107+0000 7fd3e97a6640 1 -- start start 2023-05-16T13:55:09.114 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.107+0000 7fd3e97a6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd3e40b0490 0x7fd3e4153540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:09.114 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.107+0000 7fd3e97a6640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd3e40c9a70 0x7fd3e40c7210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:09.114 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.107+0000 7fd3e97a6640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd3e4158e00 0x7fd3e41f2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:09.114 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.107+0000 7fd3e97a6640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e4153e30 con 0x7fd3e40b0490 2023-05-16T13:55:09.114 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.107+0000 7fd3e97a6640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e40c6df0 con 0x7fd3e4158e00 2023-05-16T13:55:09.115 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.107+0000 7fd3e97a6640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e40c4dc0 con 0x7fd3e40c9a70 2023-05-16T13:55:09.115 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.107+0000 7fd3e2ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd3e40b0490 0x7fd3e4153540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:09.115 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.107+0000 7fd3e2ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd3e40b0490 0x7fd3e4153540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34832/0 (socket says 172.21.15.39:34832) 2023-05-16T13:55:09.115 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.107+0000 7fd3e2ffd640 1 -- 172.21.15.39:0/849037320 learned_addr learned my addr 172.21.15.39:0/849037320 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:09.115 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.107+0000 7fd3e27fc640 1 --2- 172.21.15.39:0/849037320 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd3e40c9a70 0x7fd3e40c7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:09.115 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.107+0000 7fd3e37fe640 1 --2- 172.21.15.39:0/849037320 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd3e4158e00 0x7fd3e41f2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:09.116 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.107+0000 7fd3e2ffd640 1 -- 172.21.15.39:0/849037320 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd3e40c9a70 msgr2=0x7fd3e40c7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:09.116 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.107+0000 7fd3e2ffd640 1 --2- 172.21.15.39:0/849037320 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd3e40c9a70 0x7fd3e40c7210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:09.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.107+0000 7fd3e2ffd640 1 -- 172.21.15.39:0/849037320 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd3e4158e00 msgr2=0x7fd3e41f2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:09.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.107+0000 7fd3e2ffd640 1 --2- 172.21.15.39:0/849037320 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd3e4158e00 0x7fd3e41f2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:09.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.107+0000 7fd3e2ffd640 1 -- 172.21.15.39:0/849037320 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3d40094d0 con 0x7fd3e40b0490 2023-05-16T13:55:09.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.107+0000 7fd3e2ffd640 1 --2- 172.21.15.39:0/849037320 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd3e40b0490 0x7fd3e4153540 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd3d40b5040 tx=0x7fd3d401dce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:09.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.107+0000 7fd3cb7fe640 1 -- 172.21.15.39:0/849037320 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d40bb610 con 0x7fd3e40b0490 2023-05-16T13:55:09.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.107+0000 7fd3cb7fe640 1 -- 172.21.15.39:0/849037320 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3d40bb790 con 0x7fd3e40b0490 2023-05-16T13:55:09.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.107+0000 7fd3cb7fe640 1 -- 172.21.15.39:0/849037320 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d40bbb40 con 0x7fd3e40b0490 2023-05-16T13:55:09.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.107+0000 7fd3e97a6640 1 -- 172.21.15.39:0/849037320 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3e415d130 con 0x7fd3e40b0490 2023-05-16T13:55:09.118 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.107+0000 7fd3e97a6640 1 -- 172.21.15.39:0/849037320 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3e415ce50 con 0x7fd3e40b0490 2023-05-16T13:55:09.118 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.107+0000 7fd3e97a6640 1 -- 172.21.15.39:0/849037320 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3e40cc730 con 0x7fd3e40b0490 2023-05-16T13:55:09.118 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.111+0000 7fd3cb7fe640 1 -- 172.21.15.39:0/849037320 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd3d40ba3b0 con 0x7fd3e40b0490 2023-05-16T13:55:09.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.111+0000 7fd3cb7fe640 1 --2- 172.21.15.39:0/849037320 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd3d00662b0 0x7fd3d0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:09.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.111+0000 7fd3cb7fe640 1 -- 172.21.15.39:0/849037320 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fd3d41217b0 con 0x7fd3e40b0490 2023-05-16T13:55:09.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.111+0000 7fd3e27fc640 1 --2- 172.21.15.39:0/849037320 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd3d00662b0 0x7fd3d0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:09.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.111+0000 7fd3e27fc640 1 --2- 172.21.15.39:0/849037320 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd3d00662b0 0x7fd3d0068760 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd3e406a940 tx=0x7fd3d8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:09.122 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.115+0000 7fd3cb7fe640 1 -- 172.21.15.39:0/849037320 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fd3d40eec00 con 0x7fd3e40b0490 2023-05-16T13:55:09.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.271+0000 7fd3e97a6640 1 -- 172.21.15.39:0/849037320 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd3e415c170 con 0x7fd3e40b0490 2023-05-16T13:55:09.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.271+0000 7fd3cb7fe640 1 -- 172.21.15.39:0/849037320 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd3d40f2220 con 0x7fd3e40b0490 2023-05-16T13:55:09.278 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2023-05-16T13:55:09.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.271+0000 7fd3e97a6640 1 -- 172.21.15.39:0/849037320 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd3d00662b0 msgr2=0x7fd3d0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:09.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.271+0000 7fd3e97a6640 1 --2- 172.21.15.39:0/849037320 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd3d00662b0 0x7fd3d0068760 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd3e406a940 tx=0x7fd3d8008040 comp rx=0 tx=0).stop 2023-05-16T13:55:09.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.271+0000 7fd3e97a6640 1 -- 172.21.15.39:0/849037320 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd3e40b0490 msgr2=0x7fd3e4153540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:09.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.271+0000 7fd3e97a6640 1 --2- 172.21.15.39:0/849037320 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd3e40b0490 0x7fd3e4153540 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd3d40b5040 tx=0x7fd3d401dce0 comp rx=0 tx=0).stop 2023-05-16T13:55:09.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.271+0000 7fd3e97a6640 1 -- 172.21.15.39:0/849037320 shutdown_connections 2023-05-16T13:55:09.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.271+0000 7fd3e97a6640 1 --2- 172.21.15.39:0/849037320 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd3d00662b0 0x7fd3d0068760 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:09.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.271+0000 7fd3e97a6640 1 --2- 172.21.15.39:0/849037320 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd3e40c9a70 0x7fd3e40c7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:09.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.271+0000 7fd3e97a6640 1 --2- 172.21.15.39:0/849037320 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd3e4158e00 0x7fd3e41f2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:09.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.271+0000 7fd3e97a6640 1 --2- 172.21.15.39:0/849037320 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd3e40b0490 0x7fd3e4153540 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:09.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.271+0000 7fd3e97a6640 1 -- 172.21.15.39:0/849037320 >> 172.21.15.39:0/849037320 conn(0x7fd3e4069a50 msgr2=0x7fd3e40c8d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:09.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.271+0000 7fd3e97a6640 1 -- 172.21.15.39:0/849037320 shutdown_connections 2023-05-16T13:55:09.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.271+0000 7fd3e97a6640 1 -- 172.21.15.39:0/849037320 wait complete. 2023-05-16T13:55:09.299 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-16T13:55:09.439 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.431+0000 7fd0d7cfc640 1 Processor -- start 2023-05-16T13:55:09.439 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.431+0000 7fd0d7cfc640 1 -- start start 2023-05-16T13:55:09.440 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.431+0000 7fd0d7cfc640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd0d00b0710 0x7fd0d015d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:09.441 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.431+0000 7fd0d7cfc640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd0d00b4030 0x7fd0d0071460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:09.441 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.431+0000 7fd0d7cfc640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd0d00719a0 0x7fd0d00ce420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:09.441 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.431+0000 7fd0d7cfc640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0d015e910 con 0x7fd0d00b4030 2023-05-16T13:55:09.441 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.431+0000 7fd0d7cfc640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0d015de40 con 0x7fd0d00b0710 2023-05-16T13:55:09.441 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.431+0000 7fd0d7cfc640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d00b0ae0 con 0x7fd0d00719a0 2023-05-16T13:55:09.441 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.431+0000 7fd0d5297640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd0d00b4030 0x7fd0d0071460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:09.441 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.431+0000 7fd0d5297640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd0d00b4030 0x7fd0d0071460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34846/0 (socket says 172.21.15.39:34846) 2023-05-16T13:55:09.441 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.431+0000 7fd0d5297640 1 -- 172.21.15.39:0/647821612 learned_addr learned my addr 172.21.15.39:0/647821612 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:09.442 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.435+0000 7fd0d5a98640 1 --2- 172.21.15.39:0/647821612 >> v2:172.21.15.118:3300/0 conn(0x7fd0d00b0710 0x7fd0d015d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:09.442 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.435+0000 7fd0d6299640 1 --2- 172.21.15.39:0/647821612 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd0d00719a0 0x7fd0d00ce420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:09.442 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.435+0000 7fd0d5297640 1 -- 172.21.15.39:0/647821612 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd0d00719a0 msgr2=0x7fd0d00ce420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:09.443 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.435+0000 7fd0d5297640 1 --2- 172.21.15.39:0/647821612 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd0d00719a0 0x7fd0d00ce420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:09.443 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.435+0000 7fd0d5297640 1 -- 172.21.15.39:0/647821612 >> v2:172.21.15.118:3300/0 conn(0x7fd0d00b0710 msgr2=0x7fd0d015d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:09.443 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.435+0000 7fd0d5297640 1 --2- 172.21.15.39:0/647821612 >> v2:172.21.15.118:3300/0 conn(0x7fd0d00b0710 0x7fd0d015d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:09.443 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.435+0000 7fd0d5297640 1 -- 172.21.15.39:0/647821612 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0d015e070 con 0x7fd0d00b4030 2023-05-16T13:55:09.443 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.435+0000 7fd0d5a98640 1 --2- 172.21.15.39:0/647821612 >> v2:172.21.15.118:3300/0 conn(0x7fd0d00b0710 0x7fd0d015d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:55:09.444 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.435+0000 7fd0d5297640 1 --2- 172.21.15.39:0/647821612 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd0d00b4030 0x7fd0d0071460 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd0d00b1080 tx=0x7fd0c001c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=761e99054d27cd7f server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:09.444 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.435+0000 7fd0d4a96640 1 -- 172.21.15.39:0/647821612 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c00ab600 con 0x7fd0d00b4030 2023-05-16T13:55:09.444 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.435+0000 7fd0d4a96640 1 -- 172.21.15.39:0/647821612 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0c00a7050 con 0x7fd0d00b4030 2023-05-16T13:55:09.444 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.435+0000 7fd0d4a96640 1 -- 172.21.15.39:0/647821612 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c00ab980 con 0x7fd0d00b4030 2023-05-16T13:55:09.446 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.435+0000 7fd0d7cfc640 1 -- 172.21.15.39:0/647821612 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd0d00b4030 msgr2=0x7fd0d0071460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:09.446 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.435+0000 7fd0d7cfc640 1 --2- 172.21.15.39:0/647821612 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd0d00b4030 0x7fd0d0071460 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd0d00b1080 tx=0x7fd0c001c240 comp rx=0 tx=0).stop 2023-05-16T13:55:09.446 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.439+0000 7fd0d7cfc640 1 -- 172.21.15.39:0/647821612 shutdown_connections 2023-05-16T13:55:09.446 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.439+0000 7fd0d7cfc640 1 --2- 172.21.15.39:0/647821612 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd0d00719a0 0x7fd0d00ce420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:09.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.439+0000 7fd0d7cfc640 1 --2- 172.21.15.39:0/647821612 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd0d00b4030 0x7fd0d0071460 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:09.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.439+0000 7fd0d7cfc640 1 --2- 172.21.15.39:0/647821612 >> v2:172.21.15.118:3300/0 conn(0x7fd0d00b0710 0x7fd0d015d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:09.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.439+0000 7fd0d7cfc640 1 -- 172.21.15.39:0/647821612 >> 172.21.15.39:0/647821612 conn(0x7fd0d0069a50 msgr2=0x7fd0d0069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:09.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.439+0000 7fd0d7cfc640 1 -- 172.21.15.39:0/647821612 shutdown_connections 2023-05-16T13:55:09.448 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.439+0000 7fd0d7cfc640 1 -- 172.21.15.39:0/647821612 wait complete. 2023-05-16T13:55:09.451 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.439+0000 7fd0d7cfc640 1 Processor -- start 2023-05-16T13:55:09.451 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.439+0000 7fd0d7cfc640 1 -- start start 2023-05-16T13:55:09.452 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.439+0000 7fd0d7cfc640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd0d00719a0 0x7fd0d0155ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:09.452 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.439+0000 7fd0d7cfc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0d00b0710 0x7fd0d00c4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:09.452 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.439+0000 7fd0d7cfc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd0d00b4030 0x7fd0d00c4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:09.452 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.439+0000 7fd0d7cfc640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d015c110 con 0x7fd0d00b4030 2023-05-16T13:55:09.452 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.439+0000 7fd0d7cfc640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d00c36f0 con 0x7fd0d00b0710 2023-05-16T13:55:09.452 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.439+0000 7fd0d7cfc640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d00c2b20 con 0x7fd0d00719a0 2023-05-16T13:55:09.453 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.439+0000 7fd0d6299640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd0d00b4030 0x7fd0d00c4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:09.453 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.439+0000 7fd0d5a98640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd0d00719a0 0x7fd0d0155ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:09.453 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.439+0000 7fd0d6299640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd0d00b4030 0x7fd0d00c4a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34854/0 (socket says 172.21.15.39:34854) 2023-05-16T13:55:09.453 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.439+0000 7fd0d6299640 1 -- 172.21.15.39:0/176392582 learned_addr learned my addr 172.21.15.39:0/176392582 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:09.453 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.439+0000 7fd0d5297640 1 --2- 172.21.15.39:0/176392582 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0d00b0710 0x7fd0d00c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:09.453 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.439+0000 7fd0d6299640 1 -- 172.21.15.39:0/176392582 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd0d00719a0 msgr2=0x7fd0d0155ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:09.453 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.439+0000 7fd0d6299640 1 --2- 172.21.15.39:0/176392582 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd0d00719a0 0x7fd0d0155ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:09.454 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.439+0000 7fd0d6299640 1 -- 172.21.15.39:0/176392582 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0d00b0710 msgr2=0x7fd0d00c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:09.454 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.439+0000 7fd0d6299640 1 --2- 172.21.15.39:0/176392582 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0d00b0710 0x7fd0d00c4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:09.454 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.439+0000 7fd0d6299640 1 -- 172.21.15.39:0/176392582 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c00094d0 con 0x7fd0d00b4030 2023-05-16T13:55:09.454 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.439+0000 7fd0d6299640 1 --2- 172.21.15.39:0/176392582 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd0d00b4030 0x7fd0d00c4a50 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fd0c8007e60 tx=0x7fd0c800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:09.454 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.443+0000 7fd0c67fc640 1 -- 172.21.15.39:0/176392582 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c8014620 con 0x7fd0d00b4030 2023-05-16T13:55:09.454 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.443+0000 7fd0c67fc640 1 -- 172.21.15.39:0/176392582 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0c800ee90 con 0x7fd0d00b4030 2023-05-16T13:55:09.454 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.443+0000 7fd0c67fc640 1 -- 172.21.15.39:0/176392582 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c80149e0 con 0x7fd0d00b4030 2023-05-16T13:55:09.454 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.443+0000 7fd0d7cfc640 1 -- 172.21.15.39:0/176392582 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0d0071da0 con 0x7fd0d00b4030 2023-05-16T13:55:09.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.443+0000 7fd0d7cfc640 1 -- 172.21.15.39:0/176392582 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0d00c8ca0 con 0x7fd0d00b4030 2023-05-16T13:55:09.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.443+0000 7fd0d7cfc640 1 -- 172.21.15.39:0/176392582 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0d00c91c0 con 0x7fd0d00b4030 2023-05-16T13:55:09.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.443+0000 7fd0c67fc640 1 -- 172.21.15.39:0/176392582 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd0c8014b40 con 0x7fd0d00b4030 2023-05-16T13:55:09.455 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.443+0000 7fd0c67fc640 1 --2- 172.21.15.39:0/176392582 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd0b4066280 0x7fd0b4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:09.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.443+0000 7fd0c67fc640 1 -- 172.21.15.39:0/176392582 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fd0c80844b0 con 0x7fd0d00b4030 2023-05-16T13:55:09.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.443+0000 7fd0d5a98640 1 --2- 172.21.15.39:0/176392582 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd0b4066280 0x7fd0b4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:09.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.443+0000 7fd0d5a98640 1 --2- 172.21.15.39:0/176392582 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd0b4066280 0x7fd0b4068730 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc009950 tx=0x7fd0cc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:09.456 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.447+0000 7fd0c67fc640 1 -- 172.21.15.39:0/176392582 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fd0c8051a30 con 0x7fd0d00b4030 2023-05-16T13:55:09.609 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.603+0000 7fd0d7cfc640 1 -- 172.21.15.39:0/176392582 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd0d00c38a0 con 0x7fd0d00b4030 2023-05-16T13:55:09.609 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.603+0000 7fd0c67fc640 1 -- 172.21.15.39:0/176392582 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd0d00c38a0 con 0x7fd0d00b4030 2023-05-16T13:55:09.610 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 8 2023-05-16T13:55:09.611 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.603+0000 7fd0d7cfc640 1 -- 172.21.15.39:0/176392582 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd0b4066280 msgr2=0x7fd0b4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:09.612 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.603+0000 7fd0d7cfc640 1 --2- 172.21.15.39:0/176392582 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd0b4066280 0x7fd0b4068730 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc009950 tx=0x7fd0cc008040 comp rx=0 tx=0).stop 2023-05-16T13:55:09.612 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.603+0000 7fd0d7cfc640 1 -- 172.21.15.39:0/176392582 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd0d00b4030 msgr2=0x7fd0d00c4a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:09.612 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.603+0000 7fd0d7cfc640 1 --2- 172.21.15.39:0/176392582 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd0d00b4030 0x7fd0d00c4a50 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fd0c8007e60 tx=0x7fd0c800e4b0 comp rx=0 tx=0).stop 2023-05-16T13:55:09.612 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.603+0000 7fd0d7cfc640 1 -- 172.21.15.39:0/176392582 shutdown_connections 2023-05-16T13:55:09.612 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.603+0000 7fd0d7cfc640 1 --2- 172.21.15.39:0/176392582 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd0d00b4030 0x7fd0d00c4a50 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:09.612 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.603+0000 7fd0d7cfc640 1 --2- 172.21.15.39:0/176392582 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0d00b0710 0x7fd0d00c4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:09.613 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.603+0000 7fd0d7cfc640 1 --2- 172.21.15.39:0/176392582 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd0b4066280 0x7fd0b4068730 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:09.613 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.603+0000 7fd0d7cfc640 1 --2- 172.21.15.39:0/176392582 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd0d00719a0 0x7fd0d0155ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:09.613 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.603+0000 7fd0d7cfc640 1 -- 172.21.15.39:0/176392582 >> 172.21.15.39:0/176392582 conn(0x7fd0d0069a50 msgr2=0x7fd0d00ab8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:09.613 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.603+0000 7fd0d7cfc640 1 -- 172.21.15.39:0/176392582 shutdown_connections 2023-05-16T13:55:09.613 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.603+0000 7fd0d7cfc640 1 -- 172.21.15.39:0/176392582 wait complete. 2023-05-16T13:55:09.630 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-16T13:55:09.770 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.763+0000 7f05b1df3640 1 Processor -- start 2023-05-16T13:55:09.771 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.763+0000 7f05b1df3640 1 -- start start 2023-05-16T13:55:09.772 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.763+0000 7f05b1df3640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f05ac0cb0f0 0x7f05ac160430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:09.772 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.763+0000 7f05b1df3640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f05ac160970 0x7f05ac0718a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:09.772 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.763+0000 7f05b1df3640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05ac0cee40 con 0x7f05ac071de0 2023-05-16T13:55:09.772 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.763+0000 7f05b1df3640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05ac0cd490 con 0x7f05ac0cb0f0 2023-05-16T13:55:09.772 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.763+0000 7f05b1df3640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05ac0cf120 con 0x7f05ac160970 2023-05-16T13:55:09.772 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.763+0000 7f05ab7fe640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f05ac0cb0f0 0x7f05ac160430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:09.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.763+0000 7f05ab7fe640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f05ac0cb0f0 0x7f05ac160430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34868/0 (socket says 172.21.15.39:34868) 2023-05-16T13:55:09.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.763+0000 7f05ab7fe640 1 -- 172.21.15.39:0/3870438616 learned_addr learned my addr 172.21.15.39:0/3870438616 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:09.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.763+0000 7f05abfff640 1 --1- 172.21.15.39:0/3870438616 >> v1:172.21.15.39:6789/0 conn(0x7f05ac071de0 0x7f05ac069a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:51102/0 (socket says 172.21.15.39:51102) 2023-05-16T13:55:09.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.763+0000 7f05aaffd640 1 --2- 172.21.15.39:0/3870438616 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f05ac160970 0x7f05ac0718a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:09.774 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.763+0000 7f05ab7fe640 1 -- 172.21.15.39:0/3870438616 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f05ac160970 msgr2=0x7f05ac0718a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:09.774 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.763+0000 7f05ab7fe640 1 --2- 172.21.15.39:0/3870438616 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f05ac160970 0x7f05ac0718a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:09.774 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.763+0000 7f05ab7fe640 1 -- 172.21.15.39:0/3870438616 >> v1:172.21.15.39:6789/0 conn(0x7f05ac071de0 legacy=0x7f05ac069a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:09.774 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.763+0000 7f05ab7fe640 1 -- 172.21.15.39:0/3870438616 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05ac0cf400 con 0x7f05ac0cb0f0 2023-05-16T13:55:09.775 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.767+0000 7f05ab7fe640 1 --2- 172.21.15.39:0/3870438616 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f05ac0cb0f0 0x7f05ac160430 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f059c009870 tx=0x7f059c01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33a83d0c85dfc366 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:09.776 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.767+0000 7f05aa7fc640 1 -- 172.21.15.39:0/3870438616 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059c0a9400 con 0x7f05ac0cb0f0 2023-05-16T13:55:09.776 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.767+0000 7f05aa7fc640 1 -- 172.21.15.39:0/3870438616 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f059c0a9560 con 0x7f05ac0cb0f0 2023-05-16T13:55:09.776 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.767+0000 7f05aa7fc640 1 -- 172.21.15.39:0/3870438616 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059c0a98f0 con 0x7f05ac0cb0f0 2023-05-16T13:55:09.777 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.767+0000 7f05b1df3640 1 -- 172.21.15.39:0/3870438616 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f05ac0cb0f0 msgr2=0x7f05ac160430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:09.777 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.767+0000 7f05b1df3640 1 --2- 172.21.15.39:0/3870438616 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f05ac0cb0f0 0x7f05ac160430 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f059c009870 tx=0x7f059c01c540 comp rx=0 tx=0).stop 2023-05-16T13:55:09.777 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.767+0000 7f05b1df3640 1 -- 172.21.15.39:0/3870438616 shutdown_connections 2023-05-16T13:55:09.777 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.767+0000 7f05b1df3640 1 --2- 172.21.15.39:0/3870438616 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f05ac160970 0x7f05ac0718a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:09.777 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.767+0000 7f05b1df3640 1 --2- 172.21.15.39:0/3870438616 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f05ac0cb0f0 0x7f05ac160430 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:09.777 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.767+0000 7f05b1df3640 1 -- 172.21.15.39:0/3870438616 >> 172.21.15.39:0/3870438616 conn(0x7f05ac06ce40 msgr2=0x7f05ac06d240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:09.778 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.767+0000 7f05b1df3640 1 -- 172.21.15.39:0/3870438616 shutdown_connections 2023-05-16T13:55:09.778 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.767+0000 7f05b1df3640 1 -- 172.21.15.39:0/3870438616 wait complete. 2023-05-16T13:55:09.778 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.771+0000 7f05b1df3640 1 Processor -- start 2023-05-16T13:55:09.778 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.771+0000 7f05b1df3640 1 -- start start 2023-05-16T13:55:09.779 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.771+0000 7f05b1df3640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f05ac071de0 0x7f05ac0c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:09.780 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.771+0000 7f05b1df3640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f05ac0cb0f0 0x7f05ac155a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:09.780 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.771+0000 7f05b1df3640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f05ac160970 0x7f05ac0ab8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:09.780 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.771+0000 7f05b1df3640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05ac15f780 con 0x7f05ac071de0 2023-05-16T13:55:09.780 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.771+0000 7f05b1df3640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05ac15c6d0 con 0x7f05ac160970 2023-05-16T13:55:09.780 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.771+0000 7f05b1df3640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05ac1571a0 con 0x7f05ac0cb0f0 2023-05-16T13:55:09.780 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.771+0000 7f05ab7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f05ac071de0 0x7f05ac0c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:09.780 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.771+0000 7f05ab7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f05ac071de0 0x7f05ac0c5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34876/0 (socket says 172.21.15.39:34876) 2023-05-16T13:55:09.781 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.771+0000 7f05ab7fe640 1 -- 172.21.15.39:0/2554520344 learned_addr learned my addr 172.21.15.39:0/2554520344 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:09.781 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.771+0000 7f05abfff640 1 --2- 172.21.15.39:0/2554520344 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f05ac160970 0x7f05ac0ab8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:09.781 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.771+0000 7f05aaffd640 1 --2- 172.21.15.39:0/2554520344 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f05ac0cb0f0 0x7f05ac155a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:09.782 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.771+0000 7f05ab7fe640 1 -- 172.21.15.39:0/2554520344 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f05ac0cb0f0 msgr2=0x7f05ac155a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:09.782 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.771+0000 7f05ab7fe640 1 --2- 172.21.15.39:0/2554520344 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f05ac0cb0f0 0x7f05ac155a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:09.782 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.771+0000 7f05ab7fe640 1 -- 172.21.15.39:0/2554520344 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f05ac160970 msgr2=0x7f05ac0ab8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:09.782 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.771+0000 7f05ab7fe640 1 --2- 172.21.15.39:0/2554520344 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f05ac160970 0x7f05ac0ab8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:09.782 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.771+0000 7f05ab7fe640 1 -- 172.21.15.39:0/2554520344 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f059c0094d0 con 0x7f05ac071de0 2023-05-16T13:55:09.783 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.771+0000 7f05abfff640 1 --2- 172.21.15.39:0/2554520344 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f05ac160970 0x7f05ac0ab8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:55:09.783 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.771+0000 7f05ab7fe640 1 --2- 172.21.15.39:0/2554520344 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f05ac071de0 0x7f05ac0c5c80 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f059c01abf0 tx=0x7f059c01ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:09.783 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.771+0000 7f0593fff640 1 -- 172.21.15.39:0/2554520344 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059c0a9400 con 0x7f05ac071de0 2023-05-16T13:55:09.783 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.771+0000 7f0593fff640 1 -- 172.21.15.39:0/2554520344 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f059c0b1800 con 0x7f05ac071de0 2023-05-16T13:55:09.783 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.771+0000 7f0593fff640 1 -- 172.21.15.39:0/2554520344 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059c0b1bb0 con 0x7f05ac071de0 2023-05-16T13:55:09.783 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.771+0000 7f05b1df3640 1 -- 172.21.15.39:0/2554520344 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05ac0ceaa0 con 0x7f05ac071de0 2023-05-16T13:55:09.784 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.775+0000 7f05b1df3640 1 -- 172.21.15.39:0/2554520344 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05ac0cb4c0 con 0x7f05ac071de0 2023-05-16T13:55:09.784 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.775+0000 7f05b1df3640 1 -- 172.21.15.39:0/2554520344 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05ac0cc670 con 0x7f05ac071de0 2023-05-16T13:55:09.784 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.775+0000 7f0593fff640 1 -- 172.21.15.39:0/2554520344 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f059c0b1d10 con 0x7f05ac071de0 2023-05-16T13:55:09.785 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.775+0000 7f0593fff640 1 --2- 172.21.15.39:0/2554520344 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f0598066280 0x7f0598068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:09.785 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.775+0000 7f0593fff640 1 -- 172.21.15.39:0/2554520344 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f059c11e830 con 0x7f05ac071de0 2023-05-16T13:55:09.785 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.775+0000 7f05aaffd640 1 --2- 172.21.15.39:0/2554520344 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f0598066280 0x7f0598068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:09.785 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.775+0000 7f05aaffd640 1 --2- 172.21.15.39:0/2554520344 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f0598066280 0x7f0598068730 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f05ac0cf660 tx=0x7f05a0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:09.787 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.779+0000 7f0593fff640 1 -- 172.21.15.39:0/2554520344 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f059c0ebd00 con 0x7f05ac071de0 2023-05-16T13:55:09.942 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.935+0000 7f05b1df3640 1 -- 172.21.15.39:0/2554520344 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f05ac073c90 con 0x7f05ac071de0 2023-05-16T13:55:09.943 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.935+0000 7f0593fff640 1 -- 172.21.15.39:0/2554520344 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f059c0a6030 con 0x7f05ac071de0 2023-05-16T13:55:09.943 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2023-05-16T13:55:09.945 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.935+0000 7f05b1df3640 1 -- 172.21.15.39:0/2554520344 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f0598066280 msgr2=0x7f0598068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:09.945 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.935+0000 7f05b1df3640 1 --2- 172.21.15.39:0/2554520344 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f0598066280 0x7f0598068730 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f05ac0cf660 tx=0x7f05a0008040 comp rx=0 tx=0).stop 2023-05-16T13:55:09.945 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.935+0000 7f05b1df3640 1 -- 172.21.15.39:0/2554520344 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f05ac071de0 msgr2=0x7f05ac0c5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:09.945 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.935+0000 7f05b1df3640 1 --2- 172.21.15.39:0/2554520344 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f05ac071de0 0x7f05ac0c5c80 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f059c01abf0 tx=0x7f059c01ad80 comp rx=0 tx=0).stop 2023-05-16T13:55:09.945 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.935+0000 7f05b1df3640 1 -- 172.21.15.39:0/2554520344 shutdown_connections 2023-05-16T13:55:09.945 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.935+0000 7f05b1df3640 1 --2- 172.21.15.39:0/2554520344 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f0598066280 0x7f0598068730 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:09.945 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.935+0000 7f05b1df3640 1 --2- 172.21.15.39:0/2554520344 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f05ac0cb0f0 0x7f05ac155a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:09.946 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.935+0000 7f05b1df3640 1 --2- 172.21.15.39:0/2554520344 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f05ac160970 0x7f05ac0ab8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:09.946 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.935+0000 7f05b1df3640 1 --2- 172.21.15.39:0/2554520344 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f05ac071de0 0x7f05ac0c5c80 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:09.946 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.935+0000 7f05b1df3640 1 -- 172.21.15.39:0/2554520344 >> 172.21.15.39:0/2554520344 conn(0x7f05ac06ce40 msgr2=0x7f05ac0b4660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:09.946 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.939+0000 7f05b1df3640 1 -- 172.21.15.39:0/2554520344 shutdown_connections 2023-05-16T13:55:09.946 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:09.939+0000 7f05b1df3640 1 -- 172.21.15.39:0/2554520344 wait complete. 2023-05-16T13:55:09.964 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-16T13:55:10.104 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.095+0000 7f699ecf2640 1 Processor -- start 2023-05-16T13:55:10.105 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.095+0000 7f699ecf2640 1 -- start start 2023-05-16T13:55:10.106 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.099+0000 7f699ecf2640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f69980aff50 0x7f69980b0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:10.106 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.099+0000 7f699ecf2640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f6998070420 0x7f6998070880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:10.106 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.099+0000 7f699ecf2640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69980b08c0 con 0x7f6998158e00 2023-05-16T13:55:10.106 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.099+0000 7f699ecf2640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69980ca030 con 0x7f6998070420 2023-05-16T13:55:10.106 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.099+0000 7f699ecf2640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f699815c890 con 0x7f69980aff50 2023-05-16T13:55:10.107 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.099+0000 7f699ca8e640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f6998158e00 0x7f69980c9530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:51108/0 (socket says 172.21.15.39:51108) 2023-05-16T13:55:10.107 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.099+0000 7f699ca8e640 1 -- 172.21.15.39:0/488115185 learned_addr learned my addr 172.21.15.39:0/488115185 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:55:10.107 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.099+0000 7f699d28f640 1 --2- 172.21.15.39:0/488115185 >> v2:172.21.15.39:3300/0 conn(0x7f6998070420 0x7f6998070880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:10.107 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.099+0000 7f6997fff640 1 --2- 172.21.15.39:0/488115185 >> v2:172.21.15.118:3300/0 conn(0x7f69980aff50 0x7f69980b0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:10.108 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.099+0000 7f69977fe640 1 -- 172.21.15.39:0/488115185 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 683425752 0 0) 0x7f69980b08c0 con 0x7f6998158e00 2023-05-16T13:55:10.108 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.099+0000 7f69977fe640 1 -- 172.21.15.39:0/488115185 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6988005740 con 0x7f6998158e00 2023-05-16T13:55:10.108 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.099+0000 7f699d28f640 1 -- 172.21.15.39:0/488115185 >> v2:172.21.15.118:3300/0 conn(0x7f69980aff50 msgr2=0x7f69980b0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:10.108 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.099+0000 7f699d28f640 1 --2- 172.21.15.39:0/488115185 >> v2:172.21.15.118:3300/0 conn(0x7f69980aff50 0x7f69980b0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:10.108 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.099+0000 7f699d28f640 1 -- 172.21.15.39:0/488115185 >> v1:172.21.15.39:6789/0 conn(0x7f6998158e00 legacy=0x7f69980c9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:10.108 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.099+0000 7f699d28f640 1 -- 172.21.15.39:0/488115185 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f699815cb70 con 0x7f6998070420 2023-05-16T13:55:10.109 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.103+0000 7f699d28f640 1 --2- 172.21.15.39:0/488115185 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6998070420 0x7f6998070880 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f699806dd90 tx=0x7f699001f0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2abe3d9834834514 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:10.110 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.103+0000 7f69977fe640 1 -- 172.21.15.39:0/488115185 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69900b0440 con 0x7f6998070420 2023-05-16T13:55:10.110 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.103+0000 7f69977fe640 1 -- 172.21.15.39:0/488115185 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69900b05a0 con 0x7f6998070420 2023-05-16T13:55:10.110 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.103+0000 7f69977fe640 1 -- 172.21.15.39:0/488115185 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69900b0930 con 0x7f6998070420 2023-05-16T13:55:10.111 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.103+0000 7f699ecf2640 1 -- 172.21.15.39:0/488115185 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6998070420 msgr2=0x7f6998070880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:10.111 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.103+0000 7f699ecf2640 1 --2- 172.21.15.39:0/488115185 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6998070420 0x7f6998070880 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f699806dd90 tx=0x7f699001f0f0 comp rx=0 tx=0).stop 2023-05-16T13:55:10.111 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.103+0000 7f699ecf2640 1 -- 172.21.15.39:0/488115185 shutdown_connections 2023-05-16T13:55:10.111 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.103+0000 7f699ecf2640 1 --2- 172.21.15.39:0/488115185 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6998070420 0x7f6998070880 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:10.111 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.103+0000 7f699ecf2640 1 --2- 172.21.15.39:0/488115185 >> v2:172.21.15.118:3300/0 conn(0x7f69980aff50 0x7f69980b0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:10.111 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.103+0000 7f699ecf2640 1 -- 172.21.15.39:0/488115185 >> 172.21.15.39:0/488115185 conn(0x7f6998069a50 msgr2=0x7f6998069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:10.111 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.103+0000 7f699ecf2640 1 -- 172.21.15.39:0/488115185 shutdown_connections 2023-05-16T13:55:10.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.103+0000 7f699ecf2640 1 -- 172.21.15.39:0/488115185 wait complete. 2023-05-16T13:55:10.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.103+0000 7f699ecf2640 1 Processor -- start 2023-05-16T13:55:10.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.103+0000 7f699ecf2640 1 -- start start 2023-05-16T13:55:10.113 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.107+0000 7f699ecf2640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6998070420 0x7f69980c5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:10.113 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.107+0000 7f699ecf2640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69980aff50 0x7f6998147120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:10.114 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.107+0000 7f699ecf2640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6998158e00 0x7f69980c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:10.114 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.107+0000 7f699ecf2640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69980c5db0 con 0x7f69980aff50 2023-05-16T13:55:10.114 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.107+0000 7f699ecf2640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69980c6090 con 0x7f6998070420 2023-05-16T13:55:10.114 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.107+0000 7f699ecf2640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6998146920 con 0x7f6998158e00 2023-05-16T13:55:10.114 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.107+0000 7f6997fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69980aff50 0x7f6998147120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:10.114 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.107+0000 7f6997fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69980aff50 0x7f6998147120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34900/0 (socket says 172.21.15.39:34900) 2023-05-16T13:55:10.114 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.107+0000 7f6997fff640 1 -- 172.21.15.39:0/1781907535 learned_addr learned my addr 172.21.15.39:0/1781907535 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:10.116 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.107+0000 7f699ca8e640 1 --2- 172.21.15.39:0/1781907535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6998070420 0x7f69980c5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:10.116 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.107+0000 7f699d28f640 1 --2- 172.21.15.39:0/1781907535 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6998158e00 0x7f69980c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:10.116 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.107+0000 7f6997fff640 1 -- 172.21.15.39:0/1781907535 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6998158e00 msgr2=0x7f69980c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:10.116 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.107+0000 7f6997fff640 1 --2- 172.21.15.39:0/1781907535 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6998158e00 0x7f69980c41c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:10.116 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.107+0000 7f6997fff640 1 -- 172.21.15.39:0/1781907535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6998070420 msgr2=0x7f69980c5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:10.116 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.107+0000 7f6997fff640 1 --2- 172.21.15.39:0/1781907535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6998070420 0x7f69980c5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:10.116 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.107+0000 7f6997fff640 1 -- 172.21.15.39:0/1781907535 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6990009a70 con 0x7f69980aff50 2023-05-16T13:55:10.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.107+0000 7f699ca8e640 1 --2- 172.21.15.39:0/1781907535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6998070420 0x7f69980c5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-16T13:55:10.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.107+0000 7f6997fff640 1 --2- 172.21.15.39:0/1781907535 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69980aff50 0x7f6998147120 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f698400e870 tx=0x7f698400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:10.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.107+0000 7f69957fa640 1 -- 172.21.15.39:0/1781907535 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6984009510 con 0x7f69980aff50 2023-05-16T13:55:10.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.107+0000 7f69957fa640 1 -- 172.21.15.39:0/1781907535 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f698400eec0 con 0x7f69980aff50 2023-05-16T13:55:10.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.107+0000 7f69957fa640 1 -- 172.21.15.39:0/1781907535 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f698400cb40 con 0x7f69980aff50 2023-05-16T13:55:10.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.107+0000 7f699ecf2640 1 -- 172.21.15.39:0/1781907535 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f699815d130 con 0x7f69980aff50 2023-05-16T13:55:10.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.107+0000 7f699ecf2640 1 -- 172.21.15.39:0/1781907535 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f699815ce50 con 0x7f69980aff50 2023-05-16T13:55:10.118 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.107+0000 7f699ecf2640 1 -- 172.21.15.39:0/1781907535 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69980cc730 con 0x7f69980aff50 2023-05-16T13:55:10.118 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.107+0000 7f69957fa640 1 -- 172.21.15.39:0/1781907535 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f698400cca0 con 0x7f69980aff50 2023-05-16T13:55:10.118 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.111+0000 7f69957fa640 1 --2- 172.21.15.39:0/1781907535 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f697c066280 0x7f697c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:10.118 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.111+0000 7f69957fa640 1 -- 172.21.15.39:0/1781907535 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f6984083df0 con 0x7f69980aff50 2023-05-16T13:55:10.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.111+0000 7f699ca8e640 1 --2- 172.21.15.39:0/1781907535 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f697c066280 0x7f697c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:10.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.111+0000 7f699ca8e640 1 --2- 172.21.15.39:0/1781907535 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f697c066280 0x7f697c068730 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f698c005890 tx=0x7f698c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:10.122 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.115+0000 7f69957fa640 1 -- 172.21.15.39:0/1781907535 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f69840512c0 con 0x7f69980aff50 2023-05-16T13:55:10.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.267+0000 7f699ecf2640 1 -- 172.21.15.39:0/1781907535 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6998073c90 con 0x7f69980aff50 2023-05-16T13:55:10.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.267+0000 7f69957fa640 1 -- 172.21.15.39:0/1781907535 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f69840170a0 con 0x7f69980aff50 2023-05-16T13:55:10.277 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 64 2023-05-16T13:55:10.279 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.271+0000 7f699ecf2640 1 -- 172.21.15.39:0/1781907535 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f697c066280 msgr2=0x7f697c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:10.279 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.271+0000 7f699ecf2640 1 --2- 172.21.15.39:0/1781907535 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f697c066280 0x7f697c068730 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f698c005890 tx=0x7f698c009040 comp rx=0 tx=0).stop 2023-05-16T13:55:10.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.271+0000 7f699ecf2640 1 -- 172.21.15.39:0/1781907535 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69980aff50 msgr2=0x7f6998147120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:10.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.271+0000 7f699ecf2640 1 --2- 172.21.15.39:0/1781907535 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69980aff50 0x7f6998147120 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f698400e870 tx=0x7f698400ec70 comp rx=0 tx=0).stop 2023-05-16T13:55:10.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.271+0000 7f699ecf2640 1 -- 172.21.15.39:0/1781907535 shutdown_connections 2023-05-16T13:55:10.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.271+0000 7f699ecf2640 1 --2- 172.21.15.39:0/1781907535 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f697c066280 0x7f697c068730 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:10.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.271+0000 7f699ecf2640 1 --2- 172.21.15.39:0/1781907535 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6998158e00 0x7f69980c41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:10.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.271+0000 7f699ecf2640 1 --2- 172.21.15.39:0/1781907535 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69980aff50 0x7f6998147120 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:10.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.271+0000 7f699ecf2640 1 --2- 172.21.15.39:0/1781907535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6998070420 0x7f69980c5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:10.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.271+0000 7f699ecf2640 1 -- 172.21.15.39:0/1781907535 >> 172.21.15.39:0/1781907535 conn(0x7f6998069a50 msgr2=0x7f69981554e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:10.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.271+0000 7f699ecf2640 1 -- 172.21.15.39:0/1781907535 shutdown_connections 2023-05-16T13:55:10.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.271+0000 7f699ecf2640 1 -- 172.21.15.39:0/1781907535 wait complete. 2023-05-16T13:55:10.298 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-16T13:55:10.434 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.427+0000 7f4682812640 1 Processor -- start 2023-05-16T13:55:10.434 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.427+0000 7f4682812640 1 -- start start 2023-05-16T13:55:10.435 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.427+0000 7f4682812640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f467c0cd0c0 0x7f467c0cd490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:10.435 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.427+0000 7f4682812640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f467c0ced80 con 0x7f467c160d80 2023-05-16T13:55:10.436 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.427+0000 7f4682812640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f467c0cdbe0 con 0x7f467c08a3e0 2023-05-16T13:55:10.436 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.427+0000 7f4682812640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f467c0cd9d0 con 0x7f467c0cd0c0 2023-05-16T13:55:10.437 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.427+0000 7f4680daf640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f467c160d80 0x7f467c0afea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:51124/0 (socket says 172.21.15.39:51124) 2023-05-16T13:55:10.437 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.427+0000 7f4680daf640 1 -- 172.21.15.39:0/1537277675 learned_addr learned my addr 172.21.15.39:0/1537277675 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:55:10.437 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.427+0000 7f467bfff640 1 --2- 172.21.15.39:0/1537277675 >> v2:172.21.15.118:3300/0 conn(0x7f467c0cd0c0 0x7f467c0cd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:10.437 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.427+0000 7f467affd640 1 -- 172.21.15.39:0/1537277675 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 534082731 0 0) 0x7f46740014a0 con 0x7f467c160d80 2023-05-16T13:55:10.437 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.427+0000 7f467affd640 1 -- 172.21.15.39:0/1537277675 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4664003530 con 0x7f467c160d80 2023-05-16T13:55:10.437 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.427+0000 7f467affd640 1 -- 172.21.15.39:0/1537277675 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2772032823 0 0) 0x7f467c0cdbe0 con 0x7f467c08a3e0 2023-05-16T13:55:10.438 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.427+0000 7f467affd640 1 -- 172.21.15.39:0/1537277675 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46740014a0 con 0x7f467c08a3e0 2023-05-16T13:55:10.438 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.427+0000 7f467bfff640 1 -- 172.21.15.39:0/1537277675 >> v1:172.21.15.118:6789/0 conn(0x7f467c08a3e0 legacy=0x7f467c160670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:10.438 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.427+0000 7f467bfff640 1 -- 172.21.15.39:0/1537277675 >> v1:172.21.15.39:6789/0 conn(0x7f467c160d80 legacy=0x7f467c0afea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:10.438 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.427+0000 7f467bfff640 1 -- 172.21.15.39:0/1537277675 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f467c0ce580 con 0x7f467c0cd0c0 2023-05-16T13:55:10.439 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.431+0000 7f467bfff640 1 --2- 172.21.15.39:0/1537277675 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f467c0cd0c0 0x7f467c0cd490 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f466c0097c0 tx=0x7f466c01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14f4a6fb402b4e59 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:10.440 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.431+0000 7f467affd640 1 -- 172.21.15.39:0/1537277675 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466c0ab670 con 0x7f467c0cd0c0 2023-05-16T13:55:10.440 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.431+0000 7f467affd640 1 -- 172.21.15.39:0/1537277675 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f466c0ab7d0 con 0x7f467c0cd0c0 2023-05-16T13:55:10.440 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.431+0000 7f467affd640 1 -- 172.21.15.39:0/1537277675 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466c0abb60 con 0x7f467c0cd0c0 2023-05-16T13:55:10.441 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.431+0000 7f4682812640 1 -- 172.21.15.39:0/1537277675 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f467c0cd0c0 msgr2=0x7f467c0cd490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:10.441 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.431+0000 7f4682812640 1 --2- 172.21.15.39:0/1537277675 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f467c0cd0c0 0x7f467c0cd490 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f466c0097c0 tx=0x7f466c01c450 comp rx=0 tx=0).stop 2023-05-16T13:55:10.441 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.431+0000 7f4682812640 1 -- 172.21.15.39:0/1537277675 shutdown_connections 2023-05-16T13:55:10.441 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.431+0000 7f4682812640 1 --2- 172.21.15.39:0/1537277675 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f467c0cd0c0 0x7f467c0cd490 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:10.441 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.431+0000 7f4682812640 1 -- 172.21.15.39:0/1537277675 >> 172.21.15.39:0/1537277675 conn(0x7f467c089fe0 msgr2=0x7f467c0d05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:10.442 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.431+0000 7f4682812640 1 -- 172.21.15.39:0/1537277675 shutdown_connections 2023-05-16T13:55:10.442 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.431+0000 7f4682812640 1 -- 172.21.15.39:0/1537277675 wait complete. 2023-05-16T13:55:10.442 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.435+0000 7f4682812640 1 Processor -- start 2023-05-16T13:55:10.442 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.435+0000 7f4682812640 1 -- start start 2023-05-16T13:55:10.443 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.435+0000 7f4682812640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f467c08a3e0 0x7f467c0b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:10.444 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.435+0000 7f4682812640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f467c0cd0c0 0x7f467c150810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:10.444 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.435+0000 7f4682812640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f467c160d80 0x7f467c0b3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:10.444 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.435+0000 7f4682812640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467c0b3df0 con 0x7f467c160d80 2023-05-16T13:55:10.444 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.435+0000 7f4682812640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467c0b40d0 con 0x7f467c0cd0c0 2023-05-16T13:55:10.444 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.435+0000 7f4682812640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f467c0b43b0 con 0x7f467c08a3e0 2023-05-16T13:55:10.444 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.435+0000 7f4680daf640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f467c160d80 0x7f467c0b3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:10.445 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.435+0000 7f4680daf640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f467c160d80 0x7f467c0b3410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34904/0 (socket says 172.21.15.39:34904) 2023-05-16T13:55:10.445 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.435+0000 7f4680daf640 1 -- 172.21.15.39:0/833169215 learned_addr learned my addr 172.21.15.39:0/833169215 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:10.446 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.435+0000 7f467bfff640 1 --2- 172.21.15.39:0/833169215 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f467c08a3e0 0x7f467c0b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:10.446 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.435+0000 7f467b7fe640 1 --2- 172.21.15.39:0/833169215 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f467c0cd0c0 0x7f467c150810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:10.446 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.435+0000 7f4680daf640 1 -- 172.21.15.39:0/833169215 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f467c08a3e0 msgr2=0x7f467c0b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:10.446 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.435+0000 7f4680daf640 1 --2- 172.21.15.39:0/833169215 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f467c08a3e0 0x7f467c0b4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:10.446 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.435+0000 7f4680daf640 1 -- 172.21.15.39:0/833169215 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f467c0cd0c0 msgr2=0x7f467c150810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:10.446 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.435+0000 7f4680daf640 1 --2- 172.21.15.39:0/833169215 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f467c0cd0c0 0x7f467c150810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:10.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.435+0000 7f4680daf640 1 -- 172.21.15.39:0/833169215 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f466c009420 con 0x7f467c160d80 2023-05-16T13:55:10.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.435+0000 7f4680daf640 1 --2- 172.21.15.39:0/833169215 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f467c160d80 0x7f467c0b3410 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f467400cc30 tx=0x7f467400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:10.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.439+0000 7f4678ff9640 1 -- 172.21.15.39:0/833169215 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467400ce40 con 0x7f467c160d80 2023-05-16T13:55:10.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.439+0000 7f4678ff9640 1 -- 172.21.15.39:0/833169215 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4674012400 con 0x7f467c160d80 2023-05-16T13:55:10.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.439+0000 7f4678ff9640 1 -- 172.21.15.39:0/833169215 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4674012790 con 0x7f467c160d80 2023-05-16T13:55:10.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.439+0000 7f4682812640 1 -- 172.21.15.39:0/833169215 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f467c06bb70 con 0x7f467c160d80 2023-05-16T13:55:10.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.439+0000 7f4682812640 1 -- 172.21.15.39:0/833169215 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f467c0cdec0 con 0x7f467c160d80 2023-05-16T13:55:10.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.439+0000 7f4682812640 1 -- 172.21.15.39:0/833169215 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f467c06bd00 con 0x7f467c160d80 2023-05-16T13:55:10.448 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.439+0000 7f4678ff9640 1 -- 172.21.15.39:0/833169215 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4674007070 con 0x7f467c160d80 2023-05-16T13:55:10.448 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.439+0000 7f4678ff9640 1 --2- 172.21.15.39:0/833169215 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f4668066280 0x7f4668068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:10.448 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.439+0000 7f4678ff9640 1 -- 172.21.15.39:0/833169215 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f4674083d60 con 0x7f467c160d80 2023-05-16T13:55:10.449 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.439+0000 7f467bfff640 1 --2- 172.21.15.39:0/833169215 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f4668066280 0x7f4668068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:10.449 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.443+0000 7f467bfff640 1 --2- 172.21.15.39:0/833169215 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f4668066280 0x7f4668068730 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f466c0af000 tx=0x7f466c0a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:10.451 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.443+0000 7f4678ff9640 1 -- 172.21.15.39:0/833169215 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f4674051190 con 0x7f467c160d80 2023-05-16T13:55:10.640 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.631+0000 7f4682812640 1 -- 172.21.15.39:0/833169215 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f467c073c90 con 0x7f467c160d80 2023-05-16T13:55:10.641 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.631+0000 7f4678ff9640 1 -- 172.21.15.39:0/833169215 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4668 (secure 0 0 0) 0x7f4674017020 con 0x7f467c160d80 2023-05-16T13:55:10.641 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:55:10.641 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2374269620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":2374269620},{"type":"v1","addr":"172.21.15.118:6835","nonce":2374269620}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/3803055359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3803055359},{"type":"v1","addr":"172.21.15.118:6833","nonce":3803055359}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4308,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6836/3259535605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":3259535605},{"type":"v1","addr":"172.21.15.39:6836","nonce":3259535605}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-16T13:54:15.191894+0000","modified":"2023-05-16T13:54:18.210603+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4311},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4311":{"gid":4311,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.39:6837/616280162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6835","nonce":616280162},{"type":"v1","addr":"172.21.15.39:6837","nonce":616280162}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-16T13:55:10.641 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 8 2023-05-16T13:55:10.642 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.635+0000 7f4682812640 1 -- 172.21.15.39:0/833169215 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f4668066280 msgr2=0x7f4668068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:10.643 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.635+0000 7f4682812640 1 --2- 172.21.15.39:0/833169215 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f4668066280 0x7f4668068730 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f466c0af000 tx=0x7f466c0a7000 comp rx=0 tx=0).stop 2023-05-16T13:55:10.643 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.635+0000 7f4682812640 1 -- 172.21.15.39:0/833169215 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f467c160d80 msgr2=0x7f467c0b3410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:10.643 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.635+0000 7f4682812640 1 --2- 172.21.15.39:0/833169215 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f467c160d80 0x7f467c0b3410 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f467400cc30 tx=0x7f467400a430 comp rx=0 tx=0).stop 2023-05-16T13:55:10.643 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.635+0000 7f4682812640 1 -- 172.21.15.39:0/833169215 shutdown_connections 2023-05-16T13:55:10.643 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.635+0000 7f4682812640 1 --2- 172.21.15.39:0/833169215 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f467c160d80 0x7f467c0b3410 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:10.643 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.635+0000 7f4682812640 1 --2- 172.21.15.39:0/833169215 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f467c0cd0c0 0x7f467c150810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:10.644 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.635+0000 7f4682812640 1 --2- 172.21.15.39:0/833169215 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f4668066280 0x7f4668068730 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:10.644 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.635+0000 7f4682812640 1 --2- 172.21.15.39:0/833169215 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f467c08a3e0 0x7f467c0b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:10.644 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.635+0000 7f4682812640 1 -- 172.21.15.39:0/833169215 >> 172.21.15.39:0/833169215 conn(0x7f467c089fe0 msgr2=0x7f467c06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:10.644 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.635+0000 7f4682812640 1 -- 172.21.15.39:0/833169215 shutdown_connections 2023-05-16T13:55:10.644 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.635+0000 7f4682812640 1 -- 172.21.15.39:0/833169215 wait complete. 2023-05-16T13:55:10.662 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-16T13:55:10.799 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.791+0000 7f3603e41640 1 Processor -- start 2023-05-16T13:55:10.800 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.791+0000 7f3603e41640 1 -- start start 2023-05-16T13:55:10.800 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.791+0000 7f3603e41640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f35fc158bf0 0x7f35fc15d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:10.800 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.791+0000 7f3603e41640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35fc15d6a0 con 0x7f35fc0703b0 2023-05-16T13:55:10.801 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.791+0000 7f3603e41640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35fc070870 con 0x7f35fc0cb4c0 2023-05-16T13:55:10.801 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.791+0000 7f3603e41640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35fc070b50 con 0x7f35fc158bf0 2023-05-16T13:55:10.802 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.795+0000 7f36013dc640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f35fc0703b0 0x7f35fc0cadb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:40382/0 (socket says 172.21.15.39:40382) 2023-05-16T13:55:10.802 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.795+0000 7f36013dc640 1 -- 172.21.15.39:0/2478841214 learned_addr learned my addr 172.21.15.39:0/2478841214 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:55:10.802 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.795+0000 7f3601bdd640 1 --2- 172.21.15.39:0/2478841214 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f35fc158bf0 0x7f35fc15d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:10.802 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.795+0000 7f3600bdb640 1 -- 172.21.15.39:0/2478841214 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1362802733 0 0) 0x7f35ec001120 con 0x7f35fc0703b0 2023-05-16T13:55:10.802 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.795+0000 7f3600bdb640 1 -- 172.21.15.39:0/2478841214 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35e8003530 con 0x7f35fc0703b0 2023-05-16T13:55:10.802 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.795+0000 7f3601bdd640 1 -- 172.21.15.39:0/2478841214 >> v1:172.21.15.118:6789/0 conn(0x7f35fc0cb4c0 legacy=0x7f35fc0ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:10.802 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.795+0000 7f3600bdb640 1 -- 172.21.15.39:0/2478841214 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 376176580 0 0) 0x7f35fc070870 con 0x7f35fc0cb4c0 2023-05-16T13:55:10.803 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.795+0000 7f3601bdd640 1 -- 172.21.15.39:0/2478841214 >> v1:172.21.15.39:6789/0 conn(0x7f35fc0703b0 legacy=0x7f35fc0cadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:10.803 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.795+0000 7f3601bdd640 1 -- 172.21.15.39:0/2478841214 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35fc070e30 con 0x7f35fc158bf0 2023-05-16T13:55:10.804 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.795+0000 7f3601bdd640 1 --2- 172.21.15.39:0/2478841214 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f35fc158bf0 0x7f35fc15d160 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f35f80097f0 tx=0x7f35f801c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa419b686981388b server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:10.804 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.795+0000 7f3600bdb640 1 -- 172.21.15.39:0/2478841214 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f80ab600 con 0x7f35fc158bf0 2023-05-16T13:55:10.805 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.795+0000 7f3600bdb640 1 -- 172.21.15.39:0/2478841214 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35f80ab760 con 0x7f35fc158bf0 2023-05-16T13:55:10.805 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.795+0000 7f3600bdb640 1 -- 172.21.15.39:0/2478841214 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f80abad0 con 0x7f35fc158bf0 2023-05-16T13:55:10.805 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.799+0000 7f3603e41640 1 -- 172.21.15.39:0/2478841214 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f35fc158bf0 msgr2=0x7f35fc15d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:10.806 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.799+0000 7f3603e41640 1 --2- 172.21.15.39:0/2478841214 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f35fc158bf0 0x7f35fc15d160 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f35f80097f0 tx=0x7f35f801c400 comp rx=0 tx=0).stop 2023-05-16T13:55:10.806 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.799+0000 7f3603e41640 1 -- 172.21.15.39:0/2478841214 shutdown_connections 2023-05-16T13:55:10.806 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.799+0000 7f3603e41640 1 --2- 172.21.15.39:0/2478841214 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f35fc158bf0 0x7f35fc15d160 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:10.806 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.799+0000 7f3603e41640 1 -- 172.21.15.39:0/2478841214 >> 172.21.15.39:0/2478841214 conn(0x7f35fc069a50 msgr2=0x7f35fc069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:10.806 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.799+0000 7f3603e41640 1 -- 172.21.15.39:0/2478841214 shutdown_connections 2023-05-16T13:55:10.806 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.799+0000 7f3603e41640 1 -- 172.21.15.39:0/2478841214 wait complete. 2023-05-16T13:55:10.807 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.799+0000 7f3603e41640 1 Processor -- start 2023-05-16T13:55:10.807 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.799+0000 7f3603e41640 1 -- start start 2023-05-16T13:55:10.808 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.799+0000 7f3603e41640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f35fc0703b0 0x7f35fc0b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:10.808 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.799+0000 7f3603e41640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35fc0cb4c0 0x7f35fc159410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:10.809 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.799+0000 7f3603e41640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f35fc158bf0 0x7f35fc0c4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:10.809 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.799+0000 7f3603e41640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35fc0b2d60 con 0x7f35fc158bf0 2023-05-16T13:55:10.809 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.799+0000 7f3603e41640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35fc0b40e0 con 0x7f35fc0cb4c0 2023-05-16T13:55:10.809 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.799+0000 7f3603e41640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35fc0adc10 con 0x7f35fc0703b0 2023-05-16T13:55:10.809 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.799+0000 7f36023de640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f35fc158bf0 0x7f35fc0c4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:10.809 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.799+0000 7f3601bdd640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f35fc0703b0 0x7f35fc0b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:10.809 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.799+0000 7f36013dc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35fc0cb4c0 0x7f35fc159410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:10.809 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.799+0000 7f3601bdd640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f35fc0703b0 0x7f35fc0b3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.39:44876/0 (socket says 172.21.15.39:44876) 2023-05-16T13:55:10.810 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.799+0000 7f36023de640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f35fc158bf0 0x7f35fc0c4a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42486/0 (socket says 172.21.15.39:42486) 2023-05-16T13:55:10.810 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.799+0000 7f3601bdd640 1 -- 172.21.15.39:0/3476226467 learned_addr learned my addr 172.21.15.39:0/3476226467 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:10.811 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.803+0000 7f36023de640 1 -- 172.21.15.39:0/3476226467 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f35fc0703b0 msgr2=0x7f35fc0b3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:10.811 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.803+0000 7f36023de640 1 --2- 172.21.15.39:0/3476226467 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f35fc0703b0 0x7f35fc0b3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:10.811 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.803+0000 7f36023de640 1 -- 172.21.15.39:0/3476226467 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35fc0cb4c0 msgr2=0x7f35fc159410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:10.811 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.803+0000 7f36023de640 1 --2- 172.21.15.39:0/3476226467 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35fc0cb4c0 0x7f35fc159410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:10.811 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.803+0000 7f36023de640 1 -- 172.21.15.39:0/3476226467 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35f8009420 con 0x7f35fc158bf0 2023-05-16T13:55:10.811 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.803+0000 7f36023de640 1 --2- 172.21.15.39:0/3476226467 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f35fc158bf0 0x7f35fc0c4a60 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f35f400c750 tx=0x7f35f400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:10.812 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.803+0000 7f35f27fc640 1 -- 172.21.15.39:0/3476226467 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f4003bb0 con 0x7f35fc158bf0 2023-05-16T13:55:10.812 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.803+0000 7f35f27fc640 1 -- 172.21.15.39:0/3476226467 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35f4003d30 con 0x7f35fc158bf0 2023-05-16T13:55:10.812 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.803+0000 7f35f27fc640 1 -- 172.21.15.39:0/3476226467 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f4003ea0 con 0x7f35fc158bf0 2023-05-16T13:55:10.812 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.803+0000 7f3603e41640 1 -- 172.21.15.39:0/3476226467 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35fc0ad950 con 0x7f35fc158bf0 2023-05-16T13:55:10.812 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.803+0000 7f3603e41640 1 -- 172.21.15.39:0/3476226467 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35fc158fc0 con 0x7f35fc158bf0 2023-05-16T13:55:10.812 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.803+0000 7f3603e41640 1 -- 172.21.15.39:0/3476226467 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35fc0cdcc0 con 0x7f35fc158bf0 2023-05-16T13:55:10.813 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.803+0000 7f35f27fc640 1 -- 172.21.15.39:0/3476226467 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f35f40052b0 con 0x7f35fc158bf0 2023-05-16T13:55:10.813 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.803+0000 7f35f27fc640 1 --2- 172.21.15.39:0/3476226467 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f35e00662b0 0x7f35e0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:10.813 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.803+0000 7f35f27fc640 1 -- 172.21.15.39:0/3476226467 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f35f4083940 con 0x7f35fc158bf0 2023-05-16T13:55:10.813 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.803+0000 7f3601bdd640 1 --2- 172.21.15.39:0/3476226467 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f35e00662b0 0x7f35e0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:10.814 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.807+0000 7f3601bdd640 1 --2- 172.21.15.39:0/3476226467 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f35e00662b0 0x7f35e0068760 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f35f80ad040 tx=0x7f35f80b6040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:10.816 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.807+0000 7f35f27fc640 1 -- 172.21.15.39:0/3476226467 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f35f4050e30 con 0x7f35fc158bf0 2023-05-16T13:55:10.974 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.967+0000 7f3603e41640 1 -- 172.21.15.39:0/3476226467 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f35fc073c90 con 0x7f35fc158bf0 2023-05-16T13:55:10.975 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.967+0000 7f35f27fc640 1 -- 172.21.15.39:0/3476226467 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18375 (secure 0 0 0) 0x7f35f4054450 con 0x7f35fc158bf0 2023-05-16T13:55:10.975 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:55:10.975 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":26,"fsid":"9c1e210b-c515-4ea4-a065-397956895c68","created":"2023-05-16T13:53:48.955290+0000","modified":"2023-05-16T13:54:56.831431+0000","last_up_change":"2023-05-16T13:54:01.722051+0000","last_in_change":"2023-05-16T13:53:52.331336+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-16T13:54:00.885009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-16T13:54:08.327895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-16T13:54:12.864823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-16T13:54:14.180225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4ce0f0ba-c4bf-4405-8c95-d2e9a62878ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6809","nonce":3462013698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6811","nonce":3462013698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6815","nonce":3462013698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6813","nonce":3462013698}]},"public_addr":"172.21.15.39:6809/3462013698","cluster_addr":"172.21.15.39:6811/3462013698","heartbeat_back_addr":"172.21.15.39:6815/3462013698","heartbeat_front_addr":"172.21.15.39:6813/3462013698","state":["exists","up"]},{"osd":1,"uuid":"53fdc1ac-2473-472d-af32-2760fdf6e476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6801","nonce":2829970892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6803","nonce":2829970892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6807","nonce":2829970892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6805","nonce":2829970892}]},"public_addr":"172.21.15.39:6801/2829970892","cluster_addr":"172.21.15.39:6803/2829970892","heartbeat_back_addr":"172.21.15.39:6807/2829970892","heartbeat_front_addr":"172.21.15.39:6805/2829970892","state":["exists","up"]},{"osd":2,"uuid":"0b92d770-7030-42fa-a19f-4f7f1ac113c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6817","nonce":3888067413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6819","nonce":3888067413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6823","nonce":3888067413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6821","nonce":3888067413}]},"public_addr":"172.21.15.39:6817/3888067413","cluster_addr":"172.21.15.39:6819/3888067413","heartbeat_back_addr":"172.21.15.39:6823/3888067413","heartbeat_front_addr":"172.21.15.39:6821/3888067413","state":["exists","up"]},{"osd":3,"uuid":"000d9506-cbb2-4017-b875-deca579860ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6825","nonce":405003958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6827","nonce":405003958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6831","nonce":405003958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6829","nonce":405003958}]},"public_addr":"172.21.15.39:6825/405003958","cluster_addr":"172.21.15.39:6827/405003958","heartbeat_back_addr":"172.21.15.39:6831/405003958","heartbeat_front_addr":"172.21.15.39:6829/405003958","state":["exists","up"]},{"osd":4,"uuid":"70f0dacb-e960-40c5-bf6a-183e52bbe2ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6801","nonce":3895278838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6805","nonce":3895278838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6813","nonce":3895278838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6809","nonce":3895278838}]},"public_addr":"172.21.15.118:6801/3895278838","cluster_addr":"172.21.15.118:6805/3895278838","heartbeat_back_addr":"172.21.15.118:6813/3895278838","heartbeat_front_addr":"172.21.15.118:6809/3895278838","state":["exists","up"]},{"osd":5,"uuid":"756feb54-c3ae-4a2a-8f74-85c291ba707c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6804","nonce":3513592808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6808","nonce":3513592808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6815","nonce":3513592808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6812","nonce":3513592808}]},"public_addr":"172.21.15.118:6804/3513592808","cluster_addr":"172.21.15.118:6808/3513592808","heartbeat_back_addr":"172.21.15.118:6815/3513592808","heartbeat_front_addr":"172.21.15.118:6812/3513592808","state":["exists","up"]},{"osd":6,"uuid":"c4a982c1-f497-4b0f-8a23-c77372e4621e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6824","nonce":1863656053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6827","nonce":1863656053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6831","nonce":1863656053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6829","nonce":1863656053}]},"public_addr":"172.21.15.118:6824/1863656053","cluster_addr":"172.21.15.118:6827/1863656053","heartbeat_back_addr":"172.21.15.118:6831/1863656053","heartbeat_front_addr":"172.21.15.118:6829/1863656053","state":["exists","up"]},{"osd":7,"uuid":"6f2888aa-a7ac-4e26-9159-e31817934f44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6817","nonce":3636642904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6819","nonce":3636642904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6825","nonce":3636642904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6821","nonce":3636642904}]},"public_addr":"172.21.15.118:6817/3636642904","cluster_addr":"172.21.15.118:6819/3636642904","heartbeat_back_addr":"172.21.15.118:6825/3636642904","heartbeat_front_addr":"172.21.15.118:6821/3636642904","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.717636+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.724036+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.739144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:58.079275+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:58.073921+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.930466+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.987813+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.941098+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.24","mappings":[{"from":1,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-16T13:55:10.977 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.971+0000 7f3603e41640 1 -- 172.21.15.39:0/3476226467 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f35e00662b0 msgr2=0x7f35e0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:10.977 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.971+0000 7f3603e41640 1 --2- 172.21.15.39:0/3476226467 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f35e00662b0 0x7f35e0068760 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f35f80ad040 tx=0x7f35f80b6040 comp rx=0 tx=0).stop 2023-05-16T13:55:10.977 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.971+0000 7f3603e41640 1 -- 172.21.15.39:0/3476226467 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f35fc158bf0 msgr2=0x7f35fc0c4a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:10.977 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.971+0000 7f3603e41640 1 --2- 172.21.15.39:0/3476226467 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f35fc158bf0 0x7f35fc0c4a60 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f35f400c750 tx=0x7f35f400cc10 comp rx=0 tx=0).stop 2023-05-16T13:55:10.977 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.971+0000 7f3603e41640 1 -- 172.21.15.39:0/3476226467 shutdown_connections 2023-05-16T13:55:10.978 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.971+0000 7f3603e41640 1 --2- 172.21.15.39:0/3476226467 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f35fc158bf0 0x7f35fc0c4a60 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:10.978 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.971+0000 7f3603e41640 1 --2- 172.21.15.39:0/3476226467 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f35fc0cb4c0 0x7f35fc159410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:10.978 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.971+0000 7f3603e41640 1 --2- 172.21.15.39:0/3476226467 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f35e00662b0 0x7f35e0068760 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:10.978 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.971+0000 7f3603e41640 1 --2- 172.21.15.39:0/3476226467 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f35fc0703b0 0x7f35fc0b3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:10.978 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.971+0000 7f3603e41640 1 -- 172.21.15.39:0/3476226467 >> 172.21.15.39:0/3476226467 conn(0x7f35fc069a50 msgr2=0x7f35fc0ad120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:10.978 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.971+0000 7f3603e41640 1 -- 172.21.15.39:0/3476226467 shutdown_connections 2023-05-16T13:55:10.978 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:10.971+0000 7f3603e41640 1 -- 172.21.15.39:0/3476226467 wait complete. 2023-05-16T13:55:10.996 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-05-16T13:55:10.996 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-16T13:55:11.133 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.127+0000 7f9d98895640 1 Processor -- start 2023-05-16T13:55:11.134 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.127+0000 7f9d98895640 1 -- start start 2023-05-16T13:55:11.135 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.127+0000 7f9d98895640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9d940b5670 0x7f9d940b42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:11.135 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.127+0000 7f9d98895640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d940ce150 con 0x7f9d9415c470 2023-05-16T13:55:11.135 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.127+0000 7f9d98895640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d940cd890 con 0x7f9d940b5ae0 2023-05-16T13:55:11.135 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.127+0000 7f9d98895640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d940cdb00 con 0x7f9d940b5670 2023-05-16T13:55:11.135 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.127+0000 7f9d9259c640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f9d9415c470 0x7f9d940d0720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:40388/0 (socket says 172.21.15.39:40388) 2023-05-16T13:55:11.135 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.127+0000 7f9d9259c640 1 -- 172.21.15.39:0/3048881192 learned_addr learned my addr 172.21.15.39:0/3048881192 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:55:11.136 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.127+0000 7f9d91d9b640 1 --2- 172.21.15.39:0/3048881192 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9d940b5670 0x7f9d940b42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:11.136 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.127+0000 7f9d9159a640 1 -- 172.21.15.39:0/3048881192 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3115640194 0 0) 0x7f9d940ce150 con 0x7f9d9415c470 2023-05-16T13:55:11.136 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.127+0000 7f9d9159a640 1 -- 172.21.15.39:0/3048881192 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d7c003530 con 0x7f9d9415c470 2023-05-16T13:55:11.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.127+0000 7f9d9159a640 1 -- 172.21.15.39:0/3048881192 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1699648840 0 0) 0x7f9d940cd890 con 0x7f9d940b5ae0 2023-05-16T13:55:11.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.127+0000 7f9d9159a640 1 -- 172.21.15.39:0/3048881192 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d940ce150 con 0x7f9d940b5ae0 2023-05-16T13:55:11.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.127+0000 7f9d9159a640 1 -- 172.21.15.39:0/3048881192 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2691767859 0 0) 0x7f9d7c003530 con 0x7f9d9415c470 2023-05-16T13:55:11.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.127+0000 7f9d91d9b640 1 -- 172.21.15.39:0/3048881192 >> v1:172.21.15.118:6789/0 conn(0x7f9d940b5ae0 legacy=0x7f9d940ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:11.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.127+0000 7f9d91d9b640 1 -- 172.21.15.39:0/3048881192 >> v1:172.21.15.39:6789/0 conn(0x7f9d9415c470 legacy=0x7f9d940d0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:11.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.127+0000 7f9d91d9b640 1 -- 172.21.15.39:0/3048881192 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d940cdde0 con 0x7f9d940b5670 2023-05-16T13:55:11.138 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.131+0000 7f9d91d9b640 1 --2- 172.21.15.39:0/3048881192 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9d940b5670 0x7f9d940b42a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9d880097f0 tx=0x7f9d8801c380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f53f240d33b7221a server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:11.139 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.131+0000 7f9d9159a640 1 -- 172.21.15.39:0/3048881192 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d84001800 con 0x7f9d940b5670 2023-05-16T13:55:11.139 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.131+0000 7f9d9159a640 1 -- 172.21.15.39:0/3048881192 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d880a7050 con 0x7f9d940b5670 2023-05-16T13:55:11.139 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.131+0000 7f9d9159a640 1 -- 172.21.15.39:0/3048881192 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d880ab600 con 0x7f9d940b5670 2023-05-16T13:55:11.140 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.131+0000 7f9d98895640 1 -- 172.21.15.39:0/3048881192 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9d940b5670 msgr2=0x7f9d940b42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:11.140 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.131+0000 7f9d98895640 1 --2- 172.21.15.39:0/3048881192 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9d940b5670 0x7f9d940b42a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9d880097f0 tx=0x7f9d8801c380 comp rx=0 tx=0).stop 2023-05-16T13:55:11.140 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.131+0000 7f9d98895640 1 -- 172.21.15.39:0/3048881192 shutdown_connections 2023-05-16T13:55:11.140 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.131+0000 7f9d98895640 1 --2- 172.21.15.39:0/3048881192 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9d940b5670 0x7f9d940b42a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:11.140 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.131+0000 7f9d98895640 1 -- 172.21.15.39:0/3048881192 >> 172.21.15.39:0/3048881192 conn(0x7f9d9409bae0 msgr2=0x7f9d940d2820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:11.141 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.131+0000 7f9d98895640 1 -- 172.21.15.39:0/3048881192 shutdown_connections 2023-05-16T13:55:11.141 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.131+0000 7f9d98895640 1 -- 172.21.15.39:0/3048881192 wait complete. 2023-05-16T13:55:11.141 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.135+0000 7f9d98895640 1 Processor -- start 2023-05-16T13:55:11.141 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.135+0000 7f9d98895640 1 -- start start 2023-05-16T13:55:11.143 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.135+0000 7f9d98895640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9d940b5670 0x7f9d9414daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:11.143 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.135+0000 7f9d98895640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9d940b5ae0 0x7f9d941586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:11.143 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.135+0000 7f9d98895640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d9415c470 0x7f9d9415b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:11.143 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.135+0000 7f9d98895640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9414b460 con 0x7f9d940b5670 2023-05-16T13:55:11.143 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.135+0000 7f9d98895640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d940c5a60 con 0x7f9d9415c470 2023-05-16T13:55:11.143 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.135+0000 7f9d98895640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d940cb960 con 0x7f9d940b5ae0 2023-05-16T13:55:11.144 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.135+0000 7f9d9259c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9d940b5670 0x7f9d9414daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:11.144 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.135+0000 7f9d9259c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9d940b5670 0x7f9d9414daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42494/0 (socket says 172.21.15.39:42494) 2023-05-16T13:55:11.144 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.135+0000 7f9d9259c640 1 -- 172.21.15.39:0/271226561 learned_addr learned my addr 172.21.15.39:0/271226561 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:11.144 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.135+0000 7f9d92d9d640 1 --2- 172.21.15.39:0/271226561 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d9415c470 0x7f9d9415b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:11.144 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.135+0000 7f9d91d9b640 1 --2- 172.21.15.39:0/271226561 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9d940b5ae0 0x7f9d941586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:11.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.135+0000 7f9d9259c640 1 -- 172.21.15.39:0/271226561 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9d940b5ae0 msgr2=0x7f9d941586a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:11.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.135+0000 7f9d9259c640 1 --2- 172.21.15.39:0/271226561 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9d940b5ae0 0x7f9d941586a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:11.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.135+0000 7f9d9259c640 1 -- 172.21.15.39:0/271226561 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d9415c470 msgr2=0x7f9d9415b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:11.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.135+0000 7f9d9259c640 1 --2- 172.21.15.39:0/271226561 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d9415c470 0x7f9d9415b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:11.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.135+0000 7f9d9259c640 1 -- 172.21.15.39:0/271226561 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d88009420 con 0x7f9d940b5670 2023-05-16T13:55:11.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.135+0000 7f9d9259c640 1 --2- 172.21.15.39:0/271226561 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9d940b5670 0x7f9d9414daf0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f9d84001370 tx=0x7f9d8400cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:11.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.135+0000 7f9d82ffd640 1 -- 172.21.15.39:0/271226561 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d84007270 con 0x7f9d940b5670 2023-05-16T13:55:11.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.135+0000 7f9d82ffd640 1 -- 172.21.15.39:0/271226561 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d840073d0 con 0x7f9d940b5670 2023-05-16T13:55:11.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.135+0000 7f9d82ffd640 1 -- 172.21.15.39:0/271226561 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d840057b0 con 0x7f9d940b5670 2023-05-16T13:55:11.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.135+0000 7f9d98895640 1 -- 172.21.15.39:0/271226561 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d940d0ee0 con 0x7f9d940b5670 2023-05-16T13:55:11.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.135+0000 7f9d98895640 1 -- 172.21.15.39:0/271226561 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d940b4bf0 con 0x7f9d940b5670 2023-05-16T13:55:11.147 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.139+0000 7f9d98895640 1 -- 172.21.15.39:0/271226561 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d94073c90 con 0x7f9d940b5670 2023-05-16T13:55:11.147 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.139+0000 7f9d82ffd640 1 -- 172.21.15.39:0/271226561 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9d84005910 con 0x7f9d940b5670 2023-05-16T13:55:11.147 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.139+0000 7f9d82ffd640 1 --2- 172.21.15.39:0/271226561 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f9d74066280 0x7f9d74068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:11.147 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.139+0000 7f9d82ffd640 1 -- 172.21.15.39:0/271226561 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f9d84083430 con 0x7f9d940b5670 2023-05-16T13:55:11.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.139+0000 7f9d91d9b640 1 --2- 172.21.15.39:0/271226561 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f9d74066280 0x7f9d74068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:11.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.139+0000 7f9d91d9b640 1 --2- 172.21.15.39:0/271226561 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f9d74066280 0x7f9d74068730 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9d880ad000 tx=0x7f9d880a6000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:11.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.143+0000 7f9d82ffd640 1 -- 172.21.15.39:0/271226561 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f9d84050880 con 0x7f9d940b5670 2023-05-16T13:55:11.342 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.335+0000 7f9d98895640 1 -- 172.21.15.39:0/271226561 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9d940b4330 con 0x7f9d940b5670 2023-05-16T13:55:11.342 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.335+0000 7f9d82ffd640 1 -- 172.21.15.39:0/271226561 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4668 (secure 0 0 0) 0x7f9d84053ea0 con 0x7f9d940b5670 2023-05-16T13:55:11.343 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:55:11.343 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2374269620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":2374269620},{"type":"v1","addr":"172.21.15.118:6835","nonce":2374269620}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/3803055359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3803055359},{"type":"v1","addr":"172.21.15.118:6833","nonce":3803055359}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4308,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6836/3259535605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":3259535605},{"type":"v1","addr":"172.21.15.39:6836","nonce":3259535605}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-16T13:54:15.191894+0000","modified":"2023-05-16T13:54:18.210603+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4311},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4311":{"gid":4311,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.39:6837/616280162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6835","nonce":616280162},{"type":"v1","addr":"172.21.15.39:6837","nonce":616280162}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-16T13:55:11.343 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 8 2023-05-16T13:55:11.344 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.335+0000 7f9d98895640 1 -- 172.21.15.39:0/271226561 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f9d74066280 msgr2=0x7f9d74068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:11.345 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.335+0000 7f9d98895640 1 --2- 172.21.15.39:0/271226561 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f9d74066280 0x7f9d74068730 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9d880ad000 tx=0x7f9d880a6000 comp rx=0 tx=0).stop 2023-05-16T13:55:11.345 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.335+0000 7f9d98895640 1 -- 172.21.15.39:0/271226561 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9d940b5670 msgr2=0x7f9d9414daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:11.345 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.335+0000 7f9d98895640 1 --2- 172.21.15.39:0/271226561 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9d940b5670 0x7f9d9414daf0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f9d84001370 tx=0x7f9d8400cbe0 comp rx=0 tx=0).stop 2023-05-16T13:55:11.345 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.335+0000 7f9d98895640 1 -- 172.21.15.39:0/271226561 shutdown_connections 2023-05-16T13:55:11.345 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.335+0000 7f9d98895640 1 --2- 172.21.15.39:0/271226561 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f9d74066280 0x7f9d74068730 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:11.345 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.335+0000 7f9d98895640 1 --2- 172.21.15.39:0/271226561 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9d940b5ae0 0x7f9d941586a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:11.345 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.335+0000 7f9d98895640 1 --2- 172.21.15.39:0/271226561 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d9415c470 0x7f9d9415b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:11.346 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.335+0000 7f9d98895640 1 --2- 172.21.15.39:0/271226561 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9d940b5670 0x7f9d9414daf0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:11.346 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.335+0000 7f9d98895640 1 -- 172.21.15.39:0/271226561 >> 172.21.15.39:0/271226561 conn(0x7f9d9409bae0 msgr2=0x7f9d940b6a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:11.346 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.335+0000 7f9d98895640 1 -- 172.21.15.39:0/271226561 shutdown_connections 2023-05-16T13:55:11.346 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.335+0000 7f9d98895640 1 -- 172.21.15.39:0/271226561 wait complete. 2023-05-16T13:55:11.363 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-16T13:55:11.500 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.491+0000 7f11b1da6640 1 Processor -- start 2023-05-16T13:55:11.501 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.491+0000 7f11b1da6640 1 -- start start 2023-05-16T13:55:11.501 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.495+0000 7f11b1da6640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f11ac158bf0 0x7f11ac15d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:11.501 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.495+0000 7f11b1da6640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f11ac0cb4c0 0x7f11ac0ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:11.502 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.495+0000 7f11b1da6640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11ac15d6a0 con 0x7f11ac0703b0 2023-05-16T13:55:11.502 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.495+0000 7f11b1da6640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11ac070870 con 0x7f11ac0cb4c0 2023-05-16T13:55:11.502 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.495+0000 7f11b1da6640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11ac070b50 con 0x7f11ac158bf0 2023-05-16T13:55:11.502 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.495+0000 7f11abfff640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f11ac0cb4c0 0x7f11ac0ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:11.502 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.495+0000 7f11abfff640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f11ac0cb4c0 0x7f11ac0ccda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42506/0 (socket says 172.21.15.39:42506) 2023-05-16T13:55:11.502 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.495+0000 7f11abfff640 1 -- 172.21.15.39:0/4289136566 learned_addr learned my addr 172.21.15.39:0/4289136566 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:11.503 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.495+0000 7f11aaffd640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f11ac0703b0 0x7f11ac0cadb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:40400/0 (socket says 172.21.15.39:40400) 2023-05-16T13:55:11.503 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.495+0000 7f11ab7fe640 1 --2- 172.21.15.39:0/4289136566 >> v2:172.21.15.118:3300/0 conn(0x7f11ac158bf0 0x7f11ac15d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:11.503 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.495+0000 7f11abfff640 1 -- 172.21.15.39:0/4289136566 >> v2:172.21.15.118:3300/0 conn(0x7f11ac158bf0 msgr2=0x7f11ac15d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:11.504 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.495+0000 7f11abfff640 1 --2- 172.21.15.39:0/4289136566 >> v2:172.21.15.118:3300/0 conn(0x7f11ac158bf0 0x7f11ac15d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:11.504 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.495+0000 7f11abfff640 1 -- 172.21.15.39:0/4289136566 >> v1:172.21.15.39:6789/0 conn(0x7f11ac0703b0 legacy=0x7f11ac0cadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:11.504 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.495+0000 7f11abfff640 1 -- 172.21.15.39:0/4289136566 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11ac070e30 con 0x7f11ac0cb4c0 2023-05-16T13:55:11.504 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.495+0000 7f11aa7fc640 1 -- 172.21.15.39:0/4289136566 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3800822458 0 0) 0x7f11a0001120 con 0x7f11ac0703b0 2023-05-16T13:55:11.504 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.499+0000 7f11abfff640 1 --2- 172.21.15.39:0/4289136566 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f11ac0cb4c0 0x7f11ac0ccda0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f11ac0cbcb0 tx=0x7f11a401eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99394eac9dd56c2 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:11.505 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.499+0000 7f11aa7fc640 1 -- 172.21.15.39:0/4289136566 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a400b2d0 con 0x7f11ac0cb4c0 2023-05-16T13:55:11.505 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.499+0000 7f11aa7fc640 1 -- 172.21.15.39:0/4289136566 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11a400b430 con 0x7f11ac0cb4c0 2023-05-16T13:55:11.505 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.499+0000 7f11aa7fc640 1 -- 172.21.15.39:0/4289136566 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a40a7c00 con 0x7f11ac0cb4c0 2023-05-16T13:55:11.506 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.499+0000 7f11b1da6640 1 -- 172.21.15.39:0/4289136566 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f11ac0cb4c0 msgr2=0x7f11ac0ccda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:11.506 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.499+0000 7f11b1da6640 1 --2- 172.21.15.39:0/4289136566 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f11ac0cb4c0 0x7f11ac0ccda0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f11ac0cbcb0 tx=0x7f11a401eb10 comp rx=0 tx=0).stop 2023-05-16T13:55:11.506 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.499+0000 7f11b1da6640 1 -- 172.21.15.39:0/4289136566 shutdown_connections 2023-05-16T13:55:11.507 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.499+0000 7f11b1da6640 1 --2- 172.21.15.39:0/4289136566 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f11ac0cb4c0 0x7f11ac0ccda0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:11.507 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.499+0000 7f11b1da6640 1 --2- 172.21.15.39:0/4289136566 >> v2:172.21.15.118:3300/0 conn(0x7f11ac158bf0 0x7f11ac15d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:11.507 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.499+0000 7f11b1da6640 1 -- 172.21.15.39:0/4289136566 >> 172.21.15.39:0/4289136566 conn(0x7f11ac069a50 msgr2=0x7f11ac069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:11.507 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.499+0000 7f11b1da6640 1 -- 172.21.15.39:0/4289136566 shutdown_connections 2023-05-16T13:55:11.507 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.499+0000 7f11b1da6640 1 -- 172.21.15.39:0/4289136566 wait complete. 2023-05-16T13:55:11.510 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.499+0000 7f11b1da6640 1 Processor -- start 2023-05-16T13:55:11.510 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.499+0000 7f11b1da6640 1 -- start start 2023-05-16T13:55:11.512 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.499+0000 7f11b1da6640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f11ac0703b0 0x7f11ac14b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:11.512 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.499+0000 7f11b1da6640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f11ac0cb4c0 0x7f11ac1558f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:11.512 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.499+0000 7f11b1da6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f11ac158bf0 0x7f11ac0b23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:11.513 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.499+0000 7f11b1da6640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11ac153850 con 0x7f11ac158bf0 2023-05-16T13:55:11.513 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.499+0000 7f11b1da6640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11ac14baa0 con 0x7f11ac0703b0 2023-05-16T13:55:11.513 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.503+0000 7f11b1da6640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11ac152bd0 con 0x7f11ac0cb4c0 2023-05-16T13:55:11.513 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.503+0000 7f11abfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f11ac158bf0 0x7f11ac0b23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:11.513 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.503+0000 7f11abfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f11ac158bf0 0x7f11ac0b23d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42522/0 (socket says 172.21.15.39:42522) 2023-05-16T13:55:11.513 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.503+0000 7f11abfff640 1 -- 172.21.15.39:0/1720656773 learned_addr learned my addr 172.21.15.39:0/1720656773 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:11.513 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.503+0000 7f11ab7fe640 1 --2- 172.21.15.39:0/1720656773 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f11ac0703b0 0x7f11ac14b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:11.514 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.503+0000 7f11abfff640 1 -- 172.21.15.39:0/1720656773 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f11ac0cb4c0 msgr2=0x7f11ac1558f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:11.514 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.503+0000 7f11abfff640 1 --2- 172.21.15.39:0/1720656773 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f11ac0cb4c0 0x7f11ac1558f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:11.514 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.503+0000 7f11abfff640 1 -- 172.21.15.39:0/1720656773 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f11ac0703b0 msgr2=0x7f11ac14b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:11.514 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.503+0000 7f11abfff640 1 --2- 172.21.15.39:0/1720656773 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f11ac0703b0 0x7f11ac14b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:11.514 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.503+0000 7f11abfff640 1 -- 172.21.15.39:0/1720656773 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11a400bd40 con 0x7f11ac158bf0 2023-05-16T13:55:11.514 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.503+0000 7f11ab7fe640 1 --2- 172.21.15.39:0/1720656773 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f11ac0703b0 0x7f11ac14b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-16T13:55:11.514 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.503+0000 7f11abfff640 1 --2- 172.21.15.39:0/1720656773 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f11ac158bf0 0x7f11ac0b23d0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f11a40b1040 tx=0x7f11a401b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:11.514 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.503+0000 7f1193fff640 1 -- 172.21.15.39:0/1720656773 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a4003ba0 con 0x7f11ac158bf0 2023-05-16T13:55:11.515 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.503+0000 7f1193fff640 1 -- 172.21.15.39:0/1720656773 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11a4003d00 con 0x7f11ac158bf0 2023-05-16T13:55:11.515 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.503+0000 7f11b1da6640 1 -- 172.21.15.39:0/1720656773 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11ac0ad950 con 0x7f11ac158bf0 2023-05-16T13:55:11.515 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.503+0000 7f1193fff640 1 -- 172.21.15.39:0/1720656773 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a4004230 con 0x7f11ac158bf0 2023-05-16T13:55:11.515 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.503+0000 7f11b1da6640 1 -- 172.21.15.39:0/1720656773 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11ac158fc0 con 0x7f11ac158bf0 2023-05-16T13:55:11.515 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.503+0000 7f11b1da6640 1 -- 172.21.15.39:0/1720656773 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11ac0cdaf0 con 0x7f11ac158bf0 2023-05-16T13:55:11.515 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.503+0000 7f1193fff640 1 -- 172.21.15.39:0/1720656773 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f11a4004390 con 0x7f11ac158bf0 2023-05-16T13:55:11.516 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.503+0000 7f1193fff640 1 --2- 172.21.15.39:0/1720656773 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f1198066280 0x7f1198068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:11.516 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.507+0000 7f1193fff640 1 -- 172.21.15.39:0/1720656773 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f11a411f130 con 0x7f11ac158bf0 2023-05-16T13:55:11.516 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.507+0000 7f11ab7fe640 1 --2- 172.21.15.39:0/1720656773 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f1198066280 0x7f1198068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:11.516 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.507+0000 7f11ab7fe640 1 --2- 172.21.15.39:0/1720656773 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f1198066280 0x7f1198068730 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f11ac0b0cd0 tx=0x7f119c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:11.517 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.507+0000 7f1193fff640 1 -- 172.21.15.39:0/1720656773 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f11a40ec560 con 0x7f11ac158bf0 2023-05-16T13:55:11.702 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.695+0000 7f11b1da6640 1 -- 172.21.15.39:0/1720656773 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f11ac153990 con 0x7f11ac158bf0 2023-05-16T13:55:11.702 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.695+0000 7f1193fff640 1 -- 172.21.15.39:0/1720656773 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4668 (secure 0 0 0) 0x7f11ac153990 con 0x7f11ac158bf0 2023-05-16T13:55:11.703 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:55:11.703 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2374269620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":2374269620},{"type":"v1","addr":"172.21.15.118:6835","nonce":2374269620}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6833/3803055359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3803055359},{"type":"v1","addr":"172.21.15.118:6833","nonce":3803055359}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4308,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6836/3259535605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":3259535605},{"type":"v1","addr":"172.21.15.39:6836","nonce":3259535605}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-16T13:54:15.191894+0000","modified":"2023-05-16T13:54:18.210603+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4311},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4311":{"gid":4311,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.39:6837/616280162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6835","nonce":616280162},{"type":"v1","addr":"172.21.15.39:6837","nonce":616280162}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-16T13:55:11.703 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 8 2023-05-16T13:55:11.704 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.695+0000 7f11b1da6640 1 -- 172.21.15.39:0/1720656773 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f1198066280 msgr2=0x7f1198068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:11.704 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.695+0000 7f11b1da6640 1 --2- 172.21.15.39:0/1720656773 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f1198066280 0x7f1198068730 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f11ac0b0cd0 tx=0x7f119c008040 comp rx=0 tx=0).stop 2023-05-16T13:55:11.704 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.695+0000 7f11b1da6640 1 -- 172.21.15.39:0/1720656773 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f11ac158bf0 msgr2=0x7f11ac0b23d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:11.704 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.695+0000 7f11b1da6640 1 --2- 172.21.15.39:0/1720656773 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f11ac158bf0 0x7f11ac0b23d0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f11a40b1040 tx=0x7f11a401b8b0 comp rx=0 tx=0).stop 2023-05-16T13:55:11.705 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.695+0000 7f11b1da6640 1 -- 172.21.15.39:0/1720656773 shutdown_connections 2023-05-16T13:55:11.705 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.695+0000 7f11b1da6640 1 --2- 172.21.15.39:0/1720656773 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f1198066280 0x7f1198068730 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:11.705 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.695+0000 7f11b1da6640 1 --2- 172.21.15.39:0/1720656773 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f11ac0cb4c0 0x7f11ac1558f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:11.705 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.695+0000 7f11b1da6640 1 --2- 172.21.15.39:0/1720656773 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f11ac158bf0 0x7f11ac0b23d0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:11.705 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.695+0000 7f11b1da6640 1 --2- 172.21.15.39:0/1720656773 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f11ac0703b0 0x7f11ac14b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:11.705 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.695+0000 7f11b1da6640 1 -- 172.21.15.39:0/1720656773 >> 172.21.15.39:0/1720656773 conn(0x7f11ac069a50 msgr2=0x7f11ac162380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:11.706 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.695+0000 7f11b1da6640 1 -- 172.21.15.39:0/1720656773 shutdown_connections 2023-05-16T13:55:11.706 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.695+0000 7f11b1da6640 1 -- 172.21.15.39:0/1720656773 wait complete. 2023-05-16T13:55:11.724 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-16T13:55:11.861 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.855+0000 7fd79608c640 1 Processor -- start 2023-05-16T13:55:11.862 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.855+0000 7fd79608c640 1 -- start start 2023-05-16T13:55:11.862 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.855+0000 7fd79608c640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd7900b5670 0x7fd7900b42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:11.863 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.855+0000 7fd79608c640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7900ce150 con 0x7fd7900b5ae0 2023-05-16T13:55:11.863 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.855+0000 7fd79608c640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7900cd890 con 0x7fd79015c470 2023-05-16T13:55:11.863 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.855+0000 7fd79608c640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7900cdb00 con 0x7fd7900b5670 2023-05-16T13:55:11.864 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.855+0000 7fd78ffff640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fd7900b5ae0 0x7fd7900ce5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:40414/0 (socket says 172.21.15.39:40414) 2023-05-16T13:55:11.864 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.855+0000 7fd78ffff640 1 -- 172.21.15.39:0/3418009829 learned_addr learned my addr 172.21.15.39:0/3418009829 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:55:11.864 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.855+0000 7fd78effd640 1 --2- 172.21.15.39:0/3418009829 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd7900b5670 0x7fd7900b42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:11.864 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.855+0000 7fd78e7fc640 1 -- 172.21.15.39:0/3418009829 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1018958028 0 0) 0x7fd7900ce150 con 0x7fd7900b5ae0 2023-05-16T13:55:11.864 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.855+0000 7fd78e7fc640 1 -- 172.21.15.39:0/3418009829 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd778003530 con 0x7fd7900b5ae0 2023-05-16T13:55:11.864 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.855+0000 7fd78effd640 1 -- 172.21.15.39:0/3418009829 >> v1:172.21.15.118:6789/0 conn(0x7fd79015c470 legacy=0x7fd7900d0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:11.864 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.855+0000 7fd78effd640 1 -- 172.21.15.39:0/3418009829 >> v1:172.21.15.39:6789/0 conn(0x7fd7900b5ae0 legacy=0x7fd7900ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:11.865 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.855+0000 7fd78effd640 1 -- 172.21.15.39:0/3418009829 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7900cdde0 con 0x7fd7900b5670 2023-05-16T13:55:11.866 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.859+0000 7fd78effd640 1 --2- 172.21.15.39:0/3418009829 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd7900b5670 0x7fd7900b42a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd7840097f0 tx=0x7fd78401c460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9464341caba4097e server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:11.867 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.859+0000 7fd78e7fc640 1 -- 172.21.15.39:0/3418009829 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7840ab600 con 0x7fd7900b5670 2023-05-16T13:55:11.867 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.859+0000 7fd78e7fc640 1 -- 172.21.15.39:0/3418009829 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7840ab760 con 0x7fd7900b5670 2023-05-16T13:55:11.867 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.859+0000 7fd78e7fc640 1 -- 172.21.15.39:0/3418009829 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7840abaf0 con 0x7fd7900b5670 2023-05-16T13:55:11.868 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.859+0000 7fd79608c640 1 -- 172.21.15.39:0/3418009829 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd7900b5670 msgr2=0x7fd7900b42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:11.868 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.859+0000 7fd79608c640 1 --2- 172.21.15.39:0/3418009829 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd7900b5670 0x7fd7900b42a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd7840097f0 tx=0x7fd78401c460 comp rx=0 tx=0).stop 2023-05-16T13:55:11.868 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.859+0000 7fd79608c640 1 -- 172.21.15.39:0/3418009829 shutdown_connections 2023-05-16T13:55:11.868 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.859+0000 7fd79608c640 1 --2- 172.21.15.39:0/3418009829 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd7900b5670 0x7fd7900b42a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:11.868 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.859+0000 7fd79608c640 1 -- 172.21.15.39:0/3418009829 >> 172.21.15.39:0/3418009829 conn(0x7fd79009bae0 msgr2=0x7fd7900d2820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:11.869 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.859+0000 7fd79608c640 1 -- 172.21.15.39:0/3418009829 shutdown_connections 2023-05-16T13:55:11.869 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.859+0000 7fd79608c640 1 -- 172.21.15.39:0/3418009829 wait complete. 2023-05-16T13:55:11.869 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.863+0000 7fd79608c640 1 Processor -- start 2023-05-16T13:55:11.869 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.863+0000 7fd79608c640 1 -- start start 2023-05-16T13:55:11.871 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.863+0000 7fd79608c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7900b5670 0x7fd790159e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:11.871 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.863+0000 7fd79608c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7900b5ae0 0x7fd7900c7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:11.871 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.863+0000 7fd79608c640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd79015c470 0x7fd790158650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:11.871 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.863+0000 7fd79608c640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd790159a20 con 0x7fd7900b5ae0 2023-05-16T13:55:11.871 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.863+0000 7fd79608c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd790158b90 con 0x7fd7900b5670 2023-05-16T13:55:11.872 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.863+0000 7fd79608c640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd790158da0 con 0x7fd79015c470 2023-05-16T13:55:11.872 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.863+0000 7fd78effd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7900b5ae0 0x7fd7900c7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:11.872 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.863+0000 7fd78effd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7900b5ae0 0x7fd7900c7de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42538/0 (socket says 172.21.15.39:42538) 2023-05-16T13:55:11.872 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.863+0000 7fd78effd640 1 -- 172.21.15.39:0/86053027 learned_addr learned my addr 172.21.15.39:0/86053027 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:11.872 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.863+0000 7fd78f7fe640 1 --2- 172.21.15.39:0/86053027 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7900b5670 0x7fd790159e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:11.872 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.863+0000 7fd78ffff640 1 --2- 172.21.15.39:0/86053027 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd79015c470 0x7fd790158650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:11.873 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.863+0000 7fd78effd640 1 -- 172.21.15.39:0/86053027 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd79015c470 msgr2=0x7fd790158650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:11.873 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.863+0000 7fd78effd640 1 --2- 172.21.15.39:0/86053027 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd79015c470 0x7fd790158650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:11.874 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.863+0000 7fd78effd640 1 -- 172.21.15.39:0/86053027 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7900b5670 msgr2=0x7fd790159e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:11.874 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.863+0000 7fd78effd640 1 --2- 172.21.15.39:0/86053027 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7900b5670 0x7fd790159e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:11.874 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.863+0000 7fd78effd640 1 -- 172.21.15.39:0/86053027 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd784009420 con 0x7fd7900b5ae0 2023-05-16T13:55:11.874 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.863+0000 7fd78effd640 1 --2- 172.21.15.39:0/86053027 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7900b5ae0 0x7fd7900c7de0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fd7840ad040 tx=0x7fd78401ad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:11.874 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.863+0000 7fd777fff640 1 -- 172.21.15.39:0/86053027 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7840bf610 con 0x7fd7900b5ae0 2023-05-16T13:55:11.874 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.863+0000 7fd777fff640 1 -- 172.21.15.39:0/86053027 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7840bf790 con 0x7fd7900b5ae0 2023-05-16T13:55:11.874 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.863+0000 7fd777fff640 1 -- 172.21.15.39:0/86053027 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7840bfb40 con 0x7fd7900b5ae0 2023-05-16T13:55:11.875 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.863+0000 7fd79608c640 1 -- 172.21.15.39:0/86053027 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7900d0ee0 con 0x7fd7900b5ae0 2023-05-16T13:55:11.875 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.863+0000 7fd79608c640 1 -- 172.21.15.39:0/86053027 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7900b4bf0 con 0x7fd7900b5ae0 2023-05-16T13:55:11.875 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.867+0000 7fd79608c640 1 -- 172.21.15.39:0/86053027 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd790159b60 con 0x7fd7900b5ae0 2023-05-16T13:55:11.875 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.867+0000 7fd777fff640 1 -- 172.21.15.39:0/86053027 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd7840bfca0 con 0x7fd7900b5ae0 2023-05-16T13:55:11.876 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.867+0000 7fd777fff640 1 --2- 172.21.15.39:0/86053027 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd77c066280 0x7fd77c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:11.876 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.867+0000 7fd777fff640 1 -- 172.21.15.39:0/86053027 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fd78411ecc0 con 0x7fd7900b5ae0 2023-05-16T13:55:11.876 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.867+0000 7fd78f7fe640 1 --2- 172.21.15.39:0/86053027 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd77c066280 0x7fd77c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:11.876 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.867+0000 7fd78f7fe640 1 --2- 172.21.15.39:0/86053027 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd77c066280 0x7fd77c068730 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd780000fc0 tx=0x7fd780009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:11.879 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:11.871+0000 7fd777fff640 1 -- 172.21.15.39:0/86053027 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fd790159b60 con 0x7fd7900b5ae0 2023-05-16T13:55:12.049 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.043+0000 7fd79608c640 1 -- 172.21.15.39:0/86053027 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd790159b60 con 0x7fd7900b5ae0 2023-05-16T13:55:12.050 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.043+0000 7fd777fff640 1 -- 172.21.15.39:0/86053027 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18375 (secure 0 0 0) 0x7fd790159b60 con 0x7fd7900b5ae0 2023-05-16T13:55:12.050 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:55:12.051 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":26,"fsid":"9c1e210b-c515-4ea4-a065-397956895c68","created":"2023-05-16T13:53:48.955290+0000","modified":"2023-05-16T13:54:56.831431+0000","last_up_change":"2023-05-16T13:54:01.722051+0000","last_in_change":"2023-05-16T13:53:52.331336+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-16T13:54:00.885009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-16T13:54:08.327895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-16T13:54:12.864823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-16T13:54:14.180225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4ce0f0ba-c4bf-4405-8c95-d2e9a62878ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6809","nonce":3462013698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6811","nonce":3462013698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6815","nonce":3462013698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6813","nonce":3462013698}]},"public_addr":"172.21.15.39:6809/3462013698","cluster_addr":"172.21.15.39:6811/3462013698","heartbeat_back_addr":"172.21.15.39:6815/3462013698","heartbeat_front_addr":"172.21.15.39:6813/3462013698","state":["exists","up"]},{"osd":1,"uuid":"53fdc1ac-2473-472d-af32-2760fdf6e476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6801","nonce":2829970892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6803","nonce":2829970892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6807","nonce":2829970892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6805","nonce":2829970892}]},"public_addr":"172.21.15.39:6801/2829970892","cluster_addr":"172.21.15.39:6803/2829970892","heartbeat_back_addr":"172.21.15.39:6807/2829970892","heartbeat_front_addr":"172.21.15.39:6805/2829970892","state":["exists","up"]},{"osd":2,"uuid":"0b92d770-7030-42fa-a19f-4f7f1ac113c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6817","nonce":3888067413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6819","nonce":3888067413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6823","nonce":3888067413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6821","nonce":3888067413}]},"public_addr":"172.21.15.39:6817/3888067413","cluster_addr":"172.21.15.39:6819/3888067413","heartbeat_back_addr":"172.21.15.39:6823/3888067413","heartbeat_front_addr":"172.21.15.39:6821/3888067413","state":["exists","up"]},{"osd":3,"uuid":"000d9506-cbb2-4017-b875-deca579860ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6825","nonce":405003958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6827","nonce":405003958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6831","nonce":405003958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6829","nonce":405003958}]},"public_addr":"172.21.15.39:6825/405003958","cluster_addr":"172.21.15.39:6827/405003958","heartbeat_back_addr":"172.21.15.39:6831/405003958","heartbeat_front_addr":"172.21.15.39:6829/405003958","state":["exists","up"]},{"osd":4,"uuid":"70f0dacb-e960-40c5-bf6a-183e52bbe2ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6801","nonce":3895278838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6805","nonce":3895278838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6813","nonce":3895278838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6809","nonce":3895278838}]},"public_addr":"172.21.15.118:6801/3895278838","cluster_addr":"172.21.15.118:6805/3895278838","heartbeat_back_addr":"172.21.15.118:6813/3895278838","heartbeat_front_addr":"172.21.15.118:6809/3895278838","state":["exists","up"]},{"osd":5,"uuid":"756feb54-c3ae-4a2a-8f74-85c291ba707c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6804","nonce":3513592808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6808","nonce":3513592808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6815","nonce":3513592808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6812","nonce":3513592808}]},"public_addr":"172.21.15.118:6804/3513592808","cluster_addr":"172.21.15.118:6808/3513592808","heartbeat_back_addr":"172.21.15.118:6815/3513592808","heartbeat_front_addr":"172.21.15.118:6812/3513592808","state":["exists","up"]},{"osd":6,"uuid":"c4a982c1-f497-4b0f-8a23-c77372e4621e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6824","nonce":1863656053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6827","nonce":1863656053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6831","nonce":1863656053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6829","nonce":1863656053}]},"public_addr":"172.21.15.118:6824/1863656053","cluster_addr":"172.21.15.118:6827/1863656053","heartbeat_back_addr":"172.21.15.118:6831/1863656053","heartbeat_front_addr":"172.21.15.118:6829/1863656053","state":["exists","up"]},{"osd":7,"uuid":"6f2888aa-a7ac-4e26-9159-e31817934f44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6817","nonce":3636642904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6819","nonce":3636642904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6825","nonce":3636642904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6821","nonce":3636642904}]},"public_addr":"172.21.15.118:6817/3636642904","cluster_addr":"172.21.15.118:6819/3636642904","heartbeat_back_addr":"172.21.15.118:6825/3636642904","heartbeat_front_addr":"172.21.15.118:6821/3636642904","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.717636+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.724036+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.739144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:58.079275+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:58.073921+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.930466+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.987813+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.941098+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.24","mappings":[{"from":1,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-16T13:55:12.052 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.043+0000 7fd79608c640 1 -- 172.21.15.39:0/86053027 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd77c066280 msgr2=0x7fd77c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:12.052 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.043+0000 7fd79608c640 1 --2- 172.21.15.39:0/86053027 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd77c066280 0x7fd77c068730 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd780000fc0 tx=0x7fd780009040 comp rx=0 tx=0).stop 2023-05-16T13:55:12.053 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.043+0000 7fd79608c640 1 -- 172.21.15.39:0/86053027 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7900b5ae0 msgr2=0x7fd7900c7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:12.053 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.043+0000 7fd79608c640 1 --2- 172.21.15.39:0/86053027 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7900b5ae0 0x7fd7900c7de0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fd7840ad040 tx=0x7fd78401ad00 comp rx=0 tx=0).stop 2023-05-16T13:55:12.053 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.043+0000 7fd79608c640 1 -- 172.21.15.39:0/86053027 shutdown_connections 2023-05-16T13:55:12.053 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.043+0000 7fd79608c640 1 --2- 172.21.15.39:0/86053027 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd77c066280 0x7fd77c068730 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:12.053 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.043+0000 7fd79608c640 1 --2- 172.21.15.39:0/86053027 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd79015c470 0x7fd790158650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:12.053 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.043+0000 7fd79608c640 1 --2- 172.21.15.39:0/86053027 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7900b5ae0 0x7fd7900c7de0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:12.053 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.043+0000 7fd79608c640 1 --2- 172.21.15.39:0/86053027 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd7900b5670 0x7fd790159e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:12.054 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.043+0000 7fd79608c640 1 -- 172.21.15.39:0/86053027 >> 172.21.15.39:0/86053027 conn(0x7fd79009bae0 msgr2=0x7fd7900d0720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:12.054 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.043+0000 7fd79608c640 1 -- 172.21.15.39:0/86053027 shutdown_connections 2023-05-16T13:55:12.054 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.043+0000 7fd79608c640 1 -- 172.21.15.39:0/86053027 wait complete. 2023-05-16T13:55:12.072 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-05-16T13:55:12.209 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.203+0000 7fc2897bc640 1 Processor -- start 2023-05-16T13:55:12.210 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.203+0000 7fc2897bc640 1 -- start start 2023-05-16T13:55:12.211 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.203+0000 7fc2897bc640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc2840cd560 0x7fc2840cd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:12.211 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.203+0000 7fc2897bc640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2840ce990 con 0x7fc28406e990 2023-05-16T13:55:12.211 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.203+0000 7fc2897bc640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc284069b80 con 0x7fc2840c9540 2023-05-16T13:55:12.211 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.203+0000 7fc2897bc640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc28406a800 con 0x7fc2840cd560 2023-05-16T13:55:12.213 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.203+0000 7fc282ffd640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fc28406e990 0x7fc28406ac20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:40428/0 (socket says 172.21.15.39:40428) 2023-05-16T13:55:12.213 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.203+0000 7fc282ffd640 1 -- 172.21.15.39:0/881012017 learned_addr learned my addr 172.21.15.39:0/881012017 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:55:12.213 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.203+0000 7fc27bfff640 1 --2- 172.21.15.39:0/881012017 >> v2:172.21.15.118:3300/0 conn(0x7fc2840cd560 0x7fc2840cd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:12.213 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.203+0000 7fc2827fc640 1 -- 172.21.15.39:0/881012017 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3062142590 0 0) 0x7fc2840ce990 con 0x7fc28406e990 2023-05-16T13:55:12.213 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.203+0000 7fc2827fc640 1 -- 172.21.15.39:0/881012017 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc270003530 con 0x7fc28406e990 2023-05-16T13:55:12.213 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.203+0000 7fc2827fc640 1 -- 172.21.15.39:0/881012017 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1143979382 0 0) 0x7fc284069b80 con 0x7fc2840c9540 2023-05-16T13:55:12.213 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.203+0000 7fc2827fc640 1 -- 172.21.15.39:0/881012017 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2840ce990 con 0x7fc2840c9540 2023-05-16T13:55:12.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.203+0000 7fc2827fc640 1 -- 172.21.15.39:0/881012017 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4141684550 0 0) 0x7fc270003530 con 0x7fc28406e990 2023-05-16T13:55:12.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.203+0000 7fc2827fc640 1 -- 172.21.15.39:0/881012017 >> v2:172.21.15.118:3300/0 conn(0x7fc2840cd560 msgr2=0x7fc2840cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:12.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.203+0000 7fc2827fc640 1 --2- 172.21.15.39:0/881012017 >> v2:172.21.15.118:3300/0 conn(0x7fc2840cd560 0x7fc2840cd9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:12.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.203+0000 7fc2827fc640 1 -- 172.21.15.39:0/881012017 >> v1:172.21.15.118:6789/0 conn(0x7fc2840c9540 legacy=0x7fc2840c9940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:12.214 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.203+0000 7fc2827fc640 1 -- 172.21.15.39:0/881012017 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc284069e60 con 0x7fc28406e990 2023-05-16T13:55:12.215 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.203+0000 7fc2827fc640 1 -- 172.21.15.39:0/881012017 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1738805496 0 0) 0x7fc274001a20 con 0x7fc28406e990 2023-05-16T13:55:12.215 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.203+0000 7fc2827fc640 1 -- 172.21.15.39:0/881012017 >> v1:172.21.15.39:6789/0 conn(0x7fc28406e990 legacy=0x7fc28406ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:12.215 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.203+0000 7fc2827fc640 1 --2- 172.21.15.39:0/881012017 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc270003b10 0x7fc270003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:12.215 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.203+0000 7fc2827fc640 1 --2- 172.21.15.39:0/881012017 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2700047d0 0x7fc270004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:12.215 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.203+0000 7fc2827fc640 1 --2- 172.21.15.39:0/881012017 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc270005180 0x7fc27000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:12.215 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.203+0000 7fc2827fc640 1 -- 172.21.15.39:0/881012017 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc28406a800 con 0x7fc2700047d0 2023-05-16T13:55:12.215 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.203+0000 7fc2827fc640 1 -- 172.21.15.39:0/881012017 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc27000bfe0 con 0x7fc270003b10 2023-05-16T13:55:12.216 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.203+0000 7fc2827fc640 1 -- 172.21.15.39:0/881012017 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc27000c1a0 con 0x7fc270005180 2023-05-16T13:55:12.216 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.203+0000 7fc27bfff640 1 --2- 172.21.15.39:0/881012017 >> v2:172.21.15.118:3300/0 conn(0x7fc2840cd560 0x7fc2840cd9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-16T13:55:12.216 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.203+0000 7fc282ffd640 1 --2- 172.21.15.39:0/881012017 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc270003b10 0x7fc270003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:12.216 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.203+0000 7fc27bfff640 1 --2- 172.21.15.39:0/881012017 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2700047d0 0x7fc270004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:12.216 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.203+0000 7fc2837fe640 1 --2- 172.21.15.39:0/881012017 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc270005180 0x7fc27000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:12.216 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.207+0000 7fc27bfff640 1 -- 172.21.15.39:0/881012017 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc270005180 msgr2=0x7fc27000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:12.216 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.207+0000 7fc27bfff640 1 --2- 172.21.15.39:0/881012017 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc270005180 0x7fc27000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:12.217 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.207+0000 7fc27bfff640 1 -- 172.21.15.39:0/881012017 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc270003b10 msgr2=0x7fc270003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:12.217 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.207+0000 7fc27bfff640 1 --2- 172.21.15.39:0/881012017 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc270003b10 0x7fc270003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:12.217 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.207+0000 7fc27bfff640 1 -- 172.21.15.39:0/881012017 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc270003530 con 0x7fc2700047d0 2023-05-16T13:55:12.217 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.207+0000 7fc2837fe640 1 -- 172.21.15.39:0/881012017 reap_dead start 2023-05-16T13:55:12.218 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.207+0000 7fc27bfff640 1 --2- 172.21.15.39:0/881012017 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2700047d0 0x7fc270004c40 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fc26c009c90 tx=0x7fc26c01cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e59468fb4ea2872e server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:12.218 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.207+0000 7fc2827fc640 1 -- 172.21.15.39:0/881012017 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26c004020 con 0x7fc2700047d0 2023-05-16T13:55:12.218 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.207+0000 7fc2827fc640 1 -- 172.21.15.39:0/881012017 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc26c004180 con 0x7fc2700047d0 2023-05-16T13:55:12.218 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.207+0000 7fc2827fc640 1 -- 172.21.15.39:0/881012017 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26c0a57d0 con 0x7fc2700047d0 2023-05-16T13:55:12.219 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.207+0000 7fc2897bc640 1 -- 172.21.15.39:0/881012017 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2700047d0 msgr2=0x7fc270004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:12.219 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.207+0000 7fc2897bc640 1 --2- 172.21.15.39:0/881012017 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2700047d0 0x7fc270004c40 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fc26c009c90 tx=0x7fc26c01cbf0 comp rx=0 tx=0).stop 2023-05-16T13:55:12.219 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.207+0000 7fc2897bc640 1 -- 172.21.15.39:0/881012017 shutdown_connections 2023-05-16T13:55:12.219 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.207+0000 7fc2897bc640 1 --2- 172.21.15.39:0/881012017 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2700047d0 0x7fc270004c40 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:12.219 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.207+0000 7fc2897bc640 1 -- 172.21.15.39:0/881012017 >> 172.21.15.39:0/881012017 conn(0x7fc2840cf8e0 msgr2=0x7fc2840cb6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:12.219 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.207+0000 7fc2897bc640 1 -- 172.21.15.39:0/881012017 shutdown_connections 2023-05-16T13:55:12.219 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.207+0000 7fc2897bc640 1 -- 172.21.15.39:0/881012017 wait complete. 2023-05-16T13:55:12.219 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.211+0000 7fc2897bc640 1 Processor -- start 2023-05-16T13:55:12.220 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.211+0000 7fc2897bc640 1 -- start start 2023-05-16T13:55:12.221 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.211+0000 7fc2897bc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc2700047d0 0x7fc2840c5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:12.221 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.211+0000 7fc2897bc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc284149c90 0x7fc2840b1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:12.221 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.211+0000 7fc2897bc640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc28406d430 0x7fc28406d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:12.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.211+0000 7fc2897bc640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2840cdf00 con 0x7fc284149c90 2023-05-16T13:55:12.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.211+0000 7fc2897bc640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc28406dde0 con 0x7fc2700047d0 2023-05-16T13:55:12.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.211+0000 7fc2897bc640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2840b35e0 con 0x7fc28406d430 2023-05-16T13:55:12.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.211+0000 7fc27bfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc284149c90 0x7fc2840b1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:12.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.211+0000 7fc27bfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc284149c90 0x7fc2840b1a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42548/0 (socket says 172.21.15.39:42548) 2023-05-16T13:55:12.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.211+0000 7fc27bfff640 1 -- 172.21.15.39:0/3069503957 learned_addr learned my addr 172.21.15.39:0/3069503957 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:12.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.211+0000 7fc282ffd640 1 --2- 172.21.15.39:0/3069503957 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc2700047d0 0x7fc2840c5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:12.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.211+0000 7fc2837fe640 1 --2- 172.21.15.39:0/3069503957 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc28406d430 0x7fc28406d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:12.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.211+0000 7fc27bfff640 1 -- 172.21.15.39:0/3069503957 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc28406d430 msgr2=0x7fc28406d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:12.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.211+0000 7fc27bfff640 1 --2- 172.21.15.39:0/3069503957 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc28406d430 0x7fc28406d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:12.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.211+0000 7fc27bfff640 1 -- 172.21.15.39:0/3069503957 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc2700047d0 msgr2=0x7fc2840c5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:12.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.211+0000 7fc27bfff640 1 --2- 172.21.15.39:0/3069503957 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc2700047d0 0x7fc2840c5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:12.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.211+0000 7fc27bfff640 1 -- 172.21.15.39:0/3069503957 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc28406a420 con 0x7fc284149c90 2023-05-16T13:55:12.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.211+0000 7fc282ffd640 1 --2- 172.21.15.39:0/3069503957 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc2700047d0 0x7fc2840c5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-16T13:55:12.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.211+0000 7fc2837fe640 1 --2- 172.21.15.39:0/3069503957 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc28406d430 0x7fc28406d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-16T13:55:12.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.211+0000 7fc27bfff640 1 --2- 172.21.15.39:0/3069503957 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc284149c90 0x7fc2840b1a80 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fc26c0af040 tx=0x7fc270005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:12.224 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.211+0000 7fc27b7fe640 1 -- 172.21.15.39:0/3069503957 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26c0a59d0 con 0x7fc284149c90 2023-05-16T13:55:12.224 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.211+0000 7fc27b7fe640 1 -- 172.21.15.39:0/3069503957 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc26c0a5b30 con 0x7fc284149c90 2023-05-16T13:55:12.224 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.211+0000 7fc27b7fe640 1 -- 172.21.15.39:0/3069503957 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26c006040 con 0x7fc284149c90 2023-05-16T13:55:12.224 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.211+0000 7fc2897bc640 1 -- 172.21.15.39:0/3069503957 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc28406a140 con 0x7fc284149c90 2023-05-16T13:55:12.224 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.211+0000 7fc2897bc640 1 -- 172.21.15.39:0/3069503957 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc28406ed60 con 0x7fc284149c90 2023-05-16T13:55:12.224 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.215+0000 7fc2897bc640 1 -- 172.21.15.39:0/3069503957 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc284073c90 con 0x7fc284149c90 2023-05-16T13:55:12.225 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.215+0000 7fc27b7fe640 1 -- 172.21.15.39:0/3069503957 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc26c0061a0 con 0x7fc284149c90 2023-05-16T13:55:12.225 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.215+0000 7fc27b7fe640 1 --2- 172.21.15.39:0/3069503957 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc2640662b0 0x7fc264068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:12.225 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.215+0000 7fc27b7fe640 1 -- 172.21.15.39:0/3069503957 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fc27c001d30 con 0x7fc284149c90 2023-05-16T13:55:12.225 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.215+0000 7fc282ffd640 1 --2- 172.21.15.39:0/3069503957 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc2640662b0 0x7fc264068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:12.226 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.215+0000 7fc282ffd640 1 --2- 172.21.15.39:0/3069503957 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc2640662b0 0x7fc264068760 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc2840636a0 tx=0x7fc274006040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:12.227 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.219+0000 7fc27b7fe640 1 -- 172.21.15.39:0/3069503957 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fc26c0ebb70 con 0x7fc284149c90 2023-05-16T13:55:12.412 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.403+0000 7fc2897bc640 1 -- 172.21.15.39:0/3069503957 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fc2840cc3f0 con 0x7fc284149c90 2023-05-16T13:55:12.904 INFO:tasks.ceph.mon.a.smithi039.stderr:2023-05-16T13:55:12.895+0000 7fd571c7a640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-05-16T13:55:12.915 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.907+0000 7fc27b7fe640 1 -- 172.21.15.39:0/3069503957 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7fc26c0ef190 con 0x7fc284149c90 2023-05-16T13:55:12.915 INFO:teuthology.orchestra.run.smithi039.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-05-16T13:55:12.917 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.911+0000 7fc2897bc640 1 -- 172.21.15.39:0/3069503957 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc2640662b0 msgr2=0x7fc264068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:12.918 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.911+0000 7fc2897bc640 1 --2- 172.21.15.39:0/3069503957 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc2640662b0 0x7fc264068760 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc2840636a0 tx=0x7fc274006040 comp rx=0 tx=0).stop 2023-05-16T13:55:12.918 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.911+0000 7fc2897bc640 1 -- 172.21.15.39:0/3069503957 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc284149c90 msgr2=0x7fc2840b1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:12.918 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.911+0000 7fc2897bc640 1 --2- 172.21.15.39:0/3069503957 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc284149c90 0x7fc2840b1a80 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fc26c0af040 tx=0x7fc270005800 comp rx=0 tx=0).stop 2023-05-16T13:55:12.918 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.911+0000 7fc2897bc640 1 -- 172.21.15.39:0/3069503957 shutdown_connections 2023-05-16T13:55:12.918 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.911+0000 7fc2897bc640 1 --2- 172.21.15.39:0/3069503957 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc2640662b0 0x7fc264068760 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:12.918 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.911+0000 7fc2897bc640 1 --2- 172.21.15.39:0/3069503957 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc28406d430 0x7fc28406d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:12.918 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.911+0000 7fc2897bc640 1 --2- 172.21.15.39:0/3069503957 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc284149c90 0x7fc2840b1a80 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:12.919 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.911+0000 7fc2897bc640 1 --2- 172.21.15.39:0/3069503957 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc2700047d0 0x7fc2840c5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:12.919 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.911+0000 7fc2897bc640 1 -- 172.21.15.39:0/3069503957 >> 172.21.15.39:0/3069503957 conn(0x7fc2840cf8e0 msgr2=0x7fc2840ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:12.919 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.911+0000 7fc2897bc640 1 -- 172.21.15.39:0/3069503957 shutdown_connections 2023-05-16T13:55:12.919 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:12.911+0000 7fc2897bc640 1 -- 172.21.15.39:0/3069503957 wait complete. 2023-05-16T13:55:12.922 INFO:tasks.ceph.mds.c.smithi039.stderr: -3109> 2023-05-16T13:54:20.926+0000 7f5b6f797640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-05-16T13:55:12.939 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-05-16T13:55:12.971 INFO:tasks.ceph.mds.c.smithi039.stdout:starting mds.c at 2023-05-16T13:55:13.085 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.079+0000 7f70d6b39640 1 Processor -- start 2023-05-16T13:55:13.086 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.079+0000 7f70d6b39640 1 -- start start 2023-05-16T13:55:13.086 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.079+0000 7f70d6b39640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70d015c490 0x7f70d00ad300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:13.087 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.079+0000 7f70d6b39640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70d006b520 con 0x7f70d00b1a70 2023-05-16T13:55:13.087 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.079+0000 7f70d6b39640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70d00ad840 con 0x7f70d006c690 2023-05-16T13:55:13.087 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.079+0000 7f70d6b39640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70d00cee10 con 0x7f70d015c490 2023-05-16T13:55:13.088 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.079+0000 7f70cffff640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f70d00b1a70 0x7f70d006bf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:40448/0 (socket says 172.21.15.39:40448) 2023-05-16T13:55:13.088 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.079+0000 7f70cffff640 1 -- 172.21.15.39:0/1637080811 learned_addr learned my addr 172.21.15.39:0/1637080811 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:55:13.088 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.079+0000 7f70d48d5640 1 --2- 172.21.15.39:0/1637080811 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70d015c490 0x7f70d00ad300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:13.088 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.079+0000 7f70cf7fe640 1 -- 172.21.15.39:0/1637080811 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4134068576 0 0) 0x7f70d006b520 con 0x7f70d00b1a70 2023-05-16T13:55:13.088 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.079+0000 7f70cf7fe640 1 -- 172.21.15.39:0/1637080811 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70c0003530 con 0x7f70d00b1a70 2023-05-16T13:55:13.089 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.079+0000 7f70cf7fe640 1 -- 172.21.15.39:0/1637080811 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2457283957 0 0) 0x7f70d00ad840 con 0x7f70d006c690 2023-05-16T13:55:13.089 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.079+0000 7f70cf7fe640 1 -- 172.21.15.39:0/1637080811 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70d006b520 con 0x7f70d006c690 2023-05-16T13:55:13.089 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.079+0000 7f70d48d5640 1 -- 172.21.15.39:0/1637080811 >> v1:172.21.15.118:6789/0 conn(0x7f70d006c690 legacy=0x7f70d00b0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:13.089 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.079+0000 7f70d48d5640 1 -- 172.21.15.39:0/1637080811 >> v1:172.21.15.39:6789/0 conn(0x7f70d00b1a70 legacy=0x7f70d006bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:13.089 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.079+0000 7f70d48d5640 1 -- 172.21.15.39:0/1637080811 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d006cb10 con 0x7f70d015c490 2023-05-16T13:55:13.090 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.083+0000 7f70d48d5640 1 --2- 172.21.15.39:0/1637080811 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70d015c490 0x7f70d00ad300 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f70c40097f0 tx=0x7f70c401c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2dc55cd9b990d59e server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:13.091 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.083+0000 7f70cf7fe640 1 -- 172.21.15.39:0/1637080811 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c40a7070 con 0x7f70d015c490 2023-05-16T13:55:13.091 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.083+0000 7f70cf7fe640 1 -- 172.21.15.39:0/1637080811 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c40ab430 con 0x7f70d015c490 2023-05-16T13:55:13.091 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.083+0000 7f70cf7fe640 1 -- 172.21.15.39:0/1637080811 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c40ab7c0 con 0x7f70d015c490 2023-05-16T13:55:13.092 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.083+0000 7f70d6b39640 1 -- 172.21.15.39:0/1637080811 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70d015c490 msgr2=0x7f70d00ad300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:13.093 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.083+0000 7f70d6b39640 1 --2- 172.21.15.39:0/1637080811 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70d015c490 0x7f70d00ad300 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f70c40097f0 tx=0x7f70c401c490 comp rx=0 tx=0).stop 2023-05-16T13:55:13.093 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.083+0000 7f70d6b39640 1 -- 172.21.15.39:0/1637080811 shutdown_connections 2023-05-16T13:55:13.093 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.083+0000 7f70d6b39640 1 --2- 172.21.15.39:0/1637080811 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70d015c490 0x7f70d00ad300 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:13.093 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.083+0000 7f70d6b39640 1 -- 172.21.15.39:0/1637080811 >> 172.21.15.39:0/1637080811 conn(0x7f70d00999a0 msgr2=0x7f70d00d0670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:13.093 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.083+0000 7f70d6b39640 1 -- 172.21.15.39:0/1637080811 shutdown_connections 2023-05-16T13:55:13.093 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.083+0000 7f70d6b39640 1 -- 172.21.15.39:0/1637080811 wait complete. 2023-05-16T13:55:13.094 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.087+0000 7f70d6b39640 1 Processor -- start 2023-05-16T13:55:13.094 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.087+0000 7f70d6b39640 1 -- start start 2023-05-16T13:55:13.095 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.087+0000 7f70d6b39640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70d006c690 0x7f70d00b4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:13.095 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.087+0000 7f70d6b39640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f70d00b1a70 0x7f70d01f7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:13.095 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.087+0000 7f70d6b39640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70d015c490 0x7f70d0151d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:13.095 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.087+0000 7f70d6b39640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d00c5450 con 0x7f70d00b1a70 2023-05-16T13:55:13.095 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.087+0000 7f70d6b39640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d01f7b90 con 0x7f70d006c690 2023-05-16T13:55:13.096 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.087+0000 7f70d6b39640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70d00c56f0 con 0x7f70d015c490 2023-05-16T13:55:13.096 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.087+0000 7f70cffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f70d00b1a70 0x7f70d01f7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:13.096 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.087+0000 7f70cffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f70d00b1a70 0x7f70d01f7650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42570/0 (socket says 172.21.15.39:42570) 2023-05-16T13:55:13.096 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.087+0000 7f70cffff640 1 -- 172.21.15.39:0/3982537193 learned_addr learned my addr 172.21.15.39:0/3982537193 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:13.097 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.087+0000 7f70d50d6640 1 --2- 172.21.15.39:0/3982537193 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70d015c490 0x7f70d0151d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:13.097 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.087+0000 7f70d48d5640 1 --2- 172.21.15.39:0/3982537193 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70d006c690 0x7f70d00b4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:13.097 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.087+0000 7f70cffff640 1 -- 172.21.15.39:0/3982537193 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70d015c490 msgr2=0x7f70d0151d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:13.098 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.087+0000 7f70cffff640 1 --2- 172.21.15.39:0/3982537193 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70d015c490 0x7f70d0151d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:13.098 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.087+0000 7f70cffff640 1 -- 172.21.15.39:0/3982537193 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70d006c690 msgr2=0x7f70d00b4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:13.098 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.087+0000 7f70cffff640 1 --2- 172.21.15.39:0/3982537193 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70d006c690 0x7f70d00b4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:13.098 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.087+0000 7f70cffff640 1 -- 172.21.15.39:0/3982537193 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70c4009420 con 0x7f70d00b1a70 2023-05-16T13:55:13.098 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.087+0000 7f70d50d6640 1 --2- 172.21.15.39:0/3982537193 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70d015c490 0x7f70d0151d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-16T13:55:13.098 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.087+0000 7f70d48d5640 1 --2- 172.21.15.39:0/3982537193 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70d006c690 0x7f70d00b4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-16T13:55:13.098 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.087+0000 7f70cffff640 1 --2- 172.21.15.39:0/3982537193 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f70d00b1a70 0x7f70d01f7650 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f70bc00c4f0 tx=0x7f70bc00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:13.099 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.087+0000 7f70cd7fa640 1 -- 172.21.15.39:0/3982537193 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70bc005cf0 con 0x7f70d00b1a70 2023-05-16T13:55:13.099 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.087+0000 7f70cd7fa640 1 -- 172.21.15.39:0/3982537193 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70bc005e50 con 0x7f70d00b1a70 2023-05-16T13:55:13.099 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.087+0000 7f70cd7fa640 1 -- 172.21.15.39:0/3982537193 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70bc007270 con 0x7f70d00b1a70 2023-05-16T13:55:13.099 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.087+0000 7f70d6b39640 1 -- 172.21.15.39:0/3982537193 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70d006b780 con 0x7f70d00b1a70 2023-05-16T13:55:13.099 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.087+0000 7f70d6b39640 1 -- 172.21.15.39:0/3982537193 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70d00ceb30 con 0x7f70d00b1a70 2023-05-16T13:55:13.099 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.091+0000 7f70d6b39640 1 -- 172.21.15.39:0/3982537193 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70d006ba60 con 0x7f70d00b1a70 2023-05-16T13:55:13.100 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.091+0000 7f70cd7fa640 1 -- 172.21.15.39:0/3982537193 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f70bc0073d0 con 0x7f70d00b1a70 2023-05-16T13:55:13.100 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.091+0000 7f70cd7fa640 1 --2- 172.21.15.39:0/3982537193 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f70b4066280 0x7f70b4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:13.100 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.091+0000 7f70cd7fa640 1 -- 172.21.15.39:0/3982537193 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6206+0+0 (secure 0 0 0) 0x7f70bc0832f0 con 0x7f70d00b1a70 2023-05-16T13:55:13.100 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.091+0000 7f70d48d5640 1 --2- 172.21.15.39:0/3982537193 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f70b4066280 0x7f70b4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:13.100 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.091+0000 7f70d48d5640 1 --2- 172.21.15.39:0/3982537193 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f70b4066280 0x7f70b4068730 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f70c40af000 tx=0x7f70c4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:13.103 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.095+0000 7f70cd7fa640 1 -- 172.21.15.39:0/3982537193 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f70bc050790 con 0x7f70d00b1a70 2023-05-16T13:55:13.288 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.279+0000 7f70d6b39640 1 -- 172.21.15.39:0/3982537193 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f70d0073c90 con 0x7f70d00b1a70 2023-05-16T13:55:13.919 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.911+0000 7f70cd7fa640 1 -- 172.21.15.39:0/3982537193 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f70bc053db0 con 0x7f70d00b1a70 2023-05-16T13:55:13.921 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.915+0000 7f70d6b39640 1 -- 172.21.15.39:0/3982537193 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f70b4066280 msgr2=0x7f70b4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:13.921 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.915+0000 7f70d6b39640 1 --2- 172.21.15.39:0/3982537193 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f70b4066280 0x7f70b4068730 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f70c40af000 tx=0x7f70c4008040 comp rx=0 tx=0).stop 2023-05-16T13:55:13.921 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.915+0000 7f70d6b39640 1 -- 172.21.15.39:0/3982537193 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f70d00b1a70 msgr2=0x7f70d01f7650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:13.922 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.915+0000 7f70d6b39640 1 --2- 172.21.15.39:0/3982537193 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f70d00b1a70 0x7f70d01f7650 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f70bc00c4f0 tx=0x7f70bc00c9b0 comp rx=0 tx=0).stop 2023-05-16T13:55:13.922 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.915+0000 7f70d6b39640 1 -- 172.21.15.39:0/3982537193 shutdown_connections 2023-05-16T13:55:13.922 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.915+0000 7f70d6b39640 1 --2- 172.21.15.39:0/3982537193 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f70b4066280 0x7f70b4068730 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:13.922 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.915+0000 7f70d6b39640 1 --2- 172.21.15.39:0/3982537193 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70d015c490 0x7f70d0151d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:13.922 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.915+0000 7f70d6b39640 1 --2- 172.21.15.39:0/3982537193 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f70d00b1a70 0x7f70d01f7650 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:13.922 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.915+0000 7f70d6b39640 1 --2- 172.21.15.39:0/3982537193 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70d006c690 0x7f70d00b4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:13.922 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.915+0000 7f70d6b39640 1 -- 172.21.15.39:0/3982537193 >> 172.21.15.39:0/3982537193 conn(0x7f70d00999a0 msgr2=0x7f70d01562f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:13.923 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.915+0000 7f70d6b39640 1 -- 172.21.15.39:0/3982537193 shutdown_connections 2023-05-16T13:55:13.923 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:13.915+0000 7f70d6b39640 1 -- 172.21.15.39:0/3982537193 wait complete. 2023-05-16T13:55:13.945 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-05-16T13:55:14.133 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:14.127+0000 7f5c6b82d640 1 Processor -- start 2023-05-16T13:55:14.133 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:14.127+0000 7f5c6b82d640 1 -- start start 2023-05-16T13:55:14.134 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:14.127+0000 7f5c6b82d640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f5c6406c3c0 0x7f5c640c8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:14.135 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:14.127+0000 7f5c6b82d640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c64160a80 con 0x7f5c641606b0 2023-05-16T13:55:14.135 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:14.127+0000 7f5c6b82d640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c640ccd80 con 0x7f5c640700f0 2023-05-16T13:55:14.135 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:14.127+0000 7f5c6b82d640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c6406fca0 con 0x7f5c6406c3c0 2023-05-16T13:55:14.135 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:14.127+0000 7f5c695c9640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f5c641606b0 0x7f5c6406bcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:40454/0 (socket says 172.21.15.39:40454) 2023-05-16T13:55:14.135 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:14.127+0000 7f5c695c9640 1 -- 172.21.15.39:0/2830260326 learned_addr learned my addr 172.21.15.39:0/2830260326 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:55:14.135 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:14.127+0000 7f5c68dc8640 1 --2- 172.21.15.39:0/2830260326 >> v2:172.21.15.39:3300/0 conn(0x7f5c6406c3c0 0x7f5c640c8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:14.136 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:14.127+0000 7f5c68dc8640 1 -- 172.21.15.39:0/2830260326 >> v1:172.21.15.118:6789/0 conn(0x7f5c640700f0 legacy=0x7f5c640704f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:14.136 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:14.127+0000 7f5c68dc8640 1 -- 172.21.15.39:0/2830260326 >> v1:172.21.15.39:6789/0 conn(0x7f5c641606b0 legacy=0x7f5c6406bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:14.136 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:14.127+0000 7f5c68dc8640 1 -- 172.21.15.39:0/2830260326 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c640ca730 con 0x7f5c6406c3c0 2023-05-16T13:55:14.137 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:14.127+0000 7f5c5bfff640 1 -- 172.21.15.39:0/2830260326 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 746654059 0 0) 0x7f5c64160a80 con 0x7f5c641606b0 2023-05-16T13:55:14.138 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:14.131+0000 7f5c68dc8640 1 --2- 172.21.15.39:0/2830260326 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c6406c3c0 0x7f5c640c8a10 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f5c540097c0 tx=0x7f5c5401cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfe052fe61539ec9 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:14.138 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:14.131+0000 7f5c5bfff640 1 -- 172.21.15.39:0/2830260326 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c54004230 con 0x7f5c6406c3c0 2023-05-16T13:55:14.138 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:14.131+0000 7f5c5bfff640 1 -- 172.21.15.39:0/2830260326 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c540a7050 con 0x7f5c6406c3c0 2023-05-16T13:55:14.139 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:14.131+0000 7f5c5bfff640 1 -- 172.21.15.39:0/2830260326 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c54003620 con 0x7f5c6406c3c0 2023-05-16T13:55:14.139 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:14.131+0000 7f5c6b82d640 1 -- 172.21.15.39:0/2830260326 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c6406c3c0 msgr2=0x7f5c640c8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:14.139 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:14.131+0000 7f5c6b82d640 1 --2- 172.21.15.39:0/2830260326 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c6406c3c0 0x7f5c640c8a10 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f5c540097c0 tx=0x7f5c5401cd90 comp rx=0 tx=0).stop 2023-05-16T13:55:14.139 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:14.131+0000 7f5c6b82d640 1 -- 172.21.15.39:0/2830260326 shutdown_connections 2023-05-16T13:55:14.140 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:14.131+0000 7f5c6b82d640 1 --2- 172.21.15.39:0/2830260326 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c6406c3c0 0x7f5c640c8a10 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:14.140 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:14.131+0000 7f5c6b82d640 1 -- 172.21.15.39:0/2830260326 >> 172.21.15.39:0/2830260326 conn(0x7f5c64069a50 msgr2=0x7f5c64069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:14.140 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:14.131+0000 7f5c6b82d640 1 -- 172.21.15.39:0/2830260326 shutdown_connections 2023-05-16T13:55:14.140 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:14.131+0000 7f5c6b82d640 1 -- 172.21.15.39:0/2830260326 wait complete. 2023-05-16T13:55:14.141 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:14.135+0000 7f5c6b82d640 1 Processor -- start 2023-05-16T13:55:14.141 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:14.135+0000 7f5c6b82d640 1 -- start start 2023-05-16T13:55:14.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:14.135+0000 7f5c6b82d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c6406c3c0 0x7f5c6414e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:14.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:14.135+0000 7f5c6b82d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c640700f0 0x7f5c640ceae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:14.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:14.135+0000 7f5c6b82d640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5c641606b0 0x7f5c64153450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:14.143 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:14.135+0000 7f5c6b82d640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c641631c0 con 0x7f5c640700f0 2023-05-16T13:55:14.143 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:14.135+0000 7f5c6b82d640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6415a700 con 0x7f5c6406c3c0 2023-05-16T13:55:14.143 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:14.135+0000 7f5c6b82d640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c64162120 con 0x7f5c641606b0 2023-05-16T13:55:14.143 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:14.135+0000 7f5c68dc8640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c640700f0 0x7f5c640ceae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:14.143 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:14.135+0000 7f5c68dc8640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c640700f0 0x7f5c640ceae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42582/0 (socket says 172.21.15.39:42582) 2023-05-16T13:55:14.143 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:14.135+0000 7f5c68dc8640 1 -- 172.21.15.39:0/2028459948 learned_addr learned my addr 172.21.15.39:0/2028459948 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:14.144 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:14.135+0000 7f5c695c9640 1 --2- 172.21.15.39:0/2028459948 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c6406c3c0 0x7f5c6414e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:14.144 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:14.135+0000 7f5c69dca640 1 --2- 172.21.15.39:0/2028459948 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5c641606b0 0x7f5c64153450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:14.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:14.135+0000 7f5c68dc8640 1 -- 172.21.15.39:0/2028459948 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5c641606b0 msgr2=0x7f5c64153450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:14.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:14.135+0000 7f5c68dc8640 1 --2- 172.21.15.39:0/2028459948 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5c641606b0 0x7f5c64153450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:14.147 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:14.135+0000 7f5c68dc8640 1 -- 172.21.15.39:0/2028459948 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c6406c3c0 msgr2=0x7f5c6414e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:14.147 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:14.135+0000 7f5c68dc8640 1 --2- 172.21.15.39:0/2028459948 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c6406c3c0 0x7f5c6414e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:14.147 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:14.135+0000 7f5c68dc8640 1 -- 172.21.15.39:0/2028459948 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c54009420 con 0x7f5c640700f0 2023-05-16T13:55:14.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:14.135+0000 7f5c68dc8640 1 --2- 172.21.15.39:0/2028459948 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c640700f0 0x7f5c640ceae0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f5c54018f40 tx=0x7f5c540190d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:14.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:14.135+0000 7f5c59ffb640 1 -- 172.21.15.39:0/2028459948 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c54003cf0 con 0x7f5c640700f0 2023-05-16T13:55:14.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:14.135+0000 7f5c59ffb640 1 -- 172.21.15.39:0/2028459948 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c54003e50 con 0x7f5c640700f0 2023-05-16T13:55:14.149 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:14.135+0000 7f5c59ffb640 1 -- 172.21.15.39:0/2028459948 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c540ab680 con 0x7f5c640700f0 2023-05-16T13:55:14.149 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:14.135+0000 7f5c6b82d640 1 -- 172.21.15.39:0/2028459948 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c640cc9a0 con 0x7f5c640700f0 2023-05-16T13:55:14.149 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:14.135+0000 7f5c6b82d640 1 -- 172.21.15.39:0/2028459948 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c640ca3e0 con 0x7f5c640700f0 2023-05-16T13:55:14.149 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:14.135+0000 7f5c6b82d640 1 -- 172.21.15.39:0/2028459948 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c640ccb30 con 0x7f5c640700f0 2023-05-16T13:55:14.149 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:14.139+0000 7f5c59ffb640 1 -- 172.21.15.39:0/2028459948 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5c540b2040 con 0x7f5c640700f0 2023-05-16T13:55:14.149 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:14.139+0000 7f5c59ffb640 1 --2- 172.21.15.39:0/2028459948 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f5c480662b0 0x7f5c48068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:14.149 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:14.139+0000 7f5c59ffb640 1 -- 172.21.15.39:0/2028459948 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6206+0+0 (secure 0 0 0) 0x7f5c5411dd30 con 0x7f5c640700f0 2023-05-16T13:55:14.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:14.139+0000 7f5c695c9640 1 --2- 172.21.15.39:0/2028459948 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f5c480662b0 0x7f5c48068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:14.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:14.139+0000 7f5c695c9640 1 --2- 172.21.15.39:0/2028459948 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f5c480662b0 0x7f5c48068760 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5c60007c40 tx=0x7f5c60007b90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:14.151 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:14.143+0000 7f5c59ffb640 1 -- 172.21.15.39:0/2028459948 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f5c540eb130 con 0x7f5c640700f0 2023-05-16T13:55:14.303 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:14.295+0000 7f5c6b82d640 1 -- 172.21.15.39:0/2028459948 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5c64073c90 con 0x7f5c640700f0 2023-05-16T13:55:14.925 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:14.915+0000 7f5c59ffb640 1 -- 172.21.15.39:0/2028459948 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v28) v1 ==== 181+0+0 (secure 0 0 0) 0x7f5c540ab7e0 con 0x7f5c640700f0 2023-05-16T13:55:14.925 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'cephfs_metadata' removed 2023-05-16T13:55:14.927 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:14.919+0000 7f5c6b82d640 1 -- 172.21.15.39:0/2028459948 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f5c480662b0 msgr2=0x7f5c48068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:14.927 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:14.919+0000 7f5c6b82d640 1 --2- 172.21.15.39:0/2028459948 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f5c480662b0 0x7f5c48068760 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5c60007c40 tx=0x7f5c60007b90 comp rx=0 tx=0).stop 2023-05-16T13:55:14.927 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:14.919+0000 7f5c6b82d640 1 -- 172.21.15.39:0/2028459948 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c640700f0 msgr2=0x7f5c640ceae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:14.927 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:14.919+0000 7f5c6b82d640 1 --2- 172.21.15.39:0/2028459948 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c640700f0 0x7f5c640ceae0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f5c54018f40 tx=0x7f5c540190d0 comp rx=0 tx=0).stop 2023-05-16T13:55:14.928 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:14.919+0000 7f5c6b82d640 1 -- 172.21.15.39:0/2028459948 shutdown_connections 2023-05-16T13:55:14.928 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:14.919+0000 7f5c6b82d640 1 --2- 172.21.15.39:0/2028459948 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f5c480662b0 0x7f5c48068760 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:14.928 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:14.919+0000 7f5c6b82d640 1 --2- 172.21.15.39:0/2028459948 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5c641606b0 0x7f5c64153450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:14.928 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:14.919+0000 7f5c6b82d640 1 --2- 172.21.15.39:0/2028459948 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c640700f0 0x7f5c640ceae0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:14.928 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:14.919+0000 7f5c6b82d640 1 --2- 172.21.15.39:0/2028459948 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c6406c3c0 0x7f5c6414e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:14.928 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:14.919+0000 7f5c6b82d640 1 -- 172.21.15.39:0/2028459948 >> 172.21.15.39:0/2028459948 conn(0x7f5c64069a50 msgr2=0x7f5c6406bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:14.928 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:14.919+0000 7f5c6b82d640 1 -- 172.21.15.39:0/2028459948 shutdown_connections 2023-05-16T13:55:14.929 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:14.919+0000 7f5c6b82d640 1 -- 172.21.15.39:0/2028459948 wait complete. 2023-05-16T13:55:14.947 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-05-16T13:55:15.090 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.083+0000 7f4e3fe55640 1 Processor -- start 2023-05-16T13:55:15.091 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.083+0000 7f4e3fe55640 1 -- start start 2023-05-16T13:55:15.091 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.083+0000 7f4e3fe55640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e380c9cd0 0x7f4e3806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:15.092 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.083+0000 7f4e3fe55640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f4e3815d9e0 0x7f4e3815de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:15.092 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.083+0000 7f4e3fe55640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e380b43c0 con 0x7f4e38159f50 2023-05-16T13:55:15.092 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.083+0000 7f4e3fe55640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e3815a320 con 0x7f4e3815d9e0 2023-05-16T13:55:15.092 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.083+0000 7f4e3fe55640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e380ca220 con 0x7f4e380c9cd0 2023-05-16T13:55:15.093 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.083+0000 7f4e3e3f2640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f4e3815d9e0 0x7f4e3815de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:15.093 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.083+0000 7f4e3e3f2640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f4e3815d9e0 0x7f4e3815de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42584/0 (socket says 172.21.15.39:42584) 2023-05-16T13:55:15.093 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.083+0000 7f4e3e3f2640 1 -- 172.21.15.39:0/389903981 learned_addr learned my addr 172.21.15.39:0/389903981 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:15.093 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.083+0000 7f4e3d3f0640 1 --2- 172.21.15.39:0/389903981 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e380c9cd0 0x7f4e3806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:15.093 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.083+0000 7f4e3e3f2640 1 -- 172.21.15.39:0/389903981 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e380c9cd0 msgr2=0x7f4e3806fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:15.094 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.083+0000 7f4e3e3f2640 1 --2- 172.21.15.39:0/389903981 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e380c9cd0 0x7f4e3806fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:15.094 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.083+0000 7f4e3e3f2640 1 -- 172.21.15.39:0/389903981 >> v1:172.21.15.118:6789/0 conn(0x7f4e38159f50 legacy=0x7f4e380c9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:15.094 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.083+0000 7f4e3e3f2640 1 -- 172.21.15.39:0/389903981 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e380ca470 con 0x7f4e3815d9e0 2023-05-16T13:55:15.095 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.087+0000 7f4e3e3f2640 1 --2- 172.21.15.39:0/389903981 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e3815d9e0 0x7f4e3815de80 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f4e30009e50 tx=0x7f4e3001c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac7815bd4dd8bdbb server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:15.096 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.087+0000 7f4e3cbef640 1 -- 172.21.15.39:0/389903981 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e300a5840 con 0x7f4e3815d9e0 2023-05-16T13:55:15.096 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.087+0000 7f4e3cbef640 1 -- 172.21.15.39:0/389903981 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e300a59a0 con 0x7f4e3815d9e0 2023-05-16T13:55:15.096 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.087+0000 7f4e3cbef640 1 -- 172.21.15.39:0/389903981 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e300a5d30 con 0x7f4e3815d9e0 2023-05-16T13:55:15.097 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.087+0000 7f4e3fe55640 1 -- 172.21.15.39:0/389903981 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e3815d9e0 msgr2=0x7f4e3815de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:15.097 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.087+0000 7f4e3fe55640 1 --2- 172.21.15.39:0/389903981 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e3815d9e0 0x7f4e3815de80 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f4e30009e50 tx=0x7f4e3001c980 comp rx=0 tx=0).stop 2023-05-16T13:55:15.097 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.087+0000 7f4e3fe55640 1 -- 172.21.15.39:0/389903981 shutdown_connections 2023-05-16T13:55:15.097 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.087+0000 7f4e3fe55640 1 --2- 172.21.15.39:0/389903981 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e3815d9e0 0x7f4e3815de80 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:15.097 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.087+0000 7f4e3fe55640 1 --2- 172.21.15.39:0/389903981 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e380c9cd0 0x7f4e3806fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:15.097 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.087+0000 7f4e3fe55640 1 -- 172.21.15.39:0/389903981 >> 172.21.15.39:0/389903981 conn(0x7f4e38069a50 msgr2=0x7f4e38069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:15.097 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.087+0000 7f4e3fe55640 1 -- 172.21.15.39:0/389903981 shutdown_connections 2023-05-16T13:55:15.098 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.087+0000 7f4e3fe55640 1 -- 172.21.15.39:0/389903981 wait complete. 2023-05-16T13:55:15.098 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.091+0000 7f4e3fe55640 1 Processor -- start 2023-05-16T13:55:15.098 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.091+0000 7f4e3fe55640 1 -- start start 2023-05-16T13:55:15.099 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.091+0000 7f4e3fe55640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e380c9cd0 0x7f4e3814a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:15.099 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.091+0000 7f4e3fe55640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e38159f50 0x7f4e380b0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:15.099 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.091+0000 7f4e3fe55640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e3815d9e0 0x7f4e3814bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:15.099 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.091+0000 7f4e3fe55640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3814a090 con 0x7f4e3815d9e0 2023-05-16T13:55:15.099 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.091+0000 7f4e3fe55640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e38149130 con 0x7f4e380c9cd0 2023-05-16T13:55:15.100 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.091+0000 7f4e3fe55640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e38149410 con 0x7f4e38159f50 2023-05-16T13:55:15.101 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.091+0000 7f4e3e3f2640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e3815d9e0 0x7f4e3814bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:15.101 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.091+0000 7f4e3e3f2640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e3815d9e0 0x7f4e3814bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42592/0 (socket says 172.21.15.39:42592) 2023-05-16T13:55:15.101 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.091+0000 7f4e3e3f2640 1 -- 172.21.15.39:0/2981100753 learned_addr learned my addr 172.21.15.39:0/2981100753 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:15.101 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.091+0000 7f4e3d3f0640 1 --2- 172.21.15.39:0/2981100753 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e38159f50 0x7f4e380b0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:15.101 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.091+0000 7f4e3dbf1640 1 --2- 172.21.15.39:0/2981100753 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e380c9cd0 0x7f4e3814a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:15.101 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.091+0000 7f4e3e3f2640 1 -- 172.21.15.39:0/2981100753 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e38159f50 msgr2=0x7f4e380b0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:15.101 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.091+0000 7f4e3e3f2640 1 --2- 172.21.15.39:0/2981100753 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e38159f50 0x7f4e380b0190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:15.102 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.091+0000 7f4e3e3f2640 1 -- 172.21.15.39:0/2981100753 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e380c9cd0 msgr2=0x7f4e3814a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:15.102 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.091+0000 7f4e3e3f2640 1 --2- 172.21.15.39:0/2981100753 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e380c9cd0 0x7f4e3814a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:15.102 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.091+0000 7f4e3e3f2640 1 -- 172.21.15.39:0/2981100753 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e30009b30 con 0x7f4e3815d9e0 2023-05-16T13:55:15.102 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.091+0000 7f4e3dbf1640 1 --2- 172.21.15.39:0/2981100753 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e380c9cd0 0x7f4e3814a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-16T13:55:15.102 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.091+0000 7f4e3e3f2640 1 --2- 172.21.15.39:0/2981100753 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e3815d9e0 0x7f4e3814bcc0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f4e300af040 tx=0x7f4e30019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:15.102 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.091+0000 7f4e2e7fc640 1 -- 172.21.15.39:0/2981100753 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e300b8670 con 0x7f4e3815d9e0 2023-05-16T13:55:15.102 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.091+0000 7f4e2e7fc640 1 -- 172.21.15.39:0/2981100753 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e300b87d0 con 0x7f4e3815d9e0 2023-05-16T13:55:15.103 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.091+0000 7f4e2e7fc640 1 -- 172.21.15.39:0/2981100753 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e300b8b60 con 0x7f4e3815d9e0 2023-05-16T13:55:15.103 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.091+0000 7f4e3fe55640 1 -- 172.21.15.39:0/2981100753 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e380cad10 con 0x7f4e3815d9e0 2023-05-16T13:55:15.103 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.091+0000 7f4e3fe55640 1 -- 172.21.15.39:0/2981100753 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e380c8b40 con 0x7f4e3815d9e0 2023-05-16T13:55:15.104 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.095+0000 7f4e3fe55640 1 -- 172.21.15.39:0/2981100753 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e380c9770 con 0x7f4e3815d9e0 2023-05-16T13:55:15.104 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.095+0000 7f4e2e7fc640 1 -- 172.21.15.39:0/2981100753 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4e300b8cc0 con 0x7f4e3815d9e0 2023-05-16T13:55:15.104 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.095+0000 7f4e2e7fc640 1 --2- 172.21.15.39:0/2981100753 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f4e1c066280 0x7f4e1c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:15.104 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.095+0000 7f4e2e7fc640 1 -- 172.21.15.39:0/2981100753 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5768+0+0 (secure 0 0 0) 0x7f4e3011f140 con 0x7f4e3815d9e0 2023-05-16T13:55:15.104 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.095+0000 7f4e3dbf1640 1 --2- 172.21.15.39:0/2981100753 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f4e1c066280 0x7f4e1c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:15.104 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.095+0000 7f4e3dbf1640 1 --2- 172.21.15.39:0/2981100753 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f4e1c066280 0x7f4e1c068730 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4e3814a260 tx=0x7f4e34009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:15.107 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.099+0000 7f4e2e7fc640 1 -- 172.21.15.39:0/2981100753 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f4e300ec6d0 con 0x7f4e3815d9e0 2023-05-16T13:55:15.259 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.251+0000 7f4e3fe55640 1 -- 172.21.15.39:0/2981100753 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4e381f56c0 con 0x7f4e3815d9e0 2023-05-16T13:55:15.931 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.923+0000 7f4e2e7fc640 1 -- 172.21.15.39:0/2981100753 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v29) v1 ==== 169+0+0 (secure 0 0 0) 0x7f4e381f56c0 con 0x7f4e3815d9e0 2023-05-16T13:55:15.931 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'cephfs_data' removed 2023-05-16T13:55:15.933 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.927+0000 7f4e3fe55640 1 -- 172.21.15.39:0/2981100753 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f4e1c066280 msgr2=0x7f4e1c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:15.933 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.927+0000 7f4e3fe55640 1 --2- 172.21.15.39:0/2981100753 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f4e1c066280 0x7f4e1c068730 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4e3814a260 tx=0x7f4e34009040 comp rx=0 tx=0).stop 2023-05-16T13:55:15.933 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.927+0000 7f4e3fe55640 1 -- 172.21.15.39:0/2981100753 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e3815d9e0 msgr2=0x7f4e3814bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:15.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.927+0000 7f4e3fe55640 1 --2- 172.21.15.39:0/2981100753 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e3815d9e0 0x7f4e3814bcc0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f4e300af040 tx=0x7f4e30019720 comp rx=0 tx=0).stop 2023-05-16T13:55:15.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.927+0000 7f4e3fe55640 1 -- 172.21.15.39:0/2981100753 shutdown_connections 2023-05-16T13:55:15.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.927+0000 7f4e3fe55640 1 --2- 172.21.15.39:0/2981100753 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f4e1c066280 0x7f4e1c068730 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:15.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.927+0000 7f4e3fe55640 1 --2- 172.21.15.39:0/2981100753 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e38159f50 0x7f4e380b0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:15.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.927+0000 7f4e3fe55640 1 --2- 172.21.15.39:0/2981100753 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e3815d9e0 0x7f4e3814bcc0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:15.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.927+0000 7f4e3fe55640 1 --2- 172.21.15.39:0/2981100753 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e380c9cd0 0x7f4e3814a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:15.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.927+0000 7f4e3fe55640 1 -- 172.21.15.39:0/2981100753 >> 172.21.15.39:0/2981100753 conn(0x7f4e38069a50 msgr2=0x7f4e380c9060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:15.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.927+0000 7f4e3fe55640 1 -- 172.21.15.39:0/2981100753 shutdown_connections 2023-05-16T13:55:15.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:15.927+0000 7f4e3fe55640 1 -- 172.21.15.39:0/2981100753 wait complete. 2023-05-16T13:55:15.953 INFO:tasks.ceph.mds.a:Restarting daemon 2023-05-16T13:55:15.953 INFO:tasks.ceph.mds.a:Stopping old one... 2023-05-16T13:55:15.953 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-05-16T13:55:15.954 INFO:teuthology.orchestra.run:waiting for 300 2023-05-16T13:55:15.954 INFO:tasks.ceph.mds.c:Restarting daemon 2023-05-16T13:55:15.954 INFO:tasks.ceph.mds.c:Stopping old one... 2023-05-16T13:55:15.954 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-05-16T13:55:15.955 INFO:teuthology.orchestra.run:waiting for 300 2023-05-16T13:55:15.955 INFO:tasks.ceph.mds.b:Restarting daemon 2023-05-16T13:55:15.955 INFO:tasks.ceph.mds.b:Stopping old one... 2023-05-16T13:55:15.955 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-05-16T13:55:15.956 INFO:teuthology.orchestra.run:waiting for 300 2023-05-16T13:55:15.956 INFO:tasks.ceph.mds.d:Restarting daemon 2023-05-16T13:55:15.956 INFO:tasks.ceph.mds.d:Stopping old one... 2023-05-16T13:55:15.956 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-05-16T13:55:15.956 INFO:teuthology.orchestra.run:waiting for 300 2023-05-16T13:55:15.966 INFO:tasks.ceph.mds.a:Stopped 2023-05-16T13:55:15.966 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-05-16T13:55:15.967 INFO:tasks.ceph.mds.c:Stopped 2023-05-16T13:55:15.967 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-05-16T13:55:15.969 INFO:tasks.ceph.mds.b:Stopped 2023-05-16T13:55:15.969 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-05-16T13:55:15.970 INFO:tasks.ceph.mds.d:Stopped 2023-05-16T13:55:15.971 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-05-16T13:55:16.014 INFO:tasks.ceph.mds.a:Started 2023-05-16T13:55:16.015 DEBUG:teuthology.parallel:result is None 2023-05-16T13:55:16.016 INFO:tasks.ceph.mds.b:Started 2023-05-16T13:55:16.017 DEBUG:teuthology.parallel:result is None 2023-05-16T13:55:16.017 INFO:tasks.ceph.mds.c:Started 2023-05-16T13:55:16.018 DEBUG:teuthology.parallel:result is None 2023-05-16T13:55:16.018 INFO:tasks.ceph.mds.d:Started 2023-05-16T13:55:16.019 DEBUG:teuthology.parallel:result is None 2023-05-16T13:55:16.019 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-05-16T13:55:16.099 INFO:tasks.ceph.mds.c.smithi039.stdout:starting mds.c at 2023-05-16T13:55:16.100 INFO:tasks.ceph.mds.a.smithi039.stdout:starting mds.a at 2023-05-16T13:55:16.107 INFO:tasks.ceph.mds.b.smithi118.stdout:starting mds.b at 2023-05-16T13:55:16.107 INFO:tasks.ceph.mds.d.smithi118.stdout:starting mds.d at 2023-05-16T13:55:16.191 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:16.183+0000 7f1d6a38f640 1 Processor -- start 2023-05-16T13:55:16.191 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:16.183+0000 7f1d6a38f640 1 -- start start 2023-05-16T13:55:16.192 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:16.183+0000 7f1d6a38f640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f1d64158e90 0x7f1d640704b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:16.193 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:16.183+0000 7f1d6a38f640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d6415d2c0 0x7f1d640cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:16.193 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:16.183+0000 7f1d6a38f640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1d640cb120 0x7f1d640c9470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:16.193 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:16.183+0000 7f1d6a38f640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d64159260 con 0x7f1d64158e90 2023-05-16T13:55:16.193 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:16.183+0000 7f1d6a38f640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d640cda10 con 0x7f1d640cb120 2023-05-16T13:55:16.193 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:16.183+0000 7f1d6a38f640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d640709f0 con 0x7f1d6415d2c0 2023-05-16T13:55:16.193 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:16.183+0000 7f1d63fff640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f1d64158e90 0x7f1d640704b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:16.193 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:16.187+0000 7f1d63fff640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f1d64158e90 0x7f1d640704b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42622/0 (socket says 172.21.15.39:42622) 2023-05-16T13:55:16.194 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:16.187+0000 7f1d63fff640 1 -- 172.21.15.39:0/3650099457 learned_addr learned my addr 172.21.15.39:0/3650099457 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:16.194 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:16.187+0000 7f1d6892c640 1 --2- 172.21.15.39:0/3650099457 >> v2:172.21.15.118:3300/0 conn(0x7f1d640cb120 0x7f1d640c9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:16.194 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:16.187+0000 7f1d637fe640 1 --2- 172.21.15.39:0/3650099457 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d6415d2c0 0x7f1d640cabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:16.194 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:16.187+0000 7f1d63fff640 1 -- 172.21.15.39:0/3650099457 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d6415d2c0 msgr2=0x7f1d640cabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:16.195 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:16.187+0000 7f1d63fff640 1 --2- 172.21.15.39:0/3650099457 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d6415d2c0 0x7f1d640cabe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:16.195 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:16.187+0000 7f1d63fff640 1 -- 172.21.15.39:0/3650099457 >> v2:172.21.15.118:3300/0 conn(0x7f1d640cb120 msgr2=0x7f1d640c9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:16.195 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:16.187+0000 7f1d63fff640 1 --2- 172.21.15.39:0/3650099457 >> v2:172.21.15.118:3300/0 conn(0x7f1d640cb120 0x7f1d640c9470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:16.195 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:16.187+0000 7f1d63fff640 1 -- 172.21.15.39:0/3650099457 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d640cce90 con 0x7f1d64158e90 2023-05-16T13:55:16.195 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:16.187+0000 7f1d6892c640 1 --2- 172.21.15.39:0/3650099457 >> v2:172.21.15.118:3300/0 conn(0x7f1d640cb120 0x7f1d640c9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:55:16.195 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:16.187+0000 7f1d63fff640 1 --2- 172.21.15.39:0/3650099457 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d64158e90 0x7f1d640704b0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f1d640c5140 tx=0x7f1d5401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7ed5c8200f7039d server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:16.196 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:16.187+0000 7f1d62ffd640 1 -- 172.21.15.39:0/3650099457 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d540ab600 con 0x7f1d64158e90 2023-05-16T13:55:16.196 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:16.187+0000 7f1d62ffd640 1 -- 172.21.15.39:0/3650099457 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d540ab760 con 0x7f1d64158e90 2023-05-16T13:55:16.196 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:16.187+0000 7f1d62ffd640 1 -- 172.21.15.39:0/3650099457 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d540abaf0 con 0x7f1d64158e90 2023-05-16T13:55:16.197 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:16.187+0000 7f1d6a38f640 1 -- 172.21.15.39:0/3650099457 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d64158e90 msgr2=0x7f1d640704b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:16.197 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:16.187+0000 7f1d6a38f640 1 --2- 172.21.15.39:0/3650099457 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d64158e90 0x7f1d640704b0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f1d640c5140 tx=0x7f1d5401c440 comp rx=0 tx=0).stop 2023-05-16T13:55:16.197 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:16.191+0000 7f1d6a38f640 1 -- 172.21.15.39:0/3650099457 shutdown_connections 2023-05-16T13:55:16.198 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:16.191+0000 7f1d6a38f640 1 --2- 172.21.15.39:0/3650099457 >> v2:172.21.15.118:3300/0 conn(0x7f1d640cb120 0x7f1d640c9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:16.198 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:16.191+0000 7f1d6a38f640 1 --2- 172.21.15.39:0/3650099457 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d6415d2c0 0x7f1d640cabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:16.198 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:16.191+0000 7f1d6a38f640 1 --2- 172.21.15.39:0/3650099457 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d64158e90 0x7f1d640704b0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:16.198 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:16.191+0000 7f1d6a38f640 1 -- 172.21.15.39:0/3650099457 >> 172.21.15.39:0/3650099457 conn(0x7f1d64069a50 msgr2=0x7f1d64069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:16.198 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:16.191+0000 7f1d6a38f640 1 -- 172.21.15.39:0/3650099457 shutdown_connections 2023-05-16T13:55:16.198 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:16.191+0000 7f1d6a38f640 1 -- 172.21.15.39:0/3650099457 wait complete. 2023-05-16T13:55:16.199 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:16.191+0000 7f1d6a38f640 1 Processor -- start 2023-05-16T13:55:16.199 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:16.191+0000 7f1d6a38f640 1 -- start start 2023-05-16T13:55:16.200 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:16.191+0000 7f1d6a38f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d640cb120 0x7f1d64144970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:16.200 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:16.191+0000 7f1d6a38f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d64158e90 0x7f1d64157740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:16.200 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:16.191+0000 7f1d6a38f640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d6415d2c0 0x7f1d6415b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:16.200 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:16.191+0000 7f1d6a38f640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d64144eb0 con 0x7f1d640cb120 2023-05-16T13:55:16.200 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:16.191+0000 7f1d6a38f640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6415a8f0 con 0x7f1d64158e90 2023-05-16T13:55:16.201 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:16.191+0000 7f1d6a38f640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6415abd0 con 0x7f1d6415d2c0 2023-05-16T13:55:16.201 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:16.191+0000 7f1d63fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d640cb120 0x7f1d64144970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:16.201 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:16.191+0000 7f1d63fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d640cb120 0x7f1d64144970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42638/0 (socket says 172.21.15.39:42638) 2023-05-16T13:55:16.201 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:16.191+0000 7f1d63fff640 1 -- 172.21.15.39:0/2588916641 learned_addr learned my addr 172.21.15.39:0/2588916641 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:16.201 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:16.191+0000 7f1d637fe640 1 --2- 172.21.15.39:0/2588916641 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d64158e90 0x7f1d64157740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:16.201 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:16.191+0000 7f1d6892c640 1 --2- 172.21.15.39:0/2588916641 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d6415d2c0 0x7f1d6415b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:16.202 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:16.191+0000 7f1d63fff640 1 -- 172.21.15.39:0/2588916641 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d6415d2c0 msgr2=0x7f1d6415b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:16.202 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:16.191+0000 7f1d63fff640 1 --2- 172.21.15.39:0/2588916641 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d6415d2c0 0x7f1d6415b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:16.203 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:16.191+0000 7f1d63fff640 1 -- 172.21.15.39:0/2588916641 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d64158e90 msgr2=0x7f1d64157740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:16.203 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:16.191+0000 7f1d63fff640 1 --2- 172.21.15.39:0/2588916641 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d64158e90 0x7f1d64157740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:16.203 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:16.191+0000 7f1d63fff640 1 -- 172.21.15.39:0/2588916641 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d540094d0 con 0x7f1d640cb120 2023-05-16T13:55:16.203 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:16.191+0000 7f1d637fe640 1 --2- 172.21.15.39:0/2588916641 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d64158e90 0x7f1d64157740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-16T13:55:16.203 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:16.195+0000 7f1d63fff640 1 --2- 172.21.15.39:0/2588916641 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d640cb120 0x7f1d64144970 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f1d5401aaf0 tx=0x7f1d5401ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:16.203 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:16.195+0000 7f1d60ff9640 1 -- 172.21.15.39:0/2588916641 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d540ab600 con 0x7f1d640cb120 2023-05-16T13:55:16.203 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:16.195+0000 7f1d60ff9640 1 -- 172.21.15.39:0/2588916641 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d540b4800 con 0x7f1d640cb120 2023-05-16T13:55:16.203 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:16.195+0000 7f1d60ff9640 1 -- 172.21.15.39:0/2588916641 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d540b4b70 con 0x7f1d640cb120 2023-05-16T13:55:16.204 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:16.195+0000 7f1d6a38f640 1 -- 172.21.15.39:0/2588916641 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d640cb520 con 0x7f1d640cb120 2023-05-16T13:55:16.204 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:16.195+0000 7f1d6a38f640 1 -- 172.21.15.39:0/2588916641 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d640cd730 con 0x7f1d640cb120 2023-05-16T13:55:16.204 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:16.195+0000 7f1d6a38f640 1 -- 172.21.15.39:0/2588916641 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d640c8e10 con 0x7f1d640cb120 2023-05-16T13:55:16.205 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:16.195+0000 7f1d60ff9640 1 -- 172.21.15.39:0/2588916641 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1d540b4cd0 con 0x7f1d640cb120 2023-05-16T13:55:16.205 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:16.195+0000 7f1d60ff9640 1 --2- 172.21.15.39:0/2588916641 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f1d50066280 0x7f1d50068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:16.205 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:16.195+0000 7f1d60ff9640 1 -- 172.21.15.39:0/2588916641 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f1d5411e120 con 0x7f1d640cb120 2023-05-16T13:55:16.205 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:16.195+0000 7f1d637fe640 1 --2- 172.21.15.39:0/2588916641 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f1d50066280 0x7f1d50068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:16.205 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:16.199+0000 7f1d637fe640 1 --2- 172.21.15.39:0/2588916641 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f1d50066280 0x7f1d50068730 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1d641580d0 tx=0x7f1d58008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:16.208 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:16.199+0000 7f1d60ff9640 1 -- 172.21.15.39:0/2588916641 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f1d540eb8d0 con 0x7f1d640cb120 2023-05-16T13:55:16.378 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:16.371+0000 7f1d6a38f640 1 -- 172.21.15.39:0/2588916641 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f1d641513e0 con 0x7f1d640cb120 2023-05-16T13:55:17.165 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.159+0000 7f1d60ff9640 1 -- 172.21.15.39:0/2588916641 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v34) v1 ==== 97+0+0 (secure 0 0 0) 0x7f1d540eeef0 con 0x7f1d640cb120 2023-05-16T13:55:17.165 INFO:teuthology.orchestra.run.smithi039.stderr: removed all blocklist entries 2023-05-16T13:55:17.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.159+0000 7f1d6a38f640 1 -- 172.21.15.39:0/2588916641 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f1d50066280 msgr2=0x7f1d50068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:17.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.159+0000 7f1d6a38f640 1 --2- 172.21.15.39:0/2588916641 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f1d50066280 0x7f1d50068730 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1d641580d0 tx=0x7f1d58008040 comp rx=0 tx=0).stop 2023-05-16T13:55:17.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.159+0000 7f1d6a38f640 1 -- 172.21.15.39:0/2588916641 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d640cb120 msgr2=0x7f1d64144970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:17.168 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.159+0000 7f1d6a38f640 1 --2- 172.21.15.39:0/2588916641 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d640cb120 0x7f1d64144970 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f1d5401aaf0 tx=0x7f1d5401ac80 comp rx=0 tx=0).stop 2023-05-16T13:55:17.168 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.159+0000 7f1d6a38f640 1 -- 172.21.15.39:0/2588916641 shutdown_connections 2023-05-16T13:55:17.168 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.159+0000 7f1d6a38f640 1 --2- 172.21.15.39:0/2588916641 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f1d50066280 0x7f1d50068730 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:17.168 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.159+0000 7f1d6a38f640 1 --2- 172.21.15.39:0/2588916641 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d6415d2c0 0x7f1d6415b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:17.168 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.159+0000 7f1d6a38f640 1 --2- 172.21.15.39:0/2588916641 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d64158e90 0x7f1d64157740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:17.168 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.159+0000 7f1d6a38f640 1 --2- 172.21.15.39:0/2588916641 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d640cb120 0x7f1d64144970 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:17.168 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.159+0000 7f1d6a38f640 1 -- 172.21.15.39:0/2588916641 >> 172.21.15.39:0/2588916641 conn(0x7f1d64069a50 msgr2=0x7f1d64151620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:17.169 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.159+0000 7f1d6a38f640 1 -- 172.21.15.39:0/2588916641 shutdown_connections 2023-05-16T13:55:17.169 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.159+0000 7f1d6a38f640 1 -- 172.21.15.39:0/2588916641 wait complete. 2023-05-16T13:55:17.186 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-05-16T13:55:17.324 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.315+0000 7fd0afc20640 1 Processor -- start 2023-05-16T13:55:17.324 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.315+0000 7fd0afc20640 1 -- start start 2023-05-16T13:55:17.326 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.319+0000 7fd0afc20640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd0a8158bf0 0x7fd0a815d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:17.326 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.319+0000 7fd0afc20640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd0a80703b0 0x7fd0a80cadb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:17.327 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.319+0000 7fd0afc20640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0a815d6a0 con 0x7fd0a80cb2f0 2023-05-16T13:55:17.327 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.319+0000 7fd0afc20640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0a80cb700 con 0x7fd0a80703b0 2023-05-16T13:55:17.327 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.319+0000 7fd0afc20640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0a8070870 con 0x7fd0a8158bf0 2023-05-16T13:55:17.327 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.319+0000 7fd0ad1bb640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd0a80703b0 0x7fd0a80cadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:17.327 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.319+0000 7fd0ad1bb640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd0a80703b0 0x7fd0a80cadb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42640/0 (socket says 172.21.15.39:42640) 2023-05-16T13:55:17.327 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.319+0000 7fd0ad1bb640 1 -- 172.21.15.39:0/467335423 learned_addr learned my addr 172.21.15.39:0/467335423 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:17.327 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.319+0000 7fd0ad9bc640 1 --2- 172.21.15.39:0/467335423 >> v2:172.21.15.118:3300/0 conn(0x7fd0a8158bf0 0x7fd0a815d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:17.328 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.319+0000 7fd0ad1bb640 1 -- 172.21.15.39:0/467335423 >> v2:172.21.15.118:3300/0 conn(0x7fd0a8158bf0 msgr2=0x7fd0a815d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:17.328 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.319+0000 7fd0ad1bb640 1 --2- 172.21.15.39:0/467335423 >> v2:172.21.15.118:3300/0 conn(0x7fd0a8158bf0 0x7fd0a815d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:17.328 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.319+0000 7fd0ad1bb640 1 -- 172.21.15.39:0/467335423 >> v1:172.21.15.118:6789/0 conn(0x7fd0a80cb2f0 legacy=0x7fd0a806bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:17.328 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.319+0000 7fd0ad1bb640 1 -- 172.21.15.39:0/467335423 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a8070b50 con 0x7fd0a80703b0 2023-05-16T13:55:17.329 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.323+0000 7fd0ad1bb640 1 --2- 172.21.15.39:0/467335423 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd0a80703b0 0x7fd0a80cadb0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fd0a80cbcb0 tx=0x7fd09801eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=844dbf548763df2e server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:17.329 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.323+0000 7fd0ac9ba640 1 -- 172.21.15.39:0/467335423 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0980a7be0 con 0x7fd0a80703b0 2023-05-16T13:55:17.329 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.323+0000 7fd0ac9ba640 1 -- 172.21.15.39:0/467335423 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0980a7d40 con 0x7fd0a80703b0 2023-05-16T13:55:17.329 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.323+0000 7fd0ac9ba640 1 -- 172.21.15.39:0/467335423 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0980af660 con 0x7fd0a80703b0 2023-05-16T13:55:17.330 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.323+0000 7fd0afc20640 1 -- 172.21.15.39:0/467335423 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd0a80703b0 msgr2=0x7fd0a80cadb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:17.330 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.323+0000 7fd0afc20640 1 --2- 172.21.15.39:0/467335423 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd0a80703b0 0x7fd0a80cadb0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fd0a80cbcb0 tx=0x7fd09801eb10 comp rx=0 tx=0).stop 2023-05-16T13:55:17.331 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.323+0000 7fd0afc20640 1 -- 172.21.15.39:0/467335423 shutdown_connections 2023-05-16T13:55:17.331 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.323+0000 7fd0afc20640 1 --2- 172.21.15.39:0/467335423 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd0a80703b0 0x7fd0a80cadb0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:17.331 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.323+0000 7fd0afc20640 1 --2- 172.21.15.39:0/467335423 >> v2:172.21.15.118:3300/0 conn(0x7fd0a8158bf0 0x7fd0a815d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:17.331 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.323+0000 7fd0afc20640 1 -- 172.21.15.39:0/467335423 >> 172.21.15.39:0/467335423 conn(0x7fd0a8069a50 msgr2=0x7fd0a8069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:17.331 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.323+0000 7fd0afc20640 1 -- 172.21.15.39:0/467335423 shutdown_connections 2023-05-16T13:55:17.331 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.323+0000 7fd0afc20640 1 -- 172.21.15.39:0/467335423 wait complete. 2023-05-16T13:55:17.333 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.323+0000 7fd0afc20640 1 Processor -- start 2023-05-16T13:55:17.333 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.323+0000 7fd0afc20640 1 -- start start 2023-05-16T13:55:17.333 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.323+0000 7fd0afc20640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd0a80703b0 0x7fd0a815baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:17.333 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.323+0000 7fd0afc20640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0a80cb2f0 0x7fd0a814eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:17.333 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.323+0000 7fd0afc20640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd0a8158bf0 0x7fd0a8154fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:17.334 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.323+0000 7fd0afc20640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a80ae420 con 0x7fd0a8158bf0 2023-05-16T13:55:17.334 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.323+0000 7fd0afc20640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a80b0320 con 0x7fd0a80cb2f0 2023-05-16T13:55:17.334 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.323+0000 7fd0afc20640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a80adc10 con 0x7fd0a80703b0 2023-05-16T13:55:17.334 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.327+0000 7fd0ae1bd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd0a8158bf0 0x7fd0a8154fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:17.334 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.327+0000 7fd0ad1bb640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0a80cb2f0 0x7fd0a814eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:17.334 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.327+0000 7fd0ae1bd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd0a8158bf0 0x7fd0a8154fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42656/0 (socket says 172.21.15.39:42656) 2023-05-16T13:55:17.334 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.327+0000 7fd0ad9bc640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd0a80703b0 0x7fd0a815baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:17.335 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.327+0000 7fd0ae1bd640 1 -- 172.21.15.39:0/2915974627 learned_addr learned my addr 172.21.15.39:0/2915974627 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:17.336 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.327+0000 7fd0ae1bd640 1 -- 172.21.15.39:0/2915974627 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd0a80703b0 msgr2=0x7fd0a815baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:17.336 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.327+0000 7fd0ae1bd640 1 --2- 172.21.15.39:0/2915974627 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd0a80703b0 0x7fd0a815baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:17.336 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.327+0000 7fd0ae1bd640 1 -- 172.21.15.39:0/2915974627 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0a80cb2f0 msgr2=0x7fd0a814eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:17.336 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.327+0000 7fd0ae1bd640 1 --2- 172.21.15.39:0/2915974627 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0a80cb2f0 0x7fd0a814eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:17.336 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.327+0000 7fd0ae1bd640 1 -- 172.21.15.39:0/2915974627 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd09800b770 con 0x7fd0a8158bf0 2023-05-16T13:55:17.337 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.327+0000 7fd0ad1bb640 1 --2- 172.21.15.39:0/2915974627 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0a80cb2f0 0x7fd0a814eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-16T13:55:17.337 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.327+0000 7fd0ae1bd640 1 --2- 172.21.15.39:0/2915974627 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd0a8158bf0 0x7fd0a8154fa0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fd0a000c770 tx=0x7fd0a000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:17.337 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.327+0000 7fd09e7fc640 1 -- 172.21.15.39:0/2915974627 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a0003b80 con 0x7fd0a8158bf0 2023-05-16T13:55:17.337 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.327+0000 7fd09e7fc640 1 -- 172.21.15.39:0/2915974627 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0a0003ce0 con 0x7fd0a8158bf0 2023-05-16T13:55:17.337 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.327+0000 7fd0afc20640 1 -- 172.21.15.39:0/2915974627 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0a8158fc0 con 0x7fd0a8158bf0 2023-05-16T13:55:17.337 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.327+0000 7fd09e7fc640 1 -- 172.21.15.39:0/2915974627 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a000aa90 con 0x7fd0a8158bf0 2023-05-16T13:55:17.338 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.327+0000 7fd0afc20640 1 -- 172.21.15.39:0/2915974627 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0a80713f0 con 0x7fd0a8158bf0 2023-05-16T13:55:17.338 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.327+0000 7fd0afc20640 1 -- 172.21.15.39:0/2915974627 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0a80ad950 con 0x7fd0a8158bf0 2023-05-16T13:55:17.338 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.327+0000 7fd09e7fc640 1 -- 172.21.15.39:0/2915974627 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd0a000abf0 con 0x7fd0a8158bf0 2023-05-16T13:55:17.339 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.331+0000 7fd09e7fc640 1 --2- 172.21.15.39:0/2915974627 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd08c066280 0x7fd08c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:17.339 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.331+0000 7fd09e7fc640 1 -- 172.21.15.39:0/2915974627 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd0a0083640 con 0x7fd0a8158bf0 2023-05-16T13:55:17.339 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.331+0000 7fd0ad9bc640 1 --2- 172.21.15.39:0/2915974627 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd08c066280 0x7fd08c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:17.339 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.331+0000 7fd0ad9bc640 1 --2- 172.21.15.39:0/2915974627 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd08c066280 0x7fd08c068730 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd0a4007a60 tx=0x7fd0a4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:17.340 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.331+0000 7fd09e7fc640 1 -- 172.21.15.39:0/2915974627 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fd0a0050e20 con 0x7fd0a8158bf0 2023-05-16T13:55:17.548 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.539+0000 7fd0afc20640 1 -- 172.21.15.39:0/2915974627 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fd0a815d6a0 con 0x7fd0a8158bf0 2023-05-16T13:55:17.549 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.543+0000 7fd09e7fc640 1 -- 172.21.15.39:0/2915974627 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v2) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fd0a815d6a0 con 0x7fd0a8158bf0 2023-05-16T13:55:17.549 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:55:17.550 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2023-05-16T13:55:17.550 INFO:teuthology.orchestra.run.smithi039.stdout: "auth_dump": [ 2023-05-16T13:55:17.550 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-05-16T13:55:17.550 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "mds.a", 2023-05-16T13:55:17.550 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDEimNkC0xZFxAA00l75LfFsCjS+Fk8XxjIKw==", 2023-05-16T13:55:17.550 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-05-16T13:55:17.550 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow", 2023-05-16T13:55:17.551 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow *", 2023-05-16T13:55:17.551 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow *", 2023-05-16T13:55:17.551 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2023-05-16T13:55:17.551 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-05-16T13:55:17.551 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-05-16T13:55:17.551 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-05-16T13:55:17.551 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "mds.b", 2023-05-16T13:55:17.551 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDEimNkSRDiIhAA1sm/XseDgOA/7p5wQ6VfFw==", 2023-05-16T13:55:17.552 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-05-16T13:55:17.552 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow", 2023-05-16T13:55:17.552 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow *", 2023-05-16T13:55:17.552 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow *", 2023-05-16T13:55:17.552 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2023-05-16T13:55:17.552 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-05-16T13:55:17.552 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-05-16T13:55:17.553 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-05-16T13:55:17.553 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "mds.c", 2023-05-16T13:55:17.553 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDEimNkCGpdHhAAW8oMXx3GXs/BWtU8HhVhnQ==", 2023-05-16T13:55:17.553 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-05-16T13:55:17.553 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow", 2023-05-16T13:55:17.553 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow *", 2023-05-16T13:55:17.553 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow *", 2023-05-16T13:55:17.553 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2023-05-16T13:55:17.554 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-05-16T13:55:17.554 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-05-16T13:55:17.554 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-05-16T13:55:17.554 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "mds.d", 2023-05-16T13:55:17.554 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDEimNkqmm4KRAAx0V3HlqAinbNxzGR+Hj+cQ==", 2023-05-16T13:55:17.554 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-05-16T13:55:17.554 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow", 2023-05-16T13:55:17.554 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow *", 2023-05-16T13:55:17.555 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow *", 2023-05-16T13:55:17.555 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2023-05-16T13:55:17.555 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-05-16T13:55:17.555 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-05-16T13:55:17.555 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-05-16T13:55:17.555 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "osd.0", 2023-05-16T13:55:17.555 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDLimNkjb7HEBAAw52EfP2J1pItGm5fPPR1xA==", 2023-05-16T13:55:17.555 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-05-16T13:55:17.556 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow profile osd", 2023-05-16T13:55:17.556 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile osd", 2023-05-16T13:55:17.556 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2023-05-16T13:55:17.556 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-05-16T13:55:17.556 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-05-16T13:55:17.556 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-05-16T13:55:17.556 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "osd.1", 2023-05-16T13:55:17.556 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDOimNktVygFhAA3mtB1PemE6PcVLb2Qh6Q5w==", 2023-05-16T13:55:17.557 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-05-16T13:55:17.557 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow profile osd", 2023-05-16T13:55:17.557 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile osd", 2023-05-16T13:55:17.557 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2023-05-16T13:55:17.557 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-05-16T13:55:17.557 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-05-16T13:55:17.557 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-05-16T13:55:17.557 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "osd.2", 2023-05-16T13:55:17.558 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDRimNkwXZDHRAAXcL0G+LKLwdKTl4nNw1i7A==", 2023-05-16T13:55:17.558 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-05-16T13:55:17.558 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow profile osd", 2023-05-16T13:55:17.558 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile osd", 2023-05-16T13:55:17.558 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2023-05-16T13:55:17.558 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-05-16T13:55:17.558 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-05-16T13:55:17.558 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-05-16T13:55:17.559 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "osd.3", 2023-05-16T13:55:17.559 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDUimNkF0y5IxAAX6rco3be4G9HAkX1uvTZHQ==", 2023-05-16T13:55:17.559 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-05-16T13:55:17.559 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow profile osd", 2023-05-16T13:55:17.559 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile osd", 2023-05-16T13:55:17.559 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2023-05-16T13:55:17.559 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-05-16T13:55:17.559 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-05-16T13:55:17.560 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-05-16T13:55:17.560 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "osd.4", 2023-05-16T13:55:17.560 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDYimNks4KILhAA4/T9QW3SaCHVm22HcBKxNg==", 2023-05-16T13:55:17.560 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-05-16T13:55:17.560 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow profile osd", 2023-05-16T13:55:17.560 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile osd", 2023-05-16T13:55:17.560 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2023-05-16T13:55:17.560 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-05-16T13:55:17.561 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-05-16T13:55:17.561 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-05-16T13:55:17.561 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "osd.5", 2023-05-16T13:55:17.561 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDbimNklIRmNBAAqEDoxwnXhIBzpd7kIlRbOA==", 2023-05-16T13:55:17.561 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-05-16T13:55:17.561 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow profile osd", 2023-05-16T13:55:17.561 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile osd", 2023-05-16T13:55:17.561 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2023-05-16T13:55:17.562 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-05-16T13:55:17.562 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-05-16T13:55:17.562 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-05-16T13:55:17.562 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "osd.6", 2023-05-16T13:55:17.562 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDeimNkKoL+OhAAlisn6trkeC34SoITM0Hoiw==", 2023-05-16T13:55:17.562 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-05-16T13:55:17.562 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow profile osd", 2023-05-16T13:55:17.562 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile osd", 2023-05-16T13:55:17.563 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2023-05-16T13:55:17.563 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-05-16T13:55:17.563 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-05-16T13:55:17.563 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-05-16T13:55:17.563 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "osd.7", 2023-05-16T13:55:17.563 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDiimNkxiAKBRAA9Zj/TSPVVfu4QQ689ZIJPw==", 2023-05-16T13:55:17.563 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-05-16T13:55:17.564 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow profile osd", 2023-05-16T13:55:17.564 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile osd", 2023-05-16T13:55:17.564 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2023-05-16T13:55:17.564 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-05-16T13:55:17.564 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-05-16T13:55:17.564 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-05-16T13:55:17.564 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "client.0", 2023-05-16T13:55:17.564 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDEimNk1qqgLRAACZMHJldjFl2Cvgx7gJ6yhA==", 2023-05-16T13:55:17.565 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-05-16T13:55:17.565 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow", 2023-05-16T13:55:17.565 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow r", 2023-05-16T13:55:17.565 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow rw", 2023-05-16T13:55:17.565 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow rwx" 2023-05-16T13:55:17.565 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-05-16T13:55:17.565 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-05-16T13:55:17.565 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-05-16T13:55:17.566 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "client.1", 2023-05-16T13:55:17.566 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDEimNkU0ImNxAAI9U5Rj/iTyAbwX7kzVwEXQ==", 2023-05-16T13:55:17.566 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-05-16T13:55:17.566 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow", 2023-05-16T13:55:17.566 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow r", 2023-05-16T13:55:17.566 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow rw", 2023-05-16T13:55:17.566 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow rwx" 2023-05-16T13:55:17.566 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-05-16T13:55:17.567 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-05-16T13:55:17.567 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-05-16T13:55:17.567 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "client.2", 2023-05-16T13:55:17.567 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDEimNk48fVMxAAyGDUmFSeMFFIi/n5q6uibw==", 2023-05-16T13:55:17.567 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-05-16T13:55:17.567 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow", 2023-05-16T13:55:17.568 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow r", 2023-05-16T13:55:17.568 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow rw", 2023-05-16T13:55:17.568 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow rwx" 2023-05-16T13:55:17.568 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-05-16T13:55:17.568 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-05-16T13:55:17.568 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-05-16T13:55:17.568 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "client.3", 2023-05-16T13:55:17.568 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDFimNk2uFvARAARvQpkLQK0UDOfZOPSm7+kQ==", 2023-05-16T13:55:17.569 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-05-16T13:55:17.569 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow", 2023-05-16T13:55:17.569 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow r", 2023-05-16T13:55:17.569 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow rw", 2023-05-16T13:55:17.569 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow rwx" 2023-05-16T13:55:17.569 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-05-16T13:55:17.569 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-05-16T13:55:17.569 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-05-16T13:55:17.570 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "client.admin", 2023-05-16T13:55:17.570 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDDimNkGVCHNxAAY5W7pu9G6EdzHytSty0dWg==", 2023-05-16T13:55:17.570 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-05-16T13:55:17.570 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow *", 2023-05-16T13:55:17.570 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow *", 2023-05-16T13:55:17.570 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow *", 2023-05-16T13:55:17.570 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2023-05-16T13:55:17.570 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-05-16T13:55:17.571 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-05-16T13:55:17.571 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-05-16T13:55:17.571 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "client.bootstrap-mds", 2023-05-16T13:55:17.571 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDsimNke4H9OBAAzvETx3sKsaFdx0FhGMvTrQ==", 2023-05-16T13:55:17.571 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-05-16T13:55:17.571 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile bootstrap-mds" 2023-05-16T13:55:17.571 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-05-16T13:55:17.571 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-05-16T13:55:17.572 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-05-16T13:55:17.572 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "client.bootstrap-mgr", 2023-05-16T13:55:17.572 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDsimNkMIv9OBAAe1cpnD8ts/f+XEeE/LxjJA==", 2023-05-16T13:55:17.572 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-05-16T13:55:17.572 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile bootstrap-mgr" 2023-05-16T13:55:17.572 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-05-16T13:55:17.572 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-05-16T13:55:17.572 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-05-16T13:55:17.573 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "client.bootstrap-osd", 2023-05-16T13:55:17.573 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDsimNkY5b9OBAANXnL9XTDbBvLn6NYhlg/EA==", 2023-05-16T13:55:17.573 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-05-16T13:55:17.573 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile bootstrap-osd" 2023-05-16T13:55:17.573 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-05-16T13:55:17.573 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-05-16T13:55:17.573 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-05-16T13:55:17.573 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "client.bootstrap-rbd", 2023-05-16T13:55:17.574 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDsimNkqKH9OBAAo4EECVY6UGsVd1fAWg+fvA==", 2023-05-16T13:55:17.574 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-05-16T13:55:17.574 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile bootstrap-rbd" 2023-05-16T13:55:17.574 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-05-16T13:55:17.574 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-05-16T13:55:17.574 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-05-16T13:55:17.574 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-05-16T13:55:17.574 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDsimNkuqr9OBAAMAChpsMl/o7tPV9+vXf56g==", 2023-05-16T13:55:17.575 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-05-16T13:55:17.575 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-05-16T13:55:17.575 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-05-16T13:55:17.575 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-05-16T13:55:17.575 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-05-16T13:55:17.575 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "client.bootstrap-rgw", 2023-05-16T13:55:17.575 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDsimNk6LP9OBAA1Zpy1L58mfI612AfGG4YOA==", 2023-05-16T13:55:17.575 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-05-16T13:55:17.576 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile bootstrap-rgw" 2023-05-16T13:55:17.576 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-05-16T13:55:17.576 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-05-16T13:55:17.576 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-05-16T13:55:17.576 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "mgr.x", 2023-05-16T13:55:17.576 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDEimNk4i84ExAAKpzbf5Hl8JvWWxiql9pQtg==", 2023-05-16T13:55:17.576 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-05-16T13:55:17.577 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow *", 2023-05-16T13:55:17.577 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile mgr", 2023-05-16T13:55:17.577 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2023-05-16T13:55:17.577 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-05-16T13:55:17.577 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-05-16T13:55:17.577 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-05-16T13:55:17.577 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "mgr.y", 2023-05-16T13:55:17.577 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQDEimNkC1auDxAAJJOTGeM8/5aRi3XX9rx1Wg==", 2023-05-16T13:55:17.578 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2023-05-16T13:55:17.578 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow *", 2023-05-16T13:55:17.578 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile mgr", 2023-05-16T13:55:17.578 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2023-05-16T13:55:17.578 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-05-16T13:55:17.578 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-05-16T13:55:17.578 INFO:teuthology.orchestra.run.smithi039.stdout: ] 2023-05-16T13:55:17.578 INFO:teuthology.orchestra.run.smithi039.stdout:} 2023-05-16T13:55:17.579 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.543+0000 7fd0afc20640 1 -- 172.21.15.39:0/2915974627 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd08c066280 msgr2=0x7fd08c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:17.580 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.543+0000 7fd0afc20640 1 --2- 172.21.15.39:0/2915974627 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd08c066280 0x7fd08c068730 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd0a4007a60 tx=0x7fd0a4008040 comp rx=0 tx=0).stop 2023-05-16T13:55:17.580 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.543+0000 7fd0afc20640 1 -- 172.21.15.39:0/2915974627 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd0a8158bf0 msgr2=0x7fd0a8154fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:17.580 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.543+0000 7fd0afc20640 1 --2- 172.21.15.39:0/2915974627 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd0a8158bf0 0x7fd0a8154fa0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fd0a000c770 tx=0x7fd0a000cc30 comp rx=0 tx=0).stop 2023-05-16T13:55:17.580 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.543+0000 7fd0afc20640 1 -- 172.21.15.39:0/2915974627 shutdown_connections 2023-05-16T13:55:17.580 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.543+0000 7fd0afc20640 1 --2- 172.21.15.39:0/2915974627 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd0a8158bf0 0x7fd0a8154fa0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:17.581 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.543+0000 7fd0afc20640 1 --2- 172.21.15.39:0/2915974627 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0a80cb2f0 0x7fd0a814eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:17.581 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.543+0000 7fd0afc20640 1 --2- 172.21.15.39:0/2915974627 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fd08c066280 0x7fd08c068730 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:17.581 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.543+0000 7fd0afc20640 1 --2- 172.21.15.39:0/2915974627 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd0a80703b0 0x7fd0a815baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:17.581 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.543+0000 7fd0afc20640 1 -- 172.21.15.39:0/2915974627 >> 172.21.15.39:0/2915974627 conn(0x7fd0a8069a50 msgr2=0x7fd0a8161ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:17.581 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.543+0000 7fd0afc20640 1 -- 172.21.15.39:0/2915974627 shutdown_connections 2023-05-16T13:55:17.581 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.543+0000 7fd0afc20640 1 -- 172.21.15.39:0/2915974627 wait complete. 2023-05-16T13:55:17.582 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-05-16T13:55:17.719 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.711+0000 7f7408125640 1 Processor -- start 2023-05-16T13:55:17.720 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.711+0000 7f7408125640 1 -- start start 2023-05-16T13:55:17.721 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.711+0000 7f7408125640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f7400158e90 0x7f74000704b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:17.722 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.711+0000 7f7408125640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f740015d2c0 0x7f74000cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:17.722 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.711+0000 7f7408125640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f74000cb120 0x7f74000c9470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:17.722 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.711+0000 7f7408125640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7400159260 con 0x7f7400158e90 2023-05-16T13:55:17.722 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.711+0000 7f7408125640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74000cda10 con 0x7f740015d2c0 2023-05-16T13:55:17.722 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.711+0000 7f7408125640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74000709f0 con 0x7f74000cb120 2023-05-16T13:55:17.722 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.715+0000 7f7405ec1640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f7400158e90 0x7f74000704b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:17.722 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.715+0000 7f7405ec1640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f7400158e90 0x7f74000704b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42658/0 (socket says 172.21.15.39:42658) 2023-05-16T13:55:17.723 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.715+0000 7f7405ec1640 1 -- 172.21.15.39:0/1745600145 learned_addr learned my addr 172.21.15.39:0/1745600145 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:17.723 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.715+0000 7f74056c0640 1 --2- 172.21.15.39:0/1745600145 >> v2:172.21.15.118:3300/0 conn(0x7f740015d2c0 0x7f74000cabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:17.723 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.715+0000 7f74066c2640 1 --2- 172.21.15.39:0/1745600145 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f74000cb120 0x7f74000c9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:17.723 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.715+0000 7f7405ec1640 1 -- 172.21.15.39:0/1745600145 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f74000cb120 msgr2=0x7f74000c9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:17.723 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.715+0000 7f7405ec1640 1 --2- 172.21.15.39:0/1745600145 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f74000cb120 0x7f74000c9470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:17.723 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.715+0000 7f7405ec1640 1 -- 172.21.15.39:0/1745600145 >> v2:172.21.15.118:3300/0 conn(0x7f740015d2c0 msgr2=0x7f74000cabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:17.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.715+0000 7f7405ec1640 1 --2- 172.21.15.39:0/1745600145 >> v2:172.21.15.118:3300/0 conn(0x7f740015d2c0 0x7f74000cabe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:17.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.715+0000 7f7405ec1640 1 -- 172.21.15.39:0/1745600145 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74000cce90 con 0x7f7400158e90 2023-05-16T13:55:17.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.715+0000 7f74056c0640 1 --2- 172.21.15.39:0/1745600145 >> v2:172.21.15.118:3300/0 conn(0x7f740015d2c0 0x7f74000cabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:55:17.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.715+0000 7f7405ec1640 1 --2- 172.21.15.39:0/1745600145 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7400158e90 0x7f74000704b0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f74000ade90 tx=0x7f73fc01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d48554c9a8f1093a server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:17.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.715+0000 7f7404ebf640 1 -- 172.21.15.39:0/1745600145 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73fc0ab600 con 0x7f7400158e90 2023-05-16T13:55:17.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.715+0000 7f7404ebf640 1 -- 172.21.15.39:0/1745600145 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73fc0ab760 con 0x7f7400158e90 2023-05-16T13:55:17.726 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.715+0000 7f7404ebf640 1 -- 172.21.15.39:0/1745600145 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73fc0abaf0 con 0x7f7400158e90 2023-05-16T13:55:17.726 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.719+0000 7f7408125640 1 -- 172.21.15.39:0/1745600145 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7400158e90 msgr2=0x7f74000704b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:17.726 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.719+0000 7f7408125640 1 --2- 172.21.15.39:0/1745600145 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7400158e90 0x7f74000704b0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f74000ade90 tx=0x7f73fc01c440 comp rx=0 tx=0).stop 2023-05-16T13:55:17.726 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.719+0000 7f7408125640 1 -- 172.21.15.39:0/1745600145 shutdown_connections 2023-05-16T13:55:17.726 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.719+0000 7f7408125640 1 --2- 172.21.15.39:0/1745600145 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f74000cb120 0x7f74000c9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:17.726 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.719+0000 7f7408125640 1 --2- 172.21.15.39:0/1745600145 >> v2:172.21.15.118:3300/0 conn(0x7f740015d2c0 0x7f74000cabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:17.727 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.719+0000 7f7408125640 1 --2- 172.21.15.39:0/1745600145 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7400158e90 0x7f74000704b0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:17.727 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.719+0000 7f7408125640 1 -- 172.21.15.39:0/1745600145 >> 172.21.15.39:0/1745600145 conn(0x7f7400069a50 msgr2=0x7f7400069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:17.727 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.719+0000 7f7408125640 1 -- 172.21.15.39:0/1745600145 shutdown_connections 2023-05-16T13:55:17.727 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.719+0000 7f7408125640 1 -- 172.21.15.39:0/1745600145 wait complete. 2023-05-16T13:55:17.729 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.719+0000 7f7408125640 1 Processor -- start 2023-05-16T13:55:17.729 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.719+0000 7f7408125640 1 -- start start 2023-05-16T13:55:17.729 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.719+0000 7f7408125640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f74000cb120 0x7f740015b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:17.729 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.719+0000 7f7408125640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7400158e90 0x7f740015bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:17.729 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.719+0000 7f7408125640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f740015d2c0 0x7f74000aff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:17.730 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.719+0000 7f7408125640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f740015c230 con 0x7f7400158e90 2023-05-16T13:55:17.730 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.719+0000 7f7408125640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7400155b40 con 0x7f74000cb120 2023-05-16T13:55:17.730 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.719+0000 7f7408125640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7400155e20 con 0x7f740015d2c0 2023-05-16T13:55:17.730 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.719+0000 7f74056c0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7400158e90 0x7f740015bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:17.730 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.719+0000 7f74056c0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7400158e90 0x7f740015bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42664/0 (socket says 172.21.15.39:42664) 2023-05-16T13:55:17.730 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.719+0000 7f74056c0640 1 -- 172.21.15.39:0/3119842320 learned_addr learned my addr 172.21.15.39:0/3119842320 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:17.730 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.719+0000 7f7405ec1640 1 --2- 172.21.15.39:0/3119842320 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f74000cb120 0x7f740015b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:17.731 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.719+0000 7f74066c2640 1 --2- 172.21.15.39:0/3119842320 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f740015d2c0 0x7f74000aff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:17.731 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.723+0000 7f74056c0640 1 -- 172.21.15.39:0/3119842320 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f740015d2c0 msgr2=0x7f74000aff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:17.731 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.723+0000 7f74056c0640 1 --2- 172.21.15.39:0/3119842320 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f740015d2c0 0x7f74000aff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:17.731 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.723+0000 7f74056c0640 1 -- 172.21.15.39:0/3119842320 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f74000cb120 msgr2=0x7f740015b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:17.731 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.723+0000 7f74056c0640 1 --2- 172.21.15.39:0/3119842320 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f74000cb120 0x7f740015b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:17.731 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.723+0000 7f74056c0640 1 -- 172.21.15.39:0/3119842320 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73fc0094d0 con 0x7f7400158e90 2023-05-16T13:55:17.731 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.723+0000 7f7405ec1640 1 --2- 172.21.15.39:0/3119842320 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f74000cb120 0x7f740015b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-16T13:55:17.732 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.723+0000 7f74056c0640 1 --2- 172.21.15.39:0/3119842320 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7400158e90 0x7f740015bc40 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f73f000d800 tx=0x7f73f000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:17.733 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.723+0000 7f73f67fc640 1 -- 172.21.15.39:0/3119842320 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f000b6c0 con 0x7f7400158e90 2023-05-16T13:55:17.733 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.723+0000 7f73f67fc640 1 -- 172.21.15.39:0/3119842320 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73f000b820 con 0x7f7400158e90 2023-05-16T13:55:17.733 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.723+0000 7f73f67fc640 1 -- 172.21.15.39:0/3119842320 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f000bbd0 con 0x7f7400158e90 2023-05-16T13:55:17.733 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.723+0000 7f7408125640 1 -- 172.21.15.39:0/3119842320 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74000cb520 con 0x7f7400158e90 2023-05-16T13:55:17.733 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.723+0000 7f7408125640 1 -- 172.21.15.39:0/3119842320 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74000cd730 con 0x7f7400158e90 2023-05-16T13:55:17.734 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.723+0000 7f7408125640 1 -- 172.21.15.39:0/3119842320 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74000c8e10 con 0x7f7400158e90 2023-05-16T13:55:17.734 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.723+0000 7f73f67fc640 1 -- 172.21.15.39:0/3119842320 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f73f000bd30 con 0x7f7400158e90 2023-05-16T13:55:17.734 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.723+0000 7f73f67fc640 1 --2- 172.21.15.39:0/3119842320 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f73e4066280 0x7f73e4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:17.734 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.723+0000 7f73f67fc640 1 -- 172.21.15.39:0/3119842320 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f73f0083da0 con 0x7f7400158e90 2023-05-16T13:55:17.734 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.723+0000 7f7405ec1640 1 --2- 172.21.15.39:0/3119842320 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f73e4066280 0x7f73e4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:17.734 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.727+0000 7f7405ec1640 1 --2- 172.21.15.39:0/3119842320 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f73e4066280 0x7f73e4068730 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f73fc0af000 tx=0x7f73fc0b6040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:17.736 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.727+0000 7f73f67fc640 1 -- 172.21.15.39:0/3119842320 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f73f00515a0 con 0x7f7400158e90 2023-05-16T13:55:17.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.939+0000 7f7408125640 1 -- 172.21.15.39:0/3119842320 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f7400073c90 con 0x7f7400158e90 2023-05-16T13:55:17.951 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.943+0000 7f73f67fc640 1 -- 172.21.15.39:0/3119842320 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v3) v1 ==== 90+0+0 (secure 0 0 0) 0x7f73f0054bc0 con 0x7f7400158e90 2023-05-16T13:55:17.953 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.947+0000 7f7408125640 1 -- 172.21.15.39:0/3119842320 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f73e4066280 msgr2=0x7f73e4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:17.953 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.947+0000 7f7408125640 1 --2- 172.21.15.39:0/3119842320 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f73e4066280 0x7f73e4068730 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f73fc0af000 tx=0x7f73fc0b6040 comp rx=0 tx=0).stop 2023-05-16T13:55:17.953 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.947+0000 7f7408125640 1 -- 172.21.15.39:0/3119842320 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7400158e90 msgr2=0x7f740015bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:17.954 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.947+0000 7f7408125640 1 --2- 172.21.15.39:0/3119842320 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7400158e90 0x7f740015bc40 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f73f000d800 tx=0x7f73f000dcc0 comp rx=0 tx=0).stop 2023-05-16T13:55:17.954 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.947+0000 7f7408125640 1 -- 172.21.15.39:0/3119842320 shutdown_connections 2023-05-16T13:55:17.954 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.947+0000 7f7408125640 1 --2- 172.21.15.39:0/3119842320 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f73e4066280 0x7f73e4068730 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:17.954 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.947+0000 7f7408125640 1 --2- 172.21.15.39:0/3119842320 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f740015d2c0 0x7f74000aff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:17.954 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.947+0000 7f7408125640 1 --2- 172.21.15.39:0/3119842320 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7400158e90 0x7f740015bc40 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:17.954 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.947+0000 7f7408125640 1 --2- 172.21.15.39:0/3119842320 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f74000cb120 0x7f740015b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:17.954 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.947+0000 7f7408125640 1 -- 172.21.15.39:0/3119842320 >> 172.21.15.39:0/3119842320 conn(0x7f7400069a50 msgr2=0x7f7400069e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:17.955 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.947+0000 7f7408125640 1 -- 172.21.15.39:0/3119842320 shutdown_connections 2023-05-16T13:55:17.955 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:17.947+0000 7f7408125640 1 -- 172.21.15.39:0/3119842320 wait complete. 2023-05-16T13:55:17.972 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-05-16T13:55:18.110 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.103+0000 7fc9c2c2d640 1 Processor -- start 2023-05-16T13:55:18.110 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.103+0000 7fc9c2c2d640 1 -- start start 2023-05-16T13:55:18.111 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.103+0000 7fc9c2c2d640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc9bc158e90 0x7fc9bc0704b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:18.111 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.103+0000 7fc9c2c2d640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc9bc15d2c0 0x7fc9bc0cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:18.111 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.103+0000 7fc9c2c2d640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9bc0cda10 con 0x7fc9bc0cb120 2023-05-16T13:55:18.111 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.103+0000 7fc9c2c2d640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9bc159260 con 0x7fc9bc158e90 2023-05-16T13:55:18.111 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.103+0000 7fc9c2c2d640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc0709f0 con 0x7fc9bc15d2c0 2023-05-16T13:55:18.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.103+0000 7fc9bbfff640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc9bc15d2c0 0x7fc9bc0cabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:18.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.103+0000 7fc9c09c9640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc9bc158e90 0x7fc9bc0704b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:18.113 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.103+0000 7fc9bbfff640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc9bc15d2c0 0x7fc9bc0cabe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.39:45078/0 (socket says 172.21.15.39:45078) 2023-05-16T13:55:18.113 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.103+0000 7fc9bbfff640 1 -- 172.21.15.39:0/473388183 learned_addr learned my addr 172.21.15.39:0/473388183 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:18.113 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.103+0000 7fc9c11ca640 1 --1- 172.21.15.39:0/473388183 >> v1:172.21.15.118:6789/0 conn(0x7fc9bc0cb120 0x7fc9bc0c9470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.39:55126/0 (socket says 172.21.15.39:55126) 2023-05-16T13:55:18.113 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.103+0000 7fc9bbfff640 1 -- 172.21.15.39:0/473388183 >> v2:172.21.15.118:3300/0 conn(0x7fc9bc158e90 msgr2=0x7fc9bc0704b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:18.113 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.103+0000 7fc9bbfff640 1 --2- 172.21.15.39:0/473388183 >> v2:172.21.15.118:3300/0 conn(0x7fc9bc158e90 0x7fc9bc0704b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:18.113 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.103+0000 7fc9bbfff640 1 -- 172.21.15.39:0/473388183 >> v1:172.21.15.118:6789/0 conn(0x7fc9bc0cb120 legacy=0x7fc9bc0c9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:18.113 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.103+0000 7fc9bbfff640 1 -- 172.21.15.39:0/473388183 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9bc0cce90 con 0x7fc9bc15d2c0 2023-05-16T13:55:18.114 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.103+0000 7fc9c09c9640 1 --2- 172.21.15.39:0/473388183 >> v2:172.21.15.118:3300/0 conn(0x7fc9bc158e90 0x7fc9bc0704b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-16T13:55:18.114 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.107+0000 7fc9bbfff640 1 --2- 172.21.15.39:0/473388183 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc9bc15d2c0 0x7fc9bc0cabe0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc9a800bb10 tx=0x7fc9a801eb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=758d64b15567b0a2 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:18.115 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.107+0000 7fc9bb7fe640 1 -- 172.21.15.39:0/473388183 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a80a7be0 con 0x7fc9bc15d2c0 2023-05-16T13:55:18.115 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.107+0000 7fc9bb7fe640 1 -- 172.21.15.39:0/473388183 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9a80a7d40 con 0x7fc9bc15d2c0 2023-05-16T13:55:18.115 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.107+0000 7fc9bb7fe640 1 -- 172.21.15.39:0/473388183 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a80af660 con 0x7fc9bc15d2c0 2023-05-16T13:55:18.116 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.107+0000 7fc9c2c2d640 1 -- 172.21.15.39:0/473388183 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc9bc15d2c0 msgr2=0x7fc9bc0cabe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:18.116 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.107+0000 7fc9c2c2d640 1 --2- 172.21.15.39:0/473388183 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc9bc15d2c0 0x7fc9bc0cabe0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc9a800bb10 tx=0x7fc9a801eb50 comp rx=0 tx=0).stop 2023-05-16T13:55:18.116 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.107+0000 7fc9c2c2d640 1 -- 172.21.15.39:0/473388183 shutdown_connections 2023-05-16T13:55:18.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.107+0000 7fc9c2c2d640 1 --2- 172.21.15.39:0/473388183 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc9bc15d2c0 0x7fc9bc0cabe0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:18.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.107+0000 7fc9c2c2d640 1 --2- 172.21.15.39:0/473388183 >> v2:172.21.15.118:3300/0 conn(0x7fc9bc158e90 0x7fc9bc0704b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:18.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.107+0000 7fc9c2c2d640 1 -- 172.21.15.39:0/473388183 >> 172.21.15.39:0/473388183 conn(0x7fc9bc069a50 msgr2=0x7fc9bc069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:18.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.107+0000 7fc9c2c2d640 1 -- 172.21.15.39:0/473388183 shutdown_connections 2023-05-16T13:55:18.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.107+0000 7fc9c2c2d640 1 -- 172.21.15.39:0/473388183 wait complete. 2023-05-16T13:55:18.117 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.111+0000 7fc9c2c2d640 1 Processor -- start 2023-05-16T13:55:18.118 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.111+0000 7fc9c2c2d640 1 -- start start 2023-05-16T13:55:18.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.111+0000 7fc9c2c2d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc9bc0cb120 0x7fc9bc14b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:18.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.111+0000 7fc9c2c2d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9bc158e90 0x7fc9bc156ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:18.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.111+0000 7fc9c2c2d640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc9bc15d2c0 0x7fc9bc157430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:18.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.111+0000 7fc9c2c2d640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc14c870 con 0x7fc9bc0cb120 2023-05-16T13:55:18.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.111+0000 7fc9c2c2d640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc14c120 con 0x7fc9bc158e90 2023-05-16T13:55:18.120 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.111+0000 7fc9c2c2d640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc15b6f0 con 0x7fc9bc15d2c0 2023-05-16T13:55:18.120 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.111+0000 7fc9c09c9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc9bc0cb120 0x7fc9bc14b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:18.120 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.111+0000 7fc9c09c9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc9bc0cb120 0x7fc9bc14b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42668/0 (socket says 172.21.15.39:42668) 2023-05-16T13:55:18.120 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.111+0000 7fc9c09c9640 1 -- 172.21.15.39:0/3781739634 learned_addr learned my addr 172.21.15.39:0/3781739634 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:18.120 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.111+0000 7fc9c11ca640 1 --2- 172.21.15.39:0/3781739634 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc9bc15d2c0 0x7fc9bc157430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:18.120 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.111+0000 7fc9bbfff640 1 --2- 172.21.15.39:0/3781739634 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9bc158e90 0x7fc9bc156ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:18.122 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.111+0000 7fc9c09c9640 1 -- 172.21.15.39:0/3781739634 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc9bc15d2c0 msgr2=0x7fc9bc157430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:18.122 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.111+0000 7fc9c09c9640 1 --2- 172.21.15.39:0/3781739634 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc9bc15d2c0 0x7fc9bc157430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:18.122 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.111+0000 7fc9c09c9640 1 -- 172.21.15.39:0/3781739634 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9bc158e90 msgr2=0x7fc9bc156ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:18.122 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.111+0000 7fc9c09c9640 1 --2- 172.21.15.39:0/3781739634 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9bc158e90 0x7fc9bc156ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:18.122 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.111+0000 7fc9c09c9640 1 -- 172.21.15.39:0/3781739634 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9b0009420 con 0x7fc9bc0cb120 2023-05-16T13:55:18.123 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.111+0000 7fc9bbfff640 1 --2- 172.21.15.39:0/3781739634 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9bc158e90 0x7fc9bc156ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:55:18.123 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.111+0000 7fc9c09c9640 1 --2- 172.21.15.39:0/3781739634 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc9bc0cb120 0x7fc9bc14b8a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc9b000ebe0 tx=0x7fc9b000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:18.123 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.111+0000 7fc9b97fa640 1 -- 172.21.15.39:0/3781739634 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b000eee0 con 0x7fc9bc0cb120 2023-05-16T13:55:18.123 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.111+0000 7fc9b97fa640 1 -- 172.21.15.39:0/3781739634 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b000cc30 con 0x7fc9bc0cb120 2023-05-16T13:55:18.123 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.111+0000 7fc9b97fa640 1 -- 172.21.15.39:0/3781739634 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b0013470 con 0x7fc9bc0cb120 2023-05-16T13:55:18.123 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.111+0000 7fc9c2c2d640 1 -- 172.21.15.39:0/3781739634 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9a800b770 con 0x7fc9bc0cb120 2023-05-16T13:55:18.123 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.111+0000 7fc9c2c2d640 1 -- 172.21.15.39:0/3781739634 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9bc0cb520 con 0x7fc9bc0cb120 2023-05-16T13:55:18.124 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.115+0000 7fc9c2c2d640 1 -- 172.21.15.39:0/3781739634 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9bc0cd730 con 0x7fc9bc0cb120 2023-05-16T13:55:18.124 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.115+0000 7fc9b97fa640 1 -- 172.21.15.39:0/3781739634 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc9b00135d0 con 0x7fc9bc0cb120 2023-05-16T13:55:18.124 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.115+0000 7fc9b97fa640 1 --2- 172.21.15.39:0/3781739634 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc9a0066280 0x7fc9a0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:18.125 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.115+0000 7fc9b97fa640 1 -- 172.21.15.39:0/3781739634 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fc9b0084140 con 0x7fc9bc0cb120 2023-05-16T13:55:18.125 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.115+0000 7fc9bbfff640 1 --2- 172.21.15.39:0/3781739634 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc9a0066280 0x7fc9a0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:18.125 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.115+0000 7fc9bbfff640 1 --2- 172.21.15.39:0/3781739634 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc9a0066280 0x7fc9a0068730 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc9a80b1000 tx=0x7fc9a80a9070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:18.126 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.119+0000 7fc9b97fa640 1 -- 172.21.15.39:0/3781739634 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fc9b0055300 con 0x7fc9bc0cb120 2023-05-16T13:55:18.334 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.327+0000 7fc9c2c2d640 1 -- 172.21.15.39:0/3781739634 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fc9bc0c8e10 con 0x7fc9bc0cb120 2023-05-16T13:55:18.340 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.331+0000 7fc9b97fa640 1 -- 172.21.15.39:0/3781739634 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v4) v1 ==== 90+0+0 (secure 0 0 0) 0x7fc9b0054e90 con 0x7fc9bc0cb120 2023-05-16T13:55:18.342 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.335+0000 7fc9c2c2d640 1 -- 172.21.15.39:0/3781739634 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc9a0066280 msgr2=0x7fc9a0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:18.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.335+0000 7fc9c2c2d640 1 --2- 172.21.15.39:0/3781739634 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc9a0066280 0x7fc9a0068730 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc9a80b1000 tx=0x7fc9a80a9070 comp rx=0 tx=0).stop 2023-05-16T13:55:18.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.335+0000 7fc9c2c2d640 1 -- 172.21.15.39:0/3781739634 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc9bc0cb120 msgr2=0x7fc9bc14b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:18.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.335+0000 7fc9c2c2d640 1 --2- 172.21.15.39:0/3781739634 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc9bc0cb120 0x7fc9bc14b8a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc9b000ebe0 tx=0x7fc9b000c520 comp rx=0 tx=0).stop 2023-05-16T13:55:18.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.335+0000 7fc9c2c2d640 1 -- 172.21.15.39:0/3781739634 shutdown_connections 2023-05-16T13:55:18.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.335+0000 7fc9c2c2d640 1 --2- 172.21.15.39:0/3781739634 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc9a0066280 0x7fc9a0068730 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:18.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.335+0000 7fc9c2c2d640 1 --2- 172.21.15.39:0/3781739634 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc9bc15d2c0 0x7fc9bc157430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:18.343 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.335+0000 7fc9c2c2d640 1 --2- 172.21.15.39:0/3781739634 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9bc158e90 0x7fc9bc156ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:18.344 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.335+0000 7fc9c2c2d640 1 --2- 172.21.15.39:0/3781739634 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc9bc0cb120 0x7fc9bc14b8a0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:18.344 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.335+0000 7fc9c2c2d640 1 -- 172.21.15.39:0/3781739634 >> 172.21.15.39:0/3781739634 conn(0x7fc9bc069a50 msgr2=0x7fc9bc071860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:18.344 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.335+0000 7fc9c2c2d640 1 -- 172.21.15.39:0/3781739634 shutdown_connections 2023-05-16T13:55:18.344 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.335+0000 7fc9c2c2d640 1 -- 172.21.15.39:0/3781739634 wait complete. 2023-05-16T13:55:18.361 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-05-16T13:55:18.499 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.491+0000 7fc28f274640 1 Processor -- start 2023-05-16T13:55:18.499 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.491+0000 7fc28f274640 1 -- start start 2023-05-16T13:55:18.501 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.491+0000 7fc28f274640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc2880aff00 0x7fc2880cc380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:18.501 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.491+0000 7fc28f274640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2880ca550 con 0x7fc2880cde70 2023-05-16T13:55:18.501 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.491+0000 7fc28f274640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2880c9050 con 0x7fc288161210 2023-05-16T13:55:18.501 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.491+0000 7fc28f274640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2880ca050 con 0x7fc2880aff00 2023-05-16T13:55:18.501 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.495+0000 7fc28d010640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc2880aff00 0x7fc2880cc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:18.501 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.495+0000 7fc28c80f640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fc2880cde70 0x7fc2880b02d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:40498/0 (socket says 172.21.15.39:40498) 2023-05-16T13:55:18.501 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.495+0000 7fc28d010640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc2880aff00 0x7fc2880cc380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42682/0 (socket says 172.21.15.39:42682) 2023-05-16T13:55:18.502 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.495+0000 7fc28c80f640 1 -- 172.21.15.39:0/3516352079 learned_addr learned my addr 172.21.15.39:0/3516352079 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:55:18.502 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.495+0000 7fc28d010640 1 -- 172.21.15.39:0/3516352079 >> v1:172.21.15.118:6789/0 conn(0x7fc288161210 legacy=0x7fc2880caf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:18.502 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.495+0000 7fc28d010640 1 -- 172.21.15.39:0/3516352079 >> v1:172.21.15.39:6789/0 conn(0x7fc2880cde70 legacy=0x7fc2880b02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:18.502 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.495+0000 7fc28d010640 1 -- 172.21.15.39:0/3516352079 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2880caaf0 con 0x7fc2880aff00 2023-05-16T13:55:18.503 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.495+0000 7fc27ffff640 1 -- 172.21.15.39:0/3516352079 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4265602245 0 0) 0x7fc2880ca550 con 0x7fc2880cde70 2023-05-16T13:55:18.504 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.495+0000 7fc28d010640 1 --2- 172.21.15.39:0/3516352079 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2880aff00 0x7fc2880cc380 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fc2840097f0 tx=0x7fc2880cbea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8dfe94c051e1ecb server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:18.504 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.495+0000 7fc27ffff640 1 -- 172.21.15.39:0/3516352079 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2840ab600 con 0x7fc2880aff00 2023-05-16T13:55:18.505 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.495+0000 7fc27ffff640 1 -- 172.21.15.39:0/3516352079 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2840a7050 con 0x7fc2880aff00 2023-05-16T13:55:18.505 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.495+0000 7fc27ffff640 1 -- 172.21.15.39:0/3516352079 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2840ab980 con 0x7fc2880aff00 2023-05-16T13:55:18.505 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.499+0000 7fc28f274640 1 -- 172.21.15.39:0/3516352079 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2880aff00 msgr2=0x7fc2880cc380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:18.506 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.499+0000 7fc28f274640 1 --2- 172.21.15.39:0/3516352079 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2880aff00 0x7fc2880cc380 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fc2840097f0 tx=0x7fc2880cbea0 comp rx=0 tx=0).stop 2023-05-16T13:55:18.506 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.499+0000 7fc28f274640 1 -- 172.21.15.39:0/3516352079 shutdown_connections 2023-05-16T13:55:18.506 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.499+0000 7fc28f274640 1 --2- 172.21.15.39:0/3516352079 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2880aff00 0x7fc2880cc380 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:18.506 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.499+0000 7fc28f274640 1 -- 172.21.15.39:0/3516352079 >> 172.21.15.39:0/3516352079 conn(0x7fc288069a50 msgr2=0x7fc288069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:18.506 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.499+0000 7fc28f274640 1 -- 172.21.15.39:0/3516352079 shutdown_connections 2023-05-16T13:55:18.506 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.499+0000 7fc28f274640 1 -- 172.21.15.39:0/3516352079 wait complete. 2023-05-16T13:55:18.507 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.499+0000 7fc28f274640 1 Processor -- start 2023-05-16T13:55:18.507 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.499+0000 7fc28f274640 1 -- start start 2023-05-16T13:55:18.508 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.499+0000 7fc28f274640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2880aff00 0x7fc2880c4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:18.508 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.499+0000 7fc28f274640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc2880cde70 0x7fc288070670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:18.508 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.499+0000 7fc28f274640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc288161210 0x7fc288070bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:18.508 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.499+0000 7fc28f274640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2880c4d30 con 0x7fc2880aff00 2023-05-16T13:55:18.508 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.499+0000 7fc28f274640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc28815ce40 con 0x7fc2880cde70 2023-05-16T13:55:18.509 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.499+0000 7fc28f274640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2880c4a70 con 0x7fc288161210 2023-05-16T13:55:18.509 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.499+0000 7fc28d010640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2880aff00 0x7fc2880c4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:18.509 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.499+0000 7fc28d010640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2880aff00 0x7fc2880c4530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42696/0 (socket says 172.21.15.39:42696) 2023-05-16T13:55:18.509 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.499+0000 7fc28d010640 1 -- 172.21.15.39:0/3348200508 learned_addr learned my addr 172.21.15.39:0/3348200508 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:18.510 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.499+0000 7fc28c80f640 1 --2- 172.21.15.39:0/3348200508 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc2880cde70 0x7fc288070670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:18.510 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.499+0000 7fc28d010640 1 -- 172.21.15.39:0/3348200508 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc288161210 msgr2=0x7fc288070bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:18.511 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.499+0000 7fc28d010640 1 --2- 172.21.15.39:0/3348200508 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc288161210 0x7fc288070bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:18.511 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.499+0000 7fc28d010640 1 -- 172.21.15.39:0/3348200508 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc2880cde70 msgr2=0x7fc288070670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:18.511 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.499+0000 7fc28d010640 1 --2- 172.21.15.39:0/3348200508 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc2880cde70 0x7fc288070670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:18.511 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.499+0000 7fc28d010640 1 -- 172.21.15.39:0/3348200508 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc284009420 con 0x7fc2880aff00 2023-05-16T13:55:18.511 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.499+0000 7fc28c80f640 1 --2- 172.21.15.39:0/3348200508 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc2880cde70 0x7fc288070670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-16T13:55:18.511 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.503+0000 7fc28d010640 1 --2- 172.21.15.39:0/3348200508 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2880aff00 0x7fc2880c4530 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fc284019090 tx=0x7fc28401acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:18.511 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.503+0000 7fc27dffb640 1 -- 172.21.15.39:0/3348200508 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2840b7650 con 0x7fc2880aff00 2023-05-16T13:55:18.512 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.503+0000 7fc27dffb640 1 -- 172.21.15.39:0/3348200508 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2840b77b0 con 0x7fc2880aff00 2023-05-16T13:55:18.512 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.503+0000 7fc27dffb640 1 -- 172.21.15.39:0/3348200508 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2840b7b40 con 0x7fc2880aff00 2023-05-16T13:55:18.512 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.503+0000 7fc28f274640 1 -- 172.21.15.39:0/3348200508 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2880c8ad0 con 0x7fc2880aff00 2023-05-16T13:55:18.512 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.503+0000 7fc28f274640 1 -- 172.21.15.39:0/3348200508 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc288161a20 con 0x7fc2880aff00 2023-05-16T13:55:18.512 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.503+0000 7fc28f274640 1 -- 172.21.15.39:0/3348200508 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc28816e490 con 0x7fc2880aff00 2023-05-16T13:55:18.513 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.503+0000 7fc27dffb640 1 -- 172.21.15.39:0/3348200508 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc2840b7ca0 con 0x7fc2880aff00 2023-05-16T13:55:18.513 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.503+0000 7fc27dffb640 1 --2- 172.21.15.39:0/3348200508 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc26c066280 0x7fc26c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:18.513 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.503+0000 7fc27dffb640 1 -- 172.21.15.39:0/3348200508 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fc28411e570 con 0x7fc2880aff00 2023-05-16T13:55:18.513 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.503+0000 7fc28c80f640 1 --2- 172.21.15.39:0/3348200508 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc26c066280 0x7fc26c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:18.513 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.507+0000 7fc28c80f640 1 --2- 172.21.15.39:0/3348200508 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc26c066280 0x7fc26c068730 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc2880c88b0 tx=0x7fc278009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:18.517 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.511+0000 7fc27dffb640 1 -- 172.21.15.39:0/3348200508 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fc2840ebe50 con 0x7fc2880aff00 2023-05-16T13:55:18.728 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.719+0000 7fc28f274640 1 -- 172.21.15.39:0/3348200508 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fc288073c90 con 0x7fc2880aff00 2023-05-16T13:55:18.733 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.727+0000 7fc27dffb640 1 -- 172.21.15.39:0/3348200508 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7fc2840bb0a0 con 0x7fc2880aff00 2023-05-16T13:55:18.735 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.727+0000 7fc28f274640 1 -- 172.21.15.39:0/3348200508 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc26c066280 msgr2=0x7fc26c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:18.735 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.727+0000 7fc28f274640 1 --2- 172.21.15.39:0/3348200508 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc26c066280 0x7fc26c068730 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc2880c88b0 tx=0x7fc278009040 comp rx=0 tx=0).stop 2023-05-16T13:55:18.735 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.727+0000 7fc28f274640 1 -- 172.21.15.39:0/3348200508 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2880aff00 msgr2=0x7fc2880c4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:18.736 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.727+0000 7fc28f274640 1 --2- 172.21.15.39:0/3348200508 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2880aff00 0x7fc2880c4530 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fc284019090 tx=0x7fc28401acc0 comp rx=0 tx=0).stop 2023-05-16T13:55:18.736 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.727+0000 7fc28f274640 1 -- 172.21.15.39:0/3348200508 shutdown_connections 2023-05-16T13:55:18.736 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.727+0000 7fc28f274640 1 --2- 172.21.15.39:0/3348200508 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc26c066280 0x7fc26c068730 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:18.736 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.727+0000 7fc28f274640 1 --2- 172.21.15.39:0/3348200508 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc288161210 0x7fc288070bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:18.736 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.727+0000 7fc28f274640 1 --2- 172.21.15.39:0/3348200508 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc2880cde70 0x7fc288070670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:18.736 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.727+0000 7fc28f274640 1 --2- 172.21.15.39:0/3348200508 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2880aff00 0x7fc2880c4530 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:18.736 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.727+0000 7fc28f274640 1 -- 172.21.15.39:0/3348200508 >> 172.21.15.39:0/3348200508 conn(0x7fc288069a50 msgr2=0x7fc288162b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:18.737 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.727+0000 7fc28f274640 1 -- 172.21.15.39:0/3348200508 shutdown_connections 2023-05-16T13:55:18.737 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.727+0000 7fc28f274640 1 -- 172.21.15.39:0/3348200508 wait complete. 2023-05-16T13:55:18.754 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-05-16T13:55:18.893 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.887+0000 7f5296bf0640 1 Processor -- start 2023-05-16T13:55:18.894 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.887+0000 7f5296bf0640 1 -- start start 2023-05-16T13:55:18.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.887+0000 7f5296bf0640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f529006c870 0x7f529006fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:18.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.887+0000 7f5296bf0640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f529015ead0 con 0x7f52900b0610 2023-05-16T13:55:18.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.887+0000 7f5296bf0640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52900701c0 con 0x7f529015e700 2023-05-16T13:55:18.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.887+0000 7f5296bf0640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f529006ccf0 con 0x7f529006c870 2023-05-16T13:55:18.895 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.887+0000 7f529518d640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f529006c870 0x7f529006fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:18.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.887+0000 7f528ffff640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f52900b0610 0x7f52900cc380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:40508/0 (socket says 172.21.15.39:40508) 2023-05-16T13:55:18.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.887+0000 7f528ffff640 1 -- 172.21.15.39:0/391689107 learned_addr learned my addr 172.21.15.39:0/391689107 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:55:18.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.887+0000 7f529518d640 1 -- 172.21.15.39:0/391689107 >> v1:172.21.15.118:6789/0 conn(0x7f529015e700 legacy=0x7f52900aff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:18.896 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.887+0000 7f529518d640 1 -- 172.21.15.39:0/391689107 >> v1:172.21.15.39:6789/0 conn(0x7f52900b0610 legacy=0x7f52900cc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:18.897 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.887+0000 7f529518d640 1 -- 172.21.15.39:0/391689107 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5290071ca0 con 0x7f529006c870 2023-05-16T13:55:18.897 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.887+0000 7f528f7fe640 1 -- 172.21.15.39:0/391689107 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1765994010 0 0) 0x7f527c001120 con 0x7f52900b0610 2023-05-16T13:55:18.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.891+0000 7f529518d640 1 --2- 172.21.15.39:0/391689107 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f529006c870 0x7f529006fc80 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f5288009d90 tx=0x7f528801c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=270c7d48adb8fbcf server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:18.898 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.891+0000 7f528f7fe640 1 -- 172.21.15.39:0/391689107 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52880a5870 con 0x7f529006c870 2023-05-16T13:55:18.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.891+0000 7f528f7fe640 1 -- 172.21.15.39:0/391689107 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52880a59d0 con 0x7f529006c870 2023-05-16T13:55:18.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.891+0000 7f528f7fe640 1 -- 172.21.15.39:0/391689107 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52880a5d60 con 0x7f529006c870 2023-05-16T13:55:18.899 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.891+0000 7f5296bf0640 1 -- 172.21.15.39:0/391689107 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f529006c870 msgr2=0x7f529006fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:18.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.891+0000 7f5296bf0640 1 --2- 172.21.15.39:0/391689107 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f529006c870 0x7f529006fc80 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f5288009d90 tx=0x7f528801c8c0 comp rx=0 tx=0).stop 2023-05-16T13:55:18.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.891+0000 7f5296bf0640 1 -- 172.21.15.39:0/391689107 shutdown_connections 2023-05-16T13:55:18.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.891+0000 7f5296bf0640 1 --2- 172.21.15.39:0/391689107 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f529006c870 0x7f529006fc80 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:18.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.891+0000 7f5296bf0640 1 -- 172.21.15.39:0/391689107 >> 172.21.15.39:0/391689107 conn(0x7f5290069a50 msgr2=0x7f5290069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:18.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.891+0000 7f5296bf0640 1 -- 172.21.15.39:0/391689107 shutdown_connections 2023-05-16T13:55:18.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.891+0000 7f5296bf0640 1 -- 172.21.15.39:0/391689107 wait complete. 2023-05-16T13:55:18.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.891+0000 7f5296bf0640 1 Processor -- start 2023-05-16T13:55:18.901 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.895+0000 7f5296bf0640 1 -- start start 2023-05-16T13:55:18.902 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.895+0000 7f5296bf0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f529006c870 0x7f52900b3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:18.902 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.895+0000 7f5296bf0640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f52900b0610 0x7f529015bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:18.902 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.895+0000 7f5296bf0640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f529015e700 0x7f5290151bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:18.902 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.895+0000 7f5296bf0640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f529015b660 con 0x7f529006c870 2023-05-16T13:55:18.903 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.895+0000 7f5296bf0640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5290157d80 con 0x7f52900b0610 2023-05-16T13:55:18.903 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.895+0000 7f5296bf0640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5290158060 con 0x7f529015e700 2023-05-16T13:55:18.903 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.895+0000 7f529498c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f529006c870 0x7f52900b3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:18.903 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.895+0000 7f529498c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f529006c870 0x7f52900b3100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42716/0 (socket says 172.21.15.39:42716) 2023-05-16T13:55:18.903 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.895+0000 7f529498c640 1 -- 172.21.15.39:0/2446874069 learned_addr learned my addr 172.21.15.39:0/2446874069 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:18.903 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.895+0000 7f528ffff640 1 --2- 172.21.15.39:0/2446874069 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f52900b0610 0x7f529015bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:18.903 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.895+0000 7f529518d640 1 --2- 172.21.15.39:0/2446874069 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f529015e700 0x7f5290151bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:18.904 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.895+0000 7f529498c640 1 -- 172.21.15.39:0/2446874069 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f529015e700 msgr2=0x7f5290151bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:18.905 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.895+0000 7f529498c640 1 --2- 172.21.15.39:0/2446874069 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f529015e700 0x7f5290151bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:18.905 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.895+0000 7f529498c640 1 -- 172.21.15.39:0/2446874069 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f52900b0610 msgr2=0x7f529015bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:18.905 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.895+0000 7f529498c640 1 --2- 172.21.15.39:0/2446874069 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f52900b0610 0x7f529015bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:18.905 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.895+0000 7f529498c640 1 -- 172.21.15.39:0/2446874069 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5288009a70 con 0x7f529006c870 2023-05-16T13:55:18.905 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.895+0000 7f529518d640 1 --2- 172.21.15.39:0/2446874069 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f529015e700 0x7f5290151bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:55:18.905 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.895+0000 7f529498c640 1 --2- 172.21.15.39:0/2446874069 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f529006c870 0x7f52900b3100 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f528400c500 tx=0x7f528400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:18.905 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.895+0000 7f528d7fa640 1 -- 172.21.15.39:0/2446874069 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5284005220 con 0x7f529006c870 2023-05-16T13:55:18.906 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.895+0000 7f528d7fa640 1 -- 172.21.15.39:0/2446874069 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5284005380 con 0x7f529006c870 2023-05-16T13:55:18.906 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.895+0000 7f528d7fa640 1 -- 172.21.15.39:0/2446874069 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5284007270 con 0x7f529006c870 2023-05-16T13:55:18.906 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.895+0000 7f5296bf0640 1 -- 172.21.15.39:0/2446874069 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52900715e0 con 0x7f529006c870 2023-05-16T13:55:18.906 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.895+0000 7f5296bf0640 1 -- 172.21.15.39:0/2446874069 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5290071930 con 0x7f529006c870 2023-05-16T13:55:18.906 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.895+0000 7f5296bf0640 1 -- 172.21.15.39:0/2446874069 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f529015db40 con 0x7f529006c870 2023-05-16T13:55:18.907 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.899+0000 7f528d7fa640 1 -- 172.21.15.39:0/2446874069 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f52840073d0 con 0x7f529006c870 2023-05-16T13:55:18.907 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.899+0000 7f528d7fa640 1 --2- 172.21.15.39:0/2446874069 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f5274066280 0x7f5274068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:18.907 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.899+0000 7f528d7fa640 1 -- 172.21.15.39:0/2446874069 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f5284082bb0 con 0x7f529006c870 2023-05-16T13:55:18.907 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.899+0000 7f528ffff640 1 --2- 172.21.15.39:0/2446874069 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f5274066280 0x7f5274068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:18.907 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.899+0000 7f528ffff640 1 --2- 172.21.15.39:0/2446874069 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f5274066280 0x7f5274068730 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f529015d5c0 tx=0x7f527c007240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:18.910 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:18.903+0000 7f528d7fa640 1 -- 172.21.15.39:0/2446874069 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f52840503a0 con 0x7f529006c870 2023-05-16T13:55:19.118 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.111+0000 7f5296bf0640 1 -- 172.21.15.39:0/2446874069 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f52900701c0 con 0x7f529006c870 2023-05-16T13:55:19.123 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.115+0000 7f528d7fa640 1 -- 172.21.15.39:0/2446874069 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7f52900701c0 con 0x7f529006c870 2023-05-16T13:55:19.124 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.115+0000 7f5296bf0640 1 -- 172.21.15.39:0/2446874069 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f5274066280 msgr2=0x7f5274068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:19.125 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.115+0000 7f5296bf0640 1 --2- 172.21.15.39:0/2446874069 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f5274066280 0x7f5274068730 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f529015d5c0 tx=0x7f527c007240 comp rx=0 tx=0).stop 2023-05-16T13:55:19.125 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.115+0000 7f5296bf0640 1 -- 172.21.15.39:0/2446874069 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f529006c870 msgr2=0x7f52900b3100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:19.125 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.115+0000 7f5296bf0640 1 --2- 172.21.15.39:0/2446874069 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f529006c870 0x7f52900b3100 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f528400c500 tx=0x7f528400c9c0 comp rx=0 tx=0).stop 2023-05-16T13:55:19.125 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.115+0000 7f5296bf0640 1 -- 172.21.15.39:0/2446874069 shutdown_connections 2023-05-16T13:55:19.125 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.115+0000 7f5296bf0640 1 --2- 172.21.15.39:0/2446874069 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f5274066280 0x7f5274068730 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:19.125 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.115+0000 7f5296bf0640 1 --2- 172.21.15.39:0/2446874069 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f529015e700 0x7f5290151bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:19.126 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.115+0000 7f5296bf0640 1 --2- 172.21.15.39:0/2446874069 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f52900b0610 0x7f529015bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:19.126 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.115+0000 7f5296bf0640 1 --2- 172.21.15.39:0/2446874069 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f529006c870 0x7f52900b3100 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:19.126 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.115+0000 7f5296bf0640 1 -- 172.21.15.39:0/2446874069 >> 172.21.15.39:0/2446874069 conn(0x7f5290069a50 msgr2=0x7f52901654d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:19.126 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.115+0000 7f5296bf0640 1 -- 172.21.15.39:0/2446874069 shutdown_connections 2023-05-16T13:55:19.126 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.115+0000 7f5296bf0640 1 -- 172.21.15.39:0/2446874069 wait complete. 2023-05-16T13:55:19.143 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-05-16T13:55:19.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.275+0000 7fdd7516d640 1 Processor -- start 2023-05-16T13:55:19.283 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.275+0000 7fdd7516d640 1 -- start start 2023-05-16T13:55:19.284 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.275+0000 7fdd7516d640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fdd7015c170 0x7fdd700d0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:19.284 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.275+0000 7fdd7516d640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fdd700d09b0 0x7fdd700d2380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:19.284 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.275+0000 7fdd7516d640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd700cd400 con 0x7fdd700d28c0 2023-05-16T13:55:19.284 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.275+0000 7fdd7516d640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd700d3700 con 0x7fdd7015c170 2023-05-16T13:55:19.284 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.275+0000 7fdd7516d640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd700d0e30 con 0x7fdd700d09b0 2023-05-16T13:55:19.284 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.275+0000 7fdd6ed9d640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fdd7015c170 0x7fdd700d0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:19.285 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.275+0000 7fdd6ed9d640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fdd7015c170 0x7fdd700d0470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42728/0 (socket says 172.21.15.39:42728) 2023-05-16T13:55:19.285 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.275+0000 7fdd6ed9d640 1 -- 172.21.15.39:0/1812517641 learned_addr learned my addr 172.21.15.39:0/1812517641 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:19.285 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.275+0000 7fdd67fff640 1 --2- 172.21.15.39:0/1812517641 >> v2:172.21.15.118:3300/0 conn(0x7fdd700d09b0 0x7fdd700d2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:19.285 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.275+0000 7fdd6ed9d640 1 -- 172.21.15.39:0/1812517641 >> v2:172.21.15.118:3300/0 conn(0x7fdd700d09b0 msgr2=0x7fdd700d2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:19.285 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.275+0000 7fdd6ed9d640 1 --2- 172.21.15.39:0/1812517641 >> v2:172.21.15.118:3300/0 conn(0x7fdd700d09b0 0x7fdd700d2380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:19.286 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.275+0000 7fdd6ed9d640 1 -- 172.21.15.39:0/1812517641 >> v1:172.21.15.118:6789/0 conn(0x7fdd700d28c0 legacy=0x7fdd700cf230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:19.286 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.275+0000 7fdd6ed9d640 1 -- 172.21.15.39:0/1812517641 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd700d3140 con 0x7fdd7015c170 2023-05-16T13:55:19.287 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.279+0000 7fdd6ed9d640 1 --2- 172.21.15.39:0/1812517641 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdd7015c170 0x7fdd700d0470 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fdd700b5490 tx=0x7fdd6001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fa2689de07c4f3 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:19.287 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.279+0000 7fdd6e59c640 1 -- 172.21.15.39:0/1812517641 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd600ab640 con 0x7fdd7015c170 2023-05-16T13:55:19.288 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.279+0000 7fdd6e59c640 1 -- 172.21.15.39:0/1812517641 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd600a7070 con 0x7fdd7015c170 2023-05-16T13:55:19.288 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.279+0000 7fdd6e59c640 1 -- 172.21.15.39:0/1812517641 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd600ab9c0 con 0x7fdd7015c170 2023-05-16T13:55:19.289 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.279+0000 7fdd7516d640 1 -- 172.21.15.39:0/1812517641 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdd7015c170 msgr2=0x7fdd700d0470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:19.289 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.279+0000 7fdd7516d640 1 --2- 172.21.15.39:0/1812517641 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdd7015c170 0x7fdd700d0470 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fdd700b5490 tx=0x7fdd6001c440 comp rx=0 tx=0).stop 2023-05-16T13:55:19.289 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.279+0000 7fdd7516d640 1 -- 172.21.15.39:0/1812517641 shutdown_connections 2023-05-16T13:55:19.289 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.279+0000 7fdd7516d640 1 --2- 172.21.15.39:0/1812517641 >> v2:172.21.15.118:3300/0 conn(0x7fdd700d09b0 0x7fdd700d2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:19.289 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.279+0000 7fdd7516d640 1 --2- 172.21.15.39:0/1812517641 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdd7015c170 0x7fdd700d0470 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:19.289 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.279+0000 7fdd7516d640 1 -- 172.21.15.39:0/1812517641 >> 172.21.15.39:0/1812517641 conn(0x7fdd70071aa0 msgr2=0x7fdd7009bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:19.290 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.279+0000 7fdd7516d640 1 -- 172.21.15.39:0/1812517641 shutdown_connections 2023-05-16T13:55:19.290 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.279+0000 7fdd7516d640 1 -- 172.21.15.39:0/1812517641 wait complete. 2023-05-16T13:55:19.290 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.283+0000 7fdd7516d640 1 Processor -- start 2023-05-16T13:55:19.290 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.283+0000 7fdd7516d640 1 -- start start 2023-05-16T13:55:19.291 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.283+0000 7fdd7516d640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdd700d09b0 0x7fdd70158fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:19.292 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.283+0000 7fdd7516d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdd700d28c0 0x7fdd7006b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:19.292 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.283+0000 7fdd7516d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdd7015c170 0x7fdd7006b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:19.292 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.283+0000 7fdd7516d640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd700c8f70 con 0x7fdd700d28c0 2023-05-16T13:55:19.292 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.283+0000 7fdd7516d640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd701572f0 con 0x7fdd7015c170 2023-05-16T13:55:19.292 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.283+0000 7fdd7516d640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd701575d0 con 0x7fdd700d09b0 2023-05-16T13:55:19.292 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.283+0000 7fdd67fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdd700d28c0 0x7fdd7006b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:19.292 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.283+0000 7fdd67fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdd700d28c0 0x7fdd7006b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42736/0 (socket says 172.21.15.39:42736) 2023-05-16T13:55:19.293 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.283+0000 7fdd67fff640 1 -- 172.21.15.39:0/1766840707 learned_addr learned my addr 172.21.15.39:0/1766840707 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:19.293 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.283+0000 7fdd6ed9d640 1 --2- 172.21.15.39:0/1766840707 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdd700d09b0 0x7fdd70158fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:19.293 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.283+0000 7fdd6f59e640 1 --2- 172.21.15.39:0/1766840707 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdd7015c170 0x7fdd7006b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:19.293 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.283+0000 7fdd67fff640 1 -- 172.21.15.39:0/1766840707 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdd700d09b0 msgr2=0x7fdd70158fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:19.293 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.283+0000 7fdd67fff640 1 --2- 172.21.15.39:0/1766840707 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdd700d09b0 0x7fdd70158fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:19.293 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.283+0000 7fdd67fff640 1 -- 172.21.15.39:0/1766840707 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdd7015c170 msgr2=0x7fdd7006b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:19.293 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.283+0000 7fdd67fff640 1 --2- 172.21.15.39:0/1766840707 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdd7015c170 0x7fdd7006b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:19.294 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.283+0000 7fdd67fff640 1 -- 172.21.15.39:0/1766840707 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd600094d0 con 0x7fdd700d28c0 2023-05-16T13:55:19.294 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.283+0000 7fdd67fff640 1 --2- 172.21.15.39:0/1766840707 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdd700d28c0 0x7fdd7006b0d0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fdd5800e870 tx=0x7fdd5800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:19.295 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.283+0000 7fdd677fe640 1 -- 172.21.15.39:0/1766840707 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd58009510 con 0x7fdd700d28c0 2023-05-16T13:55:19.295 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.283+0000 7fdd677fe640 1 -- 172.21.15.39:0/1766840707 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd5800eec0 con 0x7fdd700d28c0 2023-05-16T13:55:19.295 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.283+0000 7fdd7516d640 1 -- 172.21.15.39:0/1766840707 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd700d2cc0 con 0x7fdd700d28c0 2023-05-16T13:55:19.295 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.283+0000 7fdd677fe640 1 -- 172.21.15.39:0/1766840707 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5800cb40 con 0x7fdd700d28c0 2023-05-16T13:55:19.295 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.283+0000 7fdd7516d640 1 -- 172.21.15.39:0/1766840707 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd7015c540 con 0x7fdd700d28c0 2023-05-16T13:55:19.295 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.287+0000 7fdd7516d640 1 -- 172.21.15.39:0/1766840707 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd700d2e50 con 0x7fdd700d28c0 2023-05-16T13:55:19.296 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.287+0000 7fdd677fe640 1 -- 172.21.15.39:0/1766840707 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdd5800ccc0 con 0x7fdd700d28c0 2023-05-16T13:55:19.296 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.287+0000 7fdd677fe640 1 --2- 172.21.15.39:0/1766840707 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fdd50066280 0x7fdd50068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:19.296 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.287+0000 7fdd677fe640 1 -- 172.21.15.39:0/1766840707 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fdd58083b00 con 0x7fdd700d28c0 2023-05-16T13:55:19.297 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.287+0000 7fdd6ed9d640 1 --2- 172.21.15.39:0/1766840707 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fdd50066280 0x7fdd50068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:19.297 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.287+0000 7fdd6ed9d640 1 --2- 172.21.15.39:0/1766840707 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fdd50066280 0x7fdd50068730 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fdd600af000 tx=0x7fdd600b6040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:19.299 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.291+0000 7fdd677fe640 1 -- 172.21.15.39:0/1766840707 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fdd58085e60 con 0x7fdd700d28c0 2023-05-16T13:55:19.505 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.499+0000 7fdd7516d640 1 -- 172.21.15.39:0/1766840707 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fdd70073c90 con 0x7fdd700d28c0 2023-05-16T13:55:19.513 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.507+0000 7fdd677fe640 1 -- 172.21.15.39:0/1766840707 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v7) v1 ==== 97+0+0 (secure 0 0 0) 0x7fdd580170a0 con 0x7fdd700d28c0 2023-05-16T13:55:19.516 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.507+0000 7fdd7516d640 1 -- 172.21.15.39:0/1766840707 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fdd50066280 msgr2=0x7fdd50068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:19.516 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.507+0000 7fdd7516d640 1 --2- 172.21.15.39:0/1766840707 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fdd50066280 0x7fdd50068730 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fdd600af000 tx=0x7fdd600b6040 comp rx=0 tx=0).stop 2023-05-16T13:55:19.516 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.507+0000 7fdd7516d640 1 -- 172.21.15.39:0/1766840707 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdd700d28c0 msgr2=0x7fdd7006b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:19.516 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.507+0000 7fdd7516d640 1 --2- 172.21.15.39:0/1766840707 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdd700d28c0 0x7fdd7006b0d0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fdd5800e870 tx=0x7fdd5800ec70 comp rx=0 tx=0).stop 2023-05-16T13:55:19.516 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.507+0000 7fdd7516d640 1 -- 172.21.15.39:0/1766840707 shutdown_connections 2023-05-16T13:55:19.516 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.507+0000 7fdd7516d640 1 --2- 172.21.15.39:0/1766840707 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdd7015c170 0x7fdd7006b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:19.517 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.507+0000 7fdd7516d640 1 --2- 172.21.15.39:0/1766840707 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdd700d28c0 0x7fdd7006b0d0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:19.517 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.507+0000 7fdd7516d640 1 --2- 172.21.15.39:0/1766840707 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fdd50066280 0x7fdd50068730 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:19.517 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.507+0000 7fdd7516d640 1 --2- 172.21.15.39:0/1766840707 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdd700d09b0 0x7fdd70158fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:19.517 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.507+0000 7fdd7516d640 1 -- 172.21.15.39:0/1766840707 >> 172.21.15.39:0/1766840707 conn(0x7fdd70071aa0 msgr2=0x7fdd700b56d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:19.517 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.507+0000 7fdd7516d640 1 -- 172.21.15.39:0/1766840707 shutdown_connections 2023-05-16T13:55:19.517 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.507+0000 7fdd7516d640 1 -- 172.21.15.39:0/1766840707 wait complete. 2023-05-16T13:55:19.534 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-05-16T13:55:19.674 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.667+0000 7ff6be7a2640 1 Processor -- start 2023-05-16T13:55:19.674 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.667+0000 7ff6be7a2640 1 -- start start 2023-05-16T13:55:19.675 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.667+0000 7ff6be7a2640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff6b81598b0 0x7ff6b815cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:19.675 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.667+0000 7ff6be7a2640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7ff6b80b4b00 0x7ff6b80d01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:19.675 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.667+0000 7ff6be7a2640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6b8159c80 con 0x7ff6b80d06f0 2023-05-16T13:55:19.675 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.667+0000 7ff6be7a2640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6b815d270 con 0x7ff6b80b4b00 2023-05-16T13:55:19.675 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.667+0000 7ff6be7a2640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6b80cd390 con 0x7ff6b81598b0 2023-05-16T13:55:19.676 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.667+0000 7ff6bcf9f640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7ff6b80b4b00 0x7ff6b80d01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:19.676 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.667+0000 7ff6bcf9f640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7ff6b80b4b00 0x7ff6b80d01b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42750/0 (socket says 172.21.15.39:42750) 2023-05-16T13:55:19.677 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.667+0000 7ff6bdfa1640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7ff6b80d06f0 0x7ff6b80cf000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:40522/0 (socket says 172.21.15.39:40522) 2023-05-16T13:55:19.677 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.667+0000 7ff6bcf9f640 1 -- 172.21.15.39:0/1242858235 learned_addr learned my addr 172.21.15.39:0/1242858235 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:19.677 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.667+0000 7ff6bd7a0640 1 --2- 172.21.15.39:0/1242858235 >> v2:172.21.15.118:3300/0 conn(0x7ff6b81598b0 0x7ff6b815cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:19.677 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.667+0000 7ff6bcf9f640 1 -- 172.21.15.39:0/1242858235 >> v2:172.21.15.118:3300/0 conn(0x7ff6b81598b0 msgr2=0x7ff6b815cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:19.677 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.667+0000 7ff6bcf9f640 1 --2- 172.21.15.39:0/1242858235 >> v2:172.21.15.118:3300/0 conn(0x7ff6b81598b0 0x7ff6b815cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:19.677 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.667+0000 7ff6bcf9f640 1 -- 172.21.15.39:0/1242858235 >> v1:172.21.15.39:6789/0 conn(0x7ff6b80d06f0 legacy=0x7ff6b80cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:19.677 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.667+0000 7ff6affff640 1 -- 172.21.15.39:0/1242858235 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 391676551 0 0) 0x7ff6b8159c80 con 0x7ff6b80d06f0 2023-05-16T13:55:19.677 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.667+0000 7ff6bcf9f640 1 -- 172.21.15.39:0/1242858235 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b80ccdd0 con 0x7ff6b80b4b00 2023-05-16T13:55:19.678 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.671+0000 7ff6bcf9f640 1 --2- 172.21.15.39:0/1242858235 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff6b80b4b00 0x7ff6b80d01b0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7ff6b8066ee0 tx=0x7ff6a801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53c44a0928a15e1f server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:19.679 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.671+0000 7ff6affff640 1 -- 172.21.15.39:0/1242858235 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a80ab5f0 con 0x7ff6b80b4b00 2023-05-16T13:55:19.679 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.671+0000 7ff6affff640 1 -- 172.21.15.39:0/1242858235 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a80ab750 con 0x7ff6b80b4b00 2023-05-16T13:55:19.679 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.671+0000 7ff6affff640 1 -- 172.21.15.39:0/1242858235 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a80abae0 con 0x7ff6b80b4b00 2023-05-16T13:55:19.680 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.671+0000 7ff6be7a2640 1 -- 172.21.15.39:0/1242858235 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff6b80b4b00 msgr2=0x7ff6b80d01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:19.680 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.671+0000 7ff6be7a2640 1 --2- 172.21.15.39:0/1242858235 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff6b80b4b00 0x7ff6b80d01b0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7ff6b8066ee0 tx=0x7ff6a801c500 comp rx=0 tx=0).stop 2023-05-16T13:55:19.680 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.671+0000 7ff6be7a2640 1 -- 172.21.15.39:0/1242858235 shutdown_connections 2023-05-16T13:55:19.680 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.671+0000 7ff6be7a2640 1 --2- 172.21.15.39:0/1242858235 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff6b80b4b00 0x7ff6b80d01b0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:19.680 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.671+0000 7ff6be7a2640 1 --2- 172.21.15.39:0/1242858235 >> v2:172.21.15.118:3300/0 conn(0x7ff6b81598b0 0x7ff6b815cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:19.681 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.671+0000 7ff6be7a2640 1 -- 172.21.15.39:0/1242858235 >> 172.21.15.39:0/1242858235 conn(0x7ff6b806aad0 msgr2=0x7ff6b806aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:19.681 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.671+0000 7ff6be7a2640 1 -- 172.21.15.39:0/1242858235 shutdown_connections 2023-05-16T13:55:19.681 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.671+0000 7ff6be7a2640 1 -- 172.21.15.39:0/1242858235 wait complete. 2023-05-16T13:55:19.681 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.675+0000 7ff6be7a2640 1 Processor -- start 2023-05-16T13:55:19.682 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.675+0000 7ff6be7a2640 1 -- start start 2023-05-16T13:55:19.682 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.675+0000 7ff6be7a2640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff6b80b4b00 0x7ff6b80b2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:19.682 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.675+0000 7ff6be7a2640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff6b80d06f0 0x7ff6b8158a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:19.683 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.675+0000 7ff6be7a2640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff6b81598b0 0x7ff6b814fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:19.683 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.675+0000 7ff6be7a2640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b80b1310 con 0x7ff6b81598b0 2023-05-16T13:55:19.683 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.675+0000 7ff6be7a2640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b80b25a0 con 0x7ff6b80d06f0 2023-05-16T13:55:19.683 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.675+0000 7ff6be7a2640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b80b1580 con 0x7ff6b80b4b00 2023-05-16T13:55:19.683 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.675+0000 7ff6bdfa1640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff6b81598b0 0x7ff6b814fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:19.683 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.675+0000 7ff6bdfa1640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff6b81598b0 0x7ff6b814fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42766/0 (socket says 172.21.15.39:42766) 2023-05-16T13:55:19.683 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.675+0000 7ff6bdfa1640 1 -- 172.21.15.39:0/1264255153 learned_addr learned my addr 172.21.15.39:0/1264255153 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:19.684 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.675+0000 7ff6bcf9f640 1 --2- 172.21.15.39:0/1264255153 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff6b80d06f0 0x7ff6b8158a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:19.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.675+0000 7ff6bd7a0640 1 --2- 172.21.15.39:0/1264255153 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff6b80b4b00 0x7ff6b80b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:19.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.675+0000 7ff6bdfa1640 1 -- 172.21.15.39:0/1264255153 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff6b80b4b00 msgr2=0x7ff6b80b2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:19.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.675+0000 7ff6bdfa1640 1 --2- 172.21.15.39:0/1264255153 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff6b80b4b00 0x7ff6b80b2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:19.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.675+0000 7ff6bdfa1640 1 -- 172.21.15.39:0/1264255153 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff6b80d06f0 msgr2=0x7ff6b8158a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:19.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.675+0000 7ff6bdfa1640 1 --2- 172.21.15.39:0/1264255153 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff6b80d06f0 0x7ff6b8158a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:19.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.675+0000 7ff6bdfa1640 1 -- 172.21.15.39:0/1264255153 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a80094d0 con 0x7ff6b81598b0 2023-05-16T13:55:19.685 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.675+0000 7ff6bcf9f640 1 --2- 172.21.15.39:0/1264255153 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff6b80d06f0 0x7ff6b8158a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-16T13:55:19.686 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.675+0000 7ff6bd7a0640 1 --2- 172.21.15.39:0/1264255153 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff6b80b4b00 0x7ff6b80b2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-16T13:55:19.686 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.675+0000 7ff6bdfa1640 1 --2- 172.21.15.39:0/1264255153 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff6b81598b0 0x7ff6b814fad0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7ff6b0001570 tx=0x7ff6b000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:19.686 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.675+0000 7ff6adffb640 1 -- 172.21.15.39:0/1264255153 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b000a640 con 0x7ff6b81598b0 2023-05-16T13:55:19.686 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.675+0000 7ff6adffb640 1 -- 172.21.15.39:0/1264255153 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b000a7a0 con 0x7ff6b81598b0 2023-05-16T13:55:19.686 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.675+0000 7ff6adffb640 1 -- 172.21.15.39:0/1264255153 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b000ab90 con 0x7ff6b81598b0 2023-05-16T13:55:19.686 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.675+0000 7ff6be7a2640 1 -- 172.21.15.39:0/1264255153 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6b80ce790 con 0x7ff6b81598b0 2023-05-16T13:55:19.686 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.675+0000 7ff6be7a2640 1 -- 172.21.15.39:0/1264255153 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6b80b4fa0 con 0x7ff6b81598b0 2023-05-16T13:55:19.687 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.675+0000 7ff6be7a2640 1 -- 172.21.15.39:0/1264255153 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6b8168ba0 con 0x7ff6b81598b0 2023-05-16T13:55:19.687 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.679+0000 7ff6adffb640 1 -- 172.21.15.39:0/1264255153 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff6b000acf0 con 0x7ff6b81598b0 2023-05-16T13:55:19.687 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.679+0000 7ff6adffb640 1 --2- 172.21.15.39:0/1264255153 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ff69c066280 0x7ff69c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:19.688 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.679+0000 7ff6adffb640 1 -- 172.21.15.39:0/1264255153 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff6b0082e80 con 0x7ff6b81598b0 2023-05-16T13:55:19.688 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.679+0000 7ff6bd7a0640 1 --2- 172.21.15.39:0/1264255153 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ff69c066280 0x7ff69c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:19.688 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.679+0000 7ff6bd7a0640 1 --2- 172.21.15.39:0/1264255153 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ff69c066280 0x7ff69c068730 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff6b40097a0 tx=0x7ff6b4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:19.690 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.683+0000 7ff6adffb640 1 -- 172.21.15.39:0/1264255153 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ff6b00506f0 con 0x7ff6b81598b0 2023-05-16T13:55:19.900 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.891+0000 7ff6be7a2640 1 -- 172.21.15.39:0/1264255153 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7ff6b804ed20 con 0x7ff6b81598b0 2023-05-16T13:55:19.908 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.899+0000 7ff6adffb640 1 -- 172.21.15.39:0/1264255153 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7ff6b00180a0 con 0x7ff6b81598b0 2023-05-16T13:55:19.910 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.903+0000 7ff6be7a2640 1 -- 172.21.15.39:0/1264255153 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ff69c066280 msgr2=0x7ff69c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:19.911 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.903+0000 7ff6be7a2640 1 --2- 172.21.15.39:0/1264255153 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ff69c066280 0x7ff69c068730 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff6b40097a0 tx=0x7ff6b4008040 comp rx=0 tx=0).stop 2023-05-16T13:55:19.911 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.903+0000 7ff6be7a2640 1 -- 172.21.15.39:0/1264255153 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff6b81598b0 msgr2=0x7ff6b814fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:19.911 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.903+0000 7ff6be7a2640 1 --2- 172.21.15.39:0/1264255153 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff6b81598b0 0x7ff6b814fad0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7ff6b0001570 tx=0x7ff6b000cc70 comp rx=0 tx=0).stop 2023-05-16T13:55:19.912 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.903+0000 7ff6be7a2640 1 -- 172.21.15.39:0/1264255153 shutdown_connections 2023-05-16T13:55:19.912 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.903+0000 7ff6be7a2640 1 --2- 172.21.15.39:0/1264255153 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff6b81598b0 0x7ff6b814fad0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:19.912 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.903+0000 7ff6be7a2640 1 --2- 172.21.15.39:0/1264255153 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff6b80d06f0 0x7ff6b8158a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:19.913 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.903+0000 7ff6be7a2640 1 --2- 172.21.15.39:0/1264255153 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ff69c066280 0x7ff69c068730 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:19.913 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.903+0000 7ff6be7a2640 1 --2- 172.21.15.39:0/1264255153 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff6b80b4b00 0x7ff6b80b2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:19.913 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.903+0000 7ff6be7a2640 1 -- 172.21.15.39:0/1264255153 >> 172.21.15.39:0/1264255153 conn(0x7ff6b806aad0 msgr2=0x7ff6b815ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:19.913 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.903+0000 7ff6be7a2640 1 -- 172.21.15.39:0/1264255153 shutdown_connections 2023-05-16T13:55:19.913 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:19.903+0000 7ff6be7a2640 1 -- 172.21.15.39:0/1264255153 wait complete. 2023-05-16T13:55:19.929 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-16T13:55:20.066 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.059+0000 7f2c341bc640 1 Processor -- start 2023-05-16T13:55:20.066 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.059+0000 7f2c341bc640 1 -- start start 2023-05-16T13:55:20.067 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.059+0000 7f2c341bc640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2c2c0ced10 0x7f2c2c06fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:20.068 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.059+0000 7f2c341bc640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c2c071b00 0x7f2c2c0ca290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:20.068 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.059+0000 7f2c341bc640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c2c0cf0e0 con 0x7f2c2c0c9cb0 2023-05-16T13:55:20.068 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.059+0000 7f2c341bc640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c2c0c89f0 con 0x7f2c2c0ced10 2023-05-16T13:55:20.068 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.059+0000 7f2c341bc640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2c0c8c40 con 0x7f2c2c071b00 2023-05-16T13:55:20.068 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.059+0000 7f2c31757640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f2c2c0c9cb0 0x7f2c2c0713f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:40532/0 (socket says 172.21.15.39:40532) 2023-05-16T13:55:20.068 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.059+0000 7f2c31757640 1 -- 172.21.15.39:0/1500297259 learned_addr learned my addr 172.21.15.39:0/1500297259 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:55:20.069 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.059+0000 7f2c31f58640 1 --2- 172.21.15.39:0/1500297259 >> v2:172.21.15.118:3300/0 conn(0x7f2c2c0ced10 0x7f2c2c06fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:20.069 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.059+0000 7f2c32759640 1 --2- 172.21.15.39:0/1500297259 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c2c071b00 0x7f2c2c0ca290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:20.069 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.059+0000 7f2c30f56640 1 -- 172.21.15.39:0/1500297259 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1020278319 0 0) 0x7f2c1c001120 con 0x7f2c2c0c9cb0 2023-05-16T13:55:20.070 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.059+0000 7f2c30f56640 1 -- 172.21.15.39:0/1500297259 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c18003530 con 0x7f2c2c0c9cb0 2023-05-16T13:55:20.070 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.059+0000 7f2c30f56640 1 -- 172.21.15.39:0/1500297259 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3951980733 0 0) 0x7f2c18003530 con 0x7f2c2c0c9cb0 2023-05-16T13:55:20.070 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.059+0000 7f2c31f58640 1 -- 172.21.15.39:0/1500297259 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c2c071b00 msgr2=0x7f2c2c0ca290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:20.070 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.059+0000 7f2c31f58640 1 --2- 172.21.15.39:0/1500297259 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c2c071b00 0x7f2c2c0ca290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:20.070 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.059+0000 7f2c31f58640 1 -- 172.21.15.39:0/1500297259 >> v1:172.21.15.39:6789/0 conn(0x7f2c2c0c9cb0 legacy=0x7f2c2c0713f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:20.070 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.059+0000 7f2c31f58640 1 -- 172.21.15.39:0/1500297259 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c2c0c8f20 con 0x7f2c2c0ced10 2023-05-16T13:55:20.070 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.059+0000 7f2c32759640 1 --2- 172.21.15.39:0/1500297259 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c2c071b00 0x7f2c2c0ca290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-16T13:55:20.071 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.063+0000 7f2c31f58640 1 --2- 172.21.15.39:0/1500297259 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c2c0ced10 0x7f2c2c06fc10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2c280097c0 tx=0x7f2c2801c2e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d70aff3cc9cd6bb4 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:20.072 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.063+0000 7f2c30f56640 1 -- 172.21.15.39:0/1500297259 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1c001810 con 0x7f2c2c0ced10 2023-05-16T13:55:20.072 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.063+0000 7f2c30f56640 1 -- 172.21.15.39:0/1500297259 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c280a7050 con 0x7f2c2c0ced10 2023-05-16T13:55:20.072 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.063+0000 7f2c30f56640 1 -- 172.21.15.39:0/1500297259 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c280ab620 con 0x7f2c2c0ced10 2023-05-16T13:55:20.073 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.063+0000 7f2c341bc640 1 -- 172.21.15.39:0/1500297259 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c2c0ced10 msgr2=0x7f2c2c06fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:20.073 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.063+0000 7f2c341bc640 1 --2- 172.21.15.39:0/1500297259 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c2c0ced10 0x7f2c2c06fc10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2c280097c0 tx=0x7f2c2801c2e0 comp rx=0 tx=0).stop 2023-05-16T13:55:20.073 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.063+0000 7f2c341bc640 1 -- 172.21.15.39:0/1500297259 shutdown_connections 2023-05-16T13:55:20.073 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.063+0000 7f2c341bc640 1 --2- 172.21.15.39:0/1500297259 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c2c071b00 0x7f2c2c0ca290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:20.073 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.063+0000 7f2c341bc640 1 --2- 172.21.15.39:0/1500297259 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c2c0ced10 0x7f2c2c06fc10 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:20.074 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.063+0000 7f2c341bc640 1 -- 172.21.15.39:0/1500297259 >> 172.21.15.39:0/1500297259 conn(0x7f2c2c069a50 msgr2=0x7f2c2c069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:20.074 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.067+0000 7f2c341bc640 1 -- 172.21.15.39:0/1500297259 shutdown_connections 2023-05-16T13:55:20.074 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.067+0000 7f2c341bc640 1 -- 172.21.15.39:0/1500297259 wait complete. 2023-05-16T13:55:20.074 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.067+0000 7f2c341bc640 1 Processor -- start 2023-05-16T13:55:20.075 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.067+0000 7f2c341bc640 1 -- start start 2023-05-16T13:55:20.076 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.067+0000 7f2c341bc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c2c071b00 0x7f2c2c14b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:20.076 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.067+0000 7f2c341bc640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c2c0c9cb0 0x7f2c2c0aee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:20.076 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.067+0000 7f2c341bc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c2c0ced10 0x7f2c2c1569b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:20.076 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.067+0000 7f2c341bc640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2c0b09f0 con 0x7f2c2c071b00 2023-05-16T13:55:20.076 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.067+0000 7f2c341bc640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2c0af950 con 0x7f2c2c0ced10 2023-05-16T13:55:20.077 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.067+0000 7f2c341bc640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2c0afc30 con 0x7f2c2c0c9cb0 2023-05-16T13:55:20.077 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.067+0000 7f2c31f58640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c2c071b00 0x7f2c2c14b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:20.077 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.067+0000 7f2c31f58640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c2c071b00 0x7f2c2c14b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42774/0 (socket says 172.21.15.39:42774) 2023-05-16T13:55:20.077 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.067+0000 7f2c31f58640 1 -- 172.21.15.39:0/4288511114 learned_addr learned my addr 172.21.15.39:0/4288511114 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:20.077 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.067+0000 7f2c31757640 1 --2- 172.21.15.39:0/4288511114 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c2c0c9cb0 0x7f2c2c0aee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:20.077 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.067+0000 7f2c32759640 1 --2- 172.21.15.39:0/4288511114 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c2c0ced10 0x7f2c2c1569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:20.077 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.067+0000 7f2c31f58640 1 -- 172.21.15.39:0/4288511114 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c2c0c9cb0 msgr2=0x7f2c2c0aee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:20.078 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.067+0000 7f2c31f58640 1 --2- 172.21.15.39:0/4288511114 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c2c0c9cb0 0x7f2c2c0aee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:20.078 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.067+0000 7f2c31f58640 1 -- 172.21.15.39:0/4288511114 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c2c0ced10 msgr2=0x7f2c2c1569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:20.078 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.067+0000 7f2c31f58640 1 --2- 172.21.15.39:0/4288511114 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c2c0ced10 0x7f2c2c1569b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:20.078 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.067+0000 7f2c31f58640 1 -- 172.21.15.39:0/4288511114 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c24009a70 con 0x7f2c2c071b00 2023-05-16T13:55:20.079 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.067+0000 7f2c31f58640 1 --2- 172.21.15.39:0/4288511114 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c2c071b00 0x7f2c2c14b160 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f2c280ae040 tx=0x7f2c2801ab20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:20.079 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.067+0000 7f2c227fc640 1 -- 172.21.15.39:0/4288511114 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c280b7450 con 0x7f2c2c071b00 2023-05-16T13:55:20.079 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.067+0000 7f2c227fc640 1 -- 172.21.15.39:0/4288511114 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c280b75d0 con 0x7f2c2c071b00 2023-05-16T13:55:20.080 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.067+0000 7f2c341bc640 1 -- 172.21.15.39:0/4288511114 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c28009420 con 0x7f2c2c071b00 2023-05-16T13:55:20.080 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.067+0000 7f2c227fc640 1 -- 172.21.15.39:0/4288511114 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c280b7980 con 0x7f2c2c071b00 2023-05-16T13:55:20.080 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.071+0000 7f2c341bc640 1 -- 172.21.15.39:0/4288511114 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c2c0b42f0 con 0x7f2c2c071b00 2023-05-16T13:55:20.080 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.071+0000 7f2c341bc640 1 -- 172.21.15.39:0/4288511114 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c2c0c97c0 con 0x7f2c2c071b00 2023-05-16T13:55:20.080 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.071+0000 7f2c227fc640 1 -- 172.21.15.39:0/4288511114 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2c280b7ae0 con 0x7f2c2c071b00 2023-05-16T13:55:20.081 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.071+0000 7f2c227fc640 1 --2- 172.21.15.39:0/4288511114 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f2c10066280 0x7f2c10068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:20.081 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.071+0000 7f2c227fc640 1 -- 172.21.15.39:0/4288511114 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f2c2811e150 con 0x7f2c2c071b00 2023-05-16T13:55:20.081 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.071+0000 7f2c31757640 1 --2- 172.21.15.39:0/4288511114 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f2c10066280 0x7f2c10068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:20.081 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.071+0000 7f2c31757640 1 --2- 172.21.15.39:0/4288511114 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f2c10066280 0x7f2c10068730 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c001940 tx=0x7f2c1c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:20.083 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.075+0000 7f2c227fc640 1 -- 172.21.15.39:0/4288511114 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f2c280eb800 con 0x7f2c2c071b00 2023-05-16T13:55:20.238 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.231+0000 7f2c341bc640 1 -- 172.21.15.39:0/4288511114 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2c2c0cafe0 con 0x7f2c2c071b00 2023-05-16T13:55:20.239 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.231+0000 7f2c227fc640 1 -- 172.21.15.39:0/4288511114 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+14639 (secure 0 0 0) 0x7f2c280eee20 con 0x7f2c2c071b00 2023-05-16T13:55:20.240 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:55:20.240 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":34,"fsid":"9c1e210b-c515-4ea4-a065-397956895c68","created":"2023-05-16T13:53:48.955290+0000","modified":"2023-05-16T13:55:17.152871+0000","last_up_change":"2023-05-16T13:54:01.722051+0000","last_in_change":"2023-05-16T13:53:52.331336+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-16T13:54:00.885009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-16T13:54:08.327895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4ce0f0ba-c4bf-4405-8c95-d2e9a62878ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6809","nonce":3462013698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6811","nonce":3462013698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6815","nonce":3462013698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6813","nonce":3462013698}]},"public_addr":"172.21.15.39:6809/3462013698","cluster_addr":"172.21.15.39:6811/3462013698","heartbeat_back_addr":"172.21.15.39:6815/3462013698","heartbeat_front_addr":"172.21.15.39:6813/3462013698","state":["exists","up"]},{"osd":1,"uuid":"53fdc1ac-2473-472d-af32-2760fdf6e476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6801","nonce":2829970892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6803","nonce":2829970892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6807","nonce":2829970892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6805","nonce":2829970892}]},"public_addr":"172.21.15.39:6801/2829970892","cluster_addr":"172.21.15.39:6803/2829970892","heartbeat_back_addr":"172.21.15.39:6807/2829970892","heartbeat_front_addr":"172.21.15.39:6805/2829970892","state":["exists","up"]},{"osd":2,"uuid":"0b92d770-7030-42fa-a19f-4f7f1ac113c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6817","nonce":3888067413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6819","nonce":3888067413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6823","nonce":3888067413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6821","nonce":3888067413}]},"public_addr":"172.21.15.39:6817/3888067413","cluster_addr":"172.21.15.39:6819/3888067413","heartbeat_back_addr":"172.21.15.39:6823/3888067413","heartbeat_front_addr":"172.21.15.39:6821/3888067413","state":["exists","up"]},{"osd":3,"uuid":"000d9506-cbb2-4017-b875-deca579860ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6825","nonce":405003958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6827","nonce":405003958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6831","nonce":405003958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6829","nonce":405003958}]},"public_addr":"172.21.15.39:6825/405003958","cluster_addr":"172.21.15.39:6827/405003958","heartbeat_back_addr":"172.21.15.39:6831/405003958","heartbeat_front_addr":"172.21.15.39:6829/405003958","state":["exists","up"]},{"osd":4,"uuid":"70f0dacb-e960-40c5-bf6a-183e52bbe2ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6801","nonce":3895278838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6805","nonce":3895278838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6813","nonce":3895278838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6809","nonce":3895278838}]},"public_addr":"172.21.15.118:6801/3895278838","cluster_addr":"172.21.15.118:6805/3895278838","heartbeat_back_addr":"172.21.15.118:6813/3895278838","heartbeat_front_addr":"172.21.15.118:6809/3895278838","state":["exists","up"]},{"osd":5,"uuid":"756feb54-c3ae-4a2a-8f74-85c291ba707c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6804","nonce":3513592808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6808","nonce":3513592808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6815","nonce":3513592808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6812","nonce":3513592808}]},"public_addr":"172.21.15.118:6804/3513592808","cluster_addr":"172.21.15.118:6808/3513592808","heartbeat_back_addr":"172.21.15.118:6815/3513592808","heartbeat_front_addr":"172.21.15.118:6812/3513592808","state":["exists","up"]},{"osd":6,"uuid":"c4a982c1-f497-4b0f-8a23-c77372e4621e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6824","nonce":1863656053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6827","nonce":1863656053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6831","nonce":1863656053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6829","nonce":1863656053}]},"public_addr":"172.21.15.118:6824/1863656053","cluster_addr":"172.21.15.118:6827/1863656053","heartbeat_back_addr":"172.21.15.118:6831/1863656053","heartbeat_front_addr":"172.21.15.118:6829/1863656053","state":["exists","up"]},{"osd":7,"uuid":"6f2888aa-a7ac-4e26-9159-e31817934f44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6817","nonce":3636642904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6819","nonce":3636642904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6825","nonce":3636642904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6821","nonce":3636642904}]},"public_addr":"172.21.15.118:6817/3636642904","cluster_addr":"172.21.15.118:6819/3636642904","heartbeat_back_addr":"172.21.15.118:6825/3636642904","heartbeat_front_addr":"172.21.15.118:6821/3636642904","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.717636+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.724036+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.739144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:58.079275+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:58.073921+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.930466+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.987813+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.941098+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-16T13:55:20.241 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.235+0000 7f2c341bc640 1 -- 172.21.15.39:0/4288511114 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f2c10066280 msgr2=0x7f2c10068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:20.242 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.235+0000 7f2c341bc640 1 --2- 172.21.15.39:0/4288511114 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f2c10066280 0x7f2c10068730 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c001940 tx=0x7f2c1c009040 comp rx=0 tx=0).stop 2023-05-16T13:55:20.242 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.235+0000 7f2c341bc640 1 -- 172.21.15.39:0/4288511114 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c2c071b00 msgr2=0x7f2c2c14b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:20.242 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.235+0000 7f2c341bc640 1 --2- 172.21.15.39:0/4288511114 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c2c071b00 0x7f2c2c14b160 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f2c280ae040 tx=0x7f2c2801ab20 comp rx=0 tx=0).stop 2023-05-16T13:55:20.242 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.235+0000 7f2c341bc640 1 -- 172.21.15.39:0/4288511114 shutdown_connections 2023-05-16T13:55:20.242 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.235+0000 7f2c341bc640 1 --2- 172.21.15.39:0/4288511114 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f2c10066280 0x7f2c10068730 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:20.242 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.235+0000 7f2c341bc640 1 --2- 172.21.15.39:0/4288511114 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2c2c0c9cb0 0x7f2c2c0aee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:20.243 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.235+0000 7f2c341bc640 1 --2- 172.21.15.39:0/4288511114 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2c2c0ced10 0x7f2c2c1569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:20.243 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.235+0000 7f2c341bc640 1 --2- 172.21.15.39:0/4288511114 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c2c071b00 0x7f2c2c14b160 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:20.243 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.235+0000 7f2c341bc640 1 -- 172.21.15.39:0/4288511114 >> 172.21.15.39:0/4288511114 conn(0x7f2c2c069a50 msgr2=0x7f2c2c0cd170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:20.243 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.235+0000 7f2c341bc640 1 -- 172.21.15.39:0/4288511114 shutdown_connections 2023-05-16T13:55:20.243 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.235+0000 7f2c341bc640 1 -- 172.21.15.39:0/4288511114 wait complete. 2023-05-16T13:55:20.260 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-16T13:54:00.885009+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-16T13:54:08.327895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-16T13:55:20.261 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-16T13:55:20.401 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.395+0000 7f695ff6d640 1 Processor -- start 2023-05-16T13:55:20.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.395+0000 7f695ff6d640 1 -- start start 2023-05-16T13:55:20.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.395+0000 7f695ff6d640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f695815c1a0 0x7f69580ca750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:20.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.395+0000 7f695ff6d640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f69580add00 0x7f69580cddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:20.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.395+0000 7f695ff6d640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f69580cb210 0x7f69580cb660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:20.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.395+0000 7f695ff6d640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f695815c570 con 0x7f69580add00 2023-05-16T13:55:20.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.395+0000 7f695ff6d640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69580cbba0 con 0x7f69580cb210 2023-05-16T13:55:20.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.395+0000 7f695ff6d640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69580ce300 con 0x7f695815c1a0 2023-05-16T13:55:20.404 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.395+0000 7f695d508640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f69580add00 0x7f69580cddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:20.404 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.395+0000 7f695d508640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f69580add00 0x7f69580cddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42778/0 (socket says 172.21.15.39:42778) 2023-05-16T13:55:20.404 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.395+0000 7f695d508640 1 -- 172.21.15.39:0/615341650 learned_addr learned my addr 172.21.15.39:0/615341650 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:20.404 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.395+0000 7f695dd09640 1 --2- 172.21.15.39:0/615341650 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f695815c1a0 0x7f69580ca750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:20.404 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.395+0000 7f695e50a640 1 --2- 172.21.15.39:0/615341650 >> v2:172.21.15.118:3300/0 conn(0x7f69580cb210 0x7f69580cb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:20.405 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.395+0000 7f695d508640 1 -- 172.21.15.39:0/615341650 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f695815c1a0 msgr2=0x7f69580ca750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:20.405 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.395+0000 7f695d508640 1 --2- 172.21.15.39:0/615341650 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f695815c1a0 0x7f69580ca750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:20.405 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.395+0000 7f695d508640 1 -- 172.21.15.39:0/615341650 >> v2:172.21.15.118:3300/0 conn(0x7f69580cb210 msgr2=0x7f69580cb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:20.405 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.395+0000 7f695d508640 1 --2- 172.21.15.39:0/615341650 >> v2:172.21.15.118:3300/0 conn(0x7f69580cb210 0x7f69580cb660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:20.405 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.395+0000 7f695d508640 1 -- 172.21.15.39:0/615341650 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69580c9990 con 0x7f69580add00 2023-05-16T13:55:20.405 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.395+0000 7f695e50a640 1 --2- 172.21.15.39:0/615341650 >> v2:172.21.15.118:3300/0 conn(0x7f69580cb210 0x7f69580cb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:55:20.406 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.399+0000 7f695d508640 1 --2- 172.21.15.39:0/615341650 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69580add00 0x7f69580cddc0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f695806fa50 tx=0x7f694801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af47be95e1469a58 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:20.406 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.399+0000 7f695cd07640 1 -- 172.21.15.39:0/615341650 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69480a89b0 con 0x7f69580add00 2023-05-16T13:55:20.406 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.399+0000 7f695cd07640 1 -- 172.21.15.39:0/615341650 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69480a8b10 con 0x7f69580add00 2023-05-16T13:55:20.407 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.399+0000 7f695cd07640 1 -- 172.21.15.39:0/615341650 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69480a8ea0 con 0x7f69580add00 2023-05-16T13:55:20.407 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.399+0000 7f695ff6d640 1 -- 172.21.15.39:0/615341650 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69580add00 msgr2=0x7f69580cddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:20.407 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.399+0000 7f695ff6d640 1 --2- 172.21.15.39:0/615341650 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69580add00 0x7f69580cddc0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f695806fa50 tx=0x7f694801ecf0 comp rx=0 tx=0).stop 2023-05-16T13:55:20.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.399+0000 7f695ff6d640 1 -- 172.21.15.39:0/615341650 shutdown_connections 2023-05-16T13:55:20.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.399+0000 7f695ff6d640 1 --2- 172.21.15.39:0/615341650 >> v2:172.21.15.118:3300/0 conn(0x7f69580cb210 0x7f69580cb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:20.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.399+0000 7f695ff6d640 1 --2- 172.21.15.39:0/615341650 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69580add00 0x7f69580cddc0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:20.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.399+0000 7f695ff6d640 1 --2- 172.21.15.39:0/615341650 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f695815c1a0 0x7f69580ca750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:20.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.399+0000 7f695ff6d640 1 -- 172.21.15.39:0/615341650 >> 172.21.15.39:0/615341650 conn(0x7f695806a690 msgr2=0x7f69580b0400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:20.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.399+0000 7f695ff6d640 1 -- 172.21.15.39:0/615341650 shutdown_connections 2023-05-16T13:55:20.408 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.399+0000 7f695ff6d640 1 -- 172.21.15.39:0/615341650 wait complete. 2023-05-16T13:55:20.409 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.403+0000 7f695ff6d640 1 Processor -- start 2023-05-16T13:55:20.409 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.403+0000 7f695ff6d640 1 -- start start 2023-05-16T13:55:20.410 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.403+0000 7f695ff6d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69580add00 0x7f69580c7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:20.410 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.403+0000 7f695ff6d640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f69580cb210 0x7f69580c5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:20.410 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.403+0000 7f695ff6d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f695815c1a0 0x7f69581f0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:20.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.403+0000 7f695ff6d640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69580c5ea0 con 0x7f69580add00 2023-05-16T13:55:20.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.403+0000 7f695ff6d640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69580c60b0 con 0x7f695815c1a0 2023-05-16T13:55:20.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.403+0000 7f695ff6d640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69580c6390 con 0x7f69580cb210 2023-05-16T13:55:20.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.403+0000 7f695dd09640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69580add00 0x7f69580c7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:20.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.403+0000 7f695dd09640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69580add00 0x7f69580c7940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42786/0 (socket says 172.21.15.39:42786) 2023-05-16T13:55:20.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.403+0000 7f695dd09640 1 -- 172.21.15.39:0/1901391010 learned_addr learned my addr 172.21.15.39:0/1901391010 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:20.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.403+0000 7f695e50a640 1 --2- 172.21.15.39:0/1901391010 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f695815c1a0 0x7f69581f0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:20.412 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.403+0000 7f695d508640 1 --2- 172.21.15.39:0/1901391010 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f69580cb210 0x7f69580c5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:20.412 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.403+0000 7f695dd09640 1 -- 172.21.15.39:0/1901391010 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f69580cb210 msgr2=0x7f69580c5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:20.412 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.403+0000 7f695dd09640 1 --2- 172.21.15.39:0/1901391010 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f69580cb210 0x7f69580c5960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:20.412 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.403+0000 7f695dd09640 1 -- 172.21.15.39:0/1901391010 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f695815c1a0 msgr2=0x7f69581f0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:20.412 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.403+0000 7f695dd09640 1 --2- 172.21.15.39:0/1901391010 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f695815c1a0 0x7f69581f0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:20.412 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.403+0000 7f695dd09640 1 -- 172.21.15.39:0/1901391010 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69480094d0 con 0x7f69580add00 2023-05-16T13:55:20.413 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.403+0000 7f695dd09640 1 --2- 172.21.15.39:0/1901391010 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69580add00 0x7f69580c7940 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f695400e870 tx=0x7f695400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:20.413 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.403+0000 7f694e7fc640 1 -- 172.21.15.39:0/1901391010 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6954009510 con 0x7f69580add00 2023-05-16T13:55:20.413 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.403+0000 7f694e7fc640 1 -- 172.21.15.39:0/1901391010 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f695400eec0 con 0x7f69580add00 2023-05-16T13:55:20.413 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.403+0000 7f694e7fc640 1 -- 172.21.15.39:0/1901391010 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695400cb40 con 0x7f69580add00 2023-05-16T13:55:20.414 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.403+0000 7f695ff6d640 1 -- 172.21.15.39:0/1901391010 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69580c9f50 con 0x7f69580add00 2023-05-16T13:55:20.414 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.403+0000 7f695ff6d640 1 -- 172.21.15.39:0/1901391010 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69580c9c70 con 0x7f69580add00 2023-05-16T13:55:20.414 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.403+0000 7f695ff6d640 1 -- 172.21.15.39:0/1901391010 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69580ca230 con 0x7f69580add00 2023-05-16T13:55:20.414 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.407+0000 7f694e7fc640 1 -- 172.21.15.39:0/1901391010 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f695400cca0 con 0x7f69580add00 2023-05-16T13:55:20.415 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.407+0000 7f694e7fc640 1 --2- 172.21.15.39:0/1901391010 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f693c066280 0x7f693c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:20.415 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.407+0000 7f694e7fc640 1 -- 172.21.15.39:0/1901391010 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6954083a80 con 0x7f69580add00 2023-05-16T13:55:20.415 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.407+0000 7f695d508640 1 --2- 172.21.15.39:0/1901391010 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f693c066280 0x7f693c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:20.415 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.407+0000 7f695d508640 1 --2- 172.21.15.39:0/1901391010 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f693c066280 0x7f693c068730 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f69480b2000 tx=0x7f6948008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:20.418 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.411+0000 7f694e7fc640 1 -- 172.21.15.39:0/1901391010 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f6954051240 con 0x7f69580add00 2023-05-16T13:55:20.573 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.567+0000 7f695ff6d640 1 -- 172.21.15.39:0/1901391010 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6958073c90 con 0x7f69580add00 2023-05-16T13:55:20.574 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.567+0000 7f694e7fc640 1 -- 172.21.15.39:0/1901391010 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) v1 ==== 93+0+10 (secure 0 0 0) 0x7f69540170a0 con 0x7f69580add00 2023-05-16T13:55:20.574 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2023-05-16T13:55:20.576 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.567+0000 7f695ff6d640 1 -- 172.21.15.39:0/1901391010 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f693c066280 msgr2=0x7f693c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:20.576 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.567+0000 7f695ff6d640 1 --2- 172.21.15.39:0/1901391010 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f693c066280 0x7f693c068730 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f69480b2000 tx=0x7f6948008040 comp rx=0 tx=0).stop 2023-05-16T13:55:20.576 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.567+0000 7f695ff6d640 1 -- 172.21.15.39:0/1901391010 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69580add00 msgr2=0x7f69580c7940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:20.576 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.567+0000 7f695ff6d640 1 --2- 172.21.15.39:0/1901391010 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69580add00 0x7f69580c7940 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f695400e870 tx=0x7f695400ec70 comp rx=0 tx=0).stop 2023-05-16T13:55:20.576 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.567+0000 7f695ff6d640 1 -- 172.21.15.39:0/1901391010 shutdown_connections 2023-05-16T13:55:20.577 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.567+0000 7f695ff6d640 1 --2- 172.21.15.39:0/1901391010 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f693c066280 0x7f693c068730 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:20.577 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.567+0000 7f695ff6d640 1 --2- 172.21.15.39:0/1901391010 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f69580cb210 0x7f69580c5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:20.577 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.567+0000 7f695ff6d640 1 --2- 172.21.15.39:0/1901391010 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f695815c1a0 0x7f69581f0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:20.577 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.567+0000 7f695ff6d640 1 --2- 172.21.15.39:0/1901391010 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69580add00 0x7f69580c7940 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:20.577 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.567+0000 7f695ff6d640 1 -- 172.21.15.39:0/1901391010 >> 172.21.15.39:0/1901391010 conn(0x7f695806a690 msgr2=0x7f6958159560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:20.577 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.567+0000 7f695ff6d640 1 -- 172.21.15.39:0/1901391010 shutdown_connections 2023-05-16T13:55:20.577 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.567+0000 7f695ff6d640 1 -- 172.21.15.39:0/1901391010 wait complete. 2023-05-16T13:55:20.594 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-16T13:55:20.735 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.727+0000 7f2316939640 1 Processor -- start 2023-05-16T13:55:20.736 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.727+0000 7f2316939640 1 -- start start 2023-05-16T13:55:20.737 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.731+0000 7f2316939640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f23100b4030 0x7f231015d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:20.737 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.731+0000 7f2316939640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2310071b70 0x7f23100c91c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:20.737 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.731+0000 7f2316939640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f231015de40 con 0x7f23100b0710 2023-05-16T13:55:20.737 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.731+0000 7f2316939640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f231015e910 con 0x7f23100b4030 2023-05-16T13:55:20.738 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.731+0000 7f2316939640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23100b0ae0 con 0x7f2310071b70 2023-05-16T13:55:20.738 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.731+0000 7f230f7fe640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f23100b4030 0x7f231015d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:20.738 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.731+0000 7f230ffff640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f23100b0710 0x7f2310071460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.39:59478/0 (socket says 172.21.15.39:59478) 2023-05-16T13:55:20.739 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.731+0000 7f2314ed6640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2310071b70 0x7f23100c91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:20.739 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.731+0000 7f230f7fe640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f23100b4030 0x7f231015d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.39:42468/0 (socket says 172.21.15.39:42468) 2023-05-16T13:55:20.739 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.731+0000 7f230ffff640 1 -- 172.21.15.39:0/1666731822 learned_addr learned my addr 172.21.15.39:0/1666731822 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:55:20.739 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.731+0000 7f230f7fe640 1 -- 172.21.15.39:0/1666731822 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2310071b70 msgr2=0x7f23100c91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:20.739 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.731+0000 7f230f7fe640 1 --2- 172.21.15.39:0/1666731822 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2310071b70 0x7f23100c91c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:20.739 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.731+0000 7f230f7fe640 1 -- 172.21.15.39:0/1666731822 >> v1:172.21.15.118:6789/0 conn(0x7f23100b0710 legacy=0x7f2310071460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:20.739 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.731+0000 7f230f7fe640 1 -- 172.21.15.39:0/1666731822 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f231015e070 con 0x7f23100b4030 2023-05-16T13:55:20.740 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.731+0000 7f230effd640 1 -- 172.21.15.39:0/1666731822 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 658286421 0 0) 0x7f231015de40 con 0x7f23100b0710 2023-05-16T13:55:20.741 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.735+0000 7f230f7fe640 1 --2- 172.21.15.39:0/1666731822 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23100b4030 0x7f231015d900 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f23040097c0 tx=0x7f230401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bcaf13b5a1b4a358 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:20.741 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.735+0000 7f230effd640 1 -- 172.21.15.39:0/1666731822 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23040a6040 con 0x7f23100b4030 2023-05-16T13:55:20.741 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.735+0000 7f230effd640 1 -- 172.21.15.39:0/1666731822 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23040aa600 con 0x7f23100b4030 2023-05-16T13:55:20.742 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.735+0000 7f230effd640 1 -- 172.21.15.39:0/1666731822 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23040aa990 con 0x7f23100b4030 2023-05-16T13:55:20.742 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.735+0000 7f2316939640 1 -- 172.21.15.39:0/1666731822 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23100b4030 msgr2=0x7f231015d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:20.742 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.735+0000 7f2316939640 1 --2- 172.21.15.39:0/1666731822 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23100b4030 0x7f231015d900 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f23040097c0 tx=0x7f230401c480 comp rx=0 tx=0).stop 2023-05-16T13:55:20.743 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.735+0000 7f2316939640 1 -- 172.21.15.39:0/1666731822 shutdown_connections 2023-05-16T13:55:20.743 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.735+0000 7f2316939640 1 --2- 172.21.15.39:0/1666731822 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2310071b70 0x7f23100c91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:20.743 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.735+0000 7f2316939640 1 --2- 172.21.15.39:0/1666731822 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23100b4030 0x7f231015d900 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:20.743 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.735+0000 7f2316939640 1 -- 172.21.15.39:0/1666731822 >> 172.21.15.39:0/1666731822 conn(0x7f2310069a50 msgr2=0x7f2310069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:20.743 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.735+0000 7f2316939640 1 -- 172.21.15.39:0/1666731822 shutdown_connections 2023-05-16T13:55:20.743 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.735+0000 7f2316939640 1 -- 172.21.15.39:0/1666731822 wait complete. 2023-05-16T13:55:20.744 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.735+0000 7f2316939640 1 Processor -- start 2023-05-16T13:55:20.744 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.735+0000 7f2316939640 1 -- start start 2023-05-16T13:55:20.745 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.735+0000 7f2316939640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2310071b70 0x7f231014c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:20.745 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.739+0000 7f2316939640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23100b0710 0x7f23100ad750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:20.745 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.739+0000 7f2316939640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f23100b4030 0x7f23100adc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:20.745 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.739+0000 7f2316939640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23100c7080 con 0x7f2310071b70 2023-05-16T13:55:20.745 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.739+0000 7f2316939640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23100c7360 con 0x7f23100b0710 2023-05-16T13:55:20.746 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.739+0000 7f2316939640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23100c7640 con 0x7f23100b4030 2023-05-16T13:55:20.746 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.739+0000 7f230ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2310071b70 0x7f231014c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:20.746 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.739+0000 7f230ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2310071b70 0x7f231014c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44302/0 (socket says 172.21.15.39:44302) 2023-05-16T13:55:20.746 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.739+0000 7f230ffff640 1 -- 172.21.15.39:0/2117889169 learned_addr learned my addr 172.21.15.39:0/2117889169 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:20.746 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.739+0000 7f230f7fe640 1 --2- 172.21.15.39:0/2117889169 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23100b0710 0x7f23100ad750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:20.746 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.739+0000 7f2314ed6640 1 --2- 172.21.15.39:0/2117889169 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f23100b4030 0x7f23100adc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:20.747 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.739+0000 7f230ffff640 1 -- 172.21.15.39:0/2117889169 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f23100b4030 msgr2=0x7f23100adc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:20.747 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.739+0000 7f230ffff640 1 --2- 172.21.15.39:0/2117889169 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f23100b4030 0x7f23100adc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:20.747 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.739+0000 7f230ffff640 1 -- 172.21.15.39:0/2117889169 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23100b0710 msgr2=0x7f23100ad750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:20.748 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.739+0000 7f230ffff640 1 --2- 172.21.15.39:0/2117889169 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23100b0710 0x7f23100ad750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:20.748 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.739+0000 7f230ffff640 1 -- 172.21.15.39:0/2117889169 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2304009420 con 0x7f2310071b70 2023-05-16T13:55:20.748 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.739+0000 7f230ffff640 1 --2- 172.21.15.39:0/2117889169 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2310071b70 0x7f231014c400 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f23000011f0 tx=0x7f230000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:20.748 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.739+0000 7f230cff9640 1 -- 172.21.15.39:0/2117889169 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23000074e0 con 0x7f2310071b70 2023-05-16T13:55:20.748 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.739+0000 7f230cff9640 1 -- 172.21.15.39:0/2117889169 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2300007640 con 0x7f2310071b70 2023-05-16T13:55:20.748 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.739+0000 7f230cff9640 1 -- 172.21.15.39:0/2117889169 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2300004a10 con 0x7f2310071b70 2023-05-16T13:55:20.748 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.739+0000 7f2316939640 1 -- 172.21.15.39:0/2117889169 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23100c9f10 con 0x7f2310071b70 2023-05-16T13:55:20.749 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.739+0000 7f2316939640 1 -- 172.21.15.39:0/2117889169 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23100c8ca0 con 0x7f2310071b70 2023-05-16T13:55:20.749 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.739+0000 7f2316939640 1 -- 172.21.15.39:0/2117889169 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23100ca0a0 con 0x7f2310071b70 2023-05-16T13:55:20.749 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.739+0000 7f230cff9640 1 -- 172.21.15.39:0/2117889169 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2300004b70 con 0x7f2310071b70 2023-05-16T13:55:20.750 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.743+0000 7f230cff9640 1 --2- 172.21.15.39:0/2117889169 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f22fc066280 0x7f22fc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:20.750 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.743+0000 7f230cff9640 1 -- 172.21.15.39:0/2117889169 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f2300082c00 con 0x7f2310071b70 2023-05-16T13:55:20.750 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.743+0000 7f230f7fe640 1 --2- 172.21.15.39:0/2117889169 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f22fc066280 0x7f22fc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:20.751 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.743+0000 7f230f7fe640 1 --2- 172.21.15.39:0/2117889169 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f22fc066280 0x7f22fc068730 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f23040ae000 tx=0x7f23040b5040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:20.753 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.747+0000 7f230cff9640 1 -- 172.21.15.39:0/2117889169 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f2300089080 con 0x7f2310071b70 2023-05-16T13:55:20.910 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.903+0000 7f2316939640 1 -- 172.21.15.39:0/2117889169 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2310073c90 con 0x7f2310071b70 2023-05-16T13:55:20.911 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.903+0000 7f230cff9640 1 -- 172.21.15.39:0/2117889169 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v34) v1 ==== 92+0+10 (secure 0 0 0) 0x7f23000180a0 con 0x7f2310071b70 2023-05-16T13:55:20.911 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 8 2023-05-16T13:55:20.913 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.907+0000 7f2316939640 1 -- 172.21.15.39:0/2117889169 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f22fc066280 msgr2=0x7f22fc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:20.913 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.907+0000 7f2316939640 1 --2- 172.21.15.39:0/2117889169 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f22fc066280 0x7f22fc068730 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f23040ae000 tx=0x7f23040b5040 comp rx=0 tx=0).stop 2023-05-16T13:55:20.913 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.907+0000 7f2316939640 1 -- 172.21.15.39:0/2117889169 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2310071b70 msgr2=0x7f231014c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:20.913 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.907+0000 7f2316939640 1 --2- 172.21.15.39:0/2117889169 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2310071b70 0x7f231014c400 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f23000011f0 tx=0x7f230000c9b0 comp rx=0 tx=0).stop 2023-05-16T13:55:20.914 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.907+0000 7f2316939640 1 -- 172.21.15.39:0/2117889169 shutdown_connections 2023-05-16T13:55:20.914 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.907+0000 7f2316939640 1 --2- 172.21.15.39:0/2117889169 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f22fc066280 0x7f22fc068730 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:20.914 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.907+0000 7f2316939640 1 --2- 172.21.15.39:0/2117889169 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f23100b4030 0x7f23100adc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:20.914 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.907+0000 7f2316939640 1 --2- 172.21.15.39:0/2117889169 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23100b0710 0x7f23100ad750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:20.914 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.907+0000 7f2316939640 1 --2- 172.21.15.39:0/2117889169 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2310071b70 0x7f231014c400 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:20.914 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.907+0000 7f2316939640 1 -- 172.21.15.39:0/2117889169 >> 172.21.15.39:0/2117889169 conn(0x7f2310069a50 msgr2=0x7f23100b2e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:20.914 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.907+0000 7f2316939640 1 -- 172.21.15.39:0/2117889169 shutdown_connections 2023-05-16T13:55:20.914 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:20.907+0000 7f2316939640 1 -- 172.21.15.39:0/2117889169 wait complete. 2023-05-16T13:55:20.932 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-05-16T13:55:21.071 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.063+0000 7fbc3de41640 1 Processor -- start 2023-05-16T13:55:21.072 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.063+0000 7fbc3de41640 1 -- start start 2023-05-16T13:55:21.073 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.063+0000 7fbc3de41640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fbc380ced10 0x7fbc3806fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:21.073 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.063+0000 7fbc3de41640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbc38071b00 0x7fbc380ca290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:21.073 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.063+0000 7fbc3de41640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc380cf0e0 con 0x7fbc380c9cb0 2023-05-16T13:55:21.073 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.063+0000 7fbc3de41640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc380c89f0 con 0x7fbc380ced10 2023-05-16T13:55:21.073 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.063+0000 7fbc3de41640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc380c8c40 con 0x7fbc38071b00 2023-05-16T13:55:21.073 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.063+0000 7fbc377fe640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fbc380ced10 0x7fbc3806fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:21.074 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.067+0000 7fbc377fe640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fbc380ced10 0x7fbc3806fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44312/0 (socket says 172.21.15.39:44312) 2023-05-16T13:55:21.074 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.067+0000 7fbc377fe640 1 -- 172.21.15.39:0/3027860799 learned_addr learned my addr 172.21.15.39:0/3027860799 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:21.074 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.067+0000 7fbc37fff640 1 --2- 172.21.15.39:0/3027860799 >> v2:172.21.15.118:3300/0 conn(0x7fbc38071b00 0x7fbc380ca290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:21.074 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.067+0000 7fbc377fe640 1 -- 172.21.15.39:0/3027860799 >> v2:172.21.15.118:3300/0 conn(0x7fbc38071b00 msgr2=0x7fbc380ca290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:21.075 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.067+0000 7fbc377fe640 1 --2- 172.21.15.39:0/3027860799 >> v2:172.21.15.118:3300/0 conn(0x7fbc38071b00 0x7fbc380ca290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:21.075 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.067+0000 7fbc377fe640 1 -- 172.21.15.39:0/3027860799 >> v1:172.21.15.118:6789/0 conn(0x7fbc380c9cb0 legacy=0x7fbc380713f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:21.075 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.067+0000 7fbc377fe640 1 -- 172.21.15.39:0/3027860799 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc380c8f20 con 0x7fbc380ced10 2023-05-16T13:55:21.075 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.067+0000 7fbc377fe640 1 --2- 172.21.15.39:0/3027860799 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbc380ced10 0x7fbc3806fc10 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fbc380afec0 tx=0x7fbc2801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eca9ceb6cde12acb server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:21.076 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.067+0000 7fbc367fc640 1 -- 172.21.15.39:0/3027860799 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc280ab660 con 0x7fbc380ced10 2023-05-16T13:55:21.076 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.067+0000 7fbc367fc640 1 -- 172.21.15.39:0/3027860799 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc280ab7c0 con 0x7fbc380ced10 2023-05-16T13:55:21.076 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.067+0000 7fbc367fc640 1 -- 172.21.15.39:0/3027860799 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc280abb50 con 0x7fbc380ced10 2023-05-16T13:55:21.077 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.071+0000 7fbc3de41640 1 -- 172.21.15.39:0/3027860799 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbc380ced10 msgr2=0x7fbc3806fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:21.077 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.071+0000 7fbc3de41640 1 --2- 172.21.15.39:0/3027860799 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbc380ced10 0x7fbc3806fc10 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fbc380afec0 tx=0x7fbc2801c440 comp rx=0 tx=0).stop 2023-05-16T13:55:21.078 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.071+0000 7fbc3de41640 1 -- 172.21.15.39:0/3027860799 shutdown_connections 2023-05-16T13:55:21.078 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.071+0000 7fbc3de41640 1 --2- 172.21.15.39:0/3027860799 >> v2:172.21.15.118:3300/0 conn(0x7fbc38071b00 0x7fbc380ca290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:21.078 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.071+0000 7fbc3de41640 1 --2- 172.21.15.39:0/3027860799 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbc380ced10 0x7fbc3806fc10 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:21.078 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.071+0000 7fbc3de41640 1 -- 172.21.15.39:0/3027860799 >> 172.21.15.39:0/3027860799 conn(0x7fbc38069a50 msgr2=0x7fbc38069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:21.078 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.071+0000 7fbc3de41640 1 -- 172.21.15.39:0/3027860799 shutdown_connections 2023-05-16T13:55:21.078 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.071+0000 7fbc3de41640 1 -- 172.21.15.39:0/3027860799 wait complete. 2023-05-16T13:55:21.079 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.071+0000 7fbc3de41640 1 Processor -- start 2023-05-16T13:55:21.079 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.071+0000 7fbc3de41640 1 -- start start 2023-05-16T13:55:21.080 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.071+0000 7fbc3de41640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc38071b00 0x7fbc38151760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:21.080 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.071+0000 7fbc3de41640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbc380c9cb0 0x7fbc380c5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:21.081 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.071+0000 7fbc3de41640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc380ced10 0x7fbc380c7c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:21.081 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.071+0000 7fbc3de41640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc380ada90 con 0x7fbc380c9cb0 2023-05-16T13:55:21.081 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.071+0000 7fbc3de41640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc380add70 con 0x7fbc380ced10 2023-05-16T13:55:21.081 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.071+0000 7fbc3de41640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc380ae050 con 0x7fbc38071b00 2023-05-16T13:55:21.081 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.071+0000 7fbc36ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbc380c9cb0 0x7fbc380c5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:21.081 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.071+0000 7fbc36ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbc380c9cb0 0x7fbc380c5680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44318/0 (socket says 172.21.15.39:44318) 2023-05-16T13:55:21.082 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.071+0000 7fbc36ffd640 1 -- 172.21.15.39:0/2773247030 learned_addr learned my addr 172.21.15.39:0/2773247030 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:21.082 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.071+0000 7fbc377fe640 1 --2- 172.21.15.39:0/2773247030 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc38071b00 0x7fbc38151760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:21.082 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.071+0000 7fbc37fff640 1 --2- 172.21.15.39:0/2773247030 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc380ced10 0x7fbc380c7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:21.082 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.071+0000 7fbc36ffd640 1 -- 172.21.15.39:0/2773247030 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc38071b00 msgr2=0x7fbc38151760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:21.082 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.071+0000 7fbc36ffd640 1 --2- 172.21.15.39:0/2773247030 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc38071b00 0x7fbc38151760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:21.082 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.071+0000 7fbc36ffd640 1 -- 172.21.15.39:0/2773247030 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc380ced10 msgr2=0x7fbc380c7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:21.082 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.071+0000 7fbc36ffd640 1 --2- 172.21.15.39:0/2773247030 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc380ced10 0x7fbc380c7c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:21.083 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.071+0000 7fbc36ffd640 1 -- 172.21.15.39:0/2773247030 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc280094d0 con 0x7fbc380c9cb0 2023-05-16T13:55:21.083 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.071+0000 7fbc36ffd640 1 --2- 172.21.15.39:0/2773247030 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbc380c9cb0 0x7fbc380c5680 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c00c500 tx=0x7fbc2c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:21.084 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.075+0000 7fbc1ffff640 1 -- 172.21.15.39:0/2773247030 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc2c005220 con 0x7fbc380c9cb0 2023-05-16T13:55:21.084 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.075+0000 7fbc1ffff640 1 -- 172.21.15.39:0/2773247030 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc2c005380 con 0x7fbc380c9cb0 2023-05-16T13:55:21.084 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.075+0000 7fbc3de41640 1 -- 172.21.15.39:0/2773247030 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc380b42f0 con 0x7fbc380c9cb0 2023-05-16T13:55:21.084 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.075+0000 7fbc1ffff640 1 -- 172.21.15.39:0/2773247030 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc2c007270 con 0x7fbc380c9cb0 2023-05-16T13:55:21.084 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.075+0000 7fbc3de41640 1 -- 172.21.15.39:0/2773247030 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc380c97c0 con 0x7fbc380c9cb0 2023-05-16T13:55:21.085 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.075+0000 7fbc3de41640 1 -- 172.21.15.39:0/2773247030 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc380cafe0 con 0x7fbc380c9cb0 2023-05-16T13:55:21.085 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.075+0000 7fbc1ffff640 1 -- 172.21.15.39:0/2773247030 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbc2c0073d0 con 0x7fbc380c9cb0 2023-05-16T13:55:21.085 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.075+0000 7fbc1ffff640 1 --2- 172.21.15.39:0/2773247030 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fbc24066280 0x7fbc24068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:21.085 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.075+0000 7fbc1ffff640 1 -- 172.21.15.39:0/2773247030 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fbc2c082ff0 con 0x7fbc380c9cb0 2023-05-16T13:55:21.085 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.075+0000 7fbc377fe640 1 --2- 172.21.15.39:0/2773247030 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fbc24066280 0x7fbc24068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:21.085 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.075+0000 7fbc377fe640 1 --2- 172.21.15.39:0/2773247030 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fbc24066280 0x7fbc24068730 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fbc280af000 tx=0x7fbc280b6040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:21.087 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.079+0000 7fbc1ffff640 1 -- 172.21.15.39:0/2773247030 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fbc2c0b36f0 con 0x7fbc380c9cb0 2023-05-16T13:55:21.246 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.239+0000 7fbc3de41640 1 -- 172.21.15.39:0/2773247030 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fbc38073c90 con 0x7fbc380c9cb0 2023-05-16T13:55:21.246 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.239+0000 7fbc1ffff640 1 -- 172.21.15.39:0/2773247030 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v34) v1 ==== 84+0+126 (secure 0 0 0) 0x7fbc2c050820 con 0x7fbc380c9cb0 2023-05-16T13:55:21.246 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:55:21.247 INFO:teuthology.orchestra.run.smithi039.stdout:[ 2023-05-16T13:55:21.247 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-05-16T13:55:21.247 INFO:teuthology.orchestra.run.smithi039.stdout: "poolnum": 1, 2023-05-16T13:55:21.247 INFO:teuthology.orchestra.run.smithi039.stdout: "poolname": ".mgr" 2023-05-16T13:55:21.247 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-05-16T13:55:21.247 INFO:teuthology.orchestra.run.smithi039.stdout: { 2023-05-16T13:55:21.247 INFO:teuthology.orchestra.run.smithi039.stdout: "poolnum": 2, 2023-05-16T13:55:21.248 INFO:teuthology.orchestra.run.smithi039.stdout: "poolname": "rbd" 2023-05-16T13:55:21.248 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-05-16T13:55:21.248 INFO:teuthology.orchestra.run.smithi039.stdout:] 2023-05-16T13:55:21.249 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.239+0000 7fbc3de41640 1 -- 172.21.15.39:0/2773247030 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fbc24066280 msgr2=0x7fbc24068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:21.249 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.239+0000 7fbc3de41640 1 --2- 172.21.15.39:0/2773247030 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fbc24066280 0x7fbc24068730 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fbc280af000 tx=0x7fbc280b6040 comp rx=0 tx=0).stop 2023-05-16T13:55:21.249 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.239+0000 7fbc3de41640 1 -- 172.21.15.39:0/2773247030 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbc380c9cb0 msgr2=0x7fbc380c5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:21.249 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.239+0000 7fbc3de41640 1 --2- 172.21.15.39:0/2773247030 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbc380c9cb0 0x7fbc380c5680 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c00c500 tx=0x7fbc2c00c9c0 comp rx=0 tx=0).stop 2023-05-16T13:55:21.249 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.239+0000 7fbc3de41640 1 -- 172.21.15.39:0/2773247030 shutdown_connections 2023-05-16T13:55:21.249 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.239+0000 7fbc3de41640 1 --2- 172.21.15.39:0/2773247030 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc380ced10 0x7fbc380c7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:21.250 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.239+0000 7fbc3de41640 1 --2- 172.21.15.39:0/2773247030 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbc380c9cb0 0x7fbc380c5680 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:21.250 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.239+0000 7fbc3de41640 1 --2- 172.21.15.39:0/2773247030 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fbc24066280 0x7fbc24068730 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:21.250 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.239+0000 7fbc3de41640 1 --2- 172.21.15.39:0/2773247030 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc38071b00 0x7fbc38151760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:21.250 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.239+0000 7fbc3de41640 1 -- 172.21.15.39:0/2773247030 >> 172.21.15.39:0/2773247030 conn(0x7fbc38069a50 msgr2=0x7fbc380cbf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:21.250 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.239+0000 7fbc3de41640 1 -- 172.21.15.39:0/2773247030 shutdown_connections 2023-05-16T13:55:21.250 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.239+0000 7fbc3de41640 1 -- 172.21.15.39:0/2773247030 wait complete. 2023-05-16T13:55:21.267 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-05-16T13:55:21.268 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-05-16T13:55:21.409 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.403+0000 7f7faec83640 1 Processor -- start 2023-05-16T13:55:21.410 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.403+0000 7f7faec83640 1 -- start start 2023-05-16T13:55:21.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.403+0000 7f7faec83640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7fa81603c0 0x7f7fa80cd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:21.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.403+0000 7f7faec83640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f7fa80b03f0 0x7f7fa8163eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:21.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.403+0000 7f7faec83640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fa80cb360 con 0x7f7fa80cb7f0 2023-05-16T13:55:21.411 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.403+0000 7f7faec83640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fa8160790 con 0x7f7fa80b03f0 2023-05-16T13:55:21.412 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.403+0000 7f7faec83640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fa80c1820 con 0x7f7fa81603c0 2023-05-16T13:55:21.412 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.403+0000 7f7fae482640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f7fa80b03f0 0x7f7fa8163eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:21.412 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.403+0000 7f7fae482640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f7fa80b03f0 0x7f7fa8163eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44332/0 (socket says 172.21.15.39:44332) 2023-05-16T13:55:21.412 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.403+0000 7f7fad480640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f7fa80cb7f0 0x7f7fa80afce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:35026/0 (socket says 172.21.15.39:35026) 2023-05-16T13:55:21.413 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.403+0000 7f7fae482640 1 -- 172.21.15.39:0/1829155264 learned_addr learned my addr 172.21.15.39:0/1829155264 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:21.413 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.403+0000 7f7fadc81640 1 --2- 172.21.15.39:0/1829155264 >> v2:172.21.15.118:3300/0 conn(0x7f7fa81603c0 0x7f7fa80cd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:21.414 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.403+0000 7f7fae482640 1 -- 172.21.15.39:0/1829155264 >> v2:172.21.15.118:3300/0 conn(0x7f7fa81603c0 msgr2=0x7f7fa80cd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:21.414 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.403+0000 7f7fae482640 1 --2- 172.21.15.39:0/1829155264 >> v2:172.21.15.118:3300/0 conn(0x7f7fa81603c0 0x7f7fa80cd8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:21.414 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.403+0000 7f7fae482640 1 -- 172.21.15.39:0/1829155264 >> v1:172.21.15.39:6789/0 conn(0x7f7fa80cb7f0 legacy=0x7f7fa80afce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:21.415 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.403+0000 7f7fae482640 1 -- 172.21.15.39:0/1829155264 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa80c1b00 con 0x7f7fa80b03f0 2023-05-16T13:55:21.415 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.403+0000 7f7facc7f640 1 -- 172.21.15.39:0/1829155264 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2745525754 0 0) 0x7f7fa80cb360 con 0x7f7fa80cb7f0 2023-05-16T13:55:21.415 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.407+0000 7f7fae482640 1 --2- 172.21.15.39:0/1829155264 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7fa80b03f0 0x7f7fa8163eb0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f7fa80b0e10 tx=0x7f7fa001f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7225ac5ec61a2dcb server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:21.416 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.407+0000 7f7facc7f640 1 -- 172.21.15.39:0/1829155264 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa00af400 con 0x7f7fa80b03f0 2023-05-16T13:55:21.416 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.407+0000 7f7facc7f640 1 -- 172.21.15.39:0/1829155264 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa00ab050 con 0x7f7fa80b03f0 2023-05-16T13:55:21.416 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.407+0000 7f7facc7f640 1 -- 172.21.15.39:0/1829155264 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa00af780 con 0x7f7fa80b03f0 2023-05-16T13:55:21.416 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.407+0000 7f7faec83640 1 -- 172.21.15.39:0/1829155264 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7fa80b03f0 msgr2=0x7f7fa8163eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:21.417 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.407+0000 7f7faec83640 1 --2- 172.21.15.39:0/1829155264 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7fa80b03f0 0x7f7fa8163eb0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f7fa80b0e10 tx=0x7f7fa001f1c0 comp rx=0 tx=0).stop 2023-05-16T13:55:21.417 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.407+0000 7f7faec83640 1 -- 172.21.15.39:0/1829155264 shutdown_connections 2023-05-16T13:55:21.417 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.407+0000 7f7faec83640 1 --2- 172.21.15.39:0/1829155264 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7fa80b03f0 0x7f7fa8163eb0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:21.417 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.407+0000 7f7faec83640 1 --2- 172.21.15.39:0/1829155264 >> v2:172.21.15.118:3300/0 conn(0x7f7fa81603c0 0x7f7fa80cd8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:21.417 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.407+0000 7f7faec83640 1 -- 172.21.15.39:0/1829155264 >> 172.21.15.39:0/1829155264 conn(0x7f7fa8069a50 msgr2=0x7f7fa8069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:21.417 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.407+0000 7f7faec83640 1 -- 172.21.15.39:0/1829155264 shutdown_connections 2023-05-16T13:55:21.417 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.407+0000 7f7faec83640 1 -- 172.21.15.39:0/1829155264 wait complete. 2023-05-16T13:55:21.418 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.411+0000 7f7faec83640 1 Processor -- start 2023-05-16T13:55:21.418 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.411+0000 7f7faec83640 1 -- start start 2023-05-16T13:55:21.419 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.411+0000 7f7faec83640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7fa80b03f0 0x7f7fa80c5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:21.419 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.411+0000 7f7faec83640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7fa80cb7f0 0x7f7fa81f9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:21.419 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.411+0000 7f7faec83640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7fa81603c0 0x7f7fa815a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:21.419 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.411+0000 7f7faec83640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa81f9ea0 con 0x7f7fa80b03f0 2023-05-16T13:55:21.419 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.411+0000 7f7faec83640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa80c3d00 con 0x7f7fa81603c0 2023-05-16T13:55:21.419 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.411+0000 7f7faec83640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa80c30f0 con 0x7f7fa80cb7f0 2023-05-16T13:55:21.419 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.411+0000 7f7fadc81640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7fa80b03f0 0x7f7fa80c5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:21.419 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.411+0000 7f7fadc81640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7fa80b03f0 0x7f7fa80c5cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44338/0 (socket says 172.21.15.39:44338) 2023-05-16T13:55:21.420 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.411+0000 7f7fadc81640 1 -- 172.21.15.39:0/2336999983 learned_addr learned my addr 172.21.15.39:0/2336999983 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:21.420 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.411+0000 7f7fadc81640 1 -- 172.21.15.39:0/2336999983 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7fa80cb7f0 msgr2=0x7f7fa81f9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:21.420 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.411+0000 7f7fadc81640 1 --2- 172.21.15.39:0/2336999983 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7fa80cb7f0 0x7f7fa81f9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:21.420 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.411+0000 7f7fadc81640 1 -- 172.21.15.39:0/2336999983 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7fa81603c0 msgr2=0x7f7fa815a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:21.420 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.411+0000 7f7fadc81640 1 --2- 172.21.15.39:0/2336999983 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7fa81603c0 0x7f7fa815a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:21.420 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.411+0000 7f7fadc81640 1 -- 172.21.15.39:0/2336999983 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa0009b30 con 0x7f7fa80b03f0 2023-05-16T13:55:21.421 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.411+0000 7f7fadc81640 1 --2- 172.21.15.39:0/2336999983 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7fa80b03f0 0x7f7fa80c5cd0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f7fa400e8a0 tx=0x7f7fa400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:21.421 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.411+0000 7f7f9e7fc640 1 -- 172.21.15.39:0/2336999983 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa4009510 con 0x7f7fa80b03f0 2023-05-16T13:55:21.422 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.411+0000 7f7f9e7fc640 1 -- 172.21.15.39:0/2336999983 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa400c8e0 con 0x7f7fa80b03f0 2023-05-16T13:55:21.422 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.411+0000 7f7f9e7fc640 1 -- 172.21.15.39:0/2336999983 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa400cc50 con 0x7f7fa80b03f0 2023-05-16T13:55:21.422 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.411+0000 7f7faec83640 1 -- 172.21.15.39:0/2336999983 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fa80caff0 con 0x7f7fa80b03f0 2023-05-16T13:55:21.422 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.411+0000 7f7faec83640 1 -- 172.21.15.39:0/2336999983 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fa80cad10 con 0x7f7fa80b03f0 2023-05-16T13:55:21.422 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.411+0000 7f7faec83640 1 -- 172.21.15.39:0/2336999983 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fa80c8c00 con 0x7f7fa80b03f0 2023-05-16T13:55:21.422 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.415+0000 7f7f9e7fc640 1 -- 172.21.15.39:0/2336999983 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7fa4013470 con 0x7f7fa80b03f0 2023-05-16T13:55:21.423 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.415+0000 7f7f9e7fc640 1 --2- 172.21.15.39:0/2336999983 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f7f8c066280 0x7f7f8c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:21.423 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.415+0000 7f7f9e7fc640 1 -- 172.21.15.39:0/2336999983 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7fa4083d80 con 0x7f7fa80b03f0 2023-05-16T13:55:21.423 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.415+0000 7f7fad480640 1 --2- 172.21.15.39:0/2336999983 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f7f8c066280 0x7f7f8c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:21.423 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.415+0000 7f7fad480640 1 --2- 172.21.15.39:0/2336999983 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f7f8c066280 0x7f7f8c068730 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7f980011f0 tx=0x7f7f98007930 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:21.426 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.419+0000 7f7f9e7fc640 1 -- 172.21.15.39:0/2336999983 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f7fa40515e0 con 0x7f7fa80b03f0 2023-05-16T13:55:21.579 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.571+0000 7f7faec83640 1 -- 172.21.15.39:0/2336999983 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f7fa804ed20 con 0x7f7fa80b03f0 2023-05-16T13:55:21.977 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.971+0000 7f7f9e7fc640 1 -- 172.21.15.39:0/2336999983 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v35) v1 ==== 138+0+0 (secure 0 0 0) 0x7f7fa4054c00 con 0x7f7fa80b03f0 2023-05-16T13:55:21.978 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'cephfs_metadata' created 2023-05-16T13:55:21.980 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.971+0000 7f7faec83640 1 -- 172.21.15.39:0/2336999983 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f7f8c066280 msgr2=0x7f7f8c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:21.980 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.971+0000 7f7faec83640 1 --2- 172.21.15.39:0/2336999983 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f7f8c066280 0x7f7f8c068730 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7f980011f0 tx=0x7f7f98007930 comp rx=0 tx=0).stop 2023-05-16T13:55:21.980 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.971+0000 7f7faec83640 1 -- 172.21.15.39:0/2336999983 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7fa80b03f0 msgr2=0x7f7fa80c5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:21.980 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.971+0000 7f7faec83640 1 --2- 172.21.15.39:0/2336999983 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7fa80b03f0 0x7f7fa80c5cd0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f7fa400e8a0 tx=0x7f7fa400eca0 comp rx=0 tx=0).stop 2023-05-16T13:55:21.981 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.971+0000 7f7faec83640 1 -- 172.21.15.39:0/2336999983 shutdown_connections 2023-05-16T13:55:21.981 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.971+0000 7f7faec83640 1 --2- 172.21.15.39:0/2336999983 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f7f8c066280 0x7f7f8c068730 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:21.981 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.971+0000 7f7faec83640 1 --2- 172.21.15.39:0/2336999983 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7fa80cb7f0 0x7f7fa81f9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:21.981 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.971+0000 7f7faec83640 1 --2- 172.21.15.39:0/2336999983 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7fa81603c0 0x7f7fa815a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:21.981 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.971+0000 7f7faec83640 1 --2- 172.21.15.39:0/2336999983 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7fa80b03f0 0x7f7fa80c5cd0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:21.981 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.971+0000 7f7faec83640 1 -- 172.21.15.39:0/2336999983 >> 172.21.15.39:0/2336999983 conn(0x7f7fa8069a50 msgr2=0x7f7fa8069e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:21.982 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.971+0000 7f7faec83640 1 -- 172.21.15.39:0/2336999983 shutdown_connections 2023-05-16T13:55:21.982 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:21.971+0000 7f7faec83640 1 -- 172.21.15.39:0/2336999983 wait complete. 2023-05-16T13:55:22.004 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-05-16T13:55:22.149 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:22.143+0000 7f5a15e41640 1 Processor -- start 2023-05-16T13:55:22.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:22.143+0000 7f5a15e41640 1 -- start start 2023-05-16T13:55:22.151 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:22.143+0000 7f5a15e41640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5a100b2ab0 0x7f5a1009bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:22.151 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:22.143+0000 7f5a15e41640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a100c8f50 con 0x7f5a100cb8d0 2023-05-16T13:55:22.151 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:22.143+0000 7f5a15e41640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a100caa20 con 0x7f5a100ad680 2023-05-16T13:55:22.151 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:22.143+0000 7f5a15e41640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a100cd630 con 0x7f5a100b2ab0 2023-05-16T13:55:22.152 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:22.143+0000 7f5a0ffff640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f5a100cb8d0 0x7f5a100cc080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:35036/0 (socket says 172.21.15.39:35036) 2023-05-16T13:55:22.152 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:22.143+0000 7f5a0ffff640 1 -- 172.21.15.39:0/3866833732 learned_addr learned my addr 172.21.15.39:0/3866833732 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:55:22.153 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:22.143+0000 7f5a0effd640 1 --2- 172.21.15.39:0/3866833732 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5a100b2ab0 0x7f5a1009bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:22.153 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:22.143+0000 7f5a0e7fc640 1 -- 172.21.15.39:0/3866833732 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 682731088 0 0) 0x7f5a100c8f50 con 0x7f5a100cb8d0 2023-05-16T13:55:22.153 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:22.143+0000 7f5a0e7fc640 1 -- 172.21.15.39:0/3866833732 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59f8005740 con 0x7f5a100cb8d0 2023-05-16T13:55:22.153 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:22.143+0000 7f5a0e7fc640 1 -- 172.21.15.39:0/3866833732 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2716585423 0 0) 0x7f5a100caa20 con 0x7f5a100ad680 2023-05-16T13:55:22.153 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:22.143+0000 7f5a0e7fc640 1 -- 172.21.15.39:0/3866833732 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a100c8f50 con 0x7f5a100ad680 2023-05-16T13:55:22.154 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:22.143+0000 7f5a0effd640 1 -- 172.21.15.39:0/3866833732 >> v1:172.21.15.118:6789/0 conn(0x7f5a100ad680 legacy=0x7f5a100b23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:22.154 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:22.143+0000 7f5a0effd640 1 -- 172.21.15.39:0/3866833732 >> v1:172.21.15.39:6789/0 conn(0x7f5a100cb8d0 legacy=0x7f5a100cc080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:22.154 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:22.143+0000 7f5a0e7fc640 1 -- 172.21.15.39:0/3866833732 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1593513113 0 0) 0x7f59f8005740 con 0x7f5a100cb8d0 2023-05-16T13:55:22.155 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:22.143+0000 7f5a0effd640 1 -- 172.21.15.39:0/3866833732 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a100cbcf0 con 0x7f5a100b2ab0 2023-05-16T13:55:22.156 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:22.147+0000 7f5a0effd640 1 --2- 172.21.15.39:0/3866833732 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5a100b2ab0 0x7f5a1009bc90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5a040097f0 tx=0x7f5a0401c320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=514a9ac62cc56937 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:22.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:22.147+0000 7f5a0e7fc640 1 -- 172.21.15.39:0/3866833732 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a08001a00 con 0x7f5a100b2ab0 2023-05-16T13:55:22.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:22.147+0000 7f5a0e7fc640 1 -- 172.21.15.39:0/3866833732 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a040a7050 con 0x7f5a100b2ab0 2023-05-16T13:55:22.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:22.147+0000 7f5a0e7fc640 1 -- 172.21.15.39:0/3866833732 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a040ab620 con 0x7f5a100b2ab0 2023-05-16T13:55:22.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:22.147+0000 7f5a15e41640 1 -- 172.21.15.39:0/3866833732 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5a100b2ab0 msgr2=0x7f5a1009bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:22.158 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:22.147+0000 7f5a15e41640 1 --2- 172.21.15.39:0/3866833732 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5a100b2ab0 0x7f5a1009bc90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5a040097f0 tx=0x7f5a0401c320 comp rx=0 tx=0).stop 2023-05-16T13:55:22.158 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:22.147+0000 7f5a15e41640 1 -- 172.21.15.39:0/3866833732 shutdown_connections 2023-05-16T13:55:22.158 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:22.147+0000 7f5a15e41640 1 --2- 172.21.15.39:0/3866833732 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5a100b2ab0 0x7f5a1009bc90 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:22.159 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:22.147+0000 7f5a15e41640 1 -- 172.21.15.39:0/3866833732 >> 172.21.15.39:0/3866833732 conn(0x7f5a100cadc0 msgr2=0x7f5a100cb1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:22.159 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:22.147+0000 7f5a15e41640 1 -- 172.21.15.39:0/3866833732 shutdown_connections 2023-05-16T13:55:22.159 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:22.147+0000 7f5a15e41640 1 -- 172.21.15.39:0/3866833732 wait complete. 2023-05-16T13:55:22.161 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:22.151+0000 7f5a15e41640 1 Processor -- start 2023-05-16T13:55:22.161 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:22.151+0000 7f5a15e41640 1 -- start start 2023-05-16T13:55:22.161 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:22.151+0000 7f5a15e41640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a100ad680 0x7f5a1014eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:22.161 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:22.151+0000 7f5a15e41640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5a100b2ab0 0x7f5a1014d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:22.161 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:22.151+0000 7f5a15e41640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5a100cb8d0 0x7f5a1014bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:22.161 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:22.151+0000 7f5a15e41640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1014d860 con 0x7f5a100cb8d0 2023-05-16T13:55:22.162 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:22.151+0000 7f5a15e41640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1014c100 con 0x7f5a100ad680 2023-05-16T13:55:22.162 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:22.151+0000 7f5a15e41640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1014da70 con 0x7f5a100b2ab0 2023-05-16T13:55:22.162 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:22.151+0000 7f5a0ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5a100cb8d0 0x7f5a1014bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:22.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:22.151+0000 7f5a0ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5a100cb8d0 0x7f5a1014bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44354/0 (socket says 172.21.15.39:44354) 2023-05-16T13:55:22.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:22.151+0000 7f5a0ffff640 1 -- 172.21.15.39:0/3550317706 learned_addr learned my addr 172.21.15.39:0/3550317706 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:22.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:22.151+0000 7f5a0effd640 1 --2- 172.21.15.39:0/3550317706 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5a100b2ab0 0x7f5a1014d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:22.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:22.151+0000 7f5a0f7fe640 1 --2- 172.21.15.39:0/3550317706 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a100ad680 0x7f5a1014eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:22.164 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:22.151+0000 7f5a0ffff640 1 -- 172.21.15.39:0/3550317706 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5a100b2ab0 msgr2=0x7f5a1014d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:22.164 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:22.151+0000 7f5a0ffff640 1 --2- 172.21.15.39:0/3550317706 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5a100b2ab0 0x7f5a1014d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:22.164 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:22.151+0000 7f5a0ffff640 1 -- 172.21.15.39:0/3550317706 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a100ad680 msgr2=0x7f5a1014eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:22.165 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:22.151+0000 7f5a0ffff640 1 --2- 172.21.15.39:0/3550317706 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a100ad680 0x7f5a1014eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:22.165 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:22.151+0000 7f5a0ffff640 1 -- 172.21.15.39:0/3550317706 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a04009420 con 0x7f5a100cb8d0 2023-05-16T13:55:22.165 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:22.151+0000 7f5a0ffff640 1 --2- 172.21.15.39:0/3550317706 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5a100cb8d0 0x7f5a1014bbc0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f5a08001f10 tx=0x7f5a0800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:22.165 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:22.151+0000 7f59f7fff640 1 -- 172.21.15.39:0/3550317706 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a08012400 con 0x7f5a100cb8d0 2023-05-16T13:55:22.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:22.151+0000 7f59f7fff640 1 -- 172.21.15.39:0/3550317706 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a08012560 con 0x7f5a100cb8d0 2023-05-16T13:55:22.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:22.151+0000 7f59f7fff640 1 -- 172.21.15.39:0/3550317706 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a08012910 con 0x7f5a100cb8d0 2023-05-16T13:55:22.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:22.151+0000 7f5a15e41640 1 -- 172.21.15.39:0/3550317706 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a100ca360 con 0x7f5a100cb8d0 2023-05-16T13:55:22.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:22.151+0000 7f5a15e41640 1 -- 172.21.15.39:0/3550317706 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a100ca6b0 con 0x7f5a100cb8d0 2023-05-16T13:55:22.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:22.155+0000 7f5a15e41640 1 -- 172.21.15.39:0/3550317706 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a1006b490 con 0x7f5a100cb8d0 2023-05-16T13:55:22.168 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:22.155+0000 7f59f7fff640 1 -- 172.21.15.39:0/3550317706 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5a08012a70 con 0x7f5a100cb8d0 2023-05-16T13:55:22.169 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:22.155+0000 7f59f7fff640 1 --2- 172.21.15.39:0/3550317706 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f59fc066280 0x7f59fc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:22.169 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:22.155+0000 7f59f7fff640 1 -- 172.21.15.39:0/3550317706 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f5a08084330 con 0x7f5a100cb8d0 2023-05-16T13:55:22.169 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:22.155+0000 7f5a0f7fe640 1 --2- 172.21.15.39:0/3550317706 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f59fc066280 0x7f59fc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:22.169 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:22.155+0000 7f5a0f7fe640 1 --2- 172.21.15.39:0/3550317706 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f59fc066280 0x7f59fc068730 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5a00001240 tx=0x7f5a00009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:22.170 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:22.159+0000 7f59f7fff640 1 -- 172.21.15.39:0/3550317706 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f5a080518f0 con 0x7f5a100cb8d0 2023-05-16T13:55:22.321 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:22.315+0000 7f5a15e41640 1 -- 172.21.15.39:0/3550317706 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f5a10073c90 con 0x7f5a100cb8d0 2023-05-16T13:55:22.999 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:22.991+0000 7f59f7fff640 1 -- 172.21.15.39:0/3550317706 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v36) v1 ==== 170+0+0 (secure 0 0 0) 0x7f5a08054f10 con 0x7f5a100cb8d0 2023-05-16T13:55:23.003 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'cephfs_data' created 2023-05-16T13:55:23.008 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:22.999+0000 7f5a15e41640 1 -- 172.21.15.39:0/3550317706 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f59fc066280 msgr2=0x7f59fc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:23.009 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:22.999+0000 7f5a15e41640 1 --2- 172.21.15.39:0/3550317706 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f59fc066280 0x7f59fc068730 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5a00001240 tx=0x7f5a00009040 comp rx=0 tx=0).stop 2023-05-16T13:55:23.010 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:22.999+0000 7f5a15e41640 1 -- 172.21.15.39:0/3550317706 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5a100cb8d0 msgr2=0x7f5a1014bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:23.010 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:22.999+0000 7f5a15e41640 1 --2- 172.21.15.39:0/3550317706 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5a100cb8d0 0x7f5a1014bbc0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f5a08001f10 tx=0x7f5a0800a430 comp rx=0 tx=0).stop 2023-05-16T13:55:23.015 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.007+0000 7f5a15e41640 1 -- 172.21.15.39:0/3550317706 shutdown_connections 2023-05-16T13:55:23.015 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.007+0000 7f5a15e41640 1 --2- 172.21.15.39:0/3550317706 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f59fc066280 0x7f59fc068730 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:23.015 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.007+0000 7f5a15e41640 1 --2- 172.21.15.39:0/3550317706 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5a100b2ab0 0x7f5a1014d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:23.015 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.007+0000 7f5a15e41640 1 --2- 172.21.15.39:0/3550317706 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5a100cb8d0 0x7f5a1014bbc0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:23.015 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.007+0000 7f5a15e41640 1 --2- 172.21.15.39:0/3550317706 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a100ad680 0x7f5a1014eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:23.016 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.007+0000 7f5a15e41640 1 -- 172.21.15.39:0/3550317706 >> 172.21.15.39:0/3550317706 conn(0x7f5a100cadc0 msgr2=0x7f5a100cb190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:23.016 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.007+0000 7f5a15e41640 1 -- 172.21.15.39:0/3550317706 shutdown_connections 2023-05-16T13:55:23.016 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.007+0000 7f5a15e41640 1 -- 172.21.15.39:0/3550317706 wait complete. 2023-05-16T13:55:23.036 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-05-16T13:55:23.178 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.171+0000 7fb92a9a2640 1 Processor -- start 2023-05-16T13:55:23.179 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.171+0000 7fb92a9a2640 1 -- start start 2023-05-16T13:55:23.180 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.171+0000 7fb92a9a2640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fb924160150 0x7fb92406c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:23.180 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.171+0000 7fb92a9a2640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb924160520 0x7fb9240afcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:23.180 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.171+0000 7fb92a9a2640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb92406c7d0 0x7fb9240b0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:23.180 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.171+0000 7fb92a9a2640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb924164d20 con 0x7fb924160150 2023-05-16T13:55:23.181 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.171+0000 7fb92a9a2640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9241641a0 con 0x7fb92406c7d0 2023-05-16T13:55:23.181 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.171+0000 7fb92a9a2640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb924164480 con 0x7fb924160520 2023-05-16T13:55:23.181 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.171+0000 7fb9299a0640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fb924160150 0x7fb92406c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:23.182 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.171+0000 7fb9299a0640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fb924160150 0x7fb92406c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44370/0 (socket says 172.21.15.39:44370) 2023-05-16T13:55:23.182 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.171+0000 7fb9299a0640 1 -- 172.21.15.39:0/2347254389 learned_addr learned my addr 172.21.15.39:0/2347254389 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:23.182 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.171+0000 7fb92a1a1640 1 --2- 172.21.15.39:0/2347254389 >> v2:172.21.15.118:3300/0 conn(0x7fb92406c7d0 0x7fb9240b0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:23.182 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.175+0000 7fb92919f640 1 --2- 172.21.15.39:0/2347254389 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb924160520 0x7fb9240afcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:23.182 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.175+0000 7fb9299a0640 1 -- 172.21.15.39:0/2347254389 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb924160520 msgr2=0x7fb9240afcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:23.182 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.175+0000 7fb9299a0640 1 --2- 172.21.15.39:0/2347254389 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb924160520 0x7fb9240afcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:23.182 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.175+0000 7fb9299a0640 1 -- 172.21.15.39:0/2347254389 >> v2:172.21.15.118:3300/0 conn(0x7fb92406c7d0 msgr2=0x7fb9240b0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:23.183 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.175+0000 7fb9299a0640 1 --2- 172.21.15.39:0/2347254389 >> v2:172.21.15.118:3300/0 conn(0x7fb92406c7d0 0x7fb9240b0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:23.183 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.175+0000 7fb9299a0640 1 -- 172.21.15.39:0/2347254389 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb924164760 con 0x7fb924160150 2023-05-16T13:55:23.183 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.175+0000 7fb9299a0640 1 --2- 172.21.15.39:0/2347254389 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb924160150 0x7fb92406c290 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fb924071ea0 tx=0x7fb92001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=199a2f9c4cef34a7 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:23.184 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.175+0000 7fb92899e640 1 -- 172.21.15.39:0/2347254389 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9200ad660 con 0x7fb924160150 2023-05-16T13:55:23.184 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.175+0000 7fb92899e640 1 -- 172.21.15.39:0/2347254389 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9200ad7c0 con 0x7fb924160150 2023-05-16T13:55:23.184 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.175+0000 7fb92899e640 1 -- 172.21.15.39:0/2347254389 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9200adb50 con 0x7fb924160150 2023-05-16T13:55:23.185 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.175+0000 7fb92a9a2640 1 -- 172.21.15.39:0/2347254389 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb924160150 msgr2=0x7fb92406c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:23.185 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.175+0000 7fb92a9a2640 1 --2- 172.21.15.39:0/2347254389 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb924160150 0x7fb92406c290 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fb924071ea0 tx=0x7fb92001c400 comp rx=0 tx=0).stop 2023-05-16T13:55:23.185 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.175+0000 7fb92a9a2640 1 -- 172.21.15.39:0/2347254389 shutdown_connections 2023-05-16T13:55:23.185 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.175+0000 7fb92a9a2640 1 --2- 172.21.15.39:0/2347254389 >> v2:172.21.15.118:3300/0 conn(0x7fb92406c7d0 0x7fb9240b0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:23.186 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.175+0000 7fb92a9a2640 1 --2- 172.21.15.39:0/2347254389 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb924160520 0x7fb9240afcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:23.186 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.175+0000 7fb92a9a2640 1 --2- 172.21.15.39:0/2347254389 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb924160150 0x7fb92406c290 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:23.186 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.175+0000 7fb92a9a2640 1 -- 172.21.15.39:0/2347254389 >> 172.21.15.39:0/2347254389 conn(0x7fb924069a50 msgr2=0x7fb924069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:23.186 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.179+0000 7fb92a9a2640 1 -- 172.21.15.39:0/2347254389 shutdown_connections 2023-05-16T13:55:23.186 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.179+0000 7fb92a9a2640 1 -- 172.21.15.39:0/2347254389 wait complete. 2023-05-16T13:55:23.186 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.179+0000 7fb92a9a2640 1 Processor -- start 2023-05-16T13:55:23.187 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.179+0000 7fb92a9a2640 1 -- start start 2023-05-16T13:55:23.187 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.179+0000 7fb92a9a2640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb92406c7d0 0x7fb9240af560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:23.188 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.179+0000 7fb92a9a2640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb924160150 0x7fb924159d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:23.188 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.179+0000 7fb92a9a2640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb924160520 0x7fb92415a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:23.188 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.179+0000 7fb92a9a2640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb924163170 con 0x7fb924160150 2023-05-16T13:55:23.188 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.179+0000 7fb92a9a2640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb924157860 con 0x7fb92406c7d0 2023-05-16T13:55:23.188 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.179+0000 7fb92a9a2640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb924162bb0 con 0x7fb924160520 2023-05-16T13:55:23.188 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.179+0000 7fb92919f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb924160150 0x7fb924159d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:23.188 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.179+0000 7fb92919f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb924160150 0x7fb924159d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44386/0 (socket says 172.21.15.39:44386) 2023-05-16T13:55:23.189 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.179+0000 7fb92919f640 1 -- 172.21.15.39:0/634745375 learned_addr learned my addr 172.21.15.39:0/634745375 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:23.189 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.179+0000 7fb92a1a1640 1 --2- 172.21.15.39:0/634745375 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb924160520 0x7fb92415a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:23.189 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.179+0000 7fb9299a0640 1 --2- 172.21.15.39:0/634745375 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb92406c7d0 0x7fb9240af560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:23.190 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.179+0000 7fb92919f640 1 -- 172.21.15.39:0/634745375 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb924160520 msgr2=0x7fb92415a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:23.190 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.179+0000 7fb92919f640 1 --2- 172.21.15.39:0/634745375 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb924160520 0x7fb92415a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:23.190 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.179+0000 7fb92919f640 1 -- 172.21.15.39:0/634745375 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb92406c7d0 msgr2=0x7fb9240af560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:23.190 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.179+0000 7fb92919f640 1 --2- 172.21.15.39:0/634745375 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb92406c7d0 0x7fb9240af560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:23.190 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.179+0000 7fb92919f640 1 -- 172.21.15.39:0/634745375 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9200094d0 con 0x7fb924160150 2023-05-16T13:55:23.191 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.179+0000 7fb92919f640 1 --2- 172.21.15.39:0/634745375 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb924160150 0x7fb924159d40 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fb91400d800 tx=0x7fb91400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:23.191 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.179+0000 7fb91a7fc640 1 -- 172.21.15.39:0/634745375 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91400b6c0 con 0x7fb924160150 2023-05-16T13:55:23.191 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.179+0000 7fb91a7fc640 1 -- 172.21.15.39:0/634745375 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb91400b820 con 0x7fb924160150 2023-05-16T13:55:23.191 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.179+0000 7fb91a7fc640 1 -- 172.21.15.39:0/634745375 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91400bb90 con 0x7fb924160150 2023-05-16T13:55:23.191 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.179+0000 7fb92a9a2640 1 -- 172.21.15.39:0/634745375 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9240cb5c0 con 0x7fb924160150 2023-05-16T13:55:23.191 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.183+0000 7fb92a9a2640 1 -- 172.21.15.39:0/634745375 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9240cb430 con 0x7fb924160150 2023-05-16T13:55:23.192 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.183+0000 7fb92a9a2640 1 -- 172.21.15.39:0/634745375 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9240cb750 con 0x7fb924160150 2023-05-16T13:55:23.192 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.183+0000 7fb91a7fc640 1 -- 172.21.15.39:0/634745375 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb91400bcf0 con 0x7fb924160150 2023-05-16T13:55:23.192 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.183+0000 7fb91a7fc640 1 --2- 172.21.15.39:0/634745375 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fb908066280 0x7fb908068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:23.193 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.183+0000 7fb91a7fc640 1 -- 172.21.15.39:0/634745375 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5962+0+0 (secure 0 0 0) 0x7fb914084060 con 0x7fb924160150 2023-05-16T13:55:23.193 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.183+0000 7fb9299a0640 1 --2- 172.21.15.39:0/634745375 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fb908066280 0x7fb908068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:23.193 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.183+0000 7fb9299a0640 1 --2- 172.21.15.39:0/634745375 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fb908066280 0x7fb908068730 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb9200af000 tx=0x7fb920008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:23.196 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.187+0000 7fb91a7fc640 1 -- 172.21.15.39:0/634745375 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fb914055080 con 0x7fb924160150 2023-05-16T13:55:23.384 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.375+0000 7fb92a9a2640 1 -- 172.21.15.39:0/634745375 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fb9241579d0 con 0x7fb924160150 2023-05-16T13:55:23.394 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.387+0000 7fb91a7fc640 1 -- 172.21.15.39:0/634745375 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7fb914054c10 con 0x7fb924160150 2023-05-16T13:55:23.395 INFO:teuthology.orchestra.run.smithi039.stderr:new fs with metadata pool 5 and data pool 6 2023-05-16T13:55:23.399 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.391+0000 7fb92a9a2640 1 -- 172.21.15.39:0/634745375 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fb908066280 msgr2=0x7fb908068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:23.399 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.391+0000 7fb92a9a2640 1 --2- 172.21.15.39:0/634745375 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fb908066280 0x7fb908068730 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb9200af000 tx=0x7fb920008040 comp rx=0 tx=0).stop 2023-05-16T13:55:23.399 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.391+0000 7fb92a9a2640 1 -- 172.21.15.39:0/634745375 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb924160150 msgr2=0x7fb924159d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:23.399 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.391+0000 7fb92a9a2640 1 --2- 172.21.15.39:0/634745375 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb924160150 0x7fb924159d40 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fb91400d800 tx=0x7fb91400dcc0 comp rx=0 tx=0).stop 2023-05-16T13:55:23.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.395+0000 7fb92a9a2640 1 -- 172.21.15.39:0/634745375 shutdown_connections 2023-05-16T13:55:23.404 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.395+0000 7fb92a9a2640 1 --2- 172.21.15.39:0/634745375 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fb908066280 0x7fb908068730 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:23.404 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.395+0000 7fb92a9a2640 1 --2- 172.21.15.39:0/634745375 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb924160520 0x7fb92415a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:23.404 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.395+0000 7fb92a9a2640 1 --2- 172.21.15.39:0/634745375 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb924160150 0x7fb924159d40 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:23.405 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.395+0000 7fb92a9a2640 1 --2- 172.21.15.39:0/634745375 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb92406c7d0 0x7fb9240af560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:23.405 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.395+0000 7fb92a9a2640 1 -- 172.21.15.39:0/634745375 >> 172.21.15.39:0/634745375 conn(0x7fb924069a50 msgr2=0x7fb924069e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:23.405 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.399+0000 7fb92a9a2640 1 -- 172.21.15.39:0/634745375 shutdown_connections 2023-05-16T13:55:23.406 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.399+0000 7fb92a9a2640 1 -- 172.21.15.39:0/634745375 wait complete. 2023-05-16T13:55:23.444 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-16T13:55:23.582 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.575+0000 7fc57ff6d640 1 Processor -- start 2023-05-16T13:55:23.583 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.575+0000 7fc57ff6d640 1 -- start start 2023-05-16T13:55:23.584 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.575+0000 7fc57ff6d640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc5780ced10 0x7fc57806fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:23.584 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.575+0000 7fc57ff6d640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5780cf0e0 con 0x7fc5780c9cb0 2023-05-16T13:55:23.584 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.575+0000 7fc57ff6d640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5780c89f0 con 0x7fc578071b00 2023-05-16T13:55:23.584 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.575+0000 7fc57ff6d640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5780c8c40 con 0x7fc5780ced10 2023-05-16T13:55:23.584 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.575+0000 7fc57d508640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fc5780c9cb0 0x7fc5780713f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:35052/0 (socket says 172.21.15.39:35052) 2023-05-16T13:55:23.585 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.575+0000 7fc57d508640 1 -- 172.21.15.39:0/994577900 learned_addr learned my addr 172.21.15.39:0/994577900 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:55:23.586 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.575+0000 7fc57dd09640 1 --2- 172.21.15.39:0/994577900 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc5780ced10 0x7fc57806fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:23.586 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.575+0000 7fc57cd07640 1 -- 172.21.15.39:0/994577900 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1395359424 0 0) 0x7fc568001120 con 0x7fc5780c9cb0 2023-05-16T13:55:23.587 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.575+0000 7fc57cd07640 1 -- 172.21.15.39:0/994577900 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc564003530 con 0x7fc5780c9cb0 2023-05-16T13:55:23.587 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.579+0000 7fc57cd07640 1 -- 172.21.15.39:0/994577900 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1209438405 0 0) 0x7fc5780c89f0 con 0x7fc578071b00 2023-05-16T13:55:23.587 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.579+0000 7fc57cd07640 1 -- 172.21.15.39:0/994577900 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc568001120 con 0x7fc578071b00 2023-05-16T13:55:23.587 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.579+0000 7fc57cd07640 1 -- 172.21.15.39:0/994577900 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3098263930 0 0) 0x7fc564003530 con 0x7fc5780c9cb0 2023-05-16T13:55:23.588 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.579+0000 7fc57cd07640 1 -- 172.21.15.39:0/994577900 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc5780ced10 msgr2=0x7fc57806fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:23.588 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.579+0000 7fc57cd07640 1 --2- 172.21.15.39:0/994577900 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc5780ced10 0x7fc57806fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:23.588 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.579+0000 7fc57cd07640 1 -- 172.21.15.39:0/994577900 >> v1:172.21.15.118:6789/0 conn(0x7fc578071b00 legacy=0x7fc5780ca290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:23.588 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.579+0000 7fc57cd07640 1 -- 172.21.15.39:0/994577900 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5780c8f20 con 0x7fc5780c9cb0 2023-05-16T13:55:23.588 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.579+0000 7fc57cd07640 1 -- 172.21.15.39:0/994577900 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1738805496 0 0) 0x7fc568001810 con 0x7fc5780c9cb0 2023-05-16T13:55:23.589 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.579+0000 7fc57cd07640 1 -- 172.21.15.39:0/994577900 >> v1:172.21.15.39:6789/0 conn(0x7fc5780c9cb0 legacy=0x7fc5780713f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:23.589 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.579+0000 7fc57cd07640 1 --2- 172.21.15.39:0/994577900 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc564003bb0 0x7fc564003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:23.589 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.579+0000 7fc57cd07640 1 --2- 172.21.15.39:0/994577900 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc5640047d0 0x7fc564004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:23.589 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.579+0000 7fc57cd07640 1 --2- 172.21.15.39:0/994577900 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc5780ced10 0x7fc564005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:23.589 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.579+0000 7fc57cd07640 1 -- 172.21.15.39:0/994577900 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5780c8c40 con 0x7fc564003bb0 2023-05-16T13:55:23.589 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.579+0000 7fc57cd07640 1 -- 172.21.15.39:0/994577900 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc56400bb20 con 0x7fc5640047d0 2023-05-16T13:55:23.590 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.579+0000 7fc57cd07640 1 -- 172.21.15.39:0/994577900 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc56400bcb0 con 0x7fc5780ced10 2023-05-16T13:55:23.590 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.579+0000 7fc57dd09640 1 --2- 172.21.15.39:0/994577900 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc564003bb0 0x7fc564003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:23.590 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.579+0000 7fc57e50a640 1 --2- 172.21.15.39:0/994577900 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc5780ced10 0x7fc564005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:23.590 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.579+0000 7fc57d508640 1 --2- 172.21.15.39:0/994577900 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc5640047d0 0x7fc564004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:23.590 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.579+0000 7fc57dd09640 1 -- 172.21.15.39:0/994577900 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc5780ced10 msgr2=0x7fc564005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:23.590 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.579+0000 7fc57dd09640 1 --2- 172.21.15.39:0/994577900 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc5780ced10 0x7fc564005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:23.590 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.579+0000 7fc57dd09640 1 -- 172.21.15.39:0/994577900 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc5640047d0 msgr2=0x7fc564004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:23.590 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.579+0000 7fc57dd09640 1 --2- 172.21.15.39:0/994577900 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc5640047d0 0x7fc564004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:23.591 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.579+0000 7fc57dd09640 1 -- 172.21.15.39:0/994577900 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc564003530 con 0x7fc564003bb0 2023-05-16T13:55:23.593 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.579+0000 7fc57dd09640 1 --2- 172.21.15.39:0/994577900 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc564003bb0 0x7fc564003fa0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fc574009b10 tx=0x7fc57401ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e40e6b274d16e60 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:23.593 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.579+0000 7fc57cd07640 1 -- 172.21.15.39:0/994577900 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5740a5610 con 0x7fc564003bb0 2023-05-16T13:55:23.593 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.579+0000 7fc57cd07640 1 -- 172.21.15.39:0/994577900 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5740a5770 con 0x7fc564003bb0 2023-05-16T13:55:23.593 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.579+0000 7fc57cd07640 1 -- 172.21.15.39:0/994577900 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5740a5b20 con 0x7fc564003bb0 2023-05-16T13:55:23.594 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.583+0000 7fc57ff6d640 1 -- 172.21.15.39:0/994577900 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc564003bb0 msgr2=0x7fc564003fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:23.594 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.583+0000 7fc57ff6d640 1 --2- 172.21.15.39:0/994577900 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc564003bb0 0x7fc564003fa0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fc574009b10 tx=0x7fc57401ca20 comp rx=0 tx=0).stop 2023-05-16T13:55:23.594 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.583+0000 7fc57e50a640 1 -- 172.21.15.39:0/994577900 reap_dead start 2023-05-16T13:55:23.594 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.583+0000 7fc57ff6d640 1 -- 172.21.15.39:0/994577900 shutdown_connections 2023-05-16T13:55:23.594 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.583+0000 7fc57ff6d640 1 -- 172.21.15.39:0/994577900 >> 172.21.15.39:0/994577900 conn(0x7fc578069a50 msgr2=0x7fc578069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:23.594 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.583+0000 7fc57ff6d640 1 -- 172.21.15.39:0/994577900 shutdown_connections 2023-05-16T13:55:23.594 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.583+0000 7fc57ff6d640 1 -- 172.21.15.39:0/994577900 wait complete. 2023-05-16T13:55:23.595 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.583+0000 7fc57ff6d640 1 Processor -- start 2023-05-16T13:55:23.595 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.583+0000 7fc57ff6d640 1 -- start start 2023-05-16T13:55:23.595 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.583+0000 7fc57ff6d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc564003bb0 0x7fc5781589d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:23.595 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.583+0000 7fc57ff6d640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc5780afa40 0x7fc578156d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:23.595 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.583+0000 7fc57ff6d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc578157240 0x7fc5780b2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:23.595 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.583+0000 7fc57ff6d640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc578158f10 con 0x7fc578157240 2023-05-16T13:55:23.595 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.583+0000 7fc57ff6d640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5780af260 con 0x7fc564003bb0 2023-05-16T13:55:23.595 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.583+0000 7fc57ff6d640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc578157780 con 0x7fc5780afa40 2023-05-16T13:55:23.596 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.583+0000 7fc57e50a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc578157240 0x7fc5780b2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:23.596 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.583+0000 7fc57e50a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc578157240 0x7fc5780b2790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44400/0 (socket says 172.21.15.39:44400) 2023-05-16T13:55:23.596 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.583+0000 7fc57e50a640 1 -- 172.21.15.39:0/3864467538 learned_addr learned my addr 172.21.15.39:0/3864467538 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:23.596 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.583+0000 7fc57dd09640 1 --2- 172.21.15.39:0/3864467538 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc564003bb0 0x7fc5781589d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:23.596 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.583+0000 7fc57d508640 1 --2- 172.21.15.39:0/3864467538 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc5780afa40 0x7fc578156d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:23.596 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.583+0000 7fc57e50a640 1 -- 172.21.15.39:0/3864467538 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc5780afa40 msgr2=0x7fc578156d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:23.596 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.587+0000 7fc57e50a640 1 --2- 172.21.15.39:0/3864467538 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc5780afa40 0x7fc578156d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:23.597 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.587+0000 7fc57e50a640 1 -- 172.21.15.39:0/3864467538 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc564003bb0 msgr2=0x7fc5781589d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:23.597 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.587+0000 7fc57e50a640 1 --2- 172.21.15.39:0/3864467538 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc564003bb0 0x7fc5781589d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:23.597 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.587+0000 7fc57e50a640 1 -- 172.21.15.39:0/3864467538 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5780b42f0 con 0x7fc578157240 2023-05-16T13:55:23.597 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.587+0000 7fc57d508640 1 --2- 172.21.15.39:0/3864467538 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc5780afa40 0x7fc578156d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:55:23.597 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.587+0000 7fc57e50a640 1 --2- 172.21.15.39:0/3864467538 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc578157240 0x7fc5780b2790 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fc5780720b0 tx=0x7fc57000fba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:23.597 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.587+0000 7fc56e7fc640 1 -- 172.21.15.39:0/3864467538 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc570006b60 con 0x7fc578157240 2023-05-16T13:55:23.597 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.587+0000 7fc56e7fc640 1 -- 172.21.15.39:0/3864467538 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc570006d00 con 0x7fc578157240 2023-05-16T13:55:23.597 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.587+0000 7fc56e7fc640 1 -- 172.21.15.39:0/3864467538 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc570003bc0 con 0x7fc578157240 2023-05-16T13:55:23.598 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.587+0000 7fc57ff6d640 1 -- 172.21.15.39:0/3864467538 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5780c97c0 con 0x7fc578157240 2023-05-16T13:55:23.598 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.587+0000 7fc57ff6d640 1 -- 172.21.15.39:0/3864467538 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5780cb1b0 con 0x7fc578157240 2023-05-16T13:55:23.599 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.587+0000 7fc57ff6d640 1 -- 172.21.15.39:0/3864467538 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc578157c60 con 0x7fc578157240 2023-05-16T13:55:23.599 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.587+0000 7fc56e7fc640 1 -- 172.21.15.39:0/3864467538 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc570003d20 con 0x7fc578157240 2023-05-16T13:55:23.599 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.587+0000 7fc56e7fc640 1 --2- 172.21.15.39:0/3864467538 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc55c0662b0 0x7fc55c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:23.599 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.587+0000 7fc56e7fc640 1 -- 172.21.15.39:0/3864467538 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc570082870 con 0x7fc578157240 2023-05-16T13:55:23.599 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.587+0000 7fc57dd09640 1 --2- 172.21.15.39:0/3864467538 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc55c0662b0 0x7fc55c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:23.599 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.591+0000 7fc57dd09640 1 --2- 172.21.15.39:0/3864467538 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc55c0662b0 0x7fc55c068760 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc5740af000 tx=0x7fc5740046d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:23.600 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.591+0000 7fc56e7fc640 1 -- 172.21.15.39:0/3864467538 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fc57004fda0 con 0x7fc578157240 2023-05-16T13:55:23.761 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.755+0000 7fc57ff6d640 1 -- 172.21.15.39:0/3864467538 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc578073c90 con 0x7fc578157240 2023-05-16T13:55:23.763 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.755+0000 7fc56e7fc640 1 -- 172.21.15.39:0/3864467538 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18364 (secure 0 0 0) 0x7fc5700533c0 con 0x7fc578157240 2023-05-16T13:55:23.763 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:55:23.763 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":37,"fsid":"9c1e210b-c515-4ea4-a065-397956895c68","created":"2023-05-16T13:53:48.955290+0000","modified":"2023-05-16T13:55:23.380866+0000","last_up_change":"2023-05-16T13:54:01.722051+0000","last_in_change":"2023-05-16T13:53:52.331336+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-16T13:54:00.885009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-16T13:54:08.327895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-05-16T13:55:21.618763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-05-16T13:55:22.360381+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4ce0f0ba-c4bf-4405-8c95-d2e9a62878ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6809","nonce":3462013698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6811","nonce":3462013698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6815","nonce":3462013698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6813","nonce":3462013698}]},"public_addr":"172.21.15.39:6809/3462013698","cluster_addr":"172.21.15.39:6811/3462013698","heartbeat_back_addr":"172.21.15.39:6815/3462013698","heartbeat_front_addr":"172.21.15.39:6813/3462013698","state":["exists","up"]},{"osd":1,"uuid":"53fdc1ac-2473-472d-af32-2760fdf6e476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6801","nonce":2829970892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6803","nonce":2829970892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6807","nonce":2829970892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6805","nonce":2829970892}]},"public_addr":"172.21.15.39:6801/2829970892","cluster_addr":"172.21.15.39:6803/2829970892","heartbeat_back_addr":"172.21.15.39:6807/2829970892","heartbeat_front_addr":"172.21.15.39:6805/2829970892","state":["exists","up"]},{"osd":2,"uuid":"0b92d770-7030-42fa-a19f-4f7f1ac113c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6817","nonce":3888067413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6819","nonce":3888067413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6823","nonce":3888067413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6821","nonce":3888067413}]},"public_addr":"172.21.15.39:6817/3888067413","cluster_addr":"172.21.15.39:6819/3888067413","heartbeat_back_addr":"172.21.15.39:6823/3888067413","heartbeat_front_addr":"172.21.15.39:6821/3888067413","state":["exists","up"]},{"osd":3,"uuid":"000d9506-cbb2-4017-b875-deca579860ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6825","nonce":405003958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6827","nonce":405003958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6831","nonce":405003958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6829","nonce":405003958}]},"public_addr":"172.21.15.39:6825/405003958","cluster_addr":"172.21.15.39:6827/405003958","heartbeat_back_addr":"172.21.15.39:6831/405003958","heartbeat_front_addr":"172.21.15.39:6829/405003958","state":["exists","up"]},{"osd":4,"uuid":"70f0dacb-e960-40c5-bf6a-183e52bbe2ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6801","nonce":3895278838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6805","nonce":3895278838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6813","nonce":3895278838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6809","nonce":3895278838}]},"public_addr":"172.21.15.118:6801/3895278838","cluster_addr":"172.21.15.118:6805/3895278838","heartbeat_back_addr":"172.21.15.118:6813/3895278838","heartbeat_front_addr":"172.21.15.118:6809/3895278838","state":["exists","up"]},{"osd":5,"uuid":"756feb54-c3ae-4a2a-8f74-85c291ba707c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6804","nonce":3513592808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6808","nonce":3513592808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6815","nonce":3513592808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6812","nonce":3513592808}]},"public_addr":"172.21.15.118:6804/3513592808","cluster_addr":"172.21.15.118:6808/3513592808","heartbeat_back_addr":"172.21.15.118:6815/3513592808","heartbeat_front_addr":"172.21.15.118:6812/3513592808","state":["exists","up"]},{"osd":6,"uuid":"c4a982c1-f497-4b0f-8a23-c77372e4621e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6824","nonce":1863656053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6827","nonce":1863656053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6831","nonce":1863656053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6829","nonce":1863656053}]},"public_addr":"172.21.15.118:6824/1863656053","cluster_addr":"172.21.15.118:6827/1863656053","heartbeat_back_addr":"172.21.15.118:6831/1863656053","heartbeat_front_addr":"172.21.15.118:6829/1863656053","state":["exists","up"]},{"osd":7,"uuid":"6f2888aa-a7ac-4e26-9159-e31817934f44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6817","nonce":3636642904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6819","nonce":3636642904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6825","nonce":3636642904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6821","nonce":3636642904}]},"public_addr":"172.21.15.118:6817/3636642904","cluster_addr":"172.21.15.118:6819/3636642904","heartbeat_back_addr":"172.21.15.118:6825/3636642904","heartbeat_front_addr":"172.21.15.118:6821/3636642904","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.717636+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.724036+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.739144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:58.079275+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:58.073921+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.930466+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.987813+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.941098+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-16T13:55:23.765 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.759+0000 7fc57ff6d640 1 -- 172.21.15.39:0/3864467538 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc55c0662b0 msgr2=0x7fc55c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:23.765 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.759+0000 7fc57ff6d640 1 --2- 172.21.15.39:0/3864467538 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc55c0662b0 0x7fc55c068760 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc5740af000 tx=0x7fc5740046d0 comp rx=0 tx=0).stop 2023-05-16T13:55:23.765 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.759+0000 7fc57ff6d640 1 -- 172.21.15.39:0/3864467538 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc578157240 msgr2=0x7fc5780b2790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:23.765 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.759+0000 7fc57ff6d640 1 --2- 172.21.15.39:0/3864467538 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc578157240 0x7fc5780b2790 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fc5780720b0 tx=0x7fc57000fba0 comp rx=0 tx=0).stop 2023-05-16T13:55:23.766 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.759+0000 7fc57ff6d640 1 -- 172.21.15.39:0/3864467538 shutdown_connections 2023-05-16T13:55:23.766 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.759+0000 7fc57ff6d640 1 --2- 172.21.15.39:0/3864467538 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc55c0662b0 0x7fc55c068760 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:23.766 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.759+0000 7fc57ff6d640 1 --2- 172.21.15.39:0/3864467538 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc5780afa40 0x7fc578156d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:23.766 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.759+0000 7fc57ff6d640 1 --2- 172.21.15.39:0/3864467538 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc578157240 0x7fc5780b2790 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:23.766 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.759+0000 7fc57ff6d640 1 --2- 172.21.15.39:0/3864467538 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc564003bb0 0x7fc5781589d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:23.766 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.759+0000 7fc57ff6d640 1 -- 172.21.15.39:0/3864467538 >> 172.21.15.39:0/3864467538 conn(0x7fc578069a50 msgr2=0x7fc578069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:23.766 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.759+0000 7fc57ff6d640 1 -- 172.21.15.39:0/3864467538 shutdown_connections 2023-05-16T13:55:23.767 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.759+0000 7fc57ff6d640 1 -- 172.21.15.39:0/3864467538 wait complete. 2023-05-16T13:55:23.784 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-16T13:55:23.921 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.915+0000 7f39137cc640 1 Processor -- start 2023-05-16T13:55:23.922 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.915+0000 7f39137cc640 1 -- start start 2023-05-16T13:55:23.923 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.915+0000 7f39137cc640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f390c06d4d0 0x7f390c15cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:23.923 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.915+0000 7f39137cc640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f390c145c30 con 0x7f390c145860 2023-05-16T13:55:23.923 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.915+0000 7f39137cc640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f390c160060 con 0x7f390c15faa0 2023-05-16T13:55:23.923 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.915+0000 7f39137cc640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f390c160340 con 0x7f390c06d4d0 2023-05-16T13:55:23.923 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.915+0000 7f3911568640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f390c145860 0x7f390c06cdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:35068/0 (socket says 172.21.15.39:35068) 2023-05-16T13:55:23.923 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.915+0000 7f3911568640 1 -- 172.21.15.39:0/3091589077 learned_addr learned my addr 172.21.15.39:0/3091589077 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:55:23.925 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.915+0000 7f3910d67640 1 --2- 172.21.15.39:0/3091589077 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f390c06d4d0 0x7f390c15cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:23.925 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.915+0000 7f3903fff640 1 -- 172.21.15.39:0/3091589077 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1085570372 0 0) 0x7f390c145c30 con 0x7f390c145860 2023-05-16T13:55:23.925 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.915+0000 7f3903fff640 1 -- 172.21.15.39:0/3091589077 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38f8003530 con 0x7f390c145860 2023-05-16T13:55:23.925 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.915+0000 7f3903fff640 1 -- 172.21.15.39:0/3091589077 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 984976320 0 0) 0x7f38f8003530 con 0x7f390c145860 2023-05-16T13:55:23.925 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.915+0000 7f3903fff640 1 -- 172.21.15.39:0/3091589077 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f390c06d4d0 msgr2=0x7f390c15cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:23.925 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.915+0000 7f3903fff640 1 --2- 172.21.15.39:0/3091589077 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f390c06d4d0 0x7f390c15cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:23.926 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.915+0000 7f3903fff640 1 -- 172.21.15.39:0/3091589077 >> v1:172.21.15.118:6789/0 conn(0x7f390c15faa0 legacy=0x7f390c069f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:23.926 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.915+0000 7f3903fff640 1 -- 172.21.15.39:0/3091589077 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f390c160620 con 0x7f390c145860 2023-05-16T13:55:23.926 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.915+0000 7f3903fff640 1 -- 172.21.15.39:0/3091589077 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1738805496 0 0) 0x7f3908001680 con 0x7f390c145860 2023-05-16T13:55:23.926 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.915+0000 7f3903fff640 1 -- 172.21.15.39:0/3091589077 >> v1:172.21.15.39:6789/0 conn(0x7f390c145860 legacy=0x7f390c06cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:23.926 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.915+0000 7f3903fff640 1 --2- 172.21.15.39:0/3091589077 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38f8003a20 0x7f38f8003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:23.926 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.915+0000 7f3903fff640 1 --2- 172.21.15.39:0/3091589077 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f38f80047d0 0x7f38f8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:23.926 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.915+0000 7f3903fff640 1 --2- 172.21.15.39:0/3091589077 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f390c06d4d0 0x7f38f8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:23.926 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.915+0000 7f3903fff640 1 -- 172.21.15.39:0/3091589077 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f390c160340 con 0x7f38f80047d0 2023-05-16T13:55:23.927 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.915+0000 7f3903fff640 1 -- 172.21.15.39:0/3091589077 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f800baa0 con 0x7f38f8003a20 2023-05-16T13:55:23.927 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.915+0000 7f3903fff640 1 -- 172.21.15.39:0/3091589077 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38f800bc60 con 0x7f390c06d4d0 2023-05-16T13:55:23.927 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.915+0000 7f3910d67640 1 --2- 172.21.15.39:0/3091589077 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f38f80047d0 0x7f38f8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:23.927 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.915+0000 7f3911568640 1 --2- 172.21.15.39:0/3091589077 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38f8003a20 0x7f38f8003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:23.927 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.915+0000 7f3911d69640 1 --2- 172.21.15.39:0/3091589077 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f390c06d4d0 0x7f38f8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:23.927 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.915+0000 7f3910d67640 1 -- 172.21.15.39:0/3091589077 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f390c06d4d0 msgr2=0x7f38f8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:23.927 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.915+0000 7f3910d67640 1 --2- 172.21.15.39:0/3091589077 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f390c06d4d0 0x7f38f8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:23.927 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.915+0000 7f3910d67640 1 -- 172.21.15.39:0/3091589077 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38f8003a20 msgr2=0x7f38f8003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:23.928 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.915+0000 7f3910d67640 1 --2- 172.21.15.39:0/3091589077 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38f8003a20 0x7f38f8003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:23.928 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.915+0000 7f3910d67640 1 -- 172.21.15.39:0/3091589077 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f8003530 con 0x7f38f80047d0 2023-05-16T13:55:23.929 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.919+0000 7f3910d67640 1 --2- 172.21.15.39:0/3091589077 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f38f80047d0 0x7f38f8004c40 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f38fc009ab0 tx=0x7f38fc01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aa9b15e6ad1f400 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:23.929 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.919+0000 7f3903fff640 1 -- 172.21.15.39:0/3091589077 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38fc0a5520 con 0x7f38f80047d0 2023-05-16T13:55:23.929 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.919+0000 7f3903fff640 1 -- 172.21.15.39:0/3091589077 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38fc0a5680 con 0x7f38f80047d0 2023-05-16T13:55:23.930 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.919+0000 7f3903fff640 1 -- 172.21.15.39:0/3091589077 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38fc0a5a30 con 0x7f38f80047d0 2023-05-16T13:55:23.930 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.919+0000 7f39137cc640 1 -- 172.21.15.39:0/3091589077 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f38f80047d0 msgr2=0x7f38f8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:23.930 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.919+0000 7f39137cc640 1 --2- 172.21.15.39:0/3091589077 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f38f80047d0 0x7f38f8004c40 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f38fc009ab0 tx=0x7f38fc01ca30 comp rx=0 tx=0).stop 2023-05-16T13:55:23.930 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.919+0000 7f3911d69640 1 -- 172.21.15.39:0/3091589077 reap_dead start 2023-05-16T13:55:23.930 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.919+0000 7f39137cc640 1 -- 172.21.15.39:0/3091589077 shutdown_connections 2023-05-16T13:55:23.930 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.919+0000 7f39137cc640 1 -- 172.21.15.39:0/3091589077 >> 172.21.15.39:0/3091589077 conn(0x7f390c0cb6d0 msgr2=0x7f390c0cbad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:23.930 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.919+0000 7f39137cc640 1 -- 172.21.15.39:0/3091589077 shutdown_connections 2023-05-16T13:55:23.930 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.919+0000 7f39137cc640 1 -- 172.21.15.39:0/3091589077 wait complete. 2023-05-16T13:55:23.932 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.923+0000 7f39137cc640 1 Processor -- start 2023-05-16T13:55:23.932 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.923+0000 7f39137cc640 1 -- start start 2023-05-16T13:55:23.932 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.923+0000 7f39137cc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f38f80047d0 0x7f390c15b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:23.932 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.923+0000 7f39137cc640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f390c0cad50 0x7f390c13d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:23.932 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.923+0000 7f39137cc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f390c0cb1c0 0x7f390c13dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:23.933 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.923+0000 7f39137cc640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f390c143ba0 con 0x7f38f80047d0 2023-05-16T13:55:23.933 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.923+0000 7f39137cc640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f390c142f90 con 0x7f390c0cb1c0 2023-05-16T13:55:23.933 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.923+0000 7f39137cc640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f390c143270 con 0x7f390c0cad50 2023-05-16T13:55:23.933 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.923+0000 7f3911568640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f38f80047d0 0x7f390c15b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:23.933 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.923+0000 7f3911568640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f38f80047d0 0x7f390c15b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44420/0 (socket says 172.21.15.39:44420) 2023-05-16T13:55:23.933 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.923+0000 7f3911568640 1 -- 172.21.15.39:0/1237783400 learned_addr learned my addr 172.21.15.39:0/1237783400 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:23.933 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.923+0000 7f3911568640 1 -- 172.21.15.39:0/1237783400 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f390c0cad50 msgr2=0x7f390c13d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:23.933 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.923+0000 7f3911568640 1 --2- 172.21.15.39:0/1237783400 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f390c0cad50 0x7f390c13d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:23.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.923+0000 7f3911568640 1 -- 172.21.15.39:0/1237783400 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f390c0cb1c0 msgr2=0x7f390c13dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:23.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.923+0000 7f3911568640 1 --2- 172.21.15.39:0/1237783400 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f390c0cb1c0 0x7f390c13dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:23.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.923+0000 7f3911568640 1 -- 172.21.15.39:0/1237783400 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f390c069a50 con 0x7f38f80047d0 2023-05-16T13:55:23.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.923+0000 7f3911568640 1 --2- 172.21.15.39:0/1237783400 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f38f80047d0 0x7f390c15b190 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f39080124c0 tx=0x7f3908012980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:23.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.923+0000 7f3901ffb640 1 -- 172.21.15.39:0/1237783400 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3908014810 con 0x7f38f80047d0 2023-05-16T13:55:23.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.923+0000 7f3901ffb640 1 -- 172.21.15.39:0/1237783400 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3908014990 con 0x7f38f80047d0 2023-05-16T13:55:23.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.923+0000 7f3901ffb640 1 -- 172.21.15.39:0/1237783400 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3908014d40 con 0x7f38f80047d0 2023-05-16T13:55:23.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.923+0000 7f39137cc640 1 -- 172.21.15.39:0/1237783400 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f390c160900 con 0x7f38f80047d0 2023-05-16T13:55:23.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.923+0000 7f39137cc640 1 -- 172.21.15.39:0/1237783400 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f390c15cf70 con 0x7f38f80047d0 2023-05-16T13:55:23.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.927+0000 7f39137cc640 1 -- 172.21.15.39:0/1237783400 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f390c073c90 con 0x7f38f80047d0 2023-05-16T13:55:23.936 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.927+0000 7f3901ffb640 1 -- 172.21.15.39:0/1237783400 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f39080153e0 con 0x7f38f80047d0 2023-05-16T13:55:23.936 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.927+0000 7f3901ffb640 1 --2- 172.21.15.39:0/1237783400 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f38f0066280 0x7f38f0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:23.936 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.927+0000 7f3901ffb640 1 -- 172.21.15.39:0/1237783400 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3908086640 con 0x7f38f80047d0 2023-05-16T13:55:23.936 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.927+0000 7f3910d67640 1 --2- 172.21.15.39:0/1237783400 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f38f0066280 0x7f38f0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:23.936 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.927+0000 7f3910d67640 1 --2- 172.21.15.39:0/1237783400 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f38f0066280 0x7f38f0068730 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f38fc0af000 tx=0x7f38fc004740 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:23.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:23.931+0000 7f3901ffb640 1 -- 172.21.15.39:0/1237783400 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f3908053b30 con 0x7f38f80047d0 2023-05-16T13:55:24.096 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.087+0000 7f39137cc640 1 -- 172.21.15.39:0/1237783400 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f390c0cab30 con 0x7f38f80047d0 2023-05-16T13:55:24.097 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.091+0000 7f3901ffb640 1 -- 172.21.15.39:0/1237783400 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18364 (secure 0 0 0) 0x7f3908057150 con 0x7f38f80047d0 2023-05-16T13:55:24.098 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:55:24.098 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":37,"fsid":"9c1e210b-c515-4ea4-a065-397956895c68","created":"2023-05-16T13:53:48.955290+0000","modified":"2023-05-16T13:55:23.380866+0000","last_up_change":"2023-05-16T13:54:01.722051+0000","last_in_change":"2023-05-16T13:53:52.331336+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-16T13:54:00.885009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-16T13:54:08.327895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-05-16T13:55:21.618763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-05-16T13:55:22.360381+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4ce0f0ba-c4bf-4405-8c95-d2e9a62878ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6809","nonce":3462013698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6811","nonce":3462013698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6815","nonce":3462013698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6813","nonce":3462013698}]},"public_addr":"172.21.15.39:6809/3462013698","cluster_addr":"172.21.15.39:6811/3462013698","heartbeat_back_addr":"172.21.15.39:6815/3462013698","heartbeat_front_addr":"172.21.15.39:6813/3462013698","state":["exists","up"]},{"osd":1,"uuid":"53fdc1ac-2473-472d-af32-2760fdf6e476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6801","nonce":2829970892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6803","nonce":2829970892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6807","nonce":2829970892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6805","nonce":2829970892}]},"public_addr":"172.21.15.39:6801/2829970892","cluster_addr":"172.21.15.39:6803/2829970892","heartbeat_back_addr":"172.21.15.39:6807/2829970892","heartbeat_front_addr":"172.21.15.39:6805/2829970892","state":["exists","up"]},{"osd":2,"uuid":"0b92d770-7030-42fa-a19f-4f7f1ac113c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6817","nonce":3888067413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6819","nonce":3888067413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6823","nonce":3888067413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6821","nonce":3888067413}]},"public_addr":"172.21.15.39:6817/3888067413","cluster_addr":"172.21.15.39:6819/3888067413","heartbeat_back_addr":"172.21.15.39:6823/3888067413","heartbeat_front_addr":"172.21.15.39:6821/3888067413","state":["exists","up"]},{"osd":3,"uuid":"000d9506-cbb2-4017-b875-deca579860ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6825","nonce":405003958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6827","nonce":405003958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6831","nonce":405003958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6829","nonce":405003958}]},"public_addr":"172.21.15.39:6825/405003958","cluster_addr":"172.21.15.39:6827/405003958","heartbeat_back_addr":"172.21.15.39:6831/405003958","heartbeat_front_addr":"172.21.15.39:6829/405003958","state":["exists","up"]},{"osd":4,"uuid":"70f0dacb-e960-40c5-bf6a-183e52bbe2ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6801","nonce":3895278838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6805","nonce":3895278838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6813","nonce":3895278838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6809","nonce":3895278838}]},"public_addr":"172.21.15.118:6801/3895278838","cluster_addr":"172.21.15.118:6805/3895278838","heartbeat_back_addr":"172.21.15.118:6813/3895278838","heartbeat_front_addr":"172.21.15.118:6809/3895278838","state":["exists","up"]},{"osd":5,"uuid":"756feb54-c3ae-4a2a-8f74-85c291ba707c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6804","nonce":3513592808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6808","nonce":3513592808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6815","nonce":3513592808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6812","nonce":3513592808}]},"public_addr":"172.21.15.118:6804/3513592808","cluster_addr":"172.21.15.118:6808/3513592808","heartbeat_back_addr":"172.21.15.118:6815/3513592808","heartbeat_front_addr":"172.21.15.118:6812/3513592808","state":["exists","up"]},{"osd":6,"uuid":"c4a982c1-f497-4b0f-8a23-c77372e4621e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6824","nonce":1863656053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6827","nonce":1863656053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6831","nonce":1863656053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6829","nonce":1863656053}]},"public_addr":"172.21.15.118:6824/1863656053","cluster_addr":"172.21.15.118:6827/1863656053","heartbeat_back_addr":"172.21.15.118:6831/1863656053","heartbeat_front_addr":"172.21.15.118:6829/1863656053","state":["exists","up"]},{"osd":7,"uuid":"6f2888aa-a7ac-4e26-9159-e31817934f44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6817","nonce":3636642904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6819","nonce":3636642904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6825","nonce":3636642904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6821","nonce":3636642904}]},"public_addr":"172.21.15.118:6817/3636642904","cluster_addr":"172.21.15.118:6819/3636642904","heartbeat_back_addr":"172.21.15.118:6825/3636642904","heartbeat_front_addr":"172.21.15.118:6821/3636642904","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.717636+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.724036+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.739144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:58.079275+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:58.073921+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.930466+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.987813+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.941098+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-16T13:55:24.099 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.091+0000 7f39137cc640 1 -- 172.21.15.39:0/1237783400 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f38f0066280 msgr2=0x7f38f0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:24.100 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.091+0000 7f39137cc640 1 --2- 172.21.15.39:0/1237783400 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f38f0066280 0x7f38f0068730 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f38fc0af000 tx=0x7f38fc004740 comp rx=0 tx=0).stop 2023-05-16T13:55:24.100 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.091+0000 7f39137cc640 1 -- 172.21.15.39:0/1237783400 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f38f80047d0 msgr2=0x7f390c15b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:24.100 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.091+0000 7f39137cc640 1 --2- 172.21.15.39:0/1237783400 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f38f80047d0 0x7f390c15b190 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f39080124c0 tx=0x7f3908012980 comp rx=0 tx=0).stop 2023-05-16T13:55:24.100 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.091+0000 7f39137cc640 1 -- 172.21.15.39:0/1237783400 shutdown_connections 2023-05-16T13:55:24.100 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.091+0000 7f39137cc640 1 --2- 172.21.15.39:0/1237783400 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f38f0066280 0x7f38f0068730 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:24.100 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.091+0000 7f39137cc640 1 --2- 172.21.15.39:0/1237783400 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f390c0cad50 0x7f390c13d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:24.101 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.091+0000 7f39137cc640 1 --2- 172.21.15.39:0/1237783400 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f390c0cb1c0 0x7f390c13dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:24.101 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.091+0000 7f39137cc640 1 --2- 172.21.15.39:0/1237783400 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f38f80047d0 0x7f390c15b190 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:24.101 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.091+0000 7f39137cc640 1 -- 172.21.15.39:0/1237783400 >> 172.21.15.39:0/1237783400 conn(0x7f390c0cb6d0 msgr2=0x7f390c15eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:24.101 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.091+0000 7f39137cc640 1 -- 172.21.15.39:0/1237783400 shutdown_connections 2023-05-16T13:55:24.101 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.091+0000 7f39137cc640 1 -- 172.21.15.39:0/1237783400 wait complete. 2023-05-16T13:55:24.118 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-05-16T13:55:24.260 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.251+0000 7fc4e5d7b640 1 Processor -- start 2023-05-16T13:55:24.260 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.251+0000 7fc4e5d7b640 1 -- start start 2023-05-16T13:55:24.260 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.251+0000 7fc4e5d7b640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc4e0158e00 0x7fc4e00c9530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:24.261 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.251+0000 7fc4e5d7b640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc4e00b0660 0x7fc4e0070420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:24.261 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.251+0000 7fc4e5d7b640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4e00ca030 con 0x7fc4e00c9a70 2023-05-16T13:55:24.261 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.251+0000 7fc4e5d7b640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4e015c890 con 0x7fc4e0158e00 2023-05-16T13:55:24.261 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.251+0000 7fc4e5d7b640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e015cb70 con 0x7fc4e00b0660 2023-05-16T13:55:24.263 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.251+0000 7fc4d7fff640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fc4e00c9a70 0x7fc4e00aff50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:35080/0 (socket says 172.21.15.39:35080) 2023-05-16T13:55:24.263 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.251+0000 7fc4d7fff640 1 -- 172.21.15.39:0/2085831284 learned_addr learned my addr 172.21.15.39:0/2085831284 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:55:24.263 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.251+0000 7fc4df7fe640 1 --2- 172.21.15.39:0/2085831284 >> v2:172.21.15.118:3300/0 conn(0x7fc4e0158e00 0x7fc4e00c9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:24.263 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.251+0000 7fc4dffff640 1 --2- 172.21.15.39:0/2085831284 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc4e00b0660 0x7fc4e0070420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:24.263 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.255+0000 7fc4deffd640 1 -- 172.21.15.39:0/2085831284 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2120527554 0 0) 0x7fc4e00ca030 con 0x7fc4e00c9a70 2023-05-16T13:55:24.264 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.255+0000 7fc4deffd640 1 -- 172.21.15.39:0/2085831284 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4cc003530 con 0x7fc4e00c9a70 2023-05-16T13:55:24.264 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.255+0000 7fc4deffd640 1 -- 172.21.15.39:0/2085831284 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 335506801 0 0) 0x7fc4cc003530 con 0x7fc4e00c9a70 2023-05-16T13:55:24.264 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.255+0000 7fc4deffd640 1 -- 172.21.15.39:0/2085831284 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc4e00b0660 msgr2=0x7fc4e0070420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:24.264 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.255+0000 7fc4deffd640 1 --2- 172.21.15.39:0/2085831284 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc4e00b0660 0x7fc4e0070420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:24.264 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.255+0000 7fc4deffd640 1 -- 172.21.15.39:0/2085831284 >> v2:172.21.15.118:3300/0 conn(0x7fc4e0158e00 msgr2=0x7fc4e00c9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:24.264 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.255+0000 7fc4deffd640 1 --2- 172.21.15.39:0/2085831284 >> v2:172.21.15.118:3300/0 conn(0x7fc4e0158e00 0x7fc4e00c9530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:24.264 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.255+0000 7fc4deffd640 1 -- 172.21.15.39:0/2085831284 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4e015ce50 con 0x7fc4e00c9a70 2023-05-16T13:55:24.264 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.255+0000 7fc4deffd640 1 -- 172.21.15.39:0/2085831284 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1738805496 0 0) 0x7fc4c80016a0 con 0x7fc4e00c9a70 2023-05-16T13:55:24.265 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.255+0000 7fc4df7fe640 1 --2- 172.21.15.39:0/2085831284 >> v2:172.21.15.118:3300/0 conn(0x7fc4e0158e00 0x7fc4e00c9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-16T13:55:24.265 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.255+0000 7fc4deffd640 1 -- 172.21.15.39:0/2085831284 >> v1:172.21.15.39:6789/0 conn(0x7fc4e00c9a70 legacy=0x7fc4e00aff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:24.265 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.255+0000 7fc4deffd640 1 --2- 172.21.15.39:0/2085831284 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc4e00b0660 0x7fc4cc003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:24.265 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.255+0000 7fc4deffd640 1 --2- 172.21.15.39:0/2085831284 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc4cc003f00 0x7fc4cc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:24.265 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.255+0000 7fc4deffd640 1 --2- 172.21.15.39:0/2085831284 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4cc004d10 0x7fc4cc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:24.265 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.255+0000 7fc4deffd640 1 -- 172.21.15.39:0/2085831284 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e015c890 con 0x7fc4cc003f00 2023-05-16T13:55:24.265 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.255+0000 7fc4deffd640 1 -- 172.21.15.39:0/2085831284 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e015cb70 con 0x7fc4cc004d10 2023-05-16T13:55:24.265 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.255+0000 7fc4deffd640 1 -- 172.21.15.39:0/2085831284 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4cc00b9c0 con 0x7fc4e00b0660 2023-05-16T13:55:24.266 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.255+0000 7fc4d7fff640 1 --2- 172.21.15.39:0/2085831284 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc4cc003f00 0x7fc4cc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:24.266 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.255+0000 7fc4df7fe640 1 --2- 172.21.15.39:0/2085831284 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc4e00b0660 0x7fc4cc003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:24.266 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.255+0000 7fc4dffff640 1 --2- 172.21.15.39:0/2085831284 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4cc004d10 0x7fc4cc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:24.266 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.255+0000 7fc4d7fff640 1 -- 172.21.15.39:0/2085831284 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc4e00b0660 msgr2=0x7fc4cc003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:24.266 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.255+0000 7fc4d7fff640 1 --2- 172.21.15.39:0/2085831284 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc4e00b0660 0x7fc4cc003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:24.266 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.255+0000 7fc4d7fff640 1 -- 172.21.15.39:0/2085831284 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4cc004d10 msgr2=0x7fc4cc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:24.266 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.255+0000 7fc4d7fff640 1 --2- 172.21.15.39:0/2085831284 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4cc004d10 0x7fc4cc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:24.267 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.255+0000 7fc4d7fff640 1 -- 172.21.15.39:0/2085831284 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4cc003530 con 0x7fc4cc003f00 2023-05-16T13:55:24.268 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.259+0000 7fc4d7fff640 1 --2- 172.21.15.39:0/2085831284 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc4cc003f00 0x7fc4cc0047d0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fc4c800c210 tx=0x7fc4c801cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ef4aab56614fcd7 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:24.268 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.259+0000 7fc4deffd640 1 -- 172.21.15.39:0/2085831284 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c80a5940 con 0x7fc4cc003f00 2023-05-16T13:55:24.268 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.259+0000 7fc4deffd640 1 -- 172.21.15.39:0/2085831284 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c80a5ac0 con 0x7fc4cc003f00 2023-05-16T13:55:24.268 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.259+0000 7fc4deffd640 1 -- 172.21.15.39:0/2085831284 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c80058e0 con 0x7fc4cc003f00 2023-05-16T13:55:24.268 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.259+0000 7fc4e5d7b640 1 -- 172.21.15.39:0/2085831284 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc4cc003f00 msgr2=0x7fc4cc0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:24.268 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.259+0000 7fc4e5d7b640 1 --2- 172.21.15.39:0/2085831284 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc4cc003f00 0x7fc4cc0047d0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fc4c800c210 tx=0x7fc4c801cc40 comp rx=0 tx=0).stop 2023-05-16T13:55:24.269 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.259+0000 7fc4dffff640 1 -- 172.21.15.39:0/2085831284 reap_dead start 2023-05-16T13:55:24.269 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.259+0000 7fc4e5d7b640 1 -- 172.21.15.39:0/2085831284 shutdown_connections 2023-05-16T13:55:24.269 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.259+0000 7fc4e5d7b640 1 -- 172.21.15.39:0/2085831284 >> 172.21.15.39:0/2085831284 conn(0x7fc4e0069a50 msgr2=0x7fc4e0069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:24.269 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.259+0000 7fc4e5d7b640 1 -- 172.21.15.39:0/2085831284 shutdown_connections 2023-05-16T13:55:24.269 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.259+0000 7fc4e5d7b640 1 -- 172.21.15.39:0/2085831284 wait complete. 2023-05-16T13:55:24.269 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.259+0000 7fc4e5d7b640 1 Processor -- start 2023-05-16T13:55:24.269 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.259+0000 7fc4e5d7b640 1 -- start start 2023-05-16T13:55:24.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.259+0000 7fc4e5d7b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4cc003f00 0x7fc4e00ad1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:24.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.259+0000 7fc4e5d7b640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc4e00c7690 0x7fc4e0151f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:24.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.259+0000 7fc4e5d7b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc4e00ab8d0 0x7fc4e0153720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:24.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.259+0000 7fc4e5d7b640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e00acda0 con 0x7fc4e00ab8d0 2023-05-16T13:55:24.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.259+0000 7fc4e5d7b640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e0152470 con 0x7fc4cc003f00 2023-05-16T13:55:24.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.259+0000 7fc4e5d7b640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e00ac120 con 0x7fc4e00c7690 2023-05-16T13:55:24.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.259+0000 7fc4dffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc4e00ab8d0 0x7fc4e0153720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:24.272 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.263+0000 7fc4dffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc4e00ab8d0 0x7fc4e0153720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44432/0 (socket says 172.21.15.39:44432) 2023-05-16T13:55:24.272 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.263+0000 7fc4dffff640 1 -- 172.21.15.39:0/1745529147 learned_addr learned my addr 172.21.15.39:0/1745529147 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:24.272 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.263+0000 7fc4d7fff640 1 --2- 172.21.15.39:0/1745529147 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc4e00c7690 0x7fc4e0151f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:24.272 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.263+0000 7fc4df7fe640 1 --2- 172.21.15.39:0/1745529147 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4cc003f00 0x7fc4e00ad1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:24.272 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.263+0000 7fc4dffff640 1 -- 172.21.15.39:0/1745529147 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc4e00c7690 msgr2=0x7fc4e0151f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:24.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.263+0000 7fc4dffff640 1 --2- 172.21.15.39:0/1745529147 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc4e00c7690 0x7fc4e0151f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:24.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.263+0000 7fc4dffff640 1 -- 172.21.15.39:0/1745529147 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4cc003f00 msgr2=0x7fc4e00ad1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:24.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.263+0000 7fc4dffff640 1 --2- 172.21.15.39:0/1745529147 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4cc003f00 0x7fc4e00ad1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:24.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.263+0000 7fc4dffff640 1 -- 172.21.15.39:0/1745529147 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4e00cc730 con 0x7fc4e00ab8d0 2023-05-16T13:55:24.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.263+0000 7fc4dffff640 1 --2- 172.21.15.39:0/1745529147 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc4e00ab8d0 0x7fc4e0153720 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fc4e006fc30 tx=0x7fc4d8007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:24.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.263+0000 7fc4dcff9640 1 -- 172.21.15.39:0/1745529147 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d800e070 con 0x7fc4e00ab8d0 2023-05-16T13:55:24.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.263+0000 7fc4dcff9640 1 -- 172.21.15.39:0/1745529147 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4d8003c70 con 0x7fc4e00ab8d0 2023-05-16T13:55:24.274 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.263+0000 7fc4dcff9640 1 -- 172.21.15.39:0/1745529147 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d8003e20 con 0x7fc4e00ab8d0 2023-05-16T13:55:24.274 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.263+0000 7fc4e5d7b640 1 -- 172.21.15.39:0/1745529147 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4e015d130 con 0x7fc4e00ab8d0 2023-05-16T13:55:24.274 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.263+0000 7fc4e5d7b640 1 -- 172.21.15.39:0/1745529147 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4e015d650 con 0x7fc4e00ab8d0 2023-05-16T13:55:24.274 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.263+0000 7fc4e5d7b640 1 -- 172.21.15.39:0/1745529147 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4e00acee0 con 0x7fc4e00ab8d0 2023-05-16T13:55:24.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.263+0000 7fc4dcff9640 1 -- 172.21.15.39:0/1745529147 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc4d8004030 con 0x7fc4e00ab8d0 2023-05-16T13:55:24.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.267+0000 7fc4dcff9640 1 --2- 172.21.15.39:0/1745529147 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc4c0066270 0x7fc4c0068720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:24.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.267+0000 7fc4dcff9640 1 -- 172.21.15.39:0/1745529147 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc4d8083d40 con 0x7fc4e00ab8d0 2023-05-16T13:55:24.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.267+0000 7fc4df7fe640 1 --2- 172.21.15.39:0/1745529147 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc4c0066270 0x7fc4c0068720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:24.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.267+0000 7fc4df7fe640 1 --2- 172.21.15.39:0/1745529147 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc4c0066270 0x7fc4c0068720 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc4d0009bc0 tx=0x7fc4d0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:24.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.271+0000 7fc4dcff9640 1 -- 172.21.15.39:0/1745529147 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fc4e00acee0 con 0x7fc4e00ab8d0 2023-05-16T13:55:24.470 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:24.463+0000 7fc4e5d7b640 1 -- 172.21.15.39:0/1745529147 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc4e00acee0 con 0x7fc4e00ab8d0 2023-05-16T13:55:25.399 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.391+0000 7fc4dcff9640 1 -- 172.21.15.39:0/1745529147 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v14) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc4e00acee0 con 0x7fc4e00ab8d0 2023-05-16T13:55:25.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.395+0000 7fc4e5d7b640 1 -- 172.21.15.39:0/1745529147 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc4c0066270 msgr2=0x7fc4c0068720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:25.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.395+0000 7fc4e5d7b640 1 --2- 172.21.15.39:0/1745529147 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc4c0066270 0x7fc4c0068720 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc4d0009bc0 tx=0x7fc4d0008040 comp rx=0 tx=0).stop 2023-05-16T13:55:25.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.395+0000 7fc4e5d7b640 1 -- 172.21.15.39:0/1745529147 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc4e00ab8d0 msgr2=0x7fc4e0153720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:25.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.395+0000 7fc4e5d7b640 1 --2- 172.21.15.39:0/1745529147 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc4e00ab8d0 0x7fc4e0153720 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fc4e006fc30 tx=0x7fc4d8007dd0 comp rx=0 tx=0).stop 2023-05-16T13:55:25.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.395+0000 7fc4e5d7b640 1 -- 172.21.15.39:0/1745529147 shutdown_connections 2023-05-16T13:55:25.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.395+0000 7fc4e5d7b640 1 --2- 172.21.15.39:0/1745529147 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fc4c0066270 0x7fc4c0068720 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:25.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.395+0000 7fc4e5d7b640 1 --2- 172.21.15.39:0/1745529147 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc4e00c7690 0x7fc4e0151f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:25.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.395+0000 7fc4e5d7b640 1 --2- 172.21.15.39:0/1745529147 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc4e00ab8d0 0x7fc4e0153720 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:25.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.395+0000 7fc4e5d7b640 1 --2- 172.21.15.39:0/1745529147 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4cc003f00 0x7fc4e00ad1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:25.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.395+0000 7fc4e5d7b640 1 -- 172.21.15.39:0/1745529147 >> 172.21.15.39:0/1745529147 conn(0x7fc4e0069a50 msgr2=0x7fc4e00703c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:25.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.395+0000 7fc4e5d7b640 1 -- 172.21.15.39:0/1745529147 shutdown_connections 2023-05-16T13:55:25.403 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.395+0000 7fc4e5d7b640 1 -- 172.21.15.39:0/1745529147 wait complete. 2023-05-16T13:55:25.424 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-05-16T13:55:25.425 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-05-16T13:55:25.570 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.563+0000 7fdd5f28c640 1 Processor -- start 2023-05-16T13:55:25.571 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.563+0000 7fdd5f28c640 1 -- start start 2023-05-16T13:55:25.571 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.563+0000 7fdd5f28c640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fdd580d0410 0x7fdd580d07e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:25.571 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.563+0000 7fdd5f28c640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fdd580af490 0x7fdd580af930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:25.572 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.563+0000 7fdd5f28c640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd580d3210 con 0x7fdd5806b620 2023-05-16T13:55:25.572 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.563+0000 7fdd5f28c640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd5815c620 con 0x7fdd580af490 2023-05-16T13:55:25.572 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.563+0000 7fdd5f28c640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd580d0d20 con 0x7fdd580d0410 2023-05-16T13:55:25.573 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.563+0000 7fdd5d829640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fdd580af490 0x7fdd580af930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:25.573 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.563+0000 7fdd5d829640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fdd580af490 0x7fdd580af930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44434/0 (socket says 172.21.15.39:44434) 2023-05-16T13:55:25.573 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.563+0000 7fdd5d829640 1 -- 172.21.15.39:0/698334148 learned_addr learned my addr 172.21.15.39:0/698334148 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:25.573 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.563+0000 7fdd5d028640 1 --2- 172.21.15.39:0/698334148 >> v2:172.21.15.118:3300/0 conn(0x7fdd580d0410 0x7fdd580d07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:25.573 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.563+0000 7fdd5d829640 1 -- 172.21.15.39:0/698334148 >> v2:172.21.15.118:3300/0 conn(0x7fdd580d0410 msgr2=0x7fdd580d07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:25.573 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.563+0000 7fdd5d829640 1 --2- 172.21.15.39:0/698334148 >> v2:172.21.15.118:3300/0 conn(0x7fdd580d0410 0x7fdd580d07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:25.574 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.563+0000 7fdd5d829640 1 -- 172.21.15.39:0/698334148 >> v1:172.21.15.118:6789/0 conn(0x7fdd5806b620 legacy=0x7fdd580d2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:25.574 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.563+0000 7fdd5d829640 1 -- 172.21.15.39:0/698334148 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd5806bb20 con 0x7fdd580af490 2023-05-16T13:55:25.574 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.563+0000 7fdd5d028640 1 --2- 172.21.15.39:0/698334148 >> v2:172.21.15.118:3300/0 conn(0x7fdd580d0410 0x7fdd580d07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:55:25.575 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.567+0000 7fdd5d829640 1 --2- 172.21.15.39:0/698334148 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdd580af490 0x7fdd580af930 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fdd580d27a0 tx=0x7fdd5001f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73f9382f8dcc4b6f server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:25.575 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.567+0000 7fdd4ffff640 1 -- 172.21.15.39:0/698334148 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd500af400 con 0x7fdd580af490 2023-05-16T13:55:25.576 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.567+0000 7fdd4ffff640 1 -- 172.21.15.39:0/698334148 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd500ab050 con 0x7fdd580af490 2023-05-16T13:55:25.576 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.567+0000 7fdd4ffff640 1 -- 172.21.15.39:0/698334148 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd500af780 con 0x7fdd580af490 2023-05-16T13:55:25.576 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.567+0000 7fdd5f28c640 1 -- 172.21.15.39:0/698334148 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdd580af490 msgr2=0x7fdd580af930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:25.577 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.567+0000 7fdd5f28c640 1 --2- 172.21.15.39:0/698334148 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdd580af490 0x7fdd580af930 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fdd580d27a0 tx=0x7fdd5001f1c0 comp rx=0 tx=0).stop 2023-05-16T13:55:25.577 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.567+0000 7fdd5f28c640 1 -- 172.21.15.39:0/698334148 shutdown_connections 2023-05-16T13:55:25.577 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.567+0000 7fdd5f28c640 1 --2- 172.21.15.39:0/698334148 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdd580af490 0x7fdd580af930 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:25.577 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.567+0000 7fdd5f28c640 1 --2- 172.21.15.39:0/698334148 >> v2:172.21.15.118:3300/0 conn(0x7fdd580d0410 0x7fdd580d07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:25.577 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.567+0000 7fdd5f28c640 1 -- 172.21.15.39:0/698334148 >> 172.21.15.39:0/698334148 conn(0x7fdd5809bba0 msgr2=0x7fdd58089fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:25.577 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.567+0000 7fdd5f28c640 1 -- 172.21.15.39:0/698334148 shutdown_connections 2023-05-16T13:55:25.577 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.567+0000 7fdd5f28c640 1 -- 172.21.15.39:0/698334148 wait complete. 2023-05-16T13:55:25.578 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.571+0000 7fdd5f28c640 1 Processor -- start 2023-05-16T13:55:25.578 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.571+0000 7fdd5f28c640 1 -- start start 2023-05-16T13:55:25.580 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.571+0000 7fdd5f28c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdd5806b620 0x7fdd58147c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:25.580 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.571+0000 7fdd5f28c640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdd580af490 0x7fdd580cce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:25.580 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.571+0000 7fdd5f28c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdd580d0410 0x7fdd580c8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:25.581 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.571+0000 7fdd5f28c640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd58148450 con 0x7fdd5806b620 2023-05-16T13:55:25.581 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.571+0000 7fdd5f28c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd581481b0 con 0x7fdd580d0410 2023-05-16T13:55:25.581 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.571+0000 7fdd5f28c640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd58149270 con 0x7fdd580af490 2023-05-16T13:55:25.581 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.571+0000 7fdd5d028640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdd5806b620 0x7fdd58147c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:25.581 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.571+0000 7fdd5d028640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdd5806b620 0x7fdd58147c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44450/0 (socket says 172.21.15.39:44450) 2023-05-16T13:55:25.581 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.571+0000 7fdd5d028640 1 -- 172.21.15.39:0/2359839980 learned_addr learned my addr 172.21.15.39:0/2359839980 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:25.581 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.571+0000 7fdd5d829640 1 --2- 172.21.15.39:0/2359839980 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdd580d0410 0x7fdd580c8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:25.582 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.571+0000 7fdd5d028640 1 -- 172.21.15.39:0/2359839980 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdd580af490 msgr2=0x7fdd580cce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:25.582 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.571+0000 7fdd5c827640 1 --2- 172.21.15.39:0/2359839980 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdd580af490 0x7fdd580cce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:25.582 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.571+0000 7fdd5d028640 1 --2- 172.21.15.39:0/2359839980 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdd580af490 0x7fdd580cce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:25.582 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.571+0000 7fdd5d028640 1 -- 172.21.15.39:0/2359839980 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdd580d0410 msgr2=0x7fdd580c8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:25.582 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.571+0000 7fdd5d028640 1 --2- 172.21.15.39:0/2359839980 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdd580d0410 0x7fdd580c8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:25.582 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.571+0000 7fdd5d028640 1 -- 172.21.15.39:0/2359839980 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd50009b30 con 0x7fdd5806b620 2023-05-16T13:55:25.582 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.571+0000 7fdd5d829640 1 --2- 172.21.15.39:0/2359839980 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdd580d0410 0x7fdd580c8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-16T13:55:25.582 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.571+0000 7fdd5c827640 1 --2- 172.21.15.39:0/2359839980 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdd580af490 0x7fdd580cce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-16T13:55:25.583 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.571+0000 7fdd5d028640 1 --2- 172.21.15.39:0/2359839980 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdd5806b620 0x7fdd58147c70 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fdd5400e810 tx=0x7fdd5400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:25.583 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.571+0000 7fdd4dffb640 1 -- 172.21.15.39:0/2359839980 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5400c870 con 0x7fdd5806b620 2023-05-16T13:55:25.583 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.571+0000 7fdd4dffb640 1 -- 172.21.15.39:0/2359839980 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd5400c9d0 con 0x7fdd5806b620 2023-05-16T13:55:25.583 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.571+0000 7fdd4dffb640 1 -- 172.21.15.39:0/2359839980 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5400cd60 con 0x7fdd5806b620 2023-05-16T13:55:25.583 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.571+0000 7fdd5f28c640 1 -- 172.21.15.39:0/2359839980 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd5806c0e0 con 0x7fdd5806b620 2023-05-16T13:55:25.584 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.571+0000 7fdd5f28c640 1 -- 172.21.15.39:0/2359839980 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd5806be00 con 0x7fdd5806b620 2023-05-16T13:55:25.584 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.575+0000 7fdd5f28c640 1 -- 172.21.15.39:0/2359839980 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd5806c3c0 con 0x7fdd5806b620 2023-05-16T13:55:25.584 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.575+0000 7fdd4dffb640 1 -- 172.21.15.39:0/2359839980 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdd54013410 con 0x7fdd5806b620 2023-05-16T13:55:25.585 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.575+0000 7fdd4dffb640 1 --2- 172.21.15.39:0/2359839980 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fdd3c0662d0 0x7fdd3c068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:25.585 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.575+0000 7fdd4dffb640 1 -- 172.21.15.39:0/2359839980 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdd54083ac0 con 0x7fdd5806b620 2023-05-16T13:55:25.585 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.575+0000 7fdd5c827640 1 --2- 172.21.15.39:0/2359839980 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fdd3c0662d0 0x7fdd3c068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:25.585 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.575+0000 7fdd5c827640 1 --2- 172.21.15.39:0/2359839980 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fdd3c0662d0 0x7fdd3c068780 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fdd5808a4a0 tx=0x7fdd48009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:25.587 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.579+0000 7fdd4dffb640 1 -- 172.21.15.39:0/2359839980 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fdd54050f20 con 0x7fdd5806b620 2023-05-16T13:55:25.774 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:25.767+0000 7fdd5f28c640 1 -- 172.21.15.39:0/2359839980 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fdd58073c90 con 0x7fdd5806b620 2023-05-16T13:55:26.402 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.395+0000 7fdd4dffb640 1 -- 172.21.15.39:0/2359839980 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v15) v1 ==== 122+0+0 (secure 0 0 0) 0x7fdd54009480 con 0x7fdd5806b620 2023-05-16T13:55:26.405 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.399+0000 7fdd5f28c640 1 -- 172.21.15.39:0/2359839980 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fdd3c0662d0 msgr2=0x7fdd3c068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:26.405 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.399+0000 7fdd5f28c640 1 --2- 172.21.15.39:0/2359839980 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fdd3c0662d0 0x7fdd3c068780 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fdd5808a4a0 tx=0x7fdd48009040 comp rx=0 tx=0).stop 2023-05-16T13:55:26.405 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.399+0000 7fdd5f28c640 1 -- 172.21.15.39:0/2359839980 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdd5806b620 msgr2=0x7fdd58147c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:26.405 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.399+0000 7fdd5f28c640 1 --2- 172.21.15.39:0/2359839980 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdd5806b620 0x7fdd58147c70 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fdd5400e810 tx=0x7fdd5400ecd0 comp rx=0 tx=0).stop 2023-05-16T13:55:26.406 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.399+0000 7fdd5f28c640 1 -- 172.21.15.39:0/2359839980 shutdown_connections 2023-05-16T13:55:26.406 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.399+0000 7fdd5f28c640 1 --2- 172.21.15.39:0/2359839980 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fdd3c0662d0 0x7fdd3c068780 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:26.406 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.399+0000 7fdd5f28c640 1 --2- 172.21.15.39:0/2359839980 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdd580af490 0x7fdd580cce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:26.406 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.399+0000 7fdd5f28c640 1 --2- 172.21.15.39:0/2359839980 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdd580d0410 0x7fdd580c8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:26.406 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.399+0000 7fdd5f28c640 1 --2- 172.21.15.39:0/2359839980 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdd5806b620 0x7fdd58147c70 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:26.406 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.399+0000 7fdd5f28c640 1 -- 172.21.15.39:0/2359839980 >> 172.21.15.39:0/2359839980 conn(0x7fdd5809bba0 msgr2=0x7fdd580d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:26.406 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.399+0000 7fdd5f28c640 1 -- 172.21.15.39:0/2359839980 shutdown_connections 2023-05-16T13:55:26.407 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.399+0000 7fdd5f28c640 1 -- 172.21.15.39:0/2359839980 wait complete. 2023-05-16T13:55:26.428 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-05-16T13:55:26.428 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-16T13:55:26.570 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.563+0000 7f95b4a8c640 1 Processor -- start 2023-05-16T13:55:26.570 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.563+0000 7f95b4a8c640 1 -- start start 2023-05-16T13:55:26.572 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.563+0000 7f95b4a8c640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f95b00cc4a0 0x7f95b01606c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:26.573 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.563+0000 7f95b4a8c640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f95b00cb2c0 0x7f95b00cb740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:26.573 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.563+0000 7f95b4a8c640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95b00cde70 con 0x7f95b015c1a0 2023-05-16T13:55:26.573 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.563+0000 7f95b4a8c640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95b00ccaa0 con 0x7f95b00cb2c0 2023-05-16T13:55:26.574 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.563+0000 7f95b4a8c640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95b00ce6d0 con 0x7f95b00cc4a0 2023-05-16T13:55:26.574 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.563+0000 7f95aed9d640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f95b00cb2c0 0x7f95b00cb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:26.574 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.563+0000 7f95aed9d640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f95b00cb2c0 0x7f95b00cb740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44458/0 (socket says 172.21.15.39:44458) 2023-05-16T13:55:26.575 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.563+0000 7f95aed9d640 1 -- 172.21.15.39:0/141736618 learned_addr learned my addr 172.21.15.39:0/141736618 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:26.575 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.563+0000 7f95a5d9b640 1 --2- 172.21.15.39:0/141736618 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f95b00cc4a0 0x7f95b01606c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:26.575 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.563+0000 7f95aed9d640 1 -- 172.21.15.39:0/141736618 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f95b00cc4a0 msgr2=0x7f95b01606c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:26.576 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.563+0000 7f95aed9d640 1 --2- 172.21.15.39:0/141736618 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f95b00cc4a0 0x7f95b01606c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:26.576 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.563+0000 7f95aed9d640 1 -- 172.21.15.39:0/141736618 >> v1:172.21.15.118:6789/0 conn(0x7f95b015c1a0 legacy=0x7f95b006c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:26.576 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.563+0000 7f95aed9d640 1 -- 172.21.15.39:0/141736618 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b015c570 con 0x7f95b00cb2c0 2023-05-16T13:55:26.578 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.567+0000 7f95aed9d640 1 --2- 172.21.15.39:0/141736618 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95b00cb2c0 0x7f95b00cb740 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f95a8009e50 tx=0x7f95a801c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83f75b2a39292b0c server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:26.578 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.567+0000 7f95add9b640 1 -- 172.21.15.39:0/141736618 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a80a56a0 con 0x7f95b00cb2c0 2023-05-16T13:55:26.578 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.567+0000 7f95add9b640 1 -- 172.21.15.39:0/141736618 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95a80a5800 con 0x7f95b00cb2c0 2023-05-16T13:55:26.579 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.567+0000 7f95add9b640 1 -- 172.21.15.39:0/141736618 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a80a5b90 con 0x7f95b00cb2c0 2023-05-16T13:55:26.579 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.567+0000 7f95b4a8c640 1 -- 172.21.15.39:0/141736618 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95b00cb2c0 msgr2=0x7f95b00cb740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:26.579 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.567+0000 7f95b4a8c640 1 --2- 172.21.15.39:0/141736618 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95b00cb2c0 0x7f95b00cb740 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f95a8009e50 tx=0x7f95a801c8f0 comp rx=0 tx=0).stop 2023-05-16T13:55:26.580 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.567+0000 7f95b4a8c640 1 -- 172.21.15.39:0/141736618 shutdown_connections 2023-05-16T13:55:26.580 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.567+0000 7f95b4a8c640 1 --2- 172.21.15.39:0/141736618 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95b00cb2c0 0x7f95b00cb740 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:26.580 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.567+0000 7f95b4a8c640 1 --2- 172.21.15.39:0/141736618 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f95b00cc4a0 0x7f95b01606c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:26.580 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.567+0000 7f95b4a8c640 1 -- 172.21.15.39:0/141736618 >> 172.21.15.39:0/141736618 conn(0x7f95b00b1850 msgr2=0x7f95b00b1c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:26.580 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.567+0000 7f95b4a8c640 1 -- 172.21.15.39:0/141736618 shutdown_connections 2023-05-16T13:55:26.580 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.567+0000 7f95b4a8c640 1 -- 172.21.15.39:0/141736618 wait complete. 2023-05-16T13:55:26.581 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.571+0000 7f95b4a8c640 1 Processor -- start 2023-05-16T13:55:26.581 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.571+0000 7f95b4a8c640 1 -- start start 2023-05-16T13:55:26.582 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.571+0000 7f95b4a8c640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f95b00cb2c0 0x7f95b00c83f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:26.583 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.571+0000 7f95b4a8c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95b00cc4a0 0x7f95b00ca8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:26.583 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.571+0000 7f95b4a8c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f95b015c1a0 0x7f95b0147d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:26.583 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.571+0000 7f95b4a8c640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b00c6520 con 0x7f95b00cc4a0 2023-05-16T13:55:26.583 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.571+0000 7f95b4a8c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b00c7970 con 0x7f95b015c1a0 2023-05-16T13:55:26.583 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.571+0000 7f95b4a8c640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95b00cae20 con 0x7f95b00cb2c0 2023-05-16T13:55:26.583 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.571+0000 7f95a5d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95b00cc4a0 0x7f95b00ca8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:26.584 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.571+0000 7f95a5d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95b00cc4a0 0x7f95b00ca8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44464/0 (socket says 172.21.15.39:44464) 2023-05-16T13:55:26.584 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.571+0000 7f95a5d9b640 1 -- 172.21.15.39:0/2891521158 learned_addr learned my addr 172.21.15.39:0/2891521158 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:26.584 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.571+0000 7f95aed9d640 1 --2- 172.21.15.39:0/2891521158 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f95b015c1a0 0x7f95b0147d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:26.584 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.571+0000 7f95ae59c640 1 --2- 172.21.15.39:0/2891521158 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f95b00cb2c0 0x7f95b00c83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:26.584 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.571+0000 7f95a5d9b640 1 -- 172.21.15.39:0/2891521158 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f95b00cb2c0 msgr2=0x7f95b00c83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:26.584 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.571+0000 7f95a5d9b640 1 --2- 172.21.15.39:0/2891521158 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f95b00cb2c0 0x7f95b00c83f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:26.584 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.571+0000 7f95a5d9b640 1 -- 172.21.15.39:0/2891521158 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f95b015c1a0 msgr2=0x7f95b0147d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:26.585 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.571+0000 7f95a5d9b640 1 --2- 172.21.15.39:0/2891521158 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f95b015c1a0 0x7f95b0147d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:26.585 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.571+0000 7f95a5d9b640 1 -- 172.21.15.39:0/2891521158 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a8009b30 con 0x7f95b00cc4a0 2023-05-16T13:55:26.585 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.571+0000 7f95a5d9b640 1 --2- 172.21.15.39:0/2891521158 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95b00cc4a0 0x7f95b00ca8e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f959800d800 tx=0x7f959800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:26.585 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.571+0000 7f95a77fe640 1 -- 172.21.15.39:0/2891521158 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f959800b6c0 con 0x7f95b00cc4a0 2023-05-16T13:55:26.585 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.571+0000 7f95a77fe640 1 -- 172.21.15.39:0/2891521158 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f959800b820 con 0x7f95b00cc4a0 2023-05-16T13:55:26.585 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.571+0000 7f95b4a8c640 1 -- 172.21.15.39:0/2891521158 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95b00b1280 con 0x7f95b00cc4a0 2023-05-16T13:55:26.585 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.571+0000 7f95a77fe640 1 -- 172.21.15.39:0/2891521158 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f959800bb90 con 0x7f95b00cc4a0 2023-05-16T13:55:26.585 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.571+0000 7f95b4a8c640 1 -- 172.21.15.39:0/2891521158 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95b0070200 con 0x7f95b00cc4a0 2023-05-16T13:55:26.586 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.575+0000 7f95b4a8c640 1 -- 172.21.15.39:0/2891521158 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95b0070f30 con 0x7f95b00cc4a0 2023-05-16T13:55:26.586 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.575+0000 7f95a77fe640 1 -- 172.21.15.39:0/2891521158 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f959800bcf0 con 0x7f95b00cc4a0 2023-05-16T13:55:26.586 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.575+0000 7f95a77fe640 1 --2- 172.21.15.39:0/2891521158 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f9590066280 0x7f9590068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:26.586 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.575+0000 7f95a77fe640 1 -- 172.21.15.39:0/2891521158 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f95980840f0 con 0x7f95b00cc4a0 2023-05-16T13:55:26.587 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.575+0000 7f95ae59c640 1 --2- 172.21.15.39:0/2891521158 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f9590066280 0x7f9590068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:26.587 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.575+0000 7f95ae59c640 1 --2- 172.21.15.39:0/2891521158 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f9590066280 0x7f9590068730 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f95b00cbba0 tx=0x7f95a0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:26.587 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.579+0000 7f95a77fe640 1 -- 172.21.15.39:0/2891521158 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f9598055140 con 0x7f95b00cc4a0 2023-05-16T13:55:26.772 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.763+0000 7f95b4a8c640 1 -- 172.21.15.39:0/2891521158 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f95b0073c90 con 0x7f95b00cc4a0 2023-05-16T13:55:26.773 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.767+0000 7f95a77fe640 1 -- 172.21.15.39:0/2891521158 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4671 (secure 0 0 0) 0x7f9598054cd0 con 0x7f95b00cc4a0 2023-05-16T13:55:26.773 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:55:26.774 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5248,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2560977732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2560977732},{"type":"v1","addr":"172.21.15.118:6834","nonce":2560977732}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5251,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/376752431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":376752431},{"type":"v1","addr":"172.21.15.118:6835","nonce":376752431}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5376,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6836/315984146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6835","nonce":315984146},{"type":"v1","addr":"172.21.15.39:6836","nonce":315984146}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-16T13:55:23.381170+0000","modified":"2023-05-16T13:55:26.393759+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5379":{"gid":5379,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.39:6837/4211566764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":4211566764},{"type":"v1","addr":"172.21.15.39:6837","nonce":4211566764}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-05-16T13:55:26.774 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 15 2023-05-16T13:55:26.775 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.767+0000 7f95b4a8c640 1 -- 172.21.15.39:0/2891521158 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f9590066280 msgr2=0x7f9590068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:26.775 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.767+0000 7f95b4a8c640 1 --2- 172.21.15.39:0/2891521158 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f9590066280 0x7f9590068730 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f95b00cbba0 tx=0x7f95a0009040 comp rx=0 tx=0).stop 2023-05-16T13:55:26.775 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.767+0000 7f95b4a8c640 1 -- 172.21.15.39:0/2891521158 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95b00cc4a0 msgr2=0x7f95b00ca8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:26.776 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.767+0000 7f95b4a8c640 1 --2- 172.21.15.39:0/2891521158 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95b00cc4a0 0x7f95b00ca8e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f959800d800 tx=0x7f959800dcc0 comp rx=0 tx=0).stop 2023-05-16T13:55:26.776 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.767+0000 7f95b4a8c640 1 -- 172.21.15.39:0/2891521158 shutdown_connections 2023-05-16T13:55:26.776 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.767+0000 7f95b4a8c640 1 --2- 172.21.15.39:0/2891521158 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f95b015c1a0 0x7f95b0147d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:26.776 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.767+0000 7f95b4a8c640 1 --2- 172.21.15.39:0/2891521158 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95b00cc4a0 0x7f95b00ca8e0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:26.776 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.767+0000 7f95b4a8c640 1 --2- 172.21.15.39:0/2891521158 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f9590066280 0x7f9590068730 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:26.776 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.767+0000 7f95b4a8c640 1 --2- 172.21.15.39:0/2891521158 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f95b00cb2c0 0x7f95b00c83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:26.776 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.767+0000 7f95b4a8c640 1 -- 172.21.15.39:0/2891521158 >> 172.21.15.39:0/2891521158 conn(0x7f95b00b1850 msgr2=0x7f95b006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:26.777 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.767+0000 7f95b4a8c640 1 -- 172.21.15.39:0/2891521158 shutdown_connections 2023-05-16T13:55:26.777 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.767+0000 7f95b4a8c640 1 -- 172.21.15.39:0/2891521158 wait complete. 2023-05-16T13:55:26.794 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-16T13:55:26.932 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.923+0000 7f8c374d1640 1 Processor -- start 2023-05-16T13:55:26.933 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.923+0000 7f8c374d1640 1 -- start start 2023-05-16T13:55:26.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.927+0000 7f8c374d1640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c30158bf0 0x7f8c3015d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:26.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.927+0000 7f8c374d1640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f8c300cb4c0 0x7f8c300ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:26.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.927+0000 7f8c374d1640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c3015d6a0 con 0x7f8c300703b0 2023-05-16T13:55:26.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.927+0000 7f8c374d1640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c30070870 con 0x7f8c300cb4c0 2023-05-16T13:55:26.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.927+0000 7f8c374d1640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c30070b50 con 0x7f8c30158bf0 2023-05-16T13:55:26.934 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.927+0000 7f8c35a6e640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f8c300cb4c0 0x7f8c300ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:26.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.927+0000 7f8c35a6e640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f8c300cb4c0 0x7f8c300ccda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44476/0 (socket says 172.21.15.39:44476) 2023-05-16T13:55:26.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.927+0000 7f8c35a6e640 1 -- 172.21.15.39:0/2926495432 learned_addr learned my addr 172.21.15.39:0/2926495432 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:26.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.927+0000 7f8c35a6e640 1 -- 172.21.15.39:0/2926495432 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c30158bf0 msgr2=0x7f8c3015d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:26.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.927+0000 7f8c35a6e640 1 --2- 172.21.15.39:0/2926495432 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c30158bf0 0x7f8c3015d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:26.936 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.927+0000 7f8c35a6e640 1 -- 172.21.15.39:0/2926495432 >> v1:172.21.15.118:6789/0 conn(0x7f8c300703b0 legacy=0x7f8c300cadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:26.936 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.927+0000 7f8c35a6e640 1 -- 172.21.15.39:0/2926495432 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c30070e30 con 0x7f8c300cb4c0 2023-05-16T13:55:26.937 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.931+0000 7f8c35a6e640 1 --2- 172.21.15.39:0/2926495432 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8c300cb4c0 0x7f8c300ccda0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f8c300cc380 tx=0x7f8c2801c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b17b80cd80b2e62 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:26.937 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.931+0000 7f8c27fff640 1 -- 172.21.15.39:0/2926495432 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c280a5770 con 0x7f8c300cb4c0 2023-05-16T13:55:26.937 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.931+0000 7f8c27fff640 1 -- 172.21.15.39:0/2926495432 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c280a58d0 con 0x7f8c300cb4c0 2023-05-16T13:55:26.938 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.931+0000 7f8c27fff640 1 -- 172.21.15.39:0/2926495432 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c280a5c60 con 0x7f8c300cb4c0 2023-05-16T13:55:26.938 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.931+0000 7f8c374d1640 1 -- 172.21.15.39:0/2926495432 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8c300cb4c0 msgr2=0x7f8c300ccda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:26.938 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.931+0000 7f8c374d1640 1 --2- 172.21.15.39:0/2926495432 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8c300cb4c0 0x7f8c300ccda0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f8c300cc380 tx=0x7f8c2801c8f0 comp rx=0 tx=0).stop 2023-05-16T13:55:26.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.931+0000 7f8c374d1640 1 -- 172.21.15.39:0/2926495432 shutdown_connections 2023-05-16T13:55:26.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.931+0000 7f8c374d1640 1 --2- 172.21.15.39:0/2926495432 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8c300cb4c0 0x7f8c300ccda0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:26.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.931+0000 7f8c374d1640 1 --2- 172.21.15.39:0/2926495432 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c30158bf0 0x7f8c3015d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:26.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.931+0000 7f8c374d1640 1 -- 172.21.15.39:0/2926495432 >> 172.21.15.39:0/2926495432 conn(0x7f8c30069a50 msgr2=0x7f8c30069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:26.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.931+0000 7f8c374d1640 1 -- 172.21.15.39:0/2926495432 shutdown_connections 2023-05-16T13:55:26.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.931+0000 7f8c374d1640 1 -- 172.21.15.39:0/2926495432 wait complete. 2023-05-16T13:55:26.940 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.931+0000 7f8c374d1640 1 Processor -- start 2023-05-16T13:55:26.940 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.931+0000 7f8c374d1640 1 -- start start 2023-05-16T13:55:26.940 INFO:tasks.ceph.mds.a.smithi039.stderr:2023-05-16T13:55:26.931+0000 7f00cd571640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-05-16T13:55:26.941 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.935+0000 7f8c374d1640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8c300703b0 0x7f8c30146540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:26.942 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.935+0000 7f8c374d1640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c300cb4c0 0x7f8c300c4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:26.942 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.935+0000 7f8c374d1640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c30158bf0 0x7f8c3014b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:26.942 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.935+0000 7f8c374d1640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c300c4a60 con 0x7f8c300703b0 2023-05-16T13:55:26.942 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.935+0000 7f8c374d1640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c300b2a20 con 0x7f8c30158bf0 2023-05-16T13:55:26.942 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.935+0000 7f8c374d1640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c300c4cb0 con 0x7f8c300cb4c0 2023-05-16T13:55:26.942 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.935+0000 7f8c3526d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8c300703b0 0x7f8c30146540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:26.942 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.935+0000 7f8c3526d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8c300703b0 0x7f8c30146540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44484/0 (socket says 172.21.15.39:44484) 2023-05-16T13:55:26.942 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.935+0000 7f8c3526d640 1 -- 172.21.15.39:0/472829609 learned_addr learned my addr 172.21.15.39:0/472829609 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:26.943 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.935+0000 7f8c35a6e640 1 --2- 172.21.15.39:0/472829609 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c30158bf0 0x7f8c3014b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:26.943 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.935+0000 7f8c34a6c640 1 --2- 172.21.15.39:0/472829609 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c300cb4c0 0x7f8c300c4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:26.943 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.935+0000 7f8c3526d640 1 -- 172.21.15.39:0/472829609 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c300cb4c0 msgr2=0x7f8c300c4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:26.943 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.935+0000 7f8c3526d640 1 --2- 172.21.15.39:0/472829609 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c300cb4c0 0x7f8c300c4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:26.943 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.935+0000 7f8c3526d640 1 -- 172.21.15.39:0/472829609 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c30158bf0 msgr2=0x7f8c3014b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:26.943 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.935+0000 7f8c3526d640 1 --2- 172.21.15.39:0/472829609 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c30158bf0 0x7f8c3014b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:26.943 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.935+0000 7f8c3526d640 1 -- 172.21.15.39:0/472829609 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c28009b30 con 0x7f8c300703b0 2023-05-16T13:55:26.944 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.935+0000 7f8c34a6c640 1 --2- 172.21.15.39:0/472829609 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c300cb4c0 0x7f8c300c4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:55:26.944 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.935+0000 7f8c3526d640 1 --2- 172.21.15.39:0/472829609 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8c300703b0 0x7f8c30146540 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c00b410 tx=0x7f8c2c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:26.945 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.935+0000 7f8c25ffb640 1 -- 172.21.15.39:0/472829609 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c011830 con 0x7f8c300703b0 2023-05-16T13:55:26.945 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.935+0000 7f8c25ffb640 1 -- 172.21.15.39:0/472829609 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c2c011990 con 0x7f8c300703b0 2023-05-16T13:55:26.945 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.935+0000 7f8c374d1640 1 -- 172.21.15.39:0/472829609 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c300ad950 con 0x7f8c300703b0 2023-05-16T13:55:26.945 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.935+0000 7f8c25ffb640 1 -- 172.21.15.39:0/472829609 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c011d40 con 0x7f8c300703b0 2023-05-16T13:55:26.945 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.935+0000 7f8c374d1640 1 -- 172.21.15.39:0/472829609 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c30158fc0 con 0x7f8c300703b0 2023-05-16T13:55:26.945 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.935+0000 7f8c374d1640 1 -- 172.21.15.39:0/472829609 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c300cdaf0 con 0x7f8c300703b0 2023-05-16T13:55:26.945 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.935+0000 7f8c25ffb640 1 -- 172.21.15.39:0/472829609 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8c2c01a400 con 0x7f8c300703b0 2023-05-16T13:55:26.946 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.939+0000 7f8c25ffb640 1 --2- 172.21.15.39:0/472829609 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f8c140662b0 0x7f8c14068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:26.946 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.939+0000 7f8c25ffb640 1 -- 172.21.15.39:0/472829609 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8c2c083ea0 con 0x7f8c300703b0 2023-05-16T13:55:26.946 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.939+0000 7f8c34a6c640 1 --2- 172.21.15.39:0/472829609 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f8c140662b0 0x7f8c14068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:26.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.939+0000 7f8c34a6c640 1 --2- 172.21.15.39:0/472829609 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f8c140662b0 0x7f8c14068760 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8c3015c250 tx=0x7f8c20009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:26.949 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:26.943+0000 7f8c25ffb640 1 -- 172.21.15.39:0/472829609 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f8c2c051310 con 0x7f8c300703b0 2023-05-16T13:55:27.107 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.099+0000 7f8c374d1640 1 -- 172.21.15.39:0/472829609 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8c30156290 con 0x7f8c300703b0 2023-05-16T13:55:27.108 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.103+0000 7f8c25ffb640 1 -- 172.21.15.39:0/472829609 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+18351 (secure 0 0 0) 0x7f8c2c015020 con 0x7f8c300703b0 2023-05-16T13:55:27.109 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:55:27.109 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":38,"fsid":"9c1e210b-c515-4ea4-a065-397956895c68","created":"2023-05-16T13:53:48.955290+0000","modified":"2023-05-16T13:55:24.383565+0000","last_up_change":"2023-05-16T13:54:01.722051+0000","last_in_change":"2023-05-16T13:53:52.331336+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-16T13:54:00.885009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-16T13:54:08.327895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-05-16T13:55:21.618763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-05-16T13:55:22.360381+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4ce0f0ba-c4bf-4405-8c95-d2e9a62878ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6809","nonce":3462013698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6811","nonce":3462013698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6815","nonce":3462013698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":3462013698},{"type":"v1","addr":"172.21.15.39:6813","nonce":3462013698}]},"public_addr":"172.21.15.39:6809/3462013698","cluster_addr":"172.21.15.39:6811/3462013698","heartbeat_back_addr":"172.21.15.39:6815/3462013698","heartbeat_front_addr":"172.21.15.39:6813/3462013698","state":["exists","up"]},{"osd":1,"uuid":"53fdc1ac-2473-472d-af32-2760fdf6e476","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6801","nonce":2829970892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6803","nonce":2829970892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6807","nonce":2829970892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2829970892},{"type":"v1","addr":"172.21.15.39:6805","nonce":2829970892}]},"public_addr":"172.21.15.39:6801/2829970892","cluster_addr":"172.21.15.39:6803/2829970892","heartbeat_back_addr":"172.21.15.39:6807/2829970892","heartbeat_front_addr":"172.21.15.39:6805/2829970892","state":["exists","up"]},{"osd":2,"uuid":"0b92d770-7030-42fa-a19f-4f7f1ac113c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6817","nonce":3888067413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6819","nonce":3888067413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6823","nonce":3888067413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":3888067413},{"type":"v1","addr":"172.21.15.39:6821","nonce":3888067413}]},"public_addr":"172.21.15.39:6817/3888067413","cluster_addr":"172.21.15.39:6819/3888067413","heartbeat_back_addr":"172.21.15.39:6823/3888067413","heartbeat_front_addr":"172.21.15.39:6821/3888067413","state":["exists","up"]},{"osd":3,"uuid":"000d9506-cbb2-4017-b875-deca579860ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6825","nonce":405003958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6827","nonce":405003958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6831","nonce":405003958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":405003958},{"type":"v1","addr":"172.21.15.39:6829","nonce":405003958}]},"public_addr":"172.21.15.39:6825/405003958","cluster_addr":"172.21.15.39:6827/405003958","heartbeat_back_addr":"172.21.15.39:6831/405003958","heartbeat_front_addr":"172.21.15.39:6829/405003958","state":["exists","up"]},{"osd":4,"uuid":"70f0dacb-e960-40c5-bf6a-183e52bbe2ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6801","nonce":3895278838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6803","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6805","nonce":3895278838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6811","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6813","nonce":3895278838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6807","nonce":3895278838},{"type":"v1","addr":"172.21.15.118:6809","nonce":3895278838}]},"public_addr":"172.21.15.118:6801/3895278838","cluster_addr":"172.21.15.118:6805/3895278838","heartbeat_back_addr":"172.21.15.118:6813/3895278838","heartbeat_front_addr":"172.21.15.118:6809/3895278838","state":["exists","up"]},{"osd":5,"uuid":"756feb54-c3ae-4a2a-8f74-85c291ba707c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6804","nonce":3513592808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6808","nonce":3513592808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6815","nonce":3513592808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":3513592808},{"type":"v1","addr":"172.21.15.118:6812","nonce":3513592808}]},"public_addr":"172.21.15.118:6804/3513592808","cluster_addr":"172.21.15.118:6808/3513592808","heartbeat_back_addr":"172.21.15.118:6815/3513592808","heartbeat_front_addr":"172.21.15.118:6812/3513592808","state":["exists","up"]},{"osd":6,"uuid":"c4a982c1-f497-4b0f-8a23-c77372e4621e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6824","nonce":1863656053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6827","nonce":1863656053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6831","nonce":1863656053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1863656053},{"type":"v1","addr":"172.21.15.118:6829","nonce":1863656053}]},"public_addr":"172.21.15.118:6824/1863656053","cluster_addr":"172.21.15.118:6827/1863656053","heartbeat_back_addr":"172.21.15.118:6831/1863656053","heartbeat_front_addr":"172.21.15.118:6829/1863656053","state":["exists","up"]},{"osd":7,"uuid":"6f2888aa-a7ac-4e26-9159-e31817934f44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6817","nonce":3636642904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6819","nonce":3636642904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6825","nonce":3636642904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":3636642904},{"type":"v1","addr":"172.21.15.118:6821","nonce":3636642904}]},"public_addr":"172.21.15.118:6817/3636642904","cluster_addr":"172.21.15.118:6819/3636642904","heartbeat_back_addr":"172.21.15.118:6825/3636642904","heartbeat_front_addr":"172.21.15.118:6821/3636642904","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.717636+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.724036+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.739144+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:58.079275+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:58.073921+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.930466+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.987813+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-16T13:53:57.941098+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-16T13:55:27.111 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.103+0000 7f8c374d1640 1 -- 172.21.15.39:0/472829609 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f8c140662b0 msgr2=0x7f8c14068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:27.111 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.103+0000 7f8c374d1640 1 --2- 172.21.15.39:0/472829609 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f8c140662b0 0x7f8c14068760 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8c3015c250 tx=0x7f8c20009040 comp rx=0 tx=0).stop 2023-05-16T13:55:27.111 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.103+0000 7f8c374d1640 1 -- 172.21.15.39:0/472829609 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8c300703b0 msgr2=0x7f8c30146540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:27.111 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.103+0000 7f8c374d1640 1 --2- 172.21.15.39:0/472829609 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8c300703b0 0x7f8c30146540 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c00b410 tx=0x7f8c2c00b8d0 comp rx=0 tx=0).stop 2023-05-16T13:55:27.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.103+0000 7f8c374d1640 1 -- 172.21.15.39:0/472829609 shutdown_connections 2023-05-16T13:55:27.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.103+0000 7f8c374d1640 1 --2- 172.21.15.39:0/472829609 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f8c140662b0 0x7f8c14068760 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:27.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.103+0000 7f8c374d1640 1 --2- 172.21.15.39:0/472829609 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c300cb4c0 0x7f8c300c4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:27.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.103+0000 7f8c374d1640 1 --2- 172.21.15.39:0/472829609 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c30158bf0 0x7f8c3014b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:27.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.103+0000 7f8c374d1640 1 --2- 172.21.15.39:0/472829609 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8c300703b0 0x7f8c30146540 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:27.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.103+0000 7f8c374d1640 1 -- 172.21.15.39:0/472829609 >> 172.21.15.39:0/472829609 conn(0x7f8c30069a50 msgr2=0x7f8c300cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:27.112 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.103+0000 7f8c374d1640 1 -- 172.21.15.39:0/472829609 shutdown_connections 2023-05-16T13:55:27.113 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.103+0000 7f8c374d1640 1 -- 172.21.15.39:0/472829609 wait complete. 2023-05-16T13:55:27.130 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-05-16T13:55:27.130 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-16T13:55:27.267 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.259+0000 7f9f8aed1640 1 Processor -- start 2023-05-16T13:55:27.267 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.259+0000 7f9f8aed1640 1 -- start start 2023-05-16T13:55:27.268 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.259+0000 7f9f8aed1640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9f841584f0 0x7f9f840cd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:27.268 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.259+0000 7f9f8aed1640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9f840c8c00 0x7f9f840c9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:27.269 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.259+0000 7f9f8aed1640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f841588c0 con 0x7f9f8415c080 2023-05-16T13:55:27.269 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.259+0000 7f9f8aed1640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f840cccb0 con 0x7f9f840c8c00 2023-05-16T13:55:27.269 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.259+0000 7f9f8aed1640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f840c95c0 con 0x7f9f841584f0 2023-05-16T13:55:27.269 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.259+0000 7f9f83fff640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9f840c8c00 0x7f9f840c9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:27.270 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.263+0000 7f9f83fff640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9f840c8c00 0x7f9f840c9080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44492/0 (socket says 172.21.15.39:44492) 2023-05-16T13:55:27.270 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.263+0000 7f9f88c6d640 1 --2- 172.21.15.39:0/2921797322 >> v2:172.21.15.118:3300/0 conn(0x7f9f841584f0 0x7f9f840cd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:27.270 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.263+0000 7f9f83fff640 1 -- 172.21.15.39:0/2921797322 learned_addr learned my addr 172.21.15.39:0/2921797322 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:27.270 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.263+0000 7f9f83fff640 1 -- 172.21.15.39:0/2921797322 >> v2:172.21.15.118:3300/0 conn(0x7f9f841584f0 msgr2=0x7f9f840cd0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:27.270 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.263+0000 7f9f83fff640 1 --2- 172.21.15.39:0/2921797322 >> v2:172.21.15.118:3300/0 conn(0x7f9f841584f0 0x7f9f840cd0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:27.270 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.263+0000 7f9f83fff640 1 -- 172.21.15.39:0/2921797322 >> v1:172.21.15.118:6789/0 conn(0x7f9f8415c080 legacy=0x7f9f8415c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:27.271 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.263+0000 7f9f83fff640 1 -- 172.21.15.39:0/2921797322 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f840cc380 con 0x7f9f840c8c00 2023-05-16T13:55:27.272 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.263+0000 7f9f83fff640 1 --2- 172.21.15.39:0/2921797322 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9f840c8c00 0x7f9f840c9080 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f9f8406e020 tx=0x7f9f7001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4cb8b0a6aff572d server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:27.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.263+0000 7f9f837fe640 1 -- 172.21.15.39:0/2921797322 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f700ab600 con 0x7f9f840c8c00 2023-05-16T13:55:27.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.263+0000 7f9f837fe640 1 -- 172.21.15.39:0/2921797322 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f700a7050 con 0x7f9f840c8c00 2023-05-16T13:55:27.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.263+0000 7f9f837fe640 1 -- 172.21.15.39:0/2921797322 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f700ab980 con 0x7f9f840c8c00 2023-05-16T13:55:27.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.267+0000 7f9f8aed1640 1 -- 172.21.15.39:0/2921797322 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9f840c8c00 msgr2=0x7f9f840c9080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:27.273 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.267+0000 7f9f8aed1640 1 --2- 172.21.15.39:0/2921797322 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9f840c8c00 0x7f9f840c9080 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f9f8406e020 tx=0x7f9f7001c470 comp rx=0 tx=0).stop 2023-05-16T13:55:27.274 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.267+0000 7f9f8aed1640 1 -- 172.21.15.39:0/2921797322 shutdown_connections 2023-05-16T13:55:27.274 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.267+0000 7f9f8aed1640 1 --2- 172.21.15.39:0/2921797322 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9f840c8c00 0x7f9f840c9080 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:27.274 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.267+0000 7f9f8aed1640 1 --2- 172.21.15.39:0/2921797322 >> v2:172.21.15.118:3300/0 conn(0x7f9f841584f0 0x7f9f840cd0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:27.274 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.267+0000 7f9f8aed1640 1 -- 172.21.15.39:0/2921797322 >> 172.21.15.39:0/2921797322 conn(0x7f9f84069a50 msgr2=0x7f9f84069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:27.274 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.267+0000 7f9f8aed1640 1 -- 172.21.15.39:0/2921797322 shutdown_connections 2023-05-16T13:55:27.274 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.267+0000 7f9f8aed1640 1 -- 172.21.15.39:0/2921797322 wait complete. 2023-05-16T13:55:27.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.267+0000 7f9f8aed1640 1 Processor -- start 2023-05-16T13:55:27.275 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.267+0000 7f9f8aed1640 1 -- start start 2023-05-16T13:55:27.276 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.267+0000 7f9f8aed1640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f840c8c00 0x7f9f8414f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:27.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.267+0000 7f9f8aed1640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f841584f0 0x7f9f840c2890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:27.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.267+0000 7f9f8aed1640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9f8415c080 0x7f9f840c2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:27.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.267+0000 7f9f8aed1640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f840c4720 con 0x7f9f8415c080 2023-05-16T13:55:27.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.267+0000 7f9f8aed1640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f84158a70 con 0x7f9f840c8c00 2023-05-16T13:55:27.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.267+0000 7f9f8aed1640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8414ff10 con 0x7f9f841584f0 2023-05-16T13:55:27.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.267+0000 7f9f8946e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9f8415c080 0x7f9f840c2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:27.277 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.267+0000 7f9f8946e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9f8415c080 0x7f9f840c2dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44494/0 (socket says 172.21.15.39:44494) 2023-05-16T13:55:27.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.267+0000 7f9f8946e640 1 -- 172.21.15.39:0/3937524384 learned_addr learned my addr 172.21.15.39:0/3937524384 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:27.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.267+0000 7f9f88c6d640 1 --2- 172.21.15.39:0/3937524384 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f840c8c00 0x7f9f8414f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:27.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.267+0000 7f9f83fff640 1 --2- 172.21.15.39:0/3937524384 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f841584f0 0x7f9f840c2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:27.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.267+0000 7f9f8946e640 1 -- 172.21.15.39:0/3937524384 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f841584f0 msgr2=0x7f9f840c2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:27.278 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.267+0000 7f9f8946e640 1 --2- 172.21.15.39:0/3937524384 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f841584f0 0x7f9f840c2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:27.279 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.267+0000 7f9f8946e640 1 -- 172.21.15.39:0/3937524384 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f840c8c00 msgr2=0x7f9f8414f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:27.279 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.267+0000 7f9f8946e640 1 --2- 172.21.15.39:0/3937524384 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f840c8c00 0x7f9f8414f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:27.279 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.267+0000 7f9f8946e640 1 -- 172.21.15.39:0/3937524384 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f700094d0 con 0x7f9f8415c080 2023-05-16T13:55:27.279 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.271+0000 7f9f8946e640 1 --2- 172.21.15.39:0/3937524384 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9f8415c080 0x7f9f840c2dd0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c00c760 tx=0x7f9f7c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:27.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.271+0000 7f9f817fa640 1 -- 172.21.15.39:0/3937524384 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c003b80 con 0x7f9f8415c080 2023-05-16T13:55:27.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.271+0000 7f9f817fa640 1 -- 172.21.15.39:0/3937524384 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f7c003ce0 con 0x7f9f8415c080 2023-05-16T13:55:27.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.271+0000 7f9f817fa640 1 -- 172.21.15.39:0/3937524384 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c00aa30 con 0x7f9f8415c080 2023-05-16T13:55:27.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.271+0000 7f9f8aed1640 1 -- 172.21.15.39:0/3937524384 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f8406fc10 con 0x7f9f8415c080 2023-05-16T13:55:27.280 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.271+0000 7f9f8aed1640 1 -- 172.21.15.39:0/3937524384 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f8415ce00 con 0x7f9f8415c080 2023-05-16T13:55:27.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.271+0000 7f9f8aed1640 1 -- 172.21.15.39:0/3937524384 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f8406fda0 con 0x7f9f8415c080 2023-05-16T13:55:27.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.271+0000 7f9f817fa640 1 -- 172.21.15.39:0/3937524384 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9f7c00ab90 con 0x7f9f8415c080 2023-05-16T13:55:27.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.271+0000 7f9f817fa640 1 --2- 172.21.15.39:0/3937524384 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f9f68066280 0x7f9f68068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:27.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.271+0000 7f9f817fa640 1 -- 172.21.15.39:0/3937524384 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9f7c083990 con 0x7f9f8415c080 2023-05-16T13:55:27.281 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.271+0000 7f9f88c6d640 1 --2- 172.21.15.39:0/3937524384 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f9f68066280 0x7f9f68068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:27.282 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.275+0000 7f9f88c6d640 1 --2- 172.21.15.39:0/3937524384 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f9f68066280 0x7f9f68068730 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9f7800ac60 tx=0x7f9f7800a2a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:27.284 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.275+0000 7f9f817fa640 1 -- 172.21.15.39:0/3937524384 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f9f7c050eb0 con 0x7f9f8415c080 2023-05-16T13:55:27.438 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.431+0000 7f9f8aed1640 1 -- 172.21.15.39:0/3937524384 --> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9f84073c90 con 0x7f9f68066280 2023-05-16T13:55:27.447 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.439+0000 7f9f817fa640 1 -- 172.21.15.39:0/3937524384 <== mgr.4098 v2:172.21.15.39:6832/288296800 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+303850 (secure 0 0 0) 0x7f9f84073c90 con 0x7f9f68066280 2023-05-16T13:55:27.450 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:55:27.451 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2023-05-16T13:55:27.452 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.443+0000 7f9f8aed1640 1 -- 172.21.15.39:0/3937524384 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f9f68066280 msgr2=0x7f9f68068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:27.453 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.443+0000 7f9f8aed1640 1 --2- 172.21.15.39:0/3937524384 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f9f68066280 0x7f9f68068730 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9f7800ac60 tx=0x7f9f7800a2a0 comp rx=0 tx=0).stop 2023-05-16T13:55:27.453 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.443+0000 7f9f8aed1640 1 -- 172.21.15.39:0/3937524384 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9f8415c080 msgr2=0x7f9f840c2dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:27.453 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.443+0000 7f9f8aed1640 1 --2- 172.21.15.39:0/3937524384 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9f8415c080 0x7f9f840c2dd0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c00c760 tx=0x7f9f7c00cc20 comp rx=0 tx=0).stop 2023-05-16T13:55:27.453 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.443+0000 7f9f8aed1640 1 -- 172.21.15.39:0/3937524384 shutdown_connections 2023-05-16T13:55:27.453 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.443+0000 7f9f8aed1640 1 --2- 172.21.15.39:0/3937524384 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f9f68066280 0x7f9f68068730 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:27.453 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.443+0000 7f9f8aed1640 1 --2- 172.21.15.39:0/3937524384 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f841584f0 0x7f9f840c2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:27.453 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.443+0000 7f9f8aed1640 1 --2- 172.21.15.39:0/3937524384 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9f8415c080 0x7f9f840c2dd0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:27.454 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.443+0000 7f9f8aed1640 1 --2- 172.21.15.39:0/3937524384 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f840c8c00 0x7f9f8414f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:27.454 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.443+0000 7f9f8aed1640 1 -- 172.21.15.39:0/3937524384 >> 172.21.15.39:0/3937524384 conn(0x7f9f84069a50 msgr2=0x7f9f84071030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:27.454 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.443+0000 7f9f8aed1640 1 -- 172.21.15.39:0/3937524384 shutdown_connections 2023-05-16T13:55:27.454 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.443+0000 7f9f8aed1640 1 -- 172.21.15.39:0/3937524384 wait complete. 2023-05-16T13:55:27.470 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":74,"stamp":"2023-05-16T13:55:26.843063+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592036,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":173,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":131,"ondisk_log_size":131,"up":110,"acting":110,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":108,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":102116,"kb_used_data":4324,"kb_used_omap":0,"kb_used_meta":97728,"kb_avail":754872604,"statfs":{"total":773094113280,"available":772989546496,"internally_reserved":0,"allocated":4427776,"data_stored":2492524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":100073472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1668,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.870588"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702986+0000","last_change":"2023-05-16T13:55:23.413635+0000","last_active":"2023-05-16T13:55:24.702986+0000","last_peered":"2023-05-16T13:55:24.702986+0000","last_clean":"2023-05-16T13:55:24.702986+0000","last_became_active":"2023-05-16T13:55:23.413319+0000","last_became_peered":"2023-05-16T13:55:23.413319+0000","last_unstale":"2023-05-16T13:55:24.702986+0000","last_undegraded":"2023-05-16T13:55:24.702986+0000","last_fullsized":"2023-05-16T13:55:24.702986+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:00:44.745581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702981+0000","last_change":"2023-05-16T13:55:23.420601+0000","last_active":"2023-05-16T13:55:24.702981+0000","last_peered":"2023-05-16T13:55:24.702981+0000","last_clean":"2023-05-16T13:55:24.702981+0000","last_became_active":"2023-05-16T13:55:23.420296+0000","last_became_peered":"2023-05-16T13:55:23.420296+0000","last_unstale":"2023-05-16T13:55:24.702981+0000","last_undegraded":"2023-05-16T13:55:24.702981+0000","last_fullsized":"2023-05-16T13:55:24.702981+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T14:28:21.055179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702832+0000","last_change":"2023-05-16T13:55:23.426167+0000","last_active":"2023-05-16T13:55:24.702832+0000","last_peered":"2023-05-16T13:55:24.702832+0000","last_clean":"2023-05-16T13:55:24.702832+0000","last_became_active":"2023-05-16T13:55:23.425898+0000","last_became_peered":"2023-05-16T13:55:23.425898+0000","last_unstale":"2023-05-16T13:55:24.702832+0000","last_undegraded":"2023-05-16T13:55:24.702832+0000","last_fullsized":"2023-05-16T13:55:24.702832+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T18:12:33.397086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.389344+0000","last_change":"2023-05-16T13:55:23.410640+0000","last_active":"2023-05-16T13:55:24.389344+0000","last_peered":"2023-05-16T13:55:24.389344+0000","last_clean":"2023-05-16T13:55:24.389344+0000","last_became_active":"2023-05-16T13:55:23.410201+0000","last_became_peered":"2023-05-16T13:55:23.410201+0000","last_unstale":"2023-05-16T13:55:24.389344+0000","last_undegraded":"2023-05-16T13:55:24.389344+0000","last_fullsized":"2023-05-16T13:55:24.389344+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T23:39:16.162625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.389118+0000","last_change":"2023-05-16T13:55:23.415688+0000","last_active":"2023-05-16T13:55:24.389118+0000","last_peered":"2023-05-16T13:55:24.389118+0000","last_clean":"2023-05-16T13:55:24.389118+0000","last_became_active":"2023-05-16T13:55:23.415428+0000","last_became_peered":"2023-05-16T13:55:23.415428+0000","last_unstale":"2023-05-16T13:55:24.389118+0000","last_undegraded":"2023-05-16T13:55:24.389118+0000","last_fullsized":"2023-05-16T13:55:24.389118+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T23:22:48.021414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702788+0000","last_change":"2023-05-16T13:55:23.411124+0000","last_active":"2023-05-16T13:55:24.702788+0000","last_peered":"2023-05-16T13:55:24.702788+0000","last_clean":"2023-05-16T13:55:24.702788+0000","last_became_active":"2023-05-16T13:55:23.410870+0000","last_became_peered":"2023-05-16T13:55:23.410870+0000","last_unstale":"2023-05-16T13:55:24.702788+0000","last_undegraded":"2023-05-16T13:55:24.702788+0000","last_fullsized":"2023-05-16T13:55:24.702788+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:20:17.612621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702869+0000","last_change":"2023-05-16T13:55:23.423785+0000","last_active":"2023-05-16T13:55:24.702869+0000","last_peered":"2023-05-16T13:55:24.702869+0000","last_clean":"2023-05-16T13:55:24.702869+0000","last_became_active":"2023-05-16T13:55:23.423521+0000","last_became_peered":"2023-05-16T13:55:23.423521+0000","last_unstale":"2023-05-16T13:55:24.702869+0000","last_undegraded":"2023-05-16T13:55:24.702869+0000","last_fullsized":"2023-05-16T13:55:24.702869+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:15:22.807920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703149+0000","last_change":"2023-05-16T13:55:23.426476+0000","last_active":"2023-05-16T13:55:24.703149+0000","last_peered":"2023-05-16T13:55:24.703149+0000","last_clean":"2023-05-16T13:55:24.703149+0000","last_became_active":"2023-05-16T13:55:23.426169+0000","last_became_peered":"2023-05-16T13:55:23.426169+0000","last_unstale":"2023-05-16T13:55:24.703149+0000","last_undegraded":"2023-05-16T13:55:24.703149+0000","last_fullsized":"2023-05-16T13:55:24.703149+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T15:01:43.692055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703603+0000","last_change":"2023-05-16T13:55:23.417357+0000","last_active":"2023-05-16T13:55:24.703603+0000","last_peered":"2023-05-16T13:55:24.703603+0000","last_clean":"2023-05-16T13:55:24.703603+0000","last_became_active":"2023-05-16T13:55:23.417040+0000","last_became_peered":"2023-05-16T13:55:23.417040+0000","last_unstale":"2023-05-16T13:55:24.703603+0000","last_undegraded":"2023-05-16T13:55:24.703603+0000","last_fullsized":"2023-05-16T13:55:24.703603+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:20:17.612621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.389374+0000","last_change":"2023-05-16T13:55:23.416396+0000","last_active":"2023-05-16T13:55:24.389374+0000","last_peered":"2023-05-16T13:55:24.389374+0000","last_clean":"2023-05-16T13:55:24.389374+0000","last_became_active":"2023-05-16T13:55:23.416171+0000","last_became_peered":"2023-05-16T13:55:23.416171+0000","last_unstale":"2023-05-16T13:55:24.389374+0000","last_undegraded":"2023-05-16T13:55:24.389374+0000","last_fullsized":"2023-05-16T13:55:24.389374+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:37:40.020154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.389007+0000","last_change":"2023-05-16T13:55:23.415714+0000","last_active":"2023-05-16T13:55:24.389007+0000","last_peered":"2023-05-16T13:55:24.389007+0000","last_clean":"2023-05-16T13:55:24.389007+0000","last_became_active":"2023-05-16T13:55:23.415365+0000","last_became_peered":"2023-05-16T13:55:23.415365+0000","last_unstale":"2023-05-16T13:55:24.389007+0000","last_undegraded":"2023-05-16T13:55:24.389007+0000","last_fullsized":"2023-05-16T13:55:24.389007+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:22:31.514634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703500+0000","last_change":"2023-05-16T13:55:23.424404+0000","last_active":"2023-05-16T13:55:24.703500+0000","last_peered":"2023-05-16T13:55:24.703500+0000","last_clean":"2023-05-16T13:55:24.703500+0000","last_became_active":"2023-05-16T13:55:23.424080+0000","last_became_peered":"2023-05-16T13:55:23.424080+0000","last_unstale":"2023-05-16T13:55:24.703500+0000","last_undegraded":"2023-05-16T13:55:24.703500+0000","last_fullsized":"2023-05-16T13:55:24.703500+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T23:50:36.996209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702518+0000","last_change":"2023-05-16T13:55:23.417343+0000","last_active":"2023-05-16T13:55:24.702518+0000","last_peered":"2023-05-16T13:55:24.702518+0000","last_clean":"2023-05-16T13:55:24.702518+0000","last_became_active":"2023-05-16T13:55:23.417084+0000","last_became_peered":"2023-05-16T13:55:23.417084+0000","last_unstale":"2023-05-16T13:55:24.702518+0000","last_undegraded":"2023-05-16T13:55:24.702518+0000","last_fullsized":"2023-05-16T13:55:24.702518+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:24:27.841261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:21.955159+0000","last_change":"2023-05-16T13:55:21.955159+0000","last_active":"2023-05-16T13:55:21.955159+0000","last_peered":"2023-05-16T13:55:21.955159+0000","last_clean":"2023-05-16T13:55:21.955159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:21.955159+0000","last_undegraded":"2023-05-16T13:55:21.955159+0000","last_fullsized":"2023-05-16T13:55:21.955159+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703219+0000","last_change":"2023-05-16T13:55:23.424419+0000","last_active":"2023-05-16T13:55:24.703219+0000","last_peered":"2023-05-16T13:55:24.703219+0000","last_clean":"2023-05-16T13:55:24.703219+0000","last_became_active":"2023-05-16T13:55:23.424144+0000","last_became_peered":"2023-05-16T13:55:23.424144+0000","last_unstale":"2023-05-16T13:55:24.703219+0000","last_undegraded":"2023-05-16T13:55:24.703219+0000","last_fullsized":"2023-05-16T13:55:24.703219+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T18:54:19.739155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702809+0000","last_change":"2023-05-16T13:55:23.004839+0000","last_active":"2023-05-16T13:55:24.702809+0000","last_peered":"2023-05-16T13:55:24.702809+0000","last_clean":"2023-05-16T13:55:24.702809+0000","last_became_active":"2023-05-16T13:55:23.004519+0000","last_became_peered":"2023-05-16T13:55:23.004519+0000","last_unstale":"2023-05-16T13:55:24.702809+0000","last_undegraded":"2023-05-16T13:55:24.702809+0000","last_fullsized":"2023-05-16T13:55:24.702809+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:42:58.481159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703544+0000","last_change":"2023-05-16T13:55:23.003518+0000","last_active":"2023-05-16T13:55:24.703544+0000","last_peered":"2023-05-16T13:55:24.703544+0000","last_clean":"2023-05-16T13:55:24.703544+0000","last_became_active":"2023-05-16T13:55:23.003263+0000","last_became_peered":"2023-05-16T13:55:23.003263+0000","last_unstale":"2023-05-16T13:55:24.703544+0000","last_undegraded":"2023-05-16T13:55:24.703544+0000","last_fullsized":"2023-05-16T13:55:24.703544+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T20:43:50.549191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702845+0000","last_change":"2023-05-16T13:55:23.409488+0000","last_active":"2023-05-16T13:55:24.702845+0000","last_peered":"2023-05-16T13:55:24.702845+0000","last_clean":"2023-05-16T13:55:24.702845+0000","last_became_active":"2023-05-16T13:55:23.409221+0000","last_became_peered":"2023-05-16T13:55:23.409221+0000","last_unstale":"2023-05-16T13:55:24.702845+0000","last_undegraded":"2023-05-16T13:55:24.702845+0000","last_fullsized":"2023-05-16T13:55:24.702845+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T23:37:20.052995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:21.955159+0000","last_change":"2023-05-16T13:55:21.955159+0000","last_active":"2023-05-16T13:55:21.955159+0000","last_peered":"2023-05-16T13:55:21.955159+0000","last_clean":"2023-05-16T13:55:21.955159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:21.955159+0000","last_undegraded":"2023-05-16T13:55:21.955159+0000","last_fullsized":"2023-05-16T13:55:21.955159+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703333+0000","last_change":"2023-05-16T13:55:23.410102+0000","last_active":"2023-05-16T13:55:24.703333+0000","last_peered":"2023-05-16T13:55:24.703333+0000","last_clean":"2023-05-16T13:55:24.703333+0000","last_became_active":"2023-05-16T13:55:23.409854+0000","last_became_peered":"2023-05-16T13:55:23.409854+0000","last_unstale":"2023-05-16T13:55:24.703333+0000","last_undegraded":"2023-05-16T13:55:24.703333+0000","last_fullsized":"2023-05-16T13:55:24.703333+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:39:33.113821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:21.955159+0000","last_change":"2023-05-16T13:55:21.955159+0000","last_active":"2023-05-16T13:55:21.955159+0000","last_peered":"2023-05-16T13:55:21.955159+0000","last_clean":"2023-05-16T13:55:21.955159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:21.955159+0000","last_undegraded":"2023-05-16T13:55:21.955159+0000","last_fullsized":"2023-05-16T13:55:21.955159+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:21.955159+0000","last_change":"2023-05-16T13:55:21.955159+0000","last_active":"2023-05-16T13:55:21.955159+0000","last_peered":"2023-05-16T13:55:21.955159+0000","last_clean":"2023-05-16T13:55:21.955159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:21.955159+0000","last_undegraded":"2023-05-16T13:55:21.955159+0000","last_fullsized":"2023-05-16T13:55:21.955159+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702652+0000","last_change":"2023-05-16T13:55:23.009273+0000","last_active":"2023-05-16T13:55:24.702652+0000","last_peered":"2023-05-16T13:55:24.702652+0000","last_clean":"2023-05-16T13:55:24.702652+0000","last_became_active":"2023-05-16T13:55:23.008332+0000","last_became_peered":"2023-05-16T13:55:23.008332+0000","last_unstale":"2023-05-16T13:55:24.702652+0000","last_undegraded":"2023-05-16T13:55:24.702652+0000","last_fullsized":"2023-05-16T13:55:24.702652+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:42:49.791420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703848+0000","last_change":"2023-05-16T13:55:23.414015+0000","last_active":"2023-05-16T13:55:24.703848+0000","last_peered":"2023-05-16T13:55:24.703848+0000","last_clean":"2023-05-16T13:55:24.703848+0000","last_became_active":"2023-05-16T13:55:23.413471+0000","last_became_peered":"2023-05-16T13:55:23.413471+0000","last_unstale":"2023-05-16T13:55:24.703848+0000","last_undegraded":"2023-05-16T13:55:24.703848+0000","last_fullsized":"2023-05-16T13:55:24.703848+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:45:55.863941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:21.955159+0000","last_change":"2023-05-16T13:55:21.955159+0000","last_active":"2023-05-16T13:55:21.955159+0000","last_peered":"2023-05-16T13:55:21.955159+0000","last_clean":"2023-05-16T13:55:21.955159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:21.955159+0000","last_undegraded":"2023-05-16T13:55:21.955159+0000","last_fullsized":"2023-05-16T13:55:21.955159+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.389480+0000","last_change":"2023-05-16T13:55:23.410465+0000","last_active":"2023-05-16T13:55:24.389480+0000","last_peered":"2023-05-16T13:55:24.389480+0000","last_clean":"2023-05-16T13:55:24.389480+0000","last_became_active":"2023-05-16T13:55:23.409929+0000","last_became_peered":"2023-05-16T13:55:23.409929+0000","last_unstale":"2023-05-16T13:55:24.389480+0000","last_undegraded":"2023-05-16T13:55:24.389480+0000","last_fullsized":"2023-05-16T13:55:24.389480+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T15:51:40.646591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703104+0000","last_change":"2023-05-16T13:55:23.004761+0000","last_active":"2023-05-16T13:55:24.703104+0000","last_peered":"2023-05-16T13:55:24.703104+0000","last_clean":"2023-05-16T13:55:24.703104+0000","last_became_active":"2023-05-16T13:55:23.004395+0000","last_became_peered":"2023-05-16T13:55:23.004395+0000","last_unstale":"2023-05-16T13:55:24.703104+0000","last_undegraded":"2023-05-16T13:55:24.703104+0000","last_fullsized":"2023-05-16T13:55:24.703104+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:35:41.923514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:21.955159+0000","last_change":"2023-05-16T13:55:21.955159+0000","last_active":"2023-05-16T13:55:21.955159+0000","last_peered":"2023-05-16T13:55:21.955159+0000","last_clean":"2023-05-16T13:55:21.955159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:21.955159+0000","last_undegraded":"2023-05-16T13:55:21.955159+0000","last_fullsized":"2023-05-16T13:55:21.955159+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702686+0000","last_change":"2023-05-16T13:55:23.410445+0000","last_active":"2023-05-16T13:55:24.702686+0000","last_peered":"2023-05-16T13:55:24.702686+0000","last_clean":"2023-05-16T13:55:24.702686+0000","last_became_active":"2023-05-16T13:55:23.408143+0000","last_became_peered":"2023-05-16T13:55:23.408143+0000","last_unstale":"2023-05-16T13:55:24.702686+0000","last_undegraded":"2023-05-16T13:55:24.702686+0000","last_fullsized":"2023-05-16T13:55:24.702686+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:21:33.903700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:21.955159+0000","last_change":"2023-05-16T13:55:21.955159+0000","last_active":"2023-05-16T13:55:21.955159+0000","last_peered":"2023-05-16T13:55:21.955159+0000","last_clean":"2023-05-16T13:55:21.955159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:21.955159+0000","last_undegraded":"2023-05-16T13:55:21.955159+0000","last_fullsized":"2023-05-16T13:55:21.955159+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":19,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703914+0000","last_change":"2023-05-16T13:55:23.010113+0000","last_active":"2023-05-16T13:55:24.703914+0000","last_peered":"2023-05-16T13:55:24.703914+0000","last_clean":"2023-05-16T13:55:24.703914+0000","last_became_active":"2023-05-16T13:55:23.007991+0000","last_became_peered":"2023-05-16T13:55:23.007991+0000","last_unstale":"2023-05-16T13:55:24.703914+0000","last_undegraded":"2023-05-16T13:55:24.703914+0000","last_fullsized":"2023-05-16T13:55:24.703914+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:09:25.013926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703468+0000","last_change":"2023-05-16T13:55:23.426171+0000","last_active":"2023-05-16T13:55:24.703468+0000","last_peered":"2023-05-16T13:55:24.703468+0000","last_clean":"2023-05-16T13:55:24.703468+0000","last_became_active":"2023-05-16T13:55:23.425887+0000","last_became_peered":"2023-05-16T13:55:23.425887+0000","last_unstale":"2023-05-16T13:55:24.703468+0000","last_undegraded":"2023-05-16T13:55:24.703468+0000","last_fullsized":"2023-05-16T13:55:24.703468+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:36:07.932696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.704044+0000","last_change":"2023-05-16T13:55:23.005180+0000","last_active":"2023-05-16T13:55:24.704044+0000","last_peered":"2023-05-16T13:55:24.704044+0000","last_clean":"2023-05-16T13:55:24.704044+0000","last_became_active":"2023-05-16T13:55:23.004744+0000","last_became_peered":"2023-05-16T13:55:23.004744+0000","last_unstale":"2023-05-16T13:55:24.704044+0000","last_undegraded":"2023-05-16T13:55:24.704044+0000","last_fullsized":"2023-05-16T13:55:24.704044+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:37:21.801714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703851+0000","last_change":"2023-05-16T13:55:23.412436+0000","last_active":"2023-05-16T13:55:24.703851+0000","last_peered":"2023-05-16T13:55:24.703851+0000","last_clean":"2023-05-16T13:55:24.703851+0000","last_became_active":"2023-05-16T13:55:23.412200+0000","last_became_peered":"2023-05-16T13:55:23.412200+0000","last_unstale":"2023-05-16T13:55:24.703851+0000","last_undegraded":"2023-05-16T13:55:24.703851+0000","last_fullsized":"2023-05-16T13:55:24.703851+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:37:14.267206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702898+0000","last_change":"2023-05-16T13:55:23.008139+0000","last_active":"2023-05-16T13:55:24.702898+0000","last_peered":"2023-05-16T13:55:24.702898+0000","last_clean":"2023-05-16T13:55:24.702898+0000","last_became_active":"2023-05-16T13:55:23.007732+0000","last_became_peered":"2023-05-16T13:55:23.007732+0000","last_unstale":"2023-05-16T13:55:24.702898+0000","last_undegraded":"2023-05-16T13:55:24.702898+0000","last_fullsized":"2023-05-16T13:55:24.702898+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T14:02:33.296373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:21.955159+0000","last_change":"2023-05-16T13:55:21.955159+0000","last_active":"2023-05-16T13:55:21.955159+0000","last_peered":"2023-05-16T13:55:21.955159+0000","last_clean":"2023-05-16T13:55:21.955159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:21.955159+0000","last_undegraded":"2023-05-16T13:55:21.955159+0000","last_fullsized":"2023-05-16T13:55:21.955159+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703975+0000","last_change":"2023-05-16T13:55:23.414195+0000","last_active":"2023-05-16T13:55:24.703975+0000","last_peered":"2023-05-16T13:55:24.703975+0000","last_clean":"2023-05-16T13:55:24.703975+0000","last_became_active":"2023-05-16T13:55:23.413751+0000","last_became_peered":"2023-05-16T13:55:23.413751+0000","last_unstale":"2023-05-16T13:55:24.703975+0000","last_undegraded":"2023-05-16T13:55:24.703975+0000","last_fullsized":"2023-05-16T13:55:24.703975+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T20:53:14.973983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:21.955159+0000","last_change":"2023-05-16T13:55:21.955159+0000","last_active":"2023-05-16T13:55:21.955159+0000","last_peered":"2023-05-16T13:55:21.955159+0000","last_clean":"2023-05-16T13:55:21.955159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:21.955159+0000","last_undegraded":"2023-05-16T13:55:21.955159+0000","last_fullsized":"2023-05-16T13:55:21.955159+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703817+0000","last_change":"2023-05-16T13:55:23.410961+0000","last_active":"2023-05-16T13:55:24.703817+0000","last_peered":"2023-05-16T13:55:24.703817+0000","last_clean":"2023-05-16T13:55:24.703817+0000","last_became_active":"2023-05-16T13:55:23.410710+0000","last_became_peered":"2023-05-16T13:55:23.410710+0000","last_unstale":"2023-05-16T13:55:24.703817+0000","last_undegraded":"2023-05-16T13:55:24.703817+0000","last_fullsized":"2023-05-16T13:55:24.703817+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:51:42.064641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:21.955159+0000","last_change":"2023-05-16T13:55:21.955159+0000","last_active":"2023-05-16T13:55:21.955159+0000","last_peered":"2023-05-16T13:55:21.955159+0000","last_clean":"2023-05-16T13:55:21.955159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:21.955159+0000","last_undegraded":"2023-05-16T13:55:21.955159+0000","last_fullsized":"2023-05-16T13:55:21.955159+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:21.955159+0000","last_change":"2023-05-16T13:55:21.955159+0000","last_active":"2023-05-16T13:55:21.955159+0000","last_peered":"2023-05-16T13:55:21.955159+0000","last_clean":"2023-05-16T13:55:21.955159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:21.955159+0000","last_undegraded":"2023-05-16T13:55:21.955159+0000","last_fullsized":"2023-05-16T13:55:21.955159+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.389555+0000","last_change":"2023-05-16T13:55:23.002334+0000","last_active":"2023-05-16T13:55:24.389555+0000","last_peered":"2023-05-16T13:55:24.389555+0000","last_clean":"2023-05-16T13:55:24.389555+0000","last_became_active":"2023-05-16T13:55:23.002060+0000","last_became_peered":"2023-05-16T13:55:23.002060+0000","last_unstale":"2023-05-16T13:55:24.389555+0000","last_undegraded":"2023-05-16T13:55:24.389555+0000","last_fullsized":"2023-05-16T13:55:24.389555+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:24:10.547224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.389340+0000","last_change":"2023-05-16T13:55:23.416259+0000","last_active":"2023-05-16T13:55:24.389340+0000","last_peered":"2023-05-16T13:55:24.389340+0000","last_clean":"2023-05-16T13:55:24.389340+0000","last_became_active":"2023-05-16T13:55:23.415983+0000","last_became_peered":"2023-05-16T13:55:23.415983+0000","last_unstale":"2023-05-16T13:55:24.389340+0000","last_undegraded":"2023-05-16T13:55:24.389340+0000","last_fullsized":"2023-05-16T13:55:24.389340+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:45:04.746418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703229+0000","last_change":"2023-05-16T13:55:23.003470+0000","last_active":"2023-05-16T13:55:24.703229+0000","last_peered":"2023-05-16T13:55:24.703229+0000","last_clean":"2023-05-16T13:55:24.703229+0000","last_became_active":"2023-05-16T13:55:23.003203+0000","last_became_peered":"2023-05-16T13:55:23.003203+0000","last_unstale":"2023-05-16T13:55:24.703229+0000","last_undegraded":"2023-05-16T13:55:24.703229+0000","last_fullsized":"2023-05-16T13:55:24.703229+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T20:23:26.619277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.389117+0000","last_change":"2023-05-16T13:55:23.005895+0000","last_active":"2023-05-16T13:55:24.389117+0000","last_peered":"2023-05-16T13:55:24.389117+0000","last_clean":"2023-05-16T13:55:24.389117+0000","last_became_active":"2023-05-16T13:55:23.005582+0000","last_became_peered":"2023-05-16T13:55:23.005582+0000","last_unstale":"2023-05-16T13:55:24.389117+0000","last_undegraded":"2023-05-16T13:55:24.389117+0000","last_fullsized":"2023-05-16T13:55:24.389117+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:21:37.712743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703434+0000","last_change":"2023-05-16T13:55:23.411672+0000","last_active":"2023-05-16T13:55:24.703434+0000","last_peered":"2023-05-16T13:55:24.703434+0000","last_clean":"2023-05-16T13:55:24.703434+0000","last_became_active":"2023-05-16T13:55:23.408317+0000","last_became_peered":"2023-05-16T13:55:23.408317+0000","last_unstale":"2023-05-16T13:55:24.703434+0000","last_undegraded":"2023-05-16T13:55:24.703434+0000","last_fullsized":"2023-05-16T13:55:24.703434+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:24:27.841261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.389190+0000","last_change":"2023-05-16T13:55:23.001075+0000","last_active":"2023-05-16T13:55:24.389190+0000","last_peered":"2023-05-16T13:55:24.389190+0000","last_clean":"2023-05-16T13:55:24.389190+0000","last_became_active":"2023-05-16T13:55:23.000764+0000","last_became_peered":"2023-05-16T13:55:23.000764+0000","last_unstale":"2023-05-16T13:55:24.389190+0000","last_undegraded":"2023-05-16T13:55:24.389190+0000","last_fullsized":"2023-05-16T13:55:24.389190+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:25:15.075534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:21.955159+0000","last_change":"2023-05-16T13:55:21.955159+0000","last_active":"2023-05-16T13:55:21.955159+0000","last_peered":"2023-05-16T13:55:21.955159+0000","last_clean":"2023-05-16T13:55:21.955159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:21.955159+0000","last_undegraded":"2023-05-16T13:55:21.955159+0000","last_fullsized":"2023-05-16T13:55:21.955159+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.704066+0000","last_change":"2023-05-16T13:55:23.408380+0000","last_active":"2023-05-16T13:55:24.704066+0000","last_peered":"2023-05-16T13:55:24.704066+0000","last_clean":"2023-05-16T13:55:24.704066+0000","last_became_active":"2023-05-16T13:55:23.408097+0000","last_became_peered":"2023-05-16T13:55:23.408097+0000","last_unstale":"2023-05-16T13:55:24.704066+0000","last_undegraded":"2023-05-16T13:55:24.704066+0000","last_fullsized":"2023-05-16T13:55:24.704066+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T23:46:15.133417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.389006+0000","last_change":"2023-05-16T13:55:23.006029+0000","last_active":"2023-05-16T13:55:24.389006+0000","last_peered":"2023-05-16T13:55:24.389006+0000","last_clean":"2023-05-16T13:55:24.389006+0000","last_became_active":"2023-05-16T13:55:23.005646+0000","last_became_peered":"2023-05-16T13:55:23.005646+0000","last_unstale":"2023-05-16T13:55:24.389006+0000","last_undegraded":"2023-05-16T13:55:24.389006+0000","last_fullsized":"2023-05-16T13:55:24.389006+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:49:42.765347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:21.955159+0000","last_change":"2023-05-16T13:55:21.955159+0000","last_active":"2023-05-16T13:55:21.955159+0000","last_peered":"2023-05-16T13:55:21.955159+0000","last_clean":"2023-05-16T13:55:21.955159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:21.955159+0000","last_undegraded":"2023-05-16T13:55:21.955159+0000","last_fullsized":"2023-05-16T13:55:21.955159+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":191,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-16T13:55:18.046790+0000","last_change":"2023-05-16T13:54:03.495814+0000","last_active":"2023-05-16T13:55:18.046790+0000","last_peered":"2023-05-16T13:55:18.046790+0000","last_clean":"2023-05-16T13:55:18.046790+0000","last_became_active":"2023-05-16T13:54:03.494265+0000","last_became_peered":"2023-05-16T13:54:03.494265+0000","last_unstale":"2023-05-16T13:55:18.046790+0000","last_undegraded":"2023-05-16T13:55:18.046790+0000","last_fullsized":"2023-05-16T13:55:18.046790+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:01.722051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:01.722051+0000","last_clean_scrub_stamp":"2023-05-16T13:54:01.722051+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:30:50.824134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-16T13:55:18.872199+0000","last_change":"2023-05-16T13:54:09.770727+0000","last_active":"2023-05-16T13:55:18.872199+0000","last_peered":"2023-05-16T13:55:18.872199+0000","last_clean":"2023-05-16T13:55:18.872199+0000","last_became_active":"2023-05-16T13:54:09.770179+0000","last_became_peered":"2023-05-16T13:54:09.770179+0000","last_unstale":"2023-05-16T13:55:18.872199+0000","last_undegraded":"2023-05-16T13:55:18.872199+0000","last_fullsized":"2023-05-16T13:55:18.872199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T13:54:42.241552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703107+0000","last_change":"2023-05-16T13:55:23.424350+0000","last_active":"2023-05-16T13:55:24.703107+0000","last_peered":"2023-05-16T13:55:24.703107+0000","last_clean":"2023-05-16T13:55:24.703107+0000","last_became_active":"2023-05-16T13:55:23.424033+0000","last_became_peered":"2023-05-16T13:55:23.424033+0000","last_unstale":"2023-05-16T13:55:24.703107+0000","last_undegraded":"2023-05-16T13:55:24.703107+0000","last_fullsized":"2023-05-16T13:55:24.703107+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T23:52:16.681043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:21.955159+0000","last_change":"2023-05-16T13:55:21.955159+0000","last_active":"2023-05-16T13:55:21.955159+0000","last_peered":"2023-05-16T13:55:21.955159+0000","last_clean":"2023-05-16T13:55:21.955159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:21.955159+0000","last_undegraded":"2023-05-16T13:55:21.955159+0000","last_fullsized":"2023-05-16T13:55:21.955159+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-16T13:55:18.046793+0000","last_change":"2023-05-16T13:54:09.768888+0000","last_active":"2023-05-16T13:55:18.046793+0000","last_peered":"2023-05-16T13:55:18.046793+0000","last_clean":"2023-05-16T13:55:18.046793+0000","last_became_active":"2023-05-16T13:54:09.768463+0000","last_became_peered":"2023-05-16T13:54:09.768463+0000","last_unstale":"2023-05-16T13:55:18.046793+0000","last_undegraded":"2023-05-16T13:55:18.046793+0000","last_fullsized":"2023-05-16T13:55:18.046793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T14:50:54.235998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.389284+0000","last_change":"2023-05-16T13:55:23.009854+0000","last_active":"2023-05-16T13:55:24.389284+0000","last_peered":"2023-05-16T13:55:24.389284+0000","last_clean":"2023-05-16T13:55:24.389284+0000","last_became_active":"2023-05-16T13:55:23.009546+0000","last_became_peered":"2023-05-16T13:55:23.009546+0000","last_unstale":"2023-05-16T13:55:24.389284+0000","last_undegraded":"2023-05-16T13:55:24.389284+0000","last_fullsized":"2023-05-16T13:55:24.389284+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T18:09:26.341219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.388996+0000","last_change":"2023-05-16T13:54:09.821010+0000","last_active":"2023-05-16T13:55:24.388996+0000","last_peered":"2023-05-16T13:55:24.388996+0000","last_clean":"2023-05-16T13:55:24.388996+0000","last_became_active":"2023-05-16T13:54:09.820636+0000","last_became_peered":"2023-05-16T13:54:09.820636+0000","last_unstale":"2023-05-16T13:55:24.388996+0000","last_undegraded":"2023-05-16T13:55:24.388996+0000","last_fullsized":"2023-05-16T13:55:24.388996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T16:40:06.160431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703115+0000","last_change":"2023-05-16T13:55:23.407818+0000","last_active":"2023-05-16T13:55:24.703115+0000","last_peered":"2023-05-16T13:55:24.703115+0000","last_clean":"2023-05-16T13:55:24.703115+0000","last_became_active":"2023-05-16T13:55:23.407568+0000","last_became_peered":"2023-05-16T13:55:23.407568+0000","last_unstale":"2023-05-16T13:55:24.703115+0000","last_undegraded":"2023-05-16T13:55:24.703115+0000","last_fullsized":"2023-05-16T13:55:24.703115+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:04:23.740266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702701+0000","last_change":"2023-05-16T13:55:23.003233+0000","last_active":"2023-05-16T13:55:24.702701+0000","last_peered":"2023-05-16T13:55:24.702701+0000","last_clean":"2023-05-16T13:55:24.702701+0000","last_became_active":"2023-05-16T13:55:23.002924+0000","last_became_peered":"2023-05-16T13:55:23.002924+0000","last_unstale":"2023-05-16T13:55:24.702701+0000","last_undegraded":"2023-05-16T13:55:24.702701+0000","last_fullsized":"2023-05-16T13:55:24.702701+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T16:42:10.128117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-16T13:55:18.872215+0000","last_change":"2023-05-16T13:54:09.771040+0000","last_active":"2023-05-16T13:55:18.872215+0000","last_peered":"2023-05-16T13:55:18.872215+0000","last_clean":"2023-05-16T13:55:18.872215+0000","last_became_active":"2023-05-16T13:54:09.770433+0000","last_became_peered":"2023-05-16T13:54:09.770433+0000","last_unstale":"2023-05-16T13:55:18.872215+0000","last_undegraded":"2023-05-16T13:55:18.872215+0000","last_fullsized":"2023-05-16T13:55:18.872215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T23:45:06.073649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703572+0000","last_change":"2023-05-16T13:55:23.412124+0000","last_active":"2023-05-16T13:55:24.703572+0000","last_peered":"2023-05-16T13:55:24.703572+0000","last_clean":"2023-05-16T13:55:24.703572+0000","last_became_active":"2023-05-16T13:55:23.411824+0000","last_became_peered":"2023-05-16T13:55:23.411824+0000","last_unstale":"2023-05-16T13:55:24.703572+0000","last_undegraded":"2023-05-16T13:55:24.703572+0000","last_fullsized":"2023-05-16T13:55:24.703572+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:42:50.808847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.704046+0000","last_change":"2023-05-16T13:55:22.999434+0000","last_active":"2023-05-16T13:55:24.704046+0000","last_peered":"2023-05-16T13:55:24.704046+0000","last_clean":"2023-05-16T13:55:24.704046+0000","last_became_active":"2023-05-16T13:55:22.999152+0000","last_became_peered":"2023-05-16T13:55:22.999152+0000","last_unstale":"2023-05-16T13:55:24.704046+0000","last_undegraded":"2023-05-16T13:55:24.704046+0000","last_fullsized":"2023-05-16T13:55:24.704046+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T14:02:33.296373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703306+0000","last_change":"2023-05-16T13:54:09.813177+0000","last_active":"2023-05-16T13:55:24.703306+0000","last_peered":"2023-05-16T13:55:24.703306+0000","last_clean":"2023-05-16T13:55:24.703306+0000","last_became_active":"2023-05-16T13:54:09.812487+0000","last_became_peered":"2023-05-16T13:54:09.812487+0000","last_unstale":"2023-05-16T13:55:24.703306+0000","last_undegraded":"2023-05-16T13:55:24.703306+0000","last_fullsized":"2023-05-16T13:55:24.703306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T23:57:49.146859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702519+0000","last_change":"2023-05-16T13:55:23.410758+0000","last_active":"2023-05-16T13:55:24.702519+0000","last_peered":"2023-05-16T13:55:24.702519+0000","last_clean":"2023-05-16T13:55:24.702519+0000","last_became_active":"2023-05-16T13:55:23.410389+0000","last_became_peered":"2023-05-16T13:55:23.410389+0000","last_unstale":"2023-05-16T13:55:24.702519+0000","last_undegraded":"2023-05-16T13:55:24.702519+0000","last_fullsized":"2023-05-16T13:55:24.702519+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:36:07.932696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:21.955159+0000","last_change":"2023-05-16T13:55:21.955159+0000","last_active":"2023-05-16T13:55:21.955159+0000","last_peered":"2023-05-16T13:55:21.955159+0000","last_clean":"2023-05-16T13:55:21.955159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:21.955159+0000","last_undegraded":"2023-05-16T13:55:21.955159+0000","last_fullsized":"2023-05-16T13:55:21.955159+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-16T13:55:18.046828+0000","last_change":"2023-05-16T13:54:09.813305+0000","last_active":"2023-05-16T13:55:18.046828+0000","last_peered":"2023-05-16T13:55:18.046828+0000","last_clean":"2023-05-16T13:55:18.046828+0000","last_became_active":"2023-05-16T13:54:09.812931+0000","last_became_peered":"2023-05-16T13:54:09.812931+0000","last_unstale":"2023-05-16T13:55:18.046828+0000","last_undegraded":"2023-05-16T13:55:18.046828+0000","last_fullsized":"2023-05-16T13:55:18.046828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:38:10.685762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:21.955159+0000","last_change":"2023-05-16T13:55:21.955159+0000","last_active":"2023-05-16T13:55:21.955159+0000","last_peered":"2023-05-16T13:55:21.955159+0000","last_clean":"2023-05-16T13:55:21.955159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:21.955159+0000","last_undegraded":"2023-05-16T13:55:21.955159+0000","last_fullsized":"2023-05-16T13:55:21.955159+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703646+0000","last_change":"2023-05-16T13:54:09.768257+0000","last_active":"2023-05-16T13:55:24.703646+0000","last_peered":"2023-05-16T13:55:24.703646+0000","last_clean":"2023-05-16T13:55:24.703646+0000","last_became_active":"2023-05-16T13:54:09.767879+0000","last_became_peered":"2023-05-16T13:54:09.767879+0000","last_unstale":"2023-05-16T13:55:24.703646+0000","last_undegraded":"2023-05-16T13:55:24.703646+0000","last_fullsized":"2023-05-16T13:55:24.703646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:59:08.711793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702984+0000","last_change":"2023-05-16T13:55:22.998169+0000","last_active":"2023-05-16T13:55:24.702984+0000","last_peered":"2023-05-16T13:55:24.702984+0000","last_clean":"2023-05-16T13:55:24.702984+0000","last_became_active":"2023-05-16T13:55:22.997892+0000","last_became_peered":"2023-05-16T13:55:22.997892+0000","last_unstale":"2023-05-16T13:55:24.702984+0000","last_undegraded":"2023-05-16T13:55:24.702984+0000","last_fullsized":"2023-05-16T13:55:24.702984+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:03:49.235876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-16T13:55:17.163014+0000","last_change":"2023-05-16T13:54:09.768603+0000","last_active":"2023-05-16T13:55:17.163014+0000","last_peered":"2023-05-16T13:55:17.163014+0000","last_clean":"2023-05-16T13:55:17.163014+0000","last_became_active":"2023-05-16T13:54:09.768323+0000","last_became_peered":"2023-05-16T13:54:09.768323+0000","last_unstale":"2023-05-16T13:55:17.163014+0000","last_undegraded":"2023-05-16T13:55:17.163014+0000","last_fullsized":"2023-05-16T13:55:17.163014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:53:25.367588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":60,"acting":60,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1668,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14,"ondisk_log_size":14,"up":32,"acting":32,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509459,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13500,"kb_used_data":948,"kb_used_omap":0,"kb_used_meta":12544,"kb_avail":94358340,"statfs":{"total":96636764160,"available":96622940160,"internally_reserved":0,"allocated":970752,"data_stored":740828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12845056},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue May 16 13:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.59599999999999997}]},{"osd":1,"last update":"Tue May 16 13:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.64500000000000002}]},{"osd":2,"last update":"Tue May 16 13:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.62}]},{"osd":3,"last update":"Tue May 16 13:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.76600000000000001}]},{"osd":4,"last update":"Tue May 16 13:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":1.0469999999999999}]},{"osd":5,"last update":"Tue May 16 13:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":1.1020000000000001}]},{"osd":6,"last update":"Tue May 16 13:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":1.1859999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":1.167}]}]},{"osd":6,"up_from":15,"seq":64424509458,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12344,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":11968,"kb_avail":94359496,"statfs":{"total":96636764160,"available":96624123904,"internally_reserved":0,"allocated":376832,"data_stored":150460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12255232},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.68999999999999995}]},{"osd":1,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.61299999999999999}]},{"osd":2,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.67100000000000004}]},{"osd":3,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.72499999999999998}]},{"osd":4,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.70999999999999996}]},{"osd":5,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.58899999999999997}]},{"osd":7,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.747}]}]},{"osd":5,"up_from":15,"seq":64424509459,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12344,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":11968,"kb_avail":94359496,"statfs":{"total":96636764160,"available":96624123904,"internally_reserved":0,"allocated":376832,"data_stored":150460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12255232},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue May 16 13:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.63}]},{"osd":1,"last update":"Tue May 16 13:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":0.495},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.77900000000000003}]},{"osd":2,"last update":"Tue May 16 13:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.80500000000000005}]},{"osd":3,"last update":"Tue May 16 13:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.59299999999999997}]},{"osd":4,"last update":"Tue May 16 13:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.67600000000000005}]},{"osd":6,"last update":"Tue May 16 13:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.82599999999999996}]},{"osd":7,"last update":"Tue May 16 13:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.65600000000000003}]}]},{"osd":4,"up_from":15,"seq":64424509459,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":12472,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":12096,"kb_avail":94359368,"statfs":{"total":96636764160,"available":96623992832,"internally_reserved":0,"allocated":376832,"data_stored":150460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12386304},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.56399999999999995}]},{"osd":1,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.61899999999999999}]},{"osd":2,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.58399999999999996}]},{"osd":3,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.64200000000000002}]},{"osd":5,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.59899999999999998}]},{"osd":6,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.745}]},{"osd":7,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.79100000000000004}]}]},{"osd":3,"up_from":14,"seq":60129542164,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12664,"kb_used_data":432,"kb_used_omap":0,"kb_used_meta":12224,"kb_avail":94359176,"statfs":{"total":96636764160,"available":96623796224,"internally_reserved":0,"allocated":442368,"data_stored":178637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12517376},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.41599999999999998}]},{"osd":1,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.432}]},{"osd":2,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.36099999999999999}]},{"osd":4,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":0.79600000000000004}]},{"osd":5,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.631,"5min":1.631,"15min":1.631},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.72199999999999998}]},{"osd":6,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.753}]},{"osd":7,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.80500000000000005}]}]},{"osd":2,"up_from":14,"seq":60129542164,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12524,"kb_used_data":420,"kb_used_omap":0,"kb_used_meta":12096,"kb_avail":94359316,"statfs":{"total":96636764160,"available":96623939584,"internally_reserved":0,"allocated":430080,"data_stored":177109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12386304},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue May 16 13:55:01 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.48599999999999999}]},{"osd":1,"last update":"Tue May 16 13:55:01 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.54900000000000004}]},{"osd":3,"last update":"Tue May 16 13:55:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.50600000000000001}]},{"osd":4,"last update":"Tue May 16 13:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.85899999999999999}]},{"osd":5,"last update":"Tue May 16 13:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.81799999999999995}]},{"osd":6,"last update":"Tue May 16 13:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.83899999999999997}]},{"osd":7,"last update":"Tue May 16 13:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.89300000000000002}]}]},{"osd":1,"up_from":14,"seq":60129542163,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12588,"kb_used_data":420,"kb_used_omap":0,"kb_used_meta":12160,"kb_avail":94359252,"statfs":{"total":96636764160,"available":96623874048,"internally_reserved":0,"allocated":430080,"data_stored":177129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12451840},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.311},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.46999999999999997}]},{"osd":2,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.373},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.48399999999999999}]},{"osd":3,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.441}]},{"osd":4,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.59499999999999997}]},{"osd":5,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.69699999999999995}]},{"osd":6,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.67900000000000005}]},{"osd":7,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.67100000000000004}]}]},{"osd":0,"up_from":14,"seq":60129542164,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13680,"kb_used_data":1000,"kb_used_omap":0,"kb_used_meta":12672,"kb_avail":94358160,"statfs":{"total":96636764160,"available":96622755840,"internally_reserved":0,"allocated":1024000,"data_stored":767441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12976128},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue May 16 13:55:03 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.42199999999999999}]},{"osd":2,"last update":"Tue May 16 13:55:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.497},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.53900000000000003}]},{"osd":3,"last update":"Tue May 16 13:55:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.51100000000000001}]},{"osd":4,"last update":"Tue May 16 13:55:03 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.66800000000000004}]},{"osd":5,"last update":"Tue May 16 13:55:03 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":2.2639999999999998,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.77300000000000002}]},{"osd":6,"last update":"Tue May 16 13:55:03 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":2.3380000000000001,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":0.753},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.70699999999999996}]},{"osd":7,"last update":"Tue May 16 13:55:03 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":2.403,"5min":2.403,"15min":2.403},"last":0.80900000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-16T13:55:27.478 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-16T13:55:27.649 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.639+0000 7fbb29c74640 1 Processor -- start 2023-05-16T13:55:27.649 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.643+0000 7fbb29c74640 1 -- start start 2023-05-16T13:55:27.650 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.643+0000 7fbb29c74640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb24071b00 0x7fbb2406fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:27.650 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.643+0000 7fbb29c74640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb240cf0e0 con 0x7fbb240ced10 2023-05-16T13:55:27.650 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.643+0000 7fbb29c74640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb240c89f0 con 0x7fbb240c9cb0 2023-05-16T13:55:27.650 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.643+0000 7fbb29c74640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb240c8c40 con 0x7fbb24071b00 2023-05-16T13:55:27.650 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.643+0000 7fbb237fe640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fbb240ced10 0x7fbb240713f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:35096/0 (socket says 172.21.15.39:35096) 2023-05-16T13:55:27.651 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.643+0000 7fbb237fe640 1 -- 172.21.15.39:0/2308907561 learned_addr learned my addr 172.21.15.39:0/2308907561 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:55:27.652 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.643+0000 7fbb227fc640 1 -- 172.21.15.39:0/2308907561 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2177964575 0 0) 0x7fbb14001120 con 0x7fbb240ced10 2023-05-16T13:55:27.652 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.643+0000 7fbb227fc640 1 -- 172.21.15.39:0/2308907561 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb0c003530 con 0x7fbb240ced10 2023-05-16T13:55:27.652 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.643+0000 7fbb23fff640 1 --2- 172.21.15.39:0/2308907561 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb24071b00 0x7fbb2406fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:27.652 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.643+0000 7fbb227fc640 1 -- 172.21.15.39:0/2308907561 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3821220890 0 0) 0x7fbb0c003530 con 0x7fbb240ced10 2023-05-16T13:55:27.653 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.643+0000 7fbb227fc640 1 -- 172.21.15.39:0/2308907561 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb24071b00 msgr2=0x7fbb2406fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:27.653 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.643+0000 7fbb227fc640 1 --2- 172.21.15.39:0/2308907561 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb24071b00 0x7fbb2406fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:27.653 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.643+0000 7fbb227fc640 1 -- 172.21.15.39:0/2308907561 >> v1:172.21.15.118:6789/0 conn(0x7fbb240c9cb0 legacy=0x7fbb240ca290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:27.653 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.643+0000 7fbb227fc640 1 -- 172.21.15.39:0/2308907561 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb240c8f20 con 0x7fbb240ced10 2023-05-16T13:55:27.653 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.643+0000 7fbb227fc640 1 -- 172.21.15.39:0/2308907561 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1738805496 0 0) 0x7fbb14001810 con 0x7fbb240ced10 2023-05-16T13:55:27.653 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.643+0000 7fbb227fc640 1 -- 172.21.15.39:0/2308907561 >> v1:172.21.15.39:6789/0 conn(0x7fbb240ced10 legacy=0x7fbb240713f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:27.653 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.643+0000 7fbb227fc640 1 --2- 172.21.15.39:0/2308907561 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb0c003a20 0x7fbb0c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:27.654 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.643+0000 7fbb227fc640 1 --2- 172.21.15.39:0/2308907561 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb0c0047d0 0x7fbb0c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:27.654 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.643+0000 7fbb227fc640 1 --2- 172.21.15.39:0/2308907561 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb0c0052a0 0x7fbb0c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:27.654 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.643+0000 7fbb227fc640 1 -- 172.21.15.39:0/2308907561 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb240c8c40 con 0x7fbb0c003a20 2023-05-16T13:55:27.654 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.643+0000 7fbb227fc640 1 -- 172.21.15.39:0/2308907561 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0c00c130 con 0x7fbb0c0052a0 2023-05-16T13:55:27.654 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.643+0000 7fbb227fc640 1 -- 172.21.15.39:0/2308907561 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0c00c2f0 con 0x7fbb0c0047d0 2023-05-16T13:55:27.654 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.643+0000 7fbb23fff640 1 --2- 172.21.15.39:0/2308907561 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb24071b00 0x7fbb2406fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:55:27.654 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.643+0000 7fbb237fe640 1 --2- 172.21.15.39:0/2308907561 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb0c003a20 0x7fbb0c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:27.654 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.643+0000 7fbb22ffd640 1 --2- 172.21.15.39:0/2308907561 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb0c0047d0 0x7fbb0c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:27.655 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.643+0000 7fbb23fff640 1 --2- 172.21.15.39:0/2308907561 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb0c0052a0 0x7fbb0c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:27.655 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.643+0000 7fbb237fe640 1 -- 172.21.15.39:0/2308907561 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb0c0047d0 msgr2=0x7fbb0c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:27.655 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.643+0000 7fbb237fe640 1 --2- 172.21.15.39:0/2308907561 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb0c0047d0 0x7fbb0c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:27.655 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.643+0000 7fbb237fe640 1 -- 172.21.15.39:0/2308907561 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb0c0052a0 msgr2=0x7fbb0c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:27.655 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.643+0000 7fbb237fe640 1 --2- 172.21.15.39:0/2308907561 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb0c0052a0 0x7fbb0c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:27.655 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.643+0000 7fbb237fe640 1 -- 172.21.15.39:0/2308907561 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb0c003530 con 0x7fbb0c003a20 2023-05-16T13:55:27.656 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.647+0000 7fbb237fe640 1 --2- 172.21.15.39:0/2308907561 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb0c003a20 0x7fbb0c003e30 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fbb1400c240 tx=0x7fbb1401cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a82894975fca897 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:27.656 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.647+0000 7fbb227fc640 1 -- 172.21.15.39:0/2308907561 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb140a5b10 con 0x7fbb0c003a20 2023-05-16T13:55:27.656 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.647+0000 7fbb227fc640 1 -- 172.21.15.39:0/2308907561 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb140a5c90 con 0x7fbb0c003a20 2023-05-16T13:55:27.657 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.647+0000 7fbb227fc640 1 -- 172.21.15.39:0/2308907561 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb140058e0 con 0x7fbb0c003a20 2023-05-16T13:55:27.657 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.647+0000 7fbb29c74640 1 -- 172.21.15.39:0/2308907561 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb0c003a20 msgr2=0x7fbb0c003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:27.657 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.647+0000 7fbb29c74640 1 --2- 172.21.15.39:0/2308907561 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb0c003a20 0x7fbb0c003e30 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fbb1400c240 tx=0x7fbb1401cc10 comp rx=0 tx=0).stop 2023-05-16T13:55:27.657 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.647+0000 7fbb23fff640 1 -- 172.21.15.39:0/2308907561 reap_dead start 2023-05-16T13:55:27.657 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.647+0000 7fbb29c74640 1 -- 172.21.15.39:0/2308907561 shutdown_connections 2023-05-16T13:55:27.657 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.647+0000 7fbb29c74640 1 -- 172.21.15.39:0/2308907561 >> 172.21.15.39:0/2308907561 conn(0x7fbb24069a50 msgr2=0x7fbb24069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:27.657 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.647+0000 7fbb29c74640 1 -- 172.21.15.39:0/2308907561 shutdown_connections 2023-05-16T13:55:27.657 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.647+0000 7fbb29c74640 1 -- 172.21.15.39:0/2308907561 wait complete. 2023-05-16T13:55:27.659 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.651+0000 7fbb29c74640 1 Processor -- start 2023-05-16T13:55:27.659 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.651+0000 7fbb29c74640 1 -- start start 2023-05-16T13:55:27.659 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.651+0000 7fbb29c74640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb0c003a20 0x7fbb24154bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:27.659 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.651+0000 7fbb29c74640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb241f5a30 0x7fbb240b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:27.660 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.651+0000 7fbb29c74640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb241f5e80 0x7fbb240b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:27.660 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.651+0000 7fbb29c74640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2415ce70 con 0x7fbb241f5a30 2023-05-16T13:55:27.660 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.651+0000 7fbb29c74640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb241550f0 con 0x7fbb0c003a20 2023-05-16T13:55:27.660 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.651+0000 7fbb29c74640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb241f54a0 con 0x7fbb241f5e80 2023-05-16T13:55:27.660 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.651+0000 7fbb22ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb241f5a30 0x7fbb240b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:27.660 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.651+0000 7fbb22ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb241f5a30 0x7fbb240b18d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44514/0 (socket says 172.21.15.39:44514) 2023-05-16T13:55:27.660 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.651+0000 7fbb22ffd640 1 -- 172.21.15.39:0/4229423575 learned_addr learned my addr 172.21.15.39:0/4229423575 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:27.661 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.651+0000 7fbb237fe640 1 --2- 172.21.15.39:0/4229423575 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb0c003a20 0x7fbb24154bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:27.661 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.651+0000 7fbb23fff640 1 --2- 172.21.15.39:0/4229423575 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb241f5e80 0x7fbb240b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:27.661 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.651+0000 7fbb22ffd640 1 -- 172.21.15.39:0/4229423575 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb241f5e80 msgr2=0x7fbb240b1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:27.661 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.651+0000 7fbb22ffd640 1 --2- 172.21.15.39:0/4229423575 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb241f5e80 0x7fbb240b1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:27.661 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.651+0000 7fbb22ffd640 1 -- 172.21.15.39:0/4229423575 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb0c003a20 msgr2=0x7fbb24154bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:27.661 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.651+0000 7fbb22ffd640 1 --2- 172.21.15.39:0/4229423575 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb0c003a20 0x7fbb24154bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:27.661 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.651+0000 7fbb22ffd640 1 -- 172.21.15.39:0/4229423575 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb240b42f0 con 0x7fbb241f5a30 2023-05-16T13:55:27.661 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.651+0000 7fbb23fff640 1 --2- 172.21.15.39:0/4229423575 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb241f5e80 0x7fbb240b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-16T13:55:27.662 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.651+0000 7fbb22ffd640 1 --2- 172.21.15.39:0/4229423575 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb241f5a30 0x7fbb240b18d0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fbb1800e550 tx=0x7fbb1800ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:27.662 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.651+0000 7fbb0bfff640 1 -- 172.21.15.39:0/4229423575 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb180052e0 con 0x7fbb241f5a30 2023-05-16T13:55:27.662 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.651+0000 7fbb0bfff640 1 -- 172.21.15.39:0/4229423575 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb18005440 con 0x7fbb241f5a30 2023-05-16T13:55:27.662 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.651+0000 7fbb0bfff640 1 -- 172.21.15.39:0/4229423575 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb18003820 con 0x7fbb241f5a30 2023-05-16T13:55:27.662 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.651+0000 7fbb29c74640 1 -- 172.21.15.39:0/4229423575 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb240c97c0 con 0x7fbb241f5a30 2023-05-16T13:55:27.663 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.651+0000 7fbb29c74640 1 -- 172.21.15.39:0/4229423575 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb240cb1b0 con 0x7fbb241f5a30 2023-05-16T13:55:27.663 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.651+0000 7fbb29c74640 1 -- 172.21.15.39:0/4229423575 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb24073c90 con 0x7fbb241f5a30 2023-05-16T13:55:27.663 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.655+0000 7fbb0bfff640 1 -- 172.21.15.39:0/4229423575 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbb18003980 con 0x7fbb241f5a30 2023-05-16T13:55:27.663 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.655+0000 7fbb0bfff640 1 --2- 172.21.15.39:0/4229423575 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fbb100662b0 0x7fbb10068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:27.664 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.655+0000 7fbb0bfff640 1 -- 172.21.15.39:0/4229423575 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbb18083bc0 con 0x7fbb241f5a30 2023-05-16T13:55:27.664 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.655+0000 7fbb237fe640 1 --2- 172.21.15.39:0/4229423575 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fbb100662b0 0x7fbb10068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:27.664 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.655+0000 7fbb237fe640 1 --2- 172.21.15.39:0/4229423575 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fbb100662b0 0x7fbb10068760 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fbb140ab000 tx=0x7fbb140a7070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:27.666 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.659+0000 7fbb0bfff640 1 -- 172.21.15.39:0/4229423575 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fbb18050fa0 con 0x7fbb241f5a30 2023-05-16T13:55:27.819 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.811+0000 7fbb29c74640 1 -- 172.21.15.39:0/4229423575 --> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbb2406c130 con 0x7fbb100662b0 2023-05-16T13:55:27.827 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.819+0000 7fbb0bfff640 1 -- 172.21.15.39:0/4229423575 <== mgr.4098 v2:172.21.15.39:6832/288296800 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+303850 (secure 0 0 0) 0x7fbb2406c130 con 0x7fbb100662b0 2023-05-16T13:55:27.830 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:55:27.831 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2023-05-16T13:55:27.832 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.823+0000 7fbb29c74640 1 -- 172.21.15.39:0/4229423575 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fbb100662b0 msgr2=0x7fbb10068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:27.832 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.823+0000 7fbb29c74640 1 --2- 172.21.15.39:0/4229423575 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fbb100662b0 0x7fbb10068760 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fbb140ab000 tx=0x7fbb140a7070 comp rx=0 tx=0).stop 2023-05-16T13:55:27.833 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.823+0000 7fbb29c74640 1 -- 172.21.15.39:0/4229423575 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb241f5a30 msgr2=0x7fbb240b18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:27.833 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.823+0000 7fbb29c74640 1 --2- 172.21.15.39:0/4229423575 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb241f5a30 0x7fbb240b18d0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fbb1800e550 tx=0x7fbb1800ea10 comp rx=0 tx=0).stop 2023-05-16T13:55:27.833 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.823+0000 7fbb29c74640 1 -- 172.21.15.39:0/4229423575 shutdown_connections 2023-05-16T13:55:27.833 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.823+0000 7fbb29c74640 1 --2- 172.21.15.39:0/4229423575 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fbb100662b0 0x7fbb10068760 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:27.833 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.823+0000 7fbb29c74640 1 --2- 172.21.15.39:0/4229423575 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb241f5e80 0x7fbb240b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:27.833 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.823+0000 7fbb29c74640 1 --2- 172.21.15.39:0/4229423575 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb241f5a30 0x7fbb240b18d0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:27.833 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.823+0000 7fbb29c74640 1 --2- 172.21.15.39:0/4229423575 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb0c003a20 0x7fbb24154bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:27.833 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.823+0000 7fbb29c74640 1 -- 172.21.15.39:0/4229423575 >> 172.21.15.39:0/4229423575 conn(0x7fbb24069a50 msgr2=0x7fbb240cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:27.834 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.823+0000 7fbb29c74640 1 -- 172.21.15.39:0/4229423575 shutdown_connections 2023-05-16T13:55:27.834 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:27.823+0000 7fbb29c74640 1 -- 172.21.15.39:0/4229423575 wait complete. 2023-05-16T13:55:27.850 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":74,"stamp":"2023-05-16T13:55:26.843063+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592036,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":173,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":131,"ondisk_log_size":131,"up":110,"acting":110,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":108,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":102116,"kb_used_data":4324,"kb_used_omap":0,"kb_used_meta":97728,"kb_avail":754872604,"statfs":{"total":773094113280,"available":772989546496,"internally_reserved":0,"allocated":4427776,"data_stored":2492524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":100073472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1668,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.870588"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702986+0000","last_change":"2023-05-16T13:55:23.413635+0000","last_active":"2023-05-16T13:55:24.702986+0000","last_peered":"2023-05-16T13:55:24.702986+0000","last_clean":"2023-05-16T13:55:24.702986+0000","last_became_active":"2023-05-16T13:55:23.413319+0000","last_became_peered":"2023-05-16T13:55:23.413319+0000","last_unstale":"2023-05-16T13:55:24.702986+0000","last_undegraded":"2023-05-16T13:55:24.702986+0000","last_fullsized":"2023-05-16T13:55:24.702986+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:00:44.745581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702981+0000","last_change":"2023-05-16T13:55:23.420601+0000","last_active":"2023-05-16T13:55:24.702981+0000","last_peered":"2023-05-16T13:55:24.702981+0000","last_clean":"2023-05-16T13:55:24.702981+0000","last_became_active":"2023-05-16T13:55:23.420296+0000","last_became_peered":"2023-05-16T13:55:23.420296+0000","last_unstale":"2023-05-16T13:55:24.702981+0000","last_undegraded":"2023-05-16T13:55:24.702981+0000","last_fullsized":"2023-05-16T13:55:24.702981+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T14:28:21.055179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702832+0000","last_change":"2023-05-16T13:55:23.426167+0000","last_active":"2023-05-16T13:55:24.702832+0000","last_peered":"2023-05-16T13:55:24.702832+0000","last_clean":"2023-05-16T13:55:24.702832+0000","last_became_active":"2023-05-16T13:55:23.425898+0000","last_became_peered":"2023-05-16T13:55:23.425898+0000","last_unstale":"2023-05-16T13:55:24.702832+0000","last_undegraded":"2023-05-16T13:55:24.702832+0000","last_fullsized":"2023-05-16T13:55:24.702832+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T18:12:33.397086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.389344+0000","last_change":"2023-05-16T13:55:23.410640+0000","last_active":"2023-05-16T13:55:24.389344+0000","last_peered":"2023-05-16T13:55:24.389344+0000","last_clean":"2023-05-16T13:55:24.389344+0000","last_became_active":"2023-05-16T13:55:23.410201+0000","last_became_peered":"2023-05-16T13:55:23.410201+0000","last_unstale":"2023-05-16T13:55:24.389344+0000","last_undegraded":"2023-05-16T13:55:24.389344+0000","last_fullsized":"2023-05-16T13:55:24.389344+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T23:39:16.162625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.389118+0000","last_change":"2023-05-16T13:55:23.415688+0000","last_active":"2023-05-16T13:55:24.389118+0000","last_peered":"2023-05-16T13:55:24.389118+0000","last_clean":"2023-05-16T13:55:24.389118+0000","last_became_active":"2023-05-16T13:55:23.415428+0000","last_became_peered":"2023-05-16T13:55:23.415428+0000","last_unstale":"2023-05-16T13:55:24.389118+0000","last_undegraded":"2023-05-16T13:55:24.389118+0000","last_fullsized":"2023-05-16T13:55:24.389118+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T23:22:48.021414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702788+0000","last_change":"2023-05-16T13:55:23.411124+0000","last_active":"2023-05-16T13:55:24.702788+0000","last_peered":"2023-05-16T13:55:24.702788+0000","last_clean":"2023-05-16T13:55:24.702788+0000","last_became_active":"2023-05-16T13:55:23.410870+0000","last_became_peered":"2023-05-16T13:55:23.410870+0000","last_unstale":"2023-05-16T13:55:24.702788+0000","last_undegraded":"2023-05-16T13:55:24.702788+0000","last_fullsized":"2023-05-16T13:55:24.702788+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:20:17.612621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702869+0000","last_change":"2023-05-16T13:55:23.423785+0000","last_active":"2023-05-16T13:55:24.702869+0000","last_peered":"2023-05-16T13:55:24.702869+0000","last_clean":"2023-05-16T13:55:24.702869+0000","last_became_active":"2023-05-16T13:55:23.423521+0000","last_became_peered":"2023-05-16T13:55:23.423521+0000","last_unstale":"2023-05-16T13:55:24.702869+0000","last_undegraded":"2023-05-16T13:55:24.702869+0000","last_fullsized":"2023-05-16T13:55:24.702869+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:15:22.807920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703149+0000","last_change":"2023-05-16T13:55:23.426476+0000","last_active":"2023-05-16T13:55:24.703149+0000","last_peered":"2023-05-16T13:55:24.703149+0000","last_clean":"2023-05-16T13:55:24.703149+0000","last_became_active":"2023-05-16T13:55:23.426169+0000","last_became_peered":"2023-05-16T13:55:23.426169+0000","last_unstale":"2023-05-16T13:55:24.703149+0000","last_undegraded":"2023-05-16T13:55:24.703149+0000","last_fullsized":"2023-05-16T13:55:24.703149+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T15:01:43.692055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703603+0000","last_change":"2023-05-16T13:55:23.417357+0000","last_active":"2023-05-16T13:55:24.703603+0000","last_peered":"2023-05-16T13:55:24.703603+0000","last_clean":"2023-05-16T13:55:24.703603+0000","last_became_active":"2023-05-16T13:55:23.417040+0000","last_became_peered":"2023-05-16T13:55:23.417040+0000","last_unstale":"2023-05-16T13:55:24.703603+0000","last_undegraded":"2023-05-16T13:55:24.703603+0000","last_fullsized":"2023-05-16T13:55:24.703603+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:20:17.612621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.389374+0000","last_change":"2023-05-16T13:55:23.416396+0000","last_active":"2023-05-16T13:55:24.389374+0000","last_peered":"2023-05-16T13:55:24.389374+0000","last_clean":"2023-05-16T13:55:24.389374+0000","last_became_active":"2023-05-16T13:55:23.416171+0000","last_became_peered":"2023-05-16T13:55:23.416171+0000","last_unstale":"2023-05-16T13:55:24.389374+0000","last_undegraded":"2023-05-16T13:55:24.389374+0000","last_fullsized":"2023-05-16T13:55:24.389374+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:37:40.020154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.389007+0000","last_change":"2023-05-16T13:55:23.415714+0000","last_active":"2023-05-16T13:55:24.389007+0000","last_peered":"2023-05-16T13:55:24.389007+0000","last_clean":"2023-05-16T13:55:24.389007+0000","last_became_active":"2023-05-16T13:55:23.415365+0000","last_became_peered":"2023-05-16T13:55:23.415365+0000","last_unstale":"2023-05-16T13:55:24.389007+0000","last_undegraded":"2023-05-16T13:55:24.389007+0000","last_fullsized":"2023-05-16T13:55:24.389007+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:22:31.514634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703500+0000","last_change":"2023-05-16T13:55:23.424404+0000","last_active":"2023-05-16T13:55:24.703500+0000","last_peered":"2023-05-16T13:55:24.703500+0000","last_clean":"2023-05-16T13:55:24.703500+0000","last_became_active":"2023-05-16T13:55:23.424080+0000","last_became_peered":"2023-05-16T13:55:23.424080+0000","last_unstale":"2023-05-16T13:55:24.703500+0000","last_undegraded":"2023-05-16T13:55:24.703500+0000","last_fullsized":"2023-05-16T13:55:24.703500+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T23:50:36.996209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702518+0000","last_change":"2023-05-16T13:55:23.417343+0000","last_active":"2023-05-16T13:55:24.702518+0000","last_peered":"2023-05-16T13:55:24.702518+0000","last_clean":"2023-05-16T13:55:24.702518+0000","last_became_active":"2023-05-16T13:55:23.417084+0000","last_became_peered":"2023-05-16T13:55:23.417084+0000","last_unstale":"2023-05-16T13:55:24.702518+0000","last_undegraded":"2023-05-16T13:55:24.702518+0000","last_fullsized":"2023-05-16T13:55:24.702518+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:24:27.841261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:21.955159+0000","last_change":"2023-05-16T13:55:21.955159+0000","last_active":"2023-05-16T13:55:21.955159+0000","last_peered":"2023-05-16T13:55:21.955159+0000","last_clean":"2023-05-16T13:55:21.955159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:21.955159+0000","last_undegraded":"2023-05-16T13:55:21.955159+0000","last_fullsized":"2023-05-16T13:55:21.955159+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703219+0000","last_change":"2023-05-16T13:55:23.424419+0000","last_active":"2023-05-16T13:55:24.703219+0000","last_peered":"2023-05-16T13:55:24.703219+0000","last_clean":"2023-05-16T13:55:24.703219+0000","last_became_active":"2023-05-16T13:55:23.424144+0000","last_became_peered":"2023-05-16T13:55:23.424144+0000","last_unstale":"2023-05-16T13:55:24.703219+0000","last_undegraded":"2023-05-16T13:55:24.703219+0000","last_fullsized":"2023-05-16T13:55:24.703219+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T18:54:19.739155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702809+0000","last_change":"2023-05-16T13:55:23.004839+0000","last_active":"2023-05-16T13:55:24.702809+0000","last_peered":"2023-05-16T13:55:24.702809+0000","last_clean":"2023-05-16T13:55:24.702809+0000","last_became_active":"2023-05-16T13:55:23.004519+0000","last_became_peered":"2023-05-16T13:55:23.004519+0000","last_unstale":"2023-05-16T13:55:24.702809+0000","last_undegraded":"2023-05-16T13:55:24.702809+0000","last_fullsized":"2023-05-16T13:55:24.702809+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:42:58.481159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703544+0000","last_change":"2023-05-16T13:55:23.003518+0000","last_active":"2023-05-16T13:55:24.703544+0000","last_peered":"2023-05-16T13:55:24.703544+0000","last_clean":"2023-05-16T13:55:24.703544+0000","last_became_active":"2023-05-16T13:55:23.003263+0000","last_became_peered":"2023-05-16T13:55:23.003263+0000","last_unstale":"2023-05-16T13:55:24.703544+0000","last_undegraded":"2023-05-16T13:55:24.703544+0000","last_fullsized":"2023-05-16T13:55:24.703544+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T20:43:50.549191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702845+0000","last_change":"2023-05-16T13:55:23.409488+0000","last_active":"2023-05-16T13:55:24.702845+0000","last_peered":"2023-05-16T13:55:24.702845+0000","last_clean":"2023-05-16T13:55:24.702845+0000","last_became_active":"2023-05-16T13:55:23.409221+0000","last_became_peered":"2023-05-16T13:55:23.409221+0000","last_unstale":"2023-05-16T13:55:24.702845+0000","last_undegraded":"2023-05-16T13:55:24.702845+0000","last_fullsized":"2023-05-16T13:55:24.702845+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T23:37:20.052995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:21.955159+0000","last_change":"2023-05-16T13:55:21.955159+0000","last_active":"2023-05-16T13:55:21.955159+0000","last_peered":"2023-05-16T13:55:21.955159+0000","last_clean":"2023-05-16T13:55:21.955159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:21.955159+0000","last_undegraded":"2023-05-16T13:55:21.955159+0000","last_fullsized":"2023-05-16T13:55:21.955159+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703333+0000","last_change":"2023-05-16T13:55:23.410102+0000","last_active":"2023-05-16T13:55:24.703333+0000","last_peered":"2023-05-16T13:55:24.703333+0000","last_clean":"2023-05-16T13:55:24.703333+0000","last_became_active":"2023-05-16T13:55:23.409854+0000","last_became_peered":"2023-05-16T13:55:23.409854+0000","last_unstale":"2023-05-16T13:55:24.703333+0000","last_undegraded":"2023-05-16T13:55:24.703333+0000","last_fullsized":"2023-05-16T13:55:24.703333+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:39:33.113821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:21.955159+0000","last_change":"2023-05-16T13:55:21.955159+0000","last_active":"2023-05-16T13:55:21.955159+0000","last_peered":"2023-05-16T13:55:21.955159+0000","last_clean":"2023-05-16T13:55:21.955159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:21.955159+0000","last_undegraded":"2023-05-16T13:55:21.955159+0000","last_fullsized":"2023-05-16T13:55:21.955159+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:21.955159+0000","last_change":"2023-05-16T13:55:21.955159+0000","last_active":"2023-05-16T13:55:21.955159+0000","last_peered":"2023-05-16T13:55:21.955159+0000","last_clean":"2023-05-16T13:55:21.955159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:21.955159+0000","last_undegraded":"2023-05-16T13:55:21.955159+0000","last_fullsized":"2023-05-16T13:55:21.955159+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702652+0000","last_change":"2023-05-16T13:55:23.009273+0000","last_active":"2023-05-16T13:55:24.702652+0000","last_peered":"2023-05-16T13:55:24.702652+0000","last_clean":"2023-05-16T13:55:24.702652+0000","last_became_active":"2023-05-16T13:55:23.008332+0000","last_became_peered":"2023-05-16T13:55:23.008332+0000","last_unstale":"2023-05-16T13:55:24.702652+0000","last_undegraded":"2023-05-16T13:55:24.702652+0000","last_fullsized":"2023-05-16T13:55:24.702652+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:42:49.791420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703848+0000","last_change":"2023-05-16T13:55:23.414015+0000","last_active":"2023-05-16T13:55:24.703848+0000","last_peered":"2023-05-16T13:55:24.703848+0000","last_clean":"2023-05-16T13:55:24.703848+0000","last_became_active":"2023-05-16T13:55:23.413471+0000","last_became_peered":"2023-05-16T13:55:23.413471+0000","last_unstale":"2023-05-16T13:55:24.703848+0000","last_undegraded":"2023-05-16T13:55:24.703848+0000","last_fullsized":"2023-05-16T13:55:24.703848+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:45:55.863941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:21.955159+0000","last_change":"2023-05-16T13:55:21.955159+0000","last_active":"2023-05-16T13:55:21.955159+0000","last_peered":"2023-05-16T13:55:21.955159+0000","last_clean":"2023-05-16T13:55:21.955159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:21.955159+0000","last_undegraded":"2023-05-16T13:55:21.955159+0000","last_fullsized":"2023-05-16T13:55:21.955159+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.389480+0000","last_change":"2023-05-16T13:55:23.410465+0000","last_active":"2023-05-16T13:55:24.389480+0000","last_peered":"2023-05-16T13:55:24.389480+0000","last_clean":"2023-05-16T13:55:24.389480+0000","last_became_active":"2023-05-16T13:55:23.409929+0000","last_became_peered":"2023-05-16T13:55:23.409929+0000","last_unstale":"2023-05-16T13:55:24.389480+0000","last_undegraded":"2023-05-16T13:55:24.389480+0000","last_fullsized":"2023-05-16T13:55:24.389480+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T15:51:40.646591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703104+0000","last_change":"2023-05-16T13:55:23.004761+0000","last_active":"2023-05-16T13:55:24.703104+0000","last_peered":"2023-05-16T13:55:24.703104+0000","last_clean":"2023-05-16T13:55:24.703104+0000","last_became_active":"2023-05-16T13:55:23.004395+0000","last_became_peered":"2023-05-16T13:55:23.004395+0000","last_unstale":"2023-05-16T13:55:24.703104+0000","last_undegraded":"2023-05-16T13:55:24.703104+0000","last_fullsized":"2023-05-16T13:55:24.703104+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:35:41.923514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:21.955159+0000","last_change":"2023-05-16T13:55:21.955159+0000","last_active":"2023-05-16T13:55:21.955159+0000","last_peered":"2023-05-16T13:55:21.955159+0000","last_clean":"2023-05-16T13:55:21.955159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:21.955159+0000","last_undegraded":"2023-05-16T13:55:21.955159+0000","last_fullsized":"2023-05-16T13:55:21.955159+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702686+0000","last_change":"2023-05-16T13:55:23.410445+0000","last_active":"2023-05-16T13:55:24.702686+0000","last_peered":"2023-05-16T13:55:24.702686+0000","last_clean":"2023-05-16T13:55:24.702686+0000","last_became_active":"2023-05-16T13:55:23.408143+0000","last_became_peered":"2023-05-16T13:55:23.408143+0000","last_unstale":"2023-05-16T13:55:24.702686+0000","last_undegraded":"2023-05-16T13:55:24.702686+0000","last_fullsized":"2023-05-16T13:55:24.702686+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:21:33.903700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:21.955159+0000","last_change":"2023-05-16T13:55:21.955159+0000","last_active":"2023-05-16T13:55:21.955159+0000","last_peered":"2023-05-16T13:55:21.955159+0000","last_clean":"2023-05-16T13:55:21.955159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:21.955159+0000","last_undegraded":"2023-05-16T13:55:21.955159+0000","last_fullsized":"2023-05-16T13:55:21.955159+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":19,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703914+0000","last_change":"2023-05-16T13:55:23.010113+0000","last_active":"2023-05-16T13:55:24.703914+0000","last_peered":"2023-05-16T13:55:24.703914+0000","last_clean":"2023-05-16T13:55:24.703914+0000","last_became_active":"2023-05-16T13:55:23.007991+0000","last_became_peered":"2023-05-16T13:55:23.007991+0000","last_unstale":"2023-05-16T13:55:24.703914+0000","last_undegraded":"2023-05-16T13:55:24.703914+0000","last_fullsized":"2023-05-16T13:55:24.703914+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:09:25.013926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703468+0000","last_change":"2023-05-16T13:55:23.426171+0000","last_active":"2023-05-16T13:55:24.703468+0000","last_peered":"2023-05-16T13:55:24.703468+0000","last_clean":"2023-05-16T13:55:24.703468+0000","last_became_active":"2023-05-16T13:55:23.425887+0000","last_became_peered":"2023-05-16T13:55:23.425887+0000","last_unstale":"2023-05-16T13:55:24.703468+0000","last_undegraded":"2023-05-16T13:55:24.703468+0000","last_fullsized":"2023-05-16T13:55:24.703468+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:36:07.932696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.704044+0000","last_change":"2023-05-16T13:55:23.005180+0000","last_active":"2023-05-16T13:55:24.704044+0000","last_peered":"2023-05-16T13:55:24.704044+0000","last_clean":"2023-05-16T13:55:24.704044+0000","last_became_active":"2023-05-16T13:55:23.004744+0000","last_became_peered":"2023-05-16T13:55:23.004744+0000","last_unstale":"2023-05-16T13:55:24.704044+0000","last_undegraded":"2023-05-16T13:55:24.704044+0000","last_fullsized":"2023-05-16T13:55:24.704044+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:37:21.801714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703851+0000","last_change":"2023-05-16T13:55:23.412436+0000","last_active":"2023-05-16T13:55:24.703851+0000","last_peered":"2023-05-16T13:55:24.703851+0000","last_clean":"2023-05-16T13:55:24.703851+0000","last_became_active":"2023-05-16T13:55:23.412200+0000","last_became_peered":"2023-05-16T13:55:23.412200+0000","last_unstale":"2023-05-16T13:55:24.703851+0000","last_undegraded":"2023-05-16T13:55:24.703851+0000","last_fullsized":"2023-05-16T13:55:24.703851+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:37:14.267206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702898+0000","last_change":"2023-05-16T13:55:23.008139+0000","last_active":"2023-05-16T13:55:24.702898+0000","last_peered":"2023-05-16T13:55:24.702898+0000","last_clean":"2023-05-16T13:55:24.702898+0000","last_became_active":"2023-05-16T13:55:23.007732+0000","last_became_peered":"2023-05-16T13:55:23.007732+0000","last_unstale":"2023-05-16T13:55:24.702898+0000","last_undegraded":"2023-05-16T13:55:24.702898+0000","last_fullsized":"2023-05-16T13:55:24.702898+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T14:02:33.296373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:21.955159+0000","last_change":"2023-05-16T13:55:21.955159+0000","last_active":"2023-05-16T13:55:21.955159+0000","last_peered":"2023-05-16T13:55:21.955159+0000","last_clean":"2023-05-16T13:55:21.955159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:21.955159+0000","last_undegraded":"2023-05-16T13:55:21.955159+0000","last_fullsized":"2023-05-16T13:55:21.955159+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703975+0000","last_change":"2023-05-16T13:55:23.414195+0000","last_active":"2023-05-16T13:55:24.703975+0000","last_peered":"2023-05-16T13:55:24.703975+0000","last_clean":"2023-05-16T13:55:24.703975+0000","last_became_active":"2023-05-16T13:55:23.413751+0000","last_became_peered":"2023-05-16T13:55:23.413751+0000","last_unstale":"2023-05-16T13:55:24.703975+0000","last_undegraded":"2023-05-16T13:55:24.703975+0000","last_fullsized":"2023-05-16T13:55:24.703975+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T20:53:14.973983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:21.955159+0000","last_change":"2023-05-16T13:55:21.955159+0000","last_active":"2023-05-16T13:55:21.955159+0000","last_peered":"2023-05-16T13:55:21.955159+0000","last_clean":"2023-05-16T13:55:21.955159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:21.955159+0000","last_undegraded":"2023-05-16T13:55:21.955159+0000","last_fullsized":"2023-05-16T13:55:21.955159+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703817+0000","last_change":"2023-05-16T13:55:23.410961+0000","last_active":"2023-05-16T13:55:24.703817+0000","last_peered":"2023-05-16T13:55:24.703817+0000","last_clean":"2023-05-16T13:55:24.703817+0000","last_became_active":"2023-05-16T13:55:23.410710+0000","last_became_peered":"2023-05-16T13:55:23.410710+0000","last_unstale":"2023-05-16T13:55:24.703817+0000","last_undegraded":"2023-05-16T13:55:24.703817+0000","last_fullsized":"2023-05-16T13:55:24.703817+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:51:42.064641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:21.955159+0000","last_change":"2023-05-16T13:55:21.955159+0000","last_active":"2023-05-16T13:55:21.955159+0000","last_peered":"2023-05-16T13:55:21.955159+0000","last_clean":"2023-05-16T13:55:21.955159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:21.955159+0000","last_undegraded":"2023-05-16T13:55:21.955159+0000","last_fullsized":"2023-05-16T13:55:21.955159+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:21.955159+0000","last_change":"2023-05-16T13:55:21.955159+0000","last_active":"2023-05-16T13:55:21.955159+0000","last_peered":"2023-05-16T13:55:21.955159+0000","last_clean":"2023-05-16T13:55:21.955159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:21.955159+0000","last_undegraded":"2023-05-16T13:55:21.955159+0000","last_fullsized":"2023-05-16T13:55:21.955159+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.389555+0000","last_change":"2023-05-16T13:55:23.002334+0000","last_active":"2023-05-16T13:55:24.389555+0000","last_peered":"2023-05-16T13:55:24.389555+0000","last_clean":"2023-05-16T13:55:24.389555+0000","last_became_active":"2023-05-16T13:55:23.002060+0000","last_became_peered":"2023-05-16T13:55:23.002060+0000","last_unstale":"2023-05-16T13:55:24.389555+0000","last_undegraded":"2023-05-16T13:55:24.389555+0000","last_fullsized":"2023-05-16T13:55:24.389555+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:24:10.547224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.389340+0000","last_change":"2023-05-16T13:55:23.416259+0000","last_active":"2023-05-16T13:55:24.389340+0000","last_peered":"2023-05-16T13:55:24.389340+0000","last_clean":"2023-05-16T13:55:24.389340+0000","last_became_active":"2023-05-16T13:55:23.415983+0000","last_became_peered":"2023-05-16T13:55:23.415983+0000","last_unstale":"2023-05-16T13:55:24.389340+0000","last_undegraded":"2023-05-16T13:55:24.389340+0000","last_fullsized":"2023-05-16T13:55:24.389340+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:45:04.746418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703229+0000","last_change":"2023-05-16T13:55:23.003470+0000","last_active":"2023-05-16T13:55:24.703229+0000","last_peered":"2023-05-16T13:55:24.703229+0000","last_clean":"2023-05-16T13:55:24.703229+0000","last_became_active":"2023-05-16T13:55:23.003203+0000","last_became_peered":"2023-05-16T13:55:23.003203+0000","last_unstale":"2023-05-16T13:55:24.703229+0000","last_undegraded":"2023-05-16T13:55:24.703229+0000","last_fullsized":"2023-05-16T13:55:24.703229+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T20:23:26.619277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.389117+0000","last_change":"2023-05-16T13:55:23.005895+0000","last_active":"2023-05-16T13:55:24.389117+0000","last_peered":"2023-05-16T13:55:24.389117+0000","last_clean":"2023-05-16T13:55:24.389117+0000","last_became_active":"2023-05-16T13:55:23.005582+0000","last_became_peered":"2023-05-16T13:55:23.005582+0000","last_unstale":"2023-05-16T13:55:24.389117+0000","last_undegraded":"2023-05-16T13:55:24.389117+0000","last_fullsized":"2023-05-16T13:55:24.389117+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:21:37.712743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703434+0000","last_change":"2023-05-16T13:55:23.411672+0000","last_active":"2023-05-16T13:55:24.703434+0000","last_peered":"2023-05-16T13:55:24.703434+0000","last_clean":"2023-05-16T13:55:24.703434+0000","last_became_active":"2023-05-16T13:55:23.408317+0000","last_became_peered":"2023-05-16T13:55:23.408317+0000","last_unstale":"2023-05-16T13:55:24.703434+0000","last_undegraded":"2023-05-16T13:55:24.703434+0000","last_fullsized":"2023-05-16T13:55:24.703434+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:24:27.841261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.389190+0000","last_change":"2023-05-16T13:55:23.001075+0000","last_active":"2023-05-16T13:55:24.389190+0000","last_peered":"2023-05-16T13:55:24.389190+0000","last_clean":"2023-05-16T13:55:24.389190+0000","last_became_active":"2023-05-16T13:55:23.000764+0000","last_became_peered":"2023-05-16T13:55:23.000764+0000","last_unstale":"2023-05-16T13:55:24.389190+0000","last_undegraded":"2023-05-16T13:55:24.389190+0000","last_fullsized":"2023-05-16T13:55:24.389190+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:25:15.075534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:21.955159+0000","last_change":"2023-05-16T13:55:21.955159+0000","last_active":"2023-05-16T13:55:21.955159+0000","last_peered":"2023-05-16T13:55:21.955159+0000","last_clean":"2023-05-16T13:55:21.955159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:21.955159+0000","last_undegraded":"2023-05-16T13:55:21.955159+0000","last_fullsized":"2023-05-16T13:55:21.955159+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.704066+0000","last_change":"2023-05-16T13:55:23.408380+0000","last_active":"2023-05-16T13:55:24.704066+0000","last_peered":"2023-05-16T13:55:24.704066+0000","last_clean":"2023-05-16T13:55:24.704066+0000","last_became_active":"2023-05-16T13:55:23.408097+0000","last_became_peered":"2023-05-16T13:55:23.408097+0000","last_unstale":"2023-05-16T13:55:24.704066+0000","last_undegraded":"2023-05-16T13:55:24.704066+0000","last_fullsized":"2023-05-16T13:55:24.704066+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T23:46:15.133417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.389006+0000","last_change":"2023-05-16T13:55:23.006029+0000","last_active":"2023-05-16T13:55:24.389006+0000","last_peered":"2023-05-16T13:55:24.389006+0000","last_clean":"2023-05-16T13:55:24.389006+0000","last_became_active":"2023-05-16T13:55:23.005646+0000","last_became_peered":"2023-05-16T13:55:23.005646+0000","last_unstale":"2023-05-16T13:55:24.389006+0000","last_undegraded":"2023-05-16T13:55:24.389006+0000","last_fullsized":"2023-05-16T13:55:24.389006+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:49:42.765347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:21.955159+0000","last_change":"2023-05-16T13:55:21.955159+0000","last_active":"2023-05-16T13:55:21.955159+0000","last_peered":"2023-05-16T13:55:21.955159+0000","last_clean":"2023-05-16T13:55:21.955159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:21.955159+0000","last_undegraded":"2023-05-16T13:55:21.955159+0000","last_fullsized":"2023-05-16T13:55:21.955159+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":191,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-16T13:55:18.046790+0000","last_change":"2023-05-16T13:54:03.495814+0000","last_active":"2023-05-16T13:55:18.046790+0000","last_peered":"2023-05-16T13:55:18.046790+0000","last_clean":"2023-05-16T13:55:18.046790+0000","last_became_active":"2023-05-16T13:54:03.494265+0000","last_became_peered":"2023-05-16T13:54:03.494265+0000","last_unstale":"2023-05-16T13:55:18.046790+0000","last_undegraded":"2023-05-16T13:55:18.046790+0000","last_fullsized":"2023-05-16T13:55:18.046790+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:01.722051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:01.722051+0000","last_clean_scrub_stamp":"2023-05-16T13:54:01.722051+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:30:50.824134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-16T13:55:18.872199+0000","last_change":"2023-05-16T13:54:09.770727+0000","last_active":"2023-05-16T13:55:18.872199+0000","last_peered":"2023-05-16T13:55:18.872199+0000","last_clean":"2023-05-16T13:55:18.872199+0000","last_became_active":"2023-05-16T13:54:09.770179+0000","last_became_peered":"2023-05-16T13:54:09.770179+0000","last_unstale":"2023-05-16T13:55:18.872199+0000","last_undegraded":"2023-05-16T13:55:18.872199+0000","last_fullsized":"2023-05-16T13:55:18.872199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T13:54:42.241552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703107+0000","last_change":"2023-05-16T13:55:23.424350+0000","last_active":"2023-05-16T13:55:24.703107+0000","last_peered":"2023-05-16T13:55:24.703107+0000","last_clean":"2023-05-16T13:55:24.703107+0000","last_became_active":"2023-05-16T13:55:23.424033+0000","last_became_peered":"2023-05-16T13:55:23.424033+0000","last_unstale":"2023-05-16T13:55:24.703107+0000","last_undegraded":"2023-05-16T13:55:24.703107+0000","last_fullsized":"2023-05-16T13:55:24.703107+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T23:52:16.681043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:21.955159+0000","last_change":"2023-05-16T13:55:21.955159+0000","last_active":"2023-05-16T13:55:21.955159+0000","last_peered":"2023-05-16T13:55:21.955159+0000","last_clean":"2023-05-16T13:55:21.955159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:21.955159+0000","last_undegraded":"2023-05-16T13:55:21.955159+0000","last_fullsized":"2023-05-16T13:55:21.955159+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-16T13:55:18.046793+0000","last_change":"2023-05-16T13:54:09.768888+0000","last_active":"2023-05-16T13:55:18.046793+0000","last_peered":"2023-05-16T13:55:18.046793+0000","last_clean":"2023-05-16T13:55:18.046793+0000","last_became_active":"2023-05-16T13:54:09.768463+0000","last_became_peered":"2023-05-16T13:54:09.768463+0000","last_unstale":"2023-05-16T13:55:18.046793+0000","last_undegraded":"2023-05-16T13:55:18.046793+0000","last_fullsized":"2023-05-16T13:55:18.046793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T14:50:54.235998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.389284+0000","last_change":"2023-05-16T13:55:23.009854+0000","last_active":"2023-05-16T13:55:24.389284+0000","last_peered":"2023-05-16T13:55:24.389284+0000","last_clean":"2023-05-16T13:55:24.389284+0000","last_became_active":"2023-05-16T13:55:23.009546+0000","last_became_peered":"2023-05-16T13:55:23.009546+0000","last_unstale":"2023-05-16T13:55:24.389284+0000","last_undegraded":"2023-05-16T13:55:24.389284+0000","last_fullsized":"2023-05-16T13:55:24.389284+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T18:09:26.341219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.388996+0000","last_change":"2023-05-16T13:54:09.821010+0000","last_active":"2023-05-16T13:55:24.388996+0000","last_peered":"2023-05-16T13:55:24.388996+0000","last_clean":"2023-05-16T13:55:24.388996+0000","last_became_active":"2023-05-16T13:54:09.820636+0000","last_became_peered":"2023-05-16T13:54:09.820636+0000","last_unstale":"2023-05-16T13:55:24.388996+0000","last_undegraded":"2023-05-16T13:55:24.388996+0000","last_fullsized":"2023-05-16T13:55:24.388996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T16:40:06.160431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703115+0000","last_change":"2023-05-16T13:55:23.407818+0000","last_active":"2023-05-16T13:55:24.703115+0000","last_peered":"2023-05-16T13:55:24.703115+0000","last_clean":"2023-05-16T13:55:24.703115+0000","last_became_active":"2023-05-16T13:55:23.407568+0000","last_became_peered":"2023-05-16T13:55:23.407568+0000","last_unstale":"2023-05-16T13:55:24.703115+0000","last_undegraded":"2023-05-16T13:55:24.703115+0000","last_fullsized":"2023-05-16T13:55:24.703115+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:04:23.740266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702701+0000","last_change":"2023-05-16T13:55:23.003233+0000","last_active":"2023-05-16T13:55:24.702701+0000","last_peered":"2023-05-16T13:55:24.702701+0000","last_clean":"2023-05-16T13:55:24.702701+0000","last_became_active":"2023-05-16T13:55:23.002924+0000","last_became_peered":"2023-05-16T13:55:23.002924+0000","last_unstale":"2023-05-16T13:55:24.702701+0000","last_undegraded":"2023-05-16T13:55:24.702701+0000","last_fullsized":"2023-05-16T13:55:24.702701+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T16:42:10.128117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-16T13:55:18.872215+0000","last_change":"2023-05-16T13:54:09.771040+0000","last_active":"2023-05-16T13:55:18.872215+0000","last_peered":"2023-05-16T13:55:18.872215+0000","last_clean":"2023-05-16T13:55:18.872215+0000","last_became_active":"2023-05-16T13:54:09.770433+0000","last_became_peered":"2023-05-16T13:54:09.770433+0000","last_unstale":"2023-05-16T13:55:18.872215+0000","last_undegraded":"2023-05-16T13:55:18.872215+0000","last_fullsized":"2023-05-16T13:55:18.872215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T23:45:06.073649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703572+0000","last_change":"2023-05-16T13:55:23.412124+0000","last_active":"2023-05-16T13:55:24.703572+0000","last_peered":"2023-05-16T13:55:24.703572+0000","last_clean":"2023-05-16T13:55:24.703572+0000","last_became_active":"2023-05-16T13:55:23.411824+0000","last_became_peered":"2023-05-16T13:55:23.411824+0000","last_unstale":"2023-05-16T13:55:24.703572+0000","last_undegraded":"2023-05-16T13:55:24.703572+0000","last_fullsized":"2023-05-16T13:55:24.703572+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:42:50.808847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.704046+0000","last_change":"2023-05-16T13:55:22.999434+0000","last_active":"2023-05-16T13:55:24.704046+0000","last_peered":"2023-05-16T13:55:24.704046+0000","last_clean":"2023-05-16T13:55:24.704046+0000","last_became_active":"2023-05-16T13:55:22.999152+0000","last_became_peered":"2023-05-16T13:55:22.999152+0000","last_unstale":"2023-05-16T13:55:24.704046+0000","last_undegraded":"2023-05-16T13:55:24.704046+0000","last_fullsized":"2023-05-16T13:55:24.704046+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T14:02:33.296373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703306+0000","last_change":"2023-05-16T13:54:09.813177+0000","last_active":"2023-05-16T13:55:24.703306+0000","last_peered":"2023-05-16T13:55:24.703306+0000","last_clean":"2023-05-16T13:55:24.703306+0000","last_became_active":"2023-05-16T13:54:09.812487+0000","last_became_peered":"2023-05-16T13:54:09.812487+0000","last_unstale":"2023-05-16T13:55:24.703306+0000","last_undegraded":"2023-05-16T13:55:24.703306+0000","last_fullsized":"2023-05-16T13:55:24.703306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T23:57:49.146859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702519+0000","last_change":"2023-05-16T13:55:23.410758+0000","last_active":"2023-05-16T13:55:24.702519+0000","last_peered":"2023-05-16T13:55:24.702519+0000","last_clean":"2023-05-16T13:55:24.702519+0000","last_became_active":"2023-05-16T13:55:23.410389+0000","last_became_peered":"2023-05-16T13:55:23.410389+0000","last_unstale":"2023-05-16T13:55:24.702519+0000","last_undegraded":"2023-05-16T13:55:24.702519+0000","last_fullsized":"2023-05-16T13:55:24.702519+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:36:07.932696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:21.955159+0000","last_change":"2023-05-16T13:55:21.955159+0000","last_active":"2023-05-16T13:55:21.955159+0000","last_peered":"2023-05-16T13:55:21.955159+0000","last_clean":"2023-05-16T13:55:21.955159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:21.955159+0000","last_undegraded":"2023-05-16T13:55:21.955159+0000","last_fullsized":"2023-05-16T13:55:21.955159+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-16T13:55:18.046828+0000","last_change":"2023-05-16T13:54:09.813305+0000","last_active":"2023-05-16T13:55:18.046828+0000","last_peered":"2023-05-16T13:55:18.046828+0000","last_clean":"2023-05-16T13:55:18.046828+0000","last_became_active":"2023-05-16T13:54:09.812931+0000","last_became_peered":"2023-05-16T13:54:09.812931+0000","last_unstale":"2023-05-16T13:55:18.046828+0000","last_undegraded":"2023-05-16T13:55:18.046828+0000","last_fullsized":"2023-05-16T13:55:18.046828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:38:10.685762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:21.955159+0000","last_change":"2023-05-16T13:55:21.955159+0000","last_active":"2023-05-16T13:55:21.955159+0000","last_peered":"2023-05-16T13:55:21.955159+0000","last_clean":"2023-05-16T13:55:21.955159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:21.955159+0000","last_undegraded":"2023-05-16T13:55:21.955159+0000","last_fullsized":"2023-05-16T13:55:21.955159+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703646+0000","last_change":"2023-05-16T13:54:09.768257+0000","last_active":"2023-05-16T13:55:24.703646+0000","last_peered":"2023-05-16T13:55:24.703646+0000","last_clean":"2023-05-16T13:55:24.703646+0000","last_became_active":"2023-05-16T13:54:09.767879+0000","last_became_peered":"2023-05-16T13:54:09.767879+0000","last_unstale":"2023-05-16T13:55:24.703646+0000","last_undegraded":"2023-05-16T13:55:24.703646+0000","last_fullsized":"2023-05-16T13:55:24.703646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:59:08.711793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702984+0000","last_change":"2023-05-16T13:55:22.998169+0000","last_active":"2023-05-16T13:55:24.702984+0000","last_peered":"2023-05-16T13:55:24.702984+0000","last_clean":"2023-05-16T13:55:24.702984+0000","last_became_active":"2023-05-16T13:55:22.997892+0000","last_became_peered":"2023-05-16T13:55:22.997892+0000","last_unstale":"2023-05-16T13:55:24.702984+0000","last_undegraded":"2023-05-16T13:55:24.702984+0000","last_fullsized":"2023-05-16T13:55:24.702984+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:03:49.235876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-16T13:55:17.163014+0000","last_change":"2023-05-16T13:54:09.768603+0000","last_active":"2023-05-16T13:55:17.163014+0000","last_peered":"2023-05-16T13:55:17.163014+0000","last_clean":"2023-05-16T13:55:17.163014+0000","last_became_active":"2023-05-16T13:54:09.768323+0000","last_became_peered":"2023-05-16T13:54:09.768323+0000","last_unstale":"2023-05-16T13:55:17.163014+0000","last_undegraded":"2023-05-16T13:55:17.163014+0000","last_fullsized":"2023-05-16T13:55:17.163014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:53:25.367588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":60,"acting":60,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1668,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14,"ondisk_log_size":14,"up":32,"acting":32,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509459,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13500,"kb_used_data":948,"kb_used_omap":0,"kb_used_meta":12544,"kb_avail":94358340,"statfs":{"total":96636764160,"available":96622940160,"internally_reserved":0,"allocated":970752,"data_stored":740828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12845056},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue May 16 13:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.59599999999999997}]},{"osd":1,"last update":"Tue May 16 13:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.64500000000000002}]},{"osd":2,"last update":"Tue May 16 13:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.62}]},{"osd":3,"last update":"Tue May 16 13:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.76600000000000001}]},{"osd":4,"last update":"Tue May 16 13:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":1.0469999999999999}]},{"osd":5,"last update":"Tue May 16 13:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":1.1020000000000001}]},{"osd":6,"last update":"Tue May 16 13:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":1.1859999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":1.167}]}]},{"osd":6,"up_from":15,"seq":64424509458,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12344,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":11968,"kb_avail":94359496,"statfs":{"total":96636764160,"available":96624123904,"internally_reserved":0,"allocated":376832,"data_stored":150460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12255232},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.68999999999999995}]},{"osd":1,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.61299999999999999}]},{"osd":2,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.67100000000000004}]},{"osd":3,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.72499999999999998}]},{"osd":4,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.70999999999999996}]},{"osd":5,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.58899999999999997}]},{"osd":7,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.747}]}]},{"osd":5,"up_from":15,"seq":64424509459,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12344,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":11968,"kb_avail":94359496,"statfs":{"total":96636764160,"available":96624123904,"internally_reserved":0,"allocated":376832,"data_stored":150460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12255232},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue May 16 13:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.63}]},{"osd":1,"last update":"Tue May 16 13:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":0.495},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.77900000000000003}]},{"osd":2,"last update":"Tue May 16 13:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.80500000000000005}]},{"osd":3,"last update":"Tue May 16 13:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.59299999999999997}]},{"osd":4,"last update":"Tue May 16 13:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.67600000000000005}]},{"osd":6,"last update":"Tue May 16 13:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.82599999999999996}]},{"osd":7,"last update":"Tue May 16 13:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.65600000000000003}]}]},{"osd":4,"up_from":15,"seq":64424509459,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":12472,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":12096,"kb_avail":94359368,"statfs":{"total":96636764160,"available":96623992832,"internally_reserved":0,"allocated":376832,"data_stored":150460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12386304},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.56399999999999995}]},{"osd":1,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.61899999999999999}]},{"osd":2,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.58399999999999996}]},{"osd":3,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.64200000000000002}]},{"osd":5,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.59899999999999998}]},{"osd":6,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.745}]},{"osd":7,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.79100000000000004}]}]},{"osd":3,"up_from":14,"seq":60129542164,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12664,"kb_used_data":432,"kb_used_omap":0,"kb_used_meta":12224,"kb_avail":94359176,"statfs":{"total":96636764160,"available":96623796224,"internally_reserved":0,"allocated":442368,"data_stored":178637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12517376},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.41599999999999998}]},{"osd":1,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.432}]},{"osd":2,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.36099999999999999}]},{"osd":4,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":0.79600000000000004}]},{"osd":5,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.631,"5min":1.631,"15min":1.631},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.72199999999999998}]},{"osd":6,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.753}]},{"osd":7,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.80500000000000005}]}]},{"osd":2,"up_from":14,"seq":60129542164,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12524,"kb_used_data":420,"kb_used_omap":0,"kb_used_meta":12096,"kb_avail":94359316,"statfs":{"total":96636764160,"available":96623939584,"internally_reserved":0,"allocated":430080,"data_stored":177109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12386304},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue May 16 13:55:01 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.48599999999999999}]},{"osd":1,"last update":"Tue May 16 13:55:01 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.54900000000000004}]},{"osd":3,"last update":"Tue May 16 13:55:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.50600000000000001}]},{"osd":4,"last update":"Tue May 16 13:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.85899999999999999}]},{"osd":5,"last update":"Tue May 16 13:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.81799999999999995}]},{"osd":6,"last update":"Tue May 16 13:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.83899999999999997}]},{"osd":7,"last update":"Tue May 16 13:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.89300000000000002}]}]},{"osd":1,"up_from":14,"seq":60129542163,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12588,"kb_used_data":420,"kb_used_omap":0,"kb_used_meta":12160,"kb_avail":94359252,"statfs":{"total":96636764160,"available":96623874048,"internally_reserved":0,"allocated":430080,"data_stored":177129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12451840},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.311},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.46999999999999997}]},{"osd":2,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.373},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.48399999999999999}]},{"osd":3,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.441}]},{"osd":4,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.59499999999999997}]},{"osd":5,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.69699999999999995}]},{"osd":6,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.67900000000000005}]},{"osd":7,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.67100000000000004}]}]},{"osd":0,"up_from":14,"seq":60129542164,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13680,"kb_used_data":1000,"kb_used_omap":0,"kb_used_meta":12672,"kb_avail":94358160,"statfs":{"total":96636764160,"available":96622755840,"internally_reserved":0,"allocated":1024000,"data_stored":767441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12976128},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue May 16 13:55:03 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.42199999999999999}]},{"osd":2,"last update":"Tue May 16 13:55:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.497},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.53900000000000003}]},{"osd":3,"last update":"Tue May 16 13:55:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.51100000000000001}]},{"osd":4,"last update":"Tue May 16 13:55:03 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.66800000000000004}]},{"osd":5,"last update":"Tue May 16 13:55:03 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":2.2639999999999998,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.77300000000000002}]},{"osd":6,"last update":"Tue May 16 13:55:03 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":2.3380000000000001,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":0.753},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.70699999999999996}]},{"osd":7,"last update":"Tue May 16 13:55:03 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":2.403,"5min":2.403,"15min":2.403},"last":0.80900000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-16T13:55:27.861 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-16T13:55:28.037 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.031+0000 7f6bafe8c640 1 Processor -- start 2023-05-16T13:55:28.038 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.031+0000 7f6bafe8c640 1 -- start start 2023-05-16T13:55:28.038 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.031+0000 7f6bafe8c640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ba8158bf0 0x7f6ba815d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:28.039 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.031+0000 7f6bafe8c640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ba815d6a0 con 0x7f6ba80703b0 2023-05-16T13:55:28.039 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.031+0000 7f6bafe8c640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ba8070870 con 0x7f6ba80cb4c0 2023-05-16T13:55:28.039 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.031+0000 7f6bafe8c640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba8070b50 con 0x7f6ba8158bf0 2023-05-16T13:55:28.039 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.031+0000 7f6bad427640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f6ba80703b0 0x7f6ba80cadb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:35098/0 (socket says 172.21.15.39:35098) 2023-05-16T13:55:28.039 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.031+0000 7f6bad427640 1 -- 172.21.15.39:0/1118018970 learned_addr learned my addr 172.21.15.39:0/1118018970 (peer_addr_for_me v1:172.21.15.39:0/0) 2023-05-16T13:55:28.040 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.031+0000 7f6badc28640 1 --2- 172.21.15.39:0/1118018970 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ba8158bf0 0x7f6ba815d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:28.040 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.031+0000 7f6bacc26640 1 -- 172.21.15.39:0/1118018970 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1784865071 0 0) 0x7f6b98001120 con 0x7f6ba80703b0 2023-05-16T13:55:28.041 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.031+0000 7f6bacc26640 1 -- 172.21.15.39:0/1118018970 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b94003530 con 0x7f6ba80703b0 2023-05-16T13:55:28.041 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.031+0000 7f6bacc26640 1 -- 172.21.15.39:0/1118018970 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 491759195 0 0) 0x7f6ba8070870 con 0x7f6ba80cb4c0 2023-05-16T13:55:28.041 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.031+0000 7f6bacc26640 1 -- 172.21.15.39:0/1118018970 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b98001120 con 0x7f6ba80cb4c0 2023-05-16T13:55:28.041 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.031+0000 7f6badc28640 1 -- 172.21.15.39:0/1118018970 >> v1:172.21.15.118:6789/0 conn(0x7f6ba80cb4c0 legacy=0x7f6ba80ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:28.041 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.031+0000 7f6badc28640 1 -- 172.21.15.39:0/1118018970 >> v1:172.21.15.39:6789/0 conn(0x7f6ba80703b0 legacy=0x7f6ba80cadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:28.041 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.031+0000 7f6badc28640 1 -- 172.21.15.39:0/1118018970 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba8070e30 con 0x7f6ba8158bf0 2023-05-16T13:55:28.042 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.035+0000 7f6badc28640 1 --2- 172.21.15.39:0/1118018970 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ba8158bf0 0x7f6ba815d160 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6ba40097f0 tx=0x7f6ba401c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f83e723e3686d257 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:28.043 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.035+0000 7f6bacc26640 1 -- 172.21.15.39:0/1118018970 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba40ab600 con 0x7f6ba8158bf0 2023-05-16T13:55:28.043 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.035+0000 7f6bacc26640 1 -- 172.21.15.39:0/1118018970 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ba40ab760 con 0x7f6ba8158bf0 2023-05-16T13:55:28.043 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.035+0000 7f6bacc26640 1 -- 172.21.15.39:0/1118018970 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba40abaf0 con 0x7f6ba8158bf0 2023-05-16T13:55:28.044 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.035+0000 7f6bafe8c640 1 -- 172.21.15.39:0/1118018970 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ba8158bf0 msgr2=0x7f6ba815d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:28.044 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.035+0000 7f6bafe8c640 1 --2- 172.21.15.39:0/1118018970 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ba8158bf0 0x7f6ba815d160 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6ba40097f0 tx=0x7f6ba401c400 comp rx=0 tx=0).stop 2023-05-16T13:55:28.044 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.035+0000 7f6bafe8c640 1 -- 172.21.15.39:0/1118018970 shutdown_connections 2023-05-16T13:55:28.044 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.035+0000 7f6bafe8c640 1 --2- 172.21.15.39:0/1118018970 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ba8158bf0 0x7f6ba815d160 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:28.044 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.035+0000 7f6bafe8c640 1 -- 172.21.15.39:0/1118018970 >> 172.21.15.39:0/1118018970 conn(0x7f6ba8069a50 msgr2=0x7f6ba8069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:28.044 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.035+0000 7f6bafe8c640 1 -- 172.21.15.39:0/1118018970 shutdown_connections 2023-05-16T13:55:28.045 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.035+0000 7f6bafe8c640 1 -- 172.21.15.39:0/1118018970 wait complete. 2023-05-16T13:55:28.045 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.039+0000 7f6bafe8c640 1 Processor -- start 2023-05-16T13:55:28.045 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.039+0000 7f6bafe8c640 1 -- start start 2023-05-16T13:55:28.046 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.039+0000 7f6bafe8c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ba80703b0 0x7f6ba81f57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:28.046 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.039+0000 7f6bafe8c640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ba80cb4c0 0x7f6ba80b1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:28.046 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.039+0000 7f6bafe8c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6ba8158bf0 0x7f6ba80b1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:28.046 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.039+0000 7f6bafe8c640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba80ac830 con 0x7f6ba8158bf0 2023-05-16T13:55:28.046 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.039+0000 7f6bafe8c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba814ad70 con 0x7f6ba80703b0 2023-05-16T13:55:28.047 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.039+0000 7f6bafe8c640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba80ab8d0 con 0x7f6ba80cb4c0 2023-05-16T13:55:28.048 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.039+0000 7f6bae429640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6ba8158bf0 0x7f6ba80b1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:28.048 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.039+0000 7f6bae429640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6ba8158bf0 0x7f6ba80b1e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44530/0 (socket says 172.21.15.39:44530) 2023-05-16T13:55:28.048 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.039+0000 7f6bae429640 1 -- 172.21.15.39:0/529486343 learned_addr learned my addr 172.21.15.39:0/529486343 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:28.048 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.039+0000 7f6bad427640 1 --2- 172.21.15.39:0/529486343 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ba80cb4c0 0x7f6ba80b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:28.048 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.039+0000 7f6badc28640 1 --2- 172.21.15.39:0/529486343 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ba80703b0 0x7f6ba81f57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:28.048 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.039+0000 7f6bae429640 1 -- 172.21.15.39:0/529486343 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ba80cb4c0 msgr2=0x7f6ba80b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:28.049 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.039+0000 7f6bae429640 1 --2- 172.21.15.39:0/529486343 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ba80cb4c0 0x7f6ba80b1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:28.049 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.039+0000 7f6bae429640 1 -- 172.21.15.39:0/529486343 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ba80703b0 msgr2=0x7f6ba81f57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:28.049 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.039+0000 7f6bae429640 1 --2- 172.21.15.39:0/529486343 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ba80703b0 0x7f6ba81f57e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:28.049 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.039+0000 7f6bae429640 1 -- 172.21.15.39:0/529486343 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba4009420 con 0x7f6ba8158bf0 2023-05-16T13:55:28.049 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.039+0000 7f6badc28640 1 --2- 172.21.15.39:0/529486343 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ba80703b0 0x7f6ba81f57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:55:28.049 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.039+0000 7f6bae429640 1 --2- 172.21.15.39:0/529486343 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6ba8158bf0 0x7f6ba80b1e80 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f6ba000c7a0 tx=0x7f6ba000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:28.049 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.039+0000 7f6b9e7fc640 1 -- 172.21.15.39:0/529486343 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba0003b80 con 0x7f6ba8158bf0 2023-05-16T13:55:28.049 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.039+0000 7f6b9e7fc640 1 -- 172.21.15.39:0/529486343 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ba0003ce0 con 0x7f6ba8158bf0 2023-05-16T13:55:28.050 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.039+0000 7f6bafe8c640 1 -- 172.21.15.39:0/529486343 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ba80ad950 con 0x7f6ba8158bf0 2023-05-16T13:55:28.050 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.039+0000 7f6b9e7fc640 1 -- 172.21.15.39:0/529486343 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba000aa30 con 0x7f6ba8158bf0 2023-05-16T13:55:28.050 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.039+0000 7f6bafe8c640 1 -- 172.21.15.39:0/529486343 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ba8158fc0 con 0x7f6ba8158bf0 2023-05-16T13:55:28.050 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.039+0000 7f6bafe8c640 1 -- 172.21.15.39:0/529486343 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ba80cdcc0 con 0x7f6ba8158bf0 2023-05-16T13:55:28.051 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.043+0000 7f6b9e7fc640 1 -- 172.21.15.39:0/529486343 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6ba000ab90 con 0x7f6ba8158bf0 2023-05-16T13:55:28.051 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.043+0000 7f6b9e7fc640 1 --2- 172.21.15.39:0/529486343 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f6b8c066280 0x7f6b8c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:28.051 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.043+0000 7f6b9e7fc640 1 -- 172.21.15.39:0/529486343 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6ba0083b80 con 0x7f6ba8158bf0 2023-05-16T13:55:28.051 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.043+0000 7f6badc28640 1 --2- 172.21.15.39:0/529486343 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f6b8c066280 0x7f6b8c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:28.051 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.043+0000 7f6badc28640 1 --2- 172.21.15.39:0/529486343 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f6b8c066280 0x7f6b8c068730 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6ba40af000 tx=0x7f6ba40b6040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:28.054 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.047+0000 7f6b9e7fc640 1 -- 172.21.15.39:0/529486343 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f6ba0050f60 con 0x7f6ba8158bf0 2023-05-16T13:55:28.208 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.199+0000 7f6bafe8c640 1 -- 172.21.15.39:0/529486343 --> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6ba80ac970 con 0x7f6b8c066280 2023-05-16T13:55:28.218 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.207+0000 7f6b9e7fc640 1 -- 172.21.15.39:0/529486343 <== mgr.4098 v2:172.21.15.39:6832/288296800 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+303850 (secure 0 0 0) 0x7f6ba80ac970 con 0x7f6b8c066280 2023-05-16T13:55:28.220 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:55:28.221 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2023-05-16T13:55:28.222 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.211+0000 7f6bafe8c640 1 -- 172.21.15.39:0/529486343 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f6b8c066280 msgr2=0x7f6b8c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:28.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.211+0000 7f6bafe8c640 1 --2- 172.21.15.39:0/529486343 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f6b8c066280 0x7f6b8c068730 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6ba40af000 tx=0x7f6ba40b6040 comp rx=0 tx=0).stop 2023-05-16T13:55:28.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.211+0000 7f6bafe8c640 1 -- 172.21.15.39:0/529486343 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6ba8158bf0 msgr2=0x7f6ba80b1e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:28.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.211+0000 7f6bafe8c640 1 --2- 172.21.15.39:0/529486343 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6ba8158bf0 0x7f6ba80b1e80 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f6ba000c7a0 tx=0x7f6ba000cc60 comp rx=0 tx=0).stop 2023-05-16T13:55:28.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.211+0000 7f6bafe8c640 1 -- 172.21.15.39:0/529486343 shutdown_connections 2023-05-16T13:55:28.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.211+0000 7f6bafe8c640 1 --2- 172.21.15.39:0/529486343 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f6b8c066280 0x7f6b8c068730 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:28.223 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.211+0000 7f6bafe8c640 1 --2- 172.21.15.39:0/529486343 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ba80cb4c0 0x7f6ba80b1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:28.224 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.211+0000 7f6bafe8c640 1 --2- 172.21.15.39:0/529486343 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6ba8158bf0 0x7f6ba80b1e80 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:28.224 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.211+0000 7f6bafe8c640 1 --2- 172.21.15.39:0/529486343 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ba80703b0 0x7f6ba81f57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:28.224 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.211+0000 7f6bafe8c640 1 -- 172.21.15.39:0/529486343 >> 172.21.15.39:0/529486343 conn(0x7f6ba8069a50 msgr2=0x7f6ba814f700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:28.225 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.211+0000 7f6bafe8c640 1 -- 172.21.15.39:0/529486343 shutdown_connections 2023-05-16T13:55:28.225 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.211+0000 7f6bafe8c640 1 -- 172.21.15.39:0/529486343 wait complete. 2023-05-16T13:55:28.239 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":74,"stamp":"2023-05-16T13:55:26.843063+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592036,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":173,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":131,"ondisk_log_size":131,"up":110,"acting":110,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":108,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":102116,"kb_used_data":4324,"kb_used_omap":0,"kb_used_meta":97728,"kb_avail":754872604,"statfs":{"total":773094113280,"available":772989546496,"internally_reserved":0,"allocated":4427776,"data_stored":2492524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":100073472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1668,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.870588"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702986+0000","last_change":"2023-05-16T13:55:23.413635+0000","last_active":"2023-05-16T13:55:24.702986+0000","last_peered":"2023-05-16T13:55:24.702986+0000","last_clean":"2023-05-16T13:55:24.702986+0000","last_became_active":"2023-05-16T13:55:23.413319+0000","last_became_peered":"2023-05-16T13:55:23.413319+0000","last_unstale":"2023-05-16T13:55:24.702986+0000","last_undegraded":"2023-05-16T13:55:24.702986+0000","last_fullsized":"2023-05-16T13:55:24.702986+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:00:44.745581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702981+0000","last_change":"2023-05-16T13:55:23.420601+0000","last_active":"2023-05-16T13:55:24.702981+0000","last_peered":"2023-05-16T13:55:24.702981+0000","last_clean":"2023-05-16T13:55:24.702981+0000","last_became_active":"2023-05-16T13:55:23.420296+0000","last_became_peered":"2023-05-16T13:55:23.420296+0000","last_unstale":"2023-05-16T13:55:24.702981+0000","last_undegraded":"2023-05-16T13:55:24.702981+0000","last_fullsized":"2023-05-16T13:55:24.702981+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T14:28:21.055179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702832+0000","last_change":"2023-05-16T13:55:23.426167+0000","last_active":"2023-05-16T13:55:24.702832+0000","last_peered":"2023-05-16T13:55:24.702832+0000","last_clean":"2023-05-16T13:55:24.702832+0000","last_became_active":"2023-05-16T13:55:23.425898+0000","last_became_peered":"2023-05-16T13:55:23.425898+0000","last_unstale":"2023-05-16T13:55:24.702832+0000","last_undegraded":"2023-05-16T13:55:24.702832+0000","last_fullsized":"2023-05-16T13:55:24.702832+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T18:12:33.397086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.389344+0000","last_change":"2023-05-16T13:55:23.410640+0000","last_active":"2023-05-16T13:55:24.389344+0000","last_peered":"2023-05-16T13:55:24.389344+0000","last_clean":"2023-05-16T13:55:24.389344+0000","last_became_active":"2023-05-16T13:55:23.410201+0000","last_became_peered":"2023-05-16T13:55:23.410201+0000","last_unstale":"2023-05-16T13:55:24.389344+0000","last_undegraded":"2023-05-16T13:55:24.389344+0000","last_fullsized":"2023-05-16T13:55:24.389344+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T23:39:16.162625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.389118+0000","last_change":"2023-05-16T13:55:23.415688+0000","last_active":"2023-05-16T13:55:24.389118+0000","last_peered":"2023-05-16T13:55:24.389118+0000","last_clean":"2023-05-16T13:55:24.389118+0000","last_became_active":"2023-05-16T13:55:23.415428+0000","last_became_peered":"2023-05-16T13:55:23.415428+0000","last_unstale":"2023-05-16T13:55:24.389118+0000","last_undegraded":"2023-05-16T13:55:24.389118+0000","last_fullsized":"2023-05-16T13:55:24.389118+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T23:22:48.021414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702788+0000","last_change":"2023-05-16T13:55:23.411124+0000","last_active":"2023-05-16T13:55:24.702788+0000","last_peered":"2023-05-16T13:55:24.702788+0000","last_clean":"2023-05-16T13:55:24.702788+0000","last_became_active":"2023-05-16T13:55:23.410870+0000","last_became_peered":"2023-05-16T13:55:23.410870+0000","last_unstale":"2023-05-16T13:55:24.702788+0000","last_undegraded":"2023-05-16T13:55:24.702788+0000","last_fullsized":"2023-05-16T13:55:24.702788+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:20:17.612621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702869+0000","last_change":"2023-05-16T13:55:23.423785+0000","last_active":"2023-05-16T13:55:24.702869+0000","last_peered":"2023-05-16T13:55:24.702869+0000","last_clean":"2023-05-16T13:55:24.702869+0000","last_became_active":"2023-05-16T13:55:23.423521+0000","last_became_peered":"2023-05-16T13:55:23.423521+0000","last_unstale":"2023-05-16T13:55:24.702869+0000","last_undegraded":"2023-05-16T13:55:24.702869+0000","last_fullsized":"2023-05-16T13:55:24.702869+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:15:22.807920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703149+0000","last_change":"2023-05-16T13:55:23.426476+0000","last_active":"2023-05-16T13:55:24.703149+0000","last_peered":"2023-05-16T13:55:24.703149+0000","last_clean":"2023-05-16T13:55:24.703149+0000","last_became_active":"2023-05-16T13:55:23.426169+0000","last_became_peered":"2023-05-16T13:55:23.426169+0000","last_unstale":"2023-05-16T13:55:24.703149+0000","last_undegraded":"2023-05-16T13:55:24.703149+0000","last_fullsized":"2023-05-16T13:55:24.703149+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T15:01:43.692055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703603+0000","last_change":"2023-05-16T13:55:23.417357+0000","last_active":"2023-05-16T13:55:24.703603+0000","last_peered":"2023-05-16T13:55:24.703603+0000","last_clean":"2023-05-16T13:55:24.703603+0000","last_became_active":"2023-05-16T13:55:23.417040+0000","last_became_peered":"2023-05-16T13:55:23.417040+0000","last_unstale":"2023-05-16T13:55:24.703603+0000","last_undegraded":"2023-05-16T13:55:24.703603+0000","last_fullsized":"2023-05-16T13:55:24.703603+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:20:17.612621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.389374+0000","last_change":"2023-05-16T13:55:23.416396+0000","last_active":"2023-05-16T13:55:24.389374+0000","last_peered":"2023-05-16T13:55:24.389374+0000","last_clean":"2023-05-16T13:55:24.389374+0000","last_became_active":"2023-05-16T13:55:23.416171+0000","last_became_peered":"2023-05-16T13:55:23.416171+0000","last_unstale":"2023-05-16T13:55:24.389374+0000","last_undegraded":"2023-05-16T13:55:24.389374+0000","last_fullsized":"2023-05-16T13:55:24.389374+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:37:40.020154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.389007+0000","last_change":"2023-05-16T13:55:23.415714+0000","last_active":"2023-05-16T13:55:24.389007+0000","last_peered":"2023-05-16T13:55:24.389007+0000","last_clean":"2023-05-16T13:55:24.389007+0000","last_became_active":"2023-05-16T13:55:23.415365+0000","last_became_peered":"2023-05-16T13:55:23.415365+0000","last_unstale":"2023-05-16T13:55:24.389007+0000","last_undegraded":"2023-05-16T13:55:24.389007+0000","last_fullsized":"2023-05-16T13:55:24.389007+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:22:31.514634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703500+0000","last_change":"2023-05-16T13:55:23.424404+0000","last_active":"2023-05-16T13:55:24.703500+0000","last_peered":"2023-05-16T13:55:24.703500+0000","last_clean":"2023-05-16T13:55:24.703500+0000","last_became_active":"2023-05-16T13:55:23.424080+0000","last_became_peered":"2023-05-16T13:55:23.424080+0000","last_unstale":"2023-05-16T13:55:24.703500+0000","last_undegraded":"2023-05-16T13:55:24.703500+0000","last_fullsized":"2023-05-16T13:55:24.703500+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T23:50:36.996209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702518+0000","last_change":"2023-05-16T13:55:23.417343+0000","last_active":"2023-05-16T13:55:24.702518+0000","last_peered":"2023-05-16T13:55:24.702518+0000","last_clean":"2023-05-16T13:55:24.702518+0000","last_became_active":"2023-05-16T13:55:23.417084+0000","last_became_peered":"2023-05-16T13:55:23.417084+0000","last_unstale":"2023-05-16T13:55:24.702518+0000","last_undegraded":"2023-05-16T13:55:24.702518+0000","last_fullsized":"2023-05-16T13:55:24.702518+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:24:27.841261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:21.955159+0000","last_change":"2023-05-16T13:55:21.955159+0000","last_active":"2023-05-16T13:55:21.955159+0000","last_peered":"2023-05-16T13:55:21.955159+0000","last_clean":"2023-05-16T13:55:21.955159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:21.955159+0000","last_undegraded":"2023-05-16T13:55:21.955159+0000","last_fullsized":"2023-05-16T13:55:21.955159+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703219+0000","last_change":"2023-05-16T13:55:23.424419+0000","last_active":"2023-05-16T13:55:24.703219+0000","last_peered":"2023-05-16T13:55:24.703219+0000","last_clean":"2023-05-16T13:55:24.703219+0000","last_became_active":"2023-05-16T13:55:23.424144+0000","last_became_peered":"2023-05-16T13:55:23.424144+0000","last_unstale":"2023-05-16T13:55:24.703219+0000","last_undegraded":"2023-05-16T13:55:24.703219+0000","last_fullsized":"2023-05-16T13:55:24.703219+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T18:54:19.739155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702809+0000","last_change":"2023-05-16T13:55:23.004839+0000","last_active":"2023-05-16T13:55:24.702809+0000","last_peered":"2023-05-16T13:55:24.702809+0000","last_clean":"2023-05-16T13:55:24.702809+0000","last_became_active":"2023-05-16T13:55:23.004519+0000","last_became_peered":"2023-05-16T13:55:23.004519+0000","last_unstale":"2023-05-16T13:55:24.702809+0000","last_undegraded":"2023-05-16T13:55:24.702809+0000","last_fullsized":"2023-05-16T13:55:24.702809+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:42:58.481159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703544+0000","last_change":"2023-05-16T13:55:23.003518+0000","last_active":"2023-05-16T13:55:24.703544+0000","last_peered":"2023-05-16T13:55:24.703544+0000","last_clean":"2023-05-16T13:55:24.703544+0000","last_became_active":"2023-05-16T13:55:23.003263+0000","last_became_peered":"2023-05-16T13:55:23.003263+0000","last_unstale":"2023-05-16T13:55:24.703544+0000","last_undegraded":"2023-05-16T13:55:24.703544+0000","last_fullsized":"2023-05-16T13:55:24.703544+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T20:43:50.549191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702845+0000","last_change":"2023-05-16T13:55:23.409488+0000","last_active":"2023-05-16T13:55:24.702845+0000","last_peered":"2023-05-16T13:55:24.702845+0000","last_clean":"2023-05-16T13:55:24.702845+0000","last_became_active":"2023-05-16T13:55:23.409221+0000","last_became_peered":"2023-05-16T13:55:23.409221+0000","last_unstale":"2023-05-16T13:55:24.702845+0000","last_undegraded":"2023-05-16T13:55:24.702845+0000","last_fullsized":"2023-05-16T13:55:24.702845+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T23:37:20.052995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:21.955159+0000","last_change":"2023-05-16T13:55:21.955159+0000","last_active":"2023-05-16T13:55:21.955159+0000","last_peered":"2023-05-16T13:55:21.955159+0000","last_clean":"2023-05-16T13:55:21.955159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:21.955159+0000","last_undegraded":"2023-05-16T13:55:21.955159+0000","last_fullsized":"2023-05-16T13:55:21.955159+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703333+0000","last_change":"2023-05-16T13:55:23.410102+0000","last_active":"2023-05-16T13:55:24.703333+0000","last_peered":"2023-05-16T13:55:24.703333+0000","last_clean":"2023-05-16T13:55:24.703333+0000","last_became_active":"2023-05-16T13:55:23.409854+0000","last_became_peered":"2023-05-16T13:55:23.409854+0000","last_unstale":"2023-05-16T13:55:24.703333+0000","last_undegraded":"2023-05-16T13:55:24.703333+0000","last_fullsized":"2023-05-16T13:55:24.703333+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:39:33.113821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:21.955159+0000","last_change":"2023-05-16T13:55:21.955159+0000","last_active":"2023-05-16T13:55:21.955159+0000","last_peered":"2023-05-16T13:55:21.955159+0000","last_clean":"2023-05-16T13:55:21.955159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:21.955159+0000","last_undegraded":"2023-05-16T13:55:21.955159+0000","last_fullsized":"2023-05-16T13:55:21.955159+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:21.955159+0000","last_change":"2023-05-16T13:55:21.955159+0000","last_active":"2023-05-16T13:55:21.955159+0000","last_peered":"2023-05-16T13:55:21.955159+0000","last_clean":"2023-05-16T13:55:21.955159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:21.955159+0000","last_undegraded":"2023-05-16T13:55:21.955159+0000","last_fullsized":"2023-05-16T13:55:21.955159+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702652+0000","last_change":"2023-05-16T13:55:23.009273+0000","last_active":"2023-05-16T13:55:24.702652+0000","last_peered":"2023-05-16T13:55:24.702652+0000","last_clean":"2023-05-16T13:55:24.702652+0000","last_became_active":"2023-05-16T13:55:23.008332+0000","last_became_peered":"2023-05-16T13:55:23.008332+0000","last_unstale":"2023-05-16T13:55:24.702652+0000","last_undegraded":"2023-05-16T13:55:24.702652+0000","last_fullsized":"2023-05-16T13:55:24.702652+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:42:49.791420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703848+0000","last_change":"2023-05-16T13:55:23.414015+0000","last_active":"2023-05-16T13:55:24.703848+0000","last_peered":"2023-05-16T13:55:24.703848+0000","last_clean":"2023-05-16T13:55:24.703848+0000","last_became_active":"2023-05-16T13:55:23.413471+0000","last_became_peered":"2023-05-16T13:55:23.413471+0000","last_unstale":"2023-05-16T13:55:24.703848+0000","last_undegraded":"2023-05-16T13:55:24.703848+0000","last_fullsized":"2023-05-16T13:55:24.703848+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:45:55.863941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:21.955159+0000","last_change":"2023-05-16T13:55:21.955159+0000","last_active":"2023-05-16T13:55:21.955159+0000","last_peered":"2023-05-16T13:55:21.955159+0000","last_clean":"2023-05-16T13:55:21.955159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:21.955159+0000","last_undegraded":"2023-05-16T13:55:21.955159+0000","last_fullsized":"2023-05-16T13:55:21.955159+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.389480+0000","last_change":"2023-05-16T13:55:23.410465+0000","last_active":"2023-05-16T13:55:24.389480+0000","last_peered":"2023-05-16T13:55:24.389480+0000","last_clean":"2023-05-16T13:55:24.389480+0000","last_became_active":"2023-05-16T13:55:23.409929+0000","last_became_peered":"2023-05-16T13:55:23.409929+0000","last_unstale":"2023-05-16T13:55:24.389480+0000","last_undegraded":"2023-05-16T13:55:24.389480+0000","last_fullsized":"2023-05-16T13:55:24.389480+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T15:51:40.646591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703104+0000","last_change":"2023-05-16T13:55:23.004761+0000","last_active":"2023-05-16T13:55:24.703104+0000","last_peered":"2023-05-16T13:55:24.703104+0000","last_clean":"2023-05-16T13:55:24.703104+0000","last_became_active":"2023-05-16T13:55:23.004395+0000","last_became_peered":"2023-05-16T13:55:23.004395+0000","last_unstale":"2023-05-16T13:55:24.703104+0000","last_undegraded":"2023-05-16T13:55:24.703104+0000","last_fullsized":"2023-05-16T13:55:24.703104+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:35:41.923514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:21.955159+0000","last_change":"2023-05-16T13:55:21.955159+0000","last_active":"2023-05-16T13:55:21.955159+0000","last_peered":"2023-05-16T13:55:21.955159+0000","last_clean":"2023-05-16T13:55:21.955159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:21.955159+0000","last_undegraded":"2023-05-16T13:55:21.955159+0000","last_fullsized":"2023-05-16T13:55:21.955159+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702686+0000","last_change":"2023-05-16T13:55:23.410445+0000","last_active":"2023-05-16T13:55:24.702686+0000","last_peered":"2023-05-16T13:55:24.702686+0000","last_clean":"2023-05-16T13:55:24.702686+0000","last_became_active":"2023-05-16T13:55:23.408143+0000","last_became_peered":"2023-05-16T13:55:23.408143+0000","last_unstale":"2023-05-16T13:55:24.702686+0000","last_undegraded":"2023-05-16T13:55:24.702686+0000","last_fullsized":"2023-05-16T13:55:24.702686+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:21:33.903700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:21.955159+0000","last_change":"2023-05-16T13:55:21.955159+0000","last_active":"2023-05-16T13:55:21.955159+0000","last_peered":"2023-05-16T13:55:21.955159+0000","last_clean":"2023-05-16T13:55:21.955159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:21.955159+0000","last_undegraded":"2023-05-16T13:55:21.955159+0000","last_fullsized":"2023-05-16T13:55:21.955159+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":19,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703914+0000","last_change":"2023-05-16T13:55:23.010113+0000","last_active":"2023-05-16T13:55:24.703914+0000","last_peered":"2023-05-16T13:55:24.703914+0000","last_clean":"2023-05-16T13:55:24.703914+0000","last_became_active":"2023-05-16T13:55:23.007991+0000","last_became_peered":"2023-05-16T13:55:23.007991+0000","last_unstale":"2023-05-16T13:55:24.703914+0000","last_undegraded":"2023-05-16T13:55:24.703914+0000","last_fullsized":"2023-05-16T13:55:24.703914+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:09:25.013926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703468+0000","last_change":"2023-05-16T13:55:23.426171+0000","last_active":"2023-05-16T13:55:24.703468+0000","last_peered":"2023-05-16T13:55:24.703468+0000","last_clean":"2023-05-16T13:55:24.703468+0000","last_became_active":"2023-05-16T13:55:23.425887+0000","last_became_peered":"2023-05-16T13:55:23.425887+0000","last_unstale":"2023-05-16T13:55:24.703468+0000","last_undegraded":"2023-05-16T13:55:24.703468+0000","last_fullsized":"2023-05-16T13:55:24.703468+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:36:07.932696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.704044+0000","last_change":"2023-05-16T13:55:23.005180+0000","last_active":"2023-05-16T13:55:24.704044+0000","last_peered":"2023-05-16T13:55:24.704044+0000","last_clean":"2023-05-16T13:55:24.704044+0000","last_became_active":"2023-05-16T13:55:23.004744+0000","last_became_peered":"2023-05-16T13:55:23.004744+0000","last_unstale":"2023-05-16T13:55:24.704044+0000","last_undegraded":"2023-05-16T13:55:24.704044+0000","last_fullsized":"2023-05-16T13:55:24.704044+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:37:21.801714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703851+0000","last_change":"2023-05-16T13:55:23.412436+0000","last_active":"2023-05-16T13:55:24.703851+0000","last_peered":"2023-05-16T13:55:24.703851+0000","last_clean":"2023-05-16T13:55:24.703851+0000","last_became_active":"2023-05-16T13:55:23.412200+0000","last_became_peered":"2023-05-16T13:55:23.412200+0000","last_unstale":"2023-05-16T13:55:24.703851+0000","last_undegraded":"2023-05-16T13:55:24.703851+0000","last_fullsized":"2023-05-16T13:55:24.703851+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:37:14.267206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702898+0000","last_change":"2023-05-16T13:55:23.008139+0000","last_active":"2023-05-16T13:55:24.702898+0000","last_peered":"2023-05-16T13:55:24.702898+0000","last_clean":"2023-05-16T13:55:24.702898+0000","last_became_active":"2023-05-16T13:55:23.007732+0000","last_became_peered":"2023-05-16T13:55:23.007732+0000","last_unstale":"2023-05-16T13:55:24.702898+0000","last_undegraded":"2023-05-16T13:55:24.702898+0000","last_fullsized":"2023-05-16T13:55:24.702898+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T14:02:33.296373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:21.955159+0000","last_change":"2023-05-16T13:55:21.955159+0000","last_active":"2023-05-16T13:55:21.955159+0000","last_peered":"2023-05-16T13:55:21.955159+0000","last_clean":"2023-05-16T13:55:21.955159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:21.955159+0000","last_undegraded":"2023-05-16T13:55:21.955159+0000","last_fullsized":"2023-05-16T13:55:21.955159+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703975+0000","last_change":"2023-05-16T13:55:23.414195+0000","last_active":"2023-05-16T13:55:24.703975+0000","last_peered":"2023-05-16T13:55:24.703975+0000","last_clean":"2023-05-16T13:55:24.703975+0000","last_became_active":"2023-05-16T13:55:23.413751+0000","last_became_peered":"2023-05-16T13:55:23.413751+0000","last_unstale":"2023-05-16T13:55:24.703975+0000","last_undegraded":"2023-05-16T13:55:24.703975+0000","last_fullsized":"2023-05-16T13:55:24.703975+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T20:53:14.973983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:21.955159+0000","last_change":"2023-05-16T13:55:21.955159+0000","last_active":"2023-05-16T13:55:21.955159+0000","last_peered":"2023-05-16T13:55:21.955159+0000","last_clean":"2023-05-16T13:55:21.955159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:21.955159+0000","last_undegraded":"2023-05-16T13:55:21.955159+0000","last_fullsized":"2023-05-16T13:55:21.955159+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703817+0000","last_change":"2023-05-16T13:55:23.410961+0000","last_active":"2023-05-16T13:55:24.703817+0000","last_peered":"2023-05-16T13:55:24.703817+0000","last_clean":"2023-05-16T13:55:24.703817+0000","last_became_active":"2023-05-16T13:55:23.410710+0000","last_became_peered":"2023-05-16T13:55:23.410710+0000","last_unstale":"2023-05-16T13:55:24.703817+0000","last_undegraded":"2023-05-16T13:55:24.703817+0000","last_fullsized":"2023-05-16T13:55:24.703817+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:51:42.064641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:21.955159+0000","last_change":"2023-05-16T13:55:21.955159+0000","last_active":"2023-05-16T13:55:21.955159+0000","last_peered":"2023-05-16T13:55:21.955159+0000","last_clean":"2023-05-16T13:55:21.955159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:21.955159+0000","last_undegraded":"2023-05-16T13:55:21.955159+0000","last_fullsized":"2023-05-16T13:55:21.955159+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:21.955159+0000","last_change":"2023-05-16T13:55:21.955159+0000","last_active":"2023-05-16T13:55:21.955159+0000","last_peered":"2023-05-16T13:55:21.955159+0000","last_clean":"2023-05-16T13:55:21.955159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:21.955159+0000","last_undegraded":"2023-05-16T13:55:21.955159+0000","last_fullsized":"2023-05-16T13:55:21.955159+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.389555+0000","last_change":"2023-05-16T13:55:23.002334+0000","last_active":"2023-05-16T13:55:24.389555+0000","last_peered":"2023-05-16T13:55:24.389555+0000","last_clean":"2023-05-16T13:55:24.389555+0000","last_became_active":"2023-05-16T13:55:23.002060+0000","last_became_peered":"2023-05-16T13:55:23.002060+0000","last_unstale":"2023-05-16T13:55:24.389555+0000","last_undegraded":"2023-05-16T13:55:24.389555+0000","last_fullsized":"2023-05-16T13:55:24.389555+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:24:10.547224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.389340+0000","last_change":"2023-05-16T13:55:23.416259+0000","last_active":"2023-05-16T13:55:24.389340+0000","last_peered":"2023-05-16T13:55:24.389340+0000","last_clean":"2023-05-16T13:55:24.389340+0000","last_became_active":"2023-05-16T13:55:23.415983+0000","last_became_peered":"2023-05-16T13:55:23.415983+0000","last_unstale":"2023-05-16T13:55:24.389340+0000","last_undegraded":"2023-05-16T13:55:24.389340+0000","last_fullsized":"2023-05-16T13:55:24.389340+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:45:04.746418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703229+0000","last_change":"2023-05-16T13:55:23.003470+0000","last_active":"2023-05-16T13:55:24.703229+0000","last_peered":"2023-05-16T13:55:24.703229+0000","last_clean":"2023-05-16T13:55:24.703229+0000","last_became_active":"2023-05-16T13:55:23.003203+0000","last_became_peered":"2023-05-16T13:55:23.003203+0000","last_unstale":"2023-05-16T13:55:24.703229+0000","last_undegraded":"2023-05-16T13:55:24.703229+0000","last_fullsized":"2023-05-16T13:55:24.703229+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T20:23:26.619277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.389117+0000","last_change":"2023-05-16T13:55:23.005895+0000","last_active":"2023-05-16T13:55:24.389117+0000","last_peered":"2023-05-16T13:55:24.389117+0000","last_clean":"2023-05-16T13:55:24.389117+0000","last_became_active":"2023-05-16T13:55:23.005582+0000","last_became_peered":"2023-05-16T13:55:23.005582+0000","last_unstale":"2023-05-16T13:55:24.389117+0000","last_undegraded":"2023-05-16T13:55:24.389117+0000","last_fullsized":"2023-05-16T13:55:24.389117+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:21:37.712743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703434+0000","last_change":"2023-05-16T13:55:23.411672+0000","last_active":"2023-05-16T13:55:24.703434+0000","last_peered":"2023-05-16T13:55:24.703434+0000","last_clean":"2023-05-16T13:55:24.703434+0000","last_became_active":"2023-05-16T13:55:23.408317+0000","last_became_peered":"2023-05-16T13:55:23.408317+0000","last_unstale":"2023-05-16T13:55:24.703434+0000","last_undegraded":"2023-05-16T13:55:24.703434+0000","last_fullsized":"2023-05-16T13:55:24.703434+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:24:27.841261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.389190+0000","last_change":"2023-05-16T13:55:23.001075+0000","last_active":"2023-05-16T13:55:24.389190+0000","last_peered":"2023-05-16T13:55:24.389190+0000","last_clean":"2023-05-16T13:55:24.389190+0000","last_became_active":"2023-05-16T13:55:23.000764+0000","last_became_peered":"2023-05-16T13:55:23.000764+0000","last_unstale":"2023-05-16T13:55:24.389190+0000","last_undegraded":"2023-05-16T13:55:24.389190+0000","last_fullsized":"2023-05-16T13:55:24.389190+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:25:15.075534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:21.955159+0000","last_change":"2023-05-16T13:55:21.955159+0000","last_active":"2023-05-16T13:55:21.955159+0000","last_peered":"2023-05-16T13:55:21.955159+0000","last_clean":"2023-05-16T13:55:21.955159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:21.955159+0000","last_undegraded":"2023-05-16T13:55:21.955159+0000","last_fullsized":"2023-05-16T13:55:21.955159+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.704066+0000","last_change":"2023-05-16T13:55:23.408380+0000","last_active":"2023-05-16T13:55:24.704066+0000","last_peered":"2023-05-16T13:55:24.704066+0000","last_clean":"2023-05-16T13:55:24.704066+0000","last_became_active":"2023-05-16T13:55:23.408097+0000","last_became_peered":"2023-05-16T13:55:23.408097+0000","last_unstale":"2023-05-16T13:55:24.704066+0000","last_undegraded":"2023-05-16T13:55:24.704066+0000","last_fullsized":"2023-05-16T13:55:24.704066+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T23:46:15.133417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.389006+0000","last_change":"2023-05-16T13:55:23.006029+0000","last_active":"2023-05-16T13:55:24.389006+0000","last_peered":"2023-05-16T13:55:24.389006+0000","last_clean":"2023-05-16T13:55:24.389006+0000","last_became_active":"2023-05-16T13:55:23.005646+0000","last_became_peered":"2023-05-16T13:55:23.005646+0000","last_unstale":"2023-05-16T13:55:24.389006+0000","last_undegraded":"2023-05-16T13:55:24.389006+0000","last_fullsized":"2023-05-16T13:55:24.389006+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:49:42.765347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:21.955159+0000","last_change":"2023-05-16T13:55:21.955159+0000","last_active":"2023-05-16T13:55:21.955159+0000","last_peered":"2023-05-16T13:55:21.955159+0000","last_clean":"2023-05-16T13:55:21.955159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:21.955159+0000","last_undegraded":"2023-05-16T13:55:21.955159+0000","last_fullsized":"2023-05-16T13:55:21.955159+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":191,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-16T13:55:18.046790+0000","last_change":"2023-05-16T13:54:03.495814+0000","last_active":"2023-05-16T13:55:18.046790+0000","last_peered":"2023-05-16T13:55:18.046790+0000","last_clean":"2023-05-16T13:55:18.046790+0000","last_became_active":"2023-05-16T13:54:03.494265+0000","last_became_peered":"2023-05-16T13:54:03.494265+0000","last_unstale":"2023-05-16T13:55:18.046790+0000","last_undegraded":"2023-05-16T13:55:18.046790+0000","last_fullsized":"2023-05-16T13:55:18.046790+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:01.722051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:01.722051+0000","last_clean_scrub_stamp":"2023-05-16T13:54:01.722051+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:30:50.824134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-16T13:55:18.872199+0000","last_change":"2023-05-16T13:54:09.770727+0000","last_active":"2023-05-16T13:55:18.872199+0000","last_peered":"2023-05-16T13:55:18.872199+0000","last_clean":"2023-05-16T13:55:18.872199+0000","last_became_active":"2023-05-16T13:54:09.770179+0000","last_became_peered":"2023-05-16T13:54:09.770179+0000","last_unstale":"2023-05-16T13:55:18.872199+0000","last_undegraded":"2023-05-16T13:55:18.872199+0000","last_fullsized":"2023-05-16T13:55:18.872199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T13:54:42.241552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703107+0000","last_change":"2023-05-16T13:55:23.424350+0000","last_active":"2023-05-16T13:55:24.703107+0000","last_peered":"2023-05-16T13:55:24.703107+0000","last_clean":"2023-05-16T13:55:24.703107+0000","last_became_active":"2023-05-16T13:55:23.424033+0000","last_became_peered":"2023-05-16T13:55:23.424033+0000","last_unstale":"2023-05-16T13:55:24.703107+0000","last_undegraded":"2023-05-16T13:55:24.703107+0000","last_fullsized":"2023-05-16T13:55:24.703107+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T23:52:16.681043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:21.955159+0000","last_change":"2023-05-16T13:55:21.955159+0000","last_active":"2023-05-16T13:55:21.955159+0000","last_peered":"2023-05-16T13:55:21.955159+0000","last_clean":"2023-05-16T13:55:21.955159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:21.955159+0000","last_undegraded":"2023-05-16T13:55:21.955159+0000","last_fullsized":"2023-05-16T13:55:21.955159+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-16T13:55:18.046793+0000","last_change":"2023-05-16T13:54:09.768888+0000","last_active":"2023-05-16T13:55:18.046793+0000","last_peered":"2023-05-16T13:55:18.046793+0000","last_clean":"2023-05-16T13:55:18.046793+0000","last_became_active":"2023-05-16T13:54:09.768463+0000","last_became_peered":"2023-05-16T13:54:09.768463+0000","last_unstale":"2023-05-16T13:55:18.046793+0000","last_undegraded":"2023-05-16T13:55:18.046793+0000","last_fullsized":"2023-05-16T13:55:18.046793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T14:50:54.235998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.389284+0000","last_change":"2023-05-16T13:55:23.009854+0000","last_active":"2023-05-16T13:55:24.389284+0000","last_peered":"2023-05-16T13:55:24.389284+0000","last_clean":"2023-05-16T13:55:24.389284+0000","last_became_active":"2023-05-16T13:55:23.009546+0000","last_became_peered":"2023-05-16T13:55:23.009546+0000","last_unstale":"2023-05-16T13:55:24.389284+0000","last_undegraded":"2023-05-16T13:55:24.389284+0000","last_fullsized":"2023-05-16T13:55:24.389284+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T18:09:26.341219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.388996+0000","last_change":"2023-05-16T13:54:09.821010+0000","last_active":"2023-05-16T13:55:24.388996+0000","last_peered":"2023-05-16T13:55:24.388996+0000","last_clean":"2023-05-16T13:55:24.388996+0000","last_became_active":"2023-05-16T13:54:09.820636+0000","last_became_peered":"2023-05-16T13:54:09.820636+0000","last_unstale":"2023-05-16T13:55:24.388996+0000","last_undegraded":"2023-05-16T13:55:24.388996+0000","last_fullsized":"2023-05-16T13:55:24.388996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T16:40:06.160431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703115+0000","last_change":"2023-05-16T13:55:23.407818+0000","last_active":"2023-05-16T13:55:24.703115+0000","last_peered":"2023-05-16T13:55:24.703115+0000","last_clean":"2023-05-16T13:55:24.703115+0000","last_became_active":"2023-05-16T13:55:23.407568+0000","last_became_peered":"2023-05-16T13:55:23.407568+0000","last_unstale":"2023-05-16T13:55:24.703115+0000","last_undegraded":"2023-05-16T13:55:24.703115+0000","last_fullsized":"2023-05-16T13:55:24.703115+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:04:23.740266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702701+0000","last_change":"2023-05-16T13:55:23.003233+0000","last_active":"2023-05-16T13:55:24.702701+0000","last_peered":"2023-05-16T13:55:24.702701+0000","last_clean":"2023-05-16T13:55:24.702701+0000","last_became_active":"2023-05-16T13:55:23.002924+0000","last_became_peered":"2023-05-16T13:55:23.002924+0000","last_unstale":"2023-05-16T13:55:24.702701+0000","last_undegraded":"2023-05-16T13:55:24.702701+0000","last_fullsized":"2023-05-16T13:55:24.702701+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T16:42:10.128117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-16T13:55:18.872215+0000","last_change":"2023-05-16T13:54:09.771040+0000","last_active":"2023-05-16T13:55:18.872215+0000","last_peered":"2023-05-16T13:55:18.872215+0000","last_clean":"2023-05-16T13:55:18.872215+0000","last_became_active":"2023-05-16T13:54:09.770433+0000","last_became_peered":"2023-05-16T13:54:09.770433+0000","last_unstale":"2023-05-16T13:55:18.872215+0000","last_undegraded":"2023-05-16T13:55:18.872215+0000","last_fullsized":"2023-05-16T13:55:18.872215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T23:45:06.073649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703572+0000","last_change":"2023-05-16T13:55:23.412124+0000","last_active":"2023-05-16T13:55:24.703572+0000","last_peered":"2023-05-16T13:55:24.703572+0000","last_clean":"2023-05-16T13:55:24.703572+0000","last_became_active":"2023-05-16T13:55:23.411824+0000","last_became_peered":"2023-05-16T13:55:23.411824+0000","last_unstale":"2023-05-16T13:55:24.703572+0000","last_undegraded":"2023-05-16T13:55:24.703572+0000","last_fullsized":"2023-05-16T13:55:24.703572+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:42:50.808847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.704046+0000","last_change":"2023-05-16T13:55:22.999434+0000","last_active":"2023-05-16T13:55:24.704046+0000","last_peered":"2023-05-16T13:55:24.704046+0000","last_clean":"2023-05-16T13:55:24.704046+0000","last_became_active":"2023-05-16T13:55:22.999152+0000","last_became_peered":"2023-05-16T13:55:22.999152+0000","last_unstale":"2023-05-16T13:55:24.704046+0000","last_undegraded":"2023-05-16T13:55:24.704046+0000","last_fullsized":"2023-05-16T13:55:24.704046+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T14:02:33.296373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703306+0000","last_change":"2023-05-16T13:54:09.813177+0000","last_active":"2023-05-16T13:55:24.703306+0000","last_peered":"2023-05-16T13:55:24.703306+0000","last_clean":"2023-05-16T13:55:24.703306+0000","last_became_active":"2023-05-16T13:54:09.812487+0000","last_became_peered":"2023-05-16T13:54:09.812487+0000","last_unstale":"2023-05-16T13:55:24.703306+0000","last_undegraded":"2023-05-16T13:55:24.703306+0000","last_fullsized":"2023-05-16T13:55:24.703306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T23:57:49.146859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702519+0000","last_change":"2023-05-16T13:55:23.410758+0000","last_active":"2023-05-16T13:55:24.702519+0000","last_peered":"2023-05-16T13:55:24.702519+0000","last_clean":"2023-05-16T13:55:24.702519+0000","last_became_active":"2023-05-16T13:55:23.410389+0000","last_became_peered":"2023-05-16T13:55:23.410389+0000","last_unstale":"2023-05-16T13:55:24.702519+0000","last_undegraded":"2023-05-16T13:55:24.702519+0000","last_fullsized":"2023-05-16T13:55:24.702519+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:36:07.932696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:21.955159+0000","last_change":"2023-05-16T13:55:21.955159+0000","last_active":"2023-05-16T13:55:21.955159+0000","last_peered":"2023-05-16T13:55:21.955159+0000","last_clean":"2023-05-16T13:55:21.955159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:21.955159+0000","last_undegraded":"2023-05-16T13:55:21.955159+0000","last_fullsized":"2023-05-16T13:55:21.955159+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-16T13:55:18.046828+0000","last_change":"2023-05-16T13:54:09.813305+0000","last_active":"2023-05-16T13:55:18.046828+0000","last_peered":"2023-05-16T13:55:18.046828+0000","last_clean":"2023-05-16T13:55:18.046828+0000","last_became_active":"2023-05-16T13:54:09.812931+0000","last_became_peered":"2023-05-16T13:54:09.812931+0000","last_unstale":"2023-05-16T13:55:18.046828+0000","last_undegraded":"2023-05-16T13:55:18.046828+0000","last_fullsized":"2023-05-16T13:55:18.046828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:38:10.685762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:21.955159+0000","last_change":"2023-05-16T13:55:21.955159+0000","last_active":"2023-05-16T13:55:21.955159+0000","last_peered":"2023-05-16T13:55:21.955159+0000","last_clean":"2023-05-16T13:55:21.955159+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:21.955159+0000","last_undegraded":"2023-05-16T13:55:21.955159+0000","last_fullsized":"2023-05-16T13:55:21.955159+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703646+0000","last_change":"2023-05-16T13:54:09.768257+0000","last_active":"2023-05-16T13:55:24.703646+0000","last_peered":"2023-05-16T13:55:24.703646+0000","last_clean":"2023-05-16T13:55:24.703646+0000","last_became_active":"2023-05-16T13:54:09.767879+0000","last_became_peered":"2023-05-16T13:54:09.767879+0000","last_unstale":"2023-05-16T13:55:24.703646+0000","last_undegraded":"2023-05-16T13:55:24.703646+0000","last_fullsized":"2023-05-16T13:55:24.703646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:59:08.711793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-16T13:55:22.972586+0000","last_change":"2023-05-16T13:55:22.972586+0000","last_active":"2023-05-16T13:55:22.972586+0000","last_peered":"2023-05-16T13:55:22.972586+0000","last_clean":"2023-05-16T13:55:22.972586+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-16T13:55:22.972586+0000","last_undegraded":"2023-05-16T13:55:22.972586+0000","last_fullsized":"2023-05-16T13:55:22.972586+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702984+0000","last_change":"2023-05-16T13:55:22.998169+0000","last_active":"2023-05-16T13:55:24.702984+0000","last_peered":"2023-05-16T13:55:24.702984+0000","last_clean":"2023-05-16T13:55:24.702984+0000","last_became_active":"2023-05-16T13:55:22.997892+0000","last_became_peered":"2023-05-16T13:55:22.997892+0000","last_unstale":"2023-05-16T13:55:24.702984+0000","last_undegraded":"2023-05-16T13:55:24.702984+0000","last_fullsized":"2023-05-16T13:55:24.702984+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:03:49.235876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-16T13:55:17.163014+0000","last_change":"2023-05-16T13:54:09.768603+0000","last_active":"2023-05-16T13:55:17.163014+0000","last_peered":"2023-05-16T13:55:17.163014+0000","last_clean":"2023-05-16T13:55:17.163014+0000","last_became_active":"2023-05-16T13:54:09.768323+0000","last_became_peered":"2023-05-16T13:54:09.768323+0000","last_unstale":"2023-05-16T13:55:17.163014+0000","last_undegraded":"2023-05-16T13:55:17.163014+0000","last_fullsized":"2023-05-16T13:55:17.163014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:53:25.367588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":60,"acting":60,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1668,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14,"ondisk_log_size":14,"up":32,"acting":32,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509459,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13500,"kb_used_data":948,"kb_used_omap":0,"kb_used_meta":12544,"kb_avail":94358340,"statfs":{"total":96636764160,"available":96622940160,"internally_reserved":0,"allocated":970752,"data_stored":740828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12845056},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue May 16 13:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.59599999999999997}]},{"osd":1,"last update":"Tue May 16 13:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.64500000000000002}]},{"osd":2,"last update":"Tue May 16 13:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.62}]},{"osd":3,"last update":"Tue May 16 13:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.76600000000000001}]},{"osd":4,"last update":"Tue May 16 13:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":1.0469999999999999}]},{"osd":5,"last update":"Tue May 16 13:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":1.1020000000000001}]},{"osd":6,"last update":"Tue May 16 13:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":1.1859999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":1.167}]}]},{"osd":6,"up_from":15,"seq":64424509458,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12344,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":11968,"kb_avail":94359496,"statfs":{"total":96636764160,"available":96624123904,"internally_reserved":0,"allocated":376832,"data_stored":150460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12255232},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.68999999999999995}]},{"osd":1,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.61299999999999999}]},{"osd":2,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.67100000000000004}]},{"osd":3,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.72499999999999998}]},{"osd":4,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.70999999999999996}]},{"osd":5,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.58899999999999997}]},{"osd":7,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.747}]}]},{"osd":5,"up_from":15,"seq":64424509459,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12344,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":11968,"kb_avail":94359496,"statfs":{"total":96636764160,"available":96624123904,"internally_reserved":0,"allocated":376832,"data_stored":150460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12255232},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue May 16 13:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.63}]},{"osd":1,"last update":"Tue May 16 13:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":0.495},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.77900000000000003}]},{"osd":2,"last update":"Tue May 16 13:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.80500000000000005}]},{"osd":3,"last update":"Tue May 16 13:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.59299999999999997}]},{"osd":4,"last update":"Tue May 16 13:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.67600000000000005}]},{"osd":6,"last update":"Tue May 16 13:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.82599999999999996}]},{"osd":7,"last update":"Tue May 16 13:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.65600000000000003}]}]},{"osd":4,"up_from":15,"seq":64424509459,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":12472,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":12096,"kb_avail":94359368,"statfs":{"total":96636764160,"available":96623992832,"internally_reserved":0,"allocated":376832,"data_stored":150460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12386304},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.56399999999999995}]},{"osd":1,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.61899999999999999}]},{"osd":2,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.58399999999999996}]},{"osd":3,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.64200000000000002}]},{"osd":5,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.59899999999999998}]},{"osd":6,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.745}]},{"osd":7,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.79100000000000004}]}]},{"osd":3,"up_from":14,"seq":60129542164,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12664,"kb_used_data":432,"kb_used_omap":0,"kb_used_meta":12224,"kb_avail":94359176,"statfs":{"total":96636764160,"available":96623796224,"internally_reserved":0,"allocated":442368,"data_stored":178637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12517376},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.41599999999999998}]},{"osd":1,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.432}]},{"osd":2,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.36099999999999999}]},{"osd":4,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":0.79600000000000004}]},{"osd":5,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.631,"5min":1.631,"15min":1.631},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.72199999999999998}]},{"osd":6,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.753}]},{"osd":7,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.80500000000000005}]}]},{"osd":2,"up_from":14,"seq":60129542164,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12524,"kb_used_data":420,"kb_used_omap":0,"kb_used_meta":12096,"kb_avail":94359316,"statfs":{"total":96636764160,"available":96623939584,"internally_reserved":0,"allocated":430080,"data_stored":177109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12386304},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue May 16 13:55:01 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.48599999999999999}]},{"osd":1,"last update":"Tue May 16 13:55:01 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.54900000000000004}]},{"osd":3,"last update":"Tue May 16 13:55:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.50600000000000001}]},{"osd":4,"last update":"Tue May 16 13:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.85899999999999999}]},{"osd":5,"last update":"Tue May 16 13:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.81799999999999995}]},{"osd":6,"last update":"Tue May 16 13:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.83899999999999997}]},{"osd":7,"last update":"Tue May 16 13:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.89300000000000002}]}]},{"osd":1,"up_from":14,"seq":60129542163,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12588,"kb_used_data":420,"kb_used_omap":0,"kb_used_meta":12160,"kb_avail":94359252,"statfs":{"total":96636764160,"available":96623874048,"internally_reserved":0,"allocated":430080,"data_stored":177129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12451840},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.311},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.46999999999999997}]},{"osd":2,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.373},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.48399999999999999}]},{"osd":3,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.441}]},{"osd":4,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.59499999999999997}]},{"osd":5,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.69699999999999995}]},{"osd":6,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.67900000000000005}]},{"osd":7,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.67100000000000004}]}]},{"osd":0,"up_from":14,"seq":60129542164,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13680,"kb_used_data":1000,"kb_used_omap":0,"kb_used_meta":12672,"kb_avail":94358160,"statfs":{"total":96636764160,"available":96622755840,"internally_reserved":0,"allocated":1024000,"data_stored":767441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12976128},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue May 16 13:55:03 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.42199999999999999}]},{"osd":2,"last update":"Tue May 16 13:55:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.497},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.53900000000000003}]},{"osd":3,"last update":"Tue May 16 13:55:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.51100000000000001}]},{"osd":4,"last update":"Tue May 16 13:55:03 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.66800000000000004}]},{"osd":5,"last update":"Tue May 16 13:55:03 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":2.2639999999999998,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.77300000000000002}]},{"osd":6,"last update":"Tue May 16 13:55:03 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":2.3380000000000001,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":0.753},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.70699999999999996}]},{"osd":7,"last update":"Tue May 16 13:55:03 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":2.403,"5min":2.403,"15min":2.403},"last":0.80900000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-16T13:55:28.246 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.39 is not active+clean 2023-05-16T13:55:28.246 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-16T13:55:22.972586+0000', 'last_change': '2023-05-16T13:55:22.972586+0000', 'last_active': '2023-05-16T13:55:22.972586+0000', 'last_peered': '2023-05-16T13:55:22.972586+0000', 'last_clean': '2023-05-16T13:55:22.972586+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-16T13:55:22.972586+0000', 'last_undegraded': '2023-05-16T13:55:22.972586+0000', 'last_fullsized': '2023-05-16T13:55:22.972586+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'last_clean_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-16T13:55:28.247 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.36 is not active+clean 2023-05-16T13:55:28.247 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-16T13:55:22.972586+0000', 'last_change': '2023-05-16T13:55:22.972586+0000', 'last_active': '2023-05-16T13:55:22.972586+0000', 'last_peered': '2023-05-16T13:55:22.972586+0000', 'last_clean': '2023-05-16T13:55:22.972586+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-16T13:55:22.972586+0000', 'last_undegraded': '2023-05-16T13:55:22.972586+0000', 'last_fullsized': '2023-05-16T13:55:22.972586+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'last_clean_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-16T13:55:28.247 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.35 is not active+clean 2023-05-16T13:55:28.247 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-16T13:55:22.972586+0000', 'last_change': '2023-05-16T13:55:22.972586+0000', 'last_active': '2023-05-16T13:55:22.972586+0000', 'last_peered': '2023-05-16T13:55:22.972586+0000', 'last_clean': '2023-05-16T13:55:22.972586+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-16T13:55:22.972586+0000', 'last_undegraded': '2023-05-16T13:55:22.972586+0000', 'last_fullsized': '2023-05-16T13:55:22.972586+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'last_clean_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-16T13:55:28.248 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.33 is not active+clean 2023-05-16T13:55:28.248 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-16T13:55:22.972586+0000', 'last_change': '2023-05-16T13:55:22.972586+0000', 'last_active': '2023-05-16T13:55:22.972586+0000', 'last_peered': '2023-05-16T13:55:22.972586+0000', 'last_clean': '2023-05-16T13:55:22.972586+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-16T13:55:22.972586+0000', 'last_undegraded': '2023-05-16T13:55:22.972586+0000', 'last_fullsized': '2023-05-16T13:55:22.972586+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'last_clean_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-16T13:55:28.248 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.32 is not active+clean 2023-05-16T13:55:28.249 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-16T13:55:22.972586+0000', 'last_change': '2023-05-16T13:55:22.972586+0000', 'last_active': '2023-05-16T13:55:22.972586+0000', 'last_peered': '2023-05-16T13:55:22.972586+0000', 'last_clean': '2023-05-16T13:55:22.972586+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-16T13:55:22.972586+0000', 'last_undegraded': '2023-05-16T13:55:22.972586+0000', 'last_fullsized': '2023-05-16T13:55:22.972586+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'last_clean_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-16T13:55:28.249 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.31 is not active+clean 2023-05-16T13:55:28.249 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-16T13:55:22.972586+0000', 'last_change': '2023-05-16T13:55:22.972586+0000', 'last_active': '2023-05-16T13:55:22.972586+0000', 'last_peered': '2023-05-16T13:55:22.972586+0000', 'last_clean': '2023-05-16T13:55:22.972586+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-16T13:55:22.972586+0000', 'last_undegraded': '2023-05-16T13:55:22.972586+0000', 'last_fullsized': '2023-05-16T13:55:22.972586+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'last_clean_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-16T13:55:28.250 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.30 is not active+clean 2023-05-16T13:55:28.250 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-16T13:55:22.972586+0000', 'last_change': '2023-05-16T13:55:22.972586+0000', 'last_active': '2023-05-16T13:55:22.972586+0000', 'last_peered': '2023-05-16T13:55:22.972586+0000', 'last_clean': '2023-05-16T13:55:22.972586+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-16T13:55:22.972586+0000', 'last_undegraded': '2023-05-16T13:55:22.972586+0000', 'last_fullsized': '2023-05-16T13:55:22.972586+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'last_clean_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-16T13:55:28.250 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2f is not active+clean 2023-05-16T13:55:28.251 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-16T13:55:22.972586+0000', 'last_change': '2023-05-16T13:55:22.972586+0000', 'last_active': '2023-05-16T13:55:22.972586+0000', 'last_peered': '2023-05-16T13:55:22.972586+0000', 'last_clean': '2023-05-16T13:55:22.972586+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-16T13:55:22.972586+0000', 'last_undegraded': '2023-05-16T13:55:22.972586+0000', 'last_fullsized': '2023-05-16T13:55:22.972586+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'last_clean_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-16T13:55:28.251 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2e is not active+clean 2023-05-16T13:55:28.251 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-16T13:55:22.972586+0000', 'last_change': '2023-05-16T13:55:22.972586+0000', 'last_active': '2023-05-16T13:55:22.972586+0000', 'last_peered': '2023-05-16T13:55:22.972586+0000', 'last_clean': '2023-05-16T13:55:22.972586+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-16T13:55:22.972586+0000', 'last_undegraded': '2023-05-16T13:55:22.972586+0000', 'last_fullsized': '2023-05-16T13:55:22.972586+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'last_clean_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-16T13:55:28.252 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2c is not active+clean 2023-05-16T13:55:28.252 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-16T13:55:22.972586+0000', 'last_change': '2023-05-16T13:55:22.972586+0000', 'last_active': '2023-05-16T13:55:22.972586+0000', 'last_peered': '2023-05-16T13:55:22.972586+0000', 'last_clean': '2023-05-16T13:55:22.972586+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-16T13:55:22.972586+0000', 'last_undegraded': '2023-05-16T13:55:22.972586+0000', 'last_fullsized': '2023-05-16T13:55:22.972586+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'last_clean_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-16T13:55:28.252 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2b is not active+clean 2023-05-16T13:55:28.253 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-16T13:55:22.972586+0000', 'last_change': '2023-05-16T13:55:22.972586+0000', 'last_active': '2023-05-16T13:55:22.972586+0000', 'last_peered': '2023-05-16T13:55:22.972586+0000', 'last_clean': '2023-05-16T13:55:22.972586+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-16T13:55:22.972586+0000', 'last_undegraded': '2023-05-16T13:55:22.972586+0000', 'last_fullsized': '2023-05-16T13:55:22.972586+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'last_clean_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-16T13:55:28.253 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2a is not active+clean 2023-05-16T13:55:28.253 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-16T13:55:22.972586+0000', 'last_change': '2023-05-16T13:55:22.972586+0000', 'last_active': '2023-05-16T13:55:22.972586+0000', 'last_peered': '2023-05-16T13:55:22.972586+0000', 'last_clean': '2023-05-16T13:55:22.972586+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-16T13:55:22.972586+0000', 'last_undegraded': '2023-05-16T13:55:22.972586+0000', 'last_fullsized': '2023-05-16T13:55:22.972586+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'last_clean_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-16T13:55:28.254 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.29 is not active+clean 2023-05-16T13:55:28.254 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-16T13:55:22.972586+0000', 'last_change': '2023-05-16T13:55:22.972586+0000', 'last_active': '2023-05-16T13:55:22.972586+0000', 'last_peered': '2023-05-16T13:55:22.972586+0000', 'last_clean': '2023-05-16T13:55:22.972586+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-16T13:55:22.972586+0000', 'last_undegraded': '2023-05-16T13:55:22.972586+0000', 'last_fullsized': '2023-05-16T13:55:22.972586+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'last_clean_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-16T13:55:28.254 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.27 is not active+clean 2023-05-16T13:55:28.254 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-16T13:55:22.972586+0000', 'last_change': '2023-05-16T13:55:22.972586+0000', 'last_active': '2023-05-16T13:55:22.972586+0000', 'last_peered': '2023-05-16T13:55:22.972586+0000', 'last_clean': '2023-05-16T13:55:22.972586+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-16T13:55:22.972586+0000', 'last_undegraded': '2023-05-16T13:55:22.972586+0000', 'last_fullsized': '2023-05-16T13:55:22.972586+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'last_clean_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-16T13:55:28.255 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.25 is not active+clean 2023-05-16T13:55:28.255 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-16T13:55:22.972586+0000', 'last_change': '2023-05-16T13:55:22.972586+0000', 'last_active': '2023-05-16T13:55:22.972586+0000', 'last_peered': '2023-05-16T13:55:22.972586+0000', 'last_clean': '2023-05-16T13:55:22.972586+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-16T13:55:22.972586+0000', 'last_undegraded': '2023-05-16T13:55:22.972586+0000', 'last_fullsized': '2023-05-16T13:55:22.972586+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'last_clean_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-16T13:55:28.255 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.24 is not active+clean 2023-05-16T13:55:28.256 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-16T13:55:22.972586+0000', 'last_change': '2023-05-16T13:55:22.972586+0000', 'last_active': '2023-05-16T13:55:22.972586+0000', 'last_peered': '2023-05-16T13:55:22.972586+0000', 'last_clean': '2023-05-16T13:55:22.972586+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-16T13:55:22.972586+0000', 'last_undegraded': '2023-05-16T13:55:22.972586+0000', 'last_fullsized': '2023-05-16T13:55:22.972586+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'last_clean_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-16T13:55:28.256 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.23 is not active+clean 2023-05-16T13:55:28.256 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-16T13:55:22.972586+0000', 'last_change': '2023-05-16T13:55:22.972586+0000', 'last_active': '2023-05-16T13:55:22.972586+0000', 'last_peered': '2023-05-16T13:55:22.972586+0000', 'last_clean': '2023-05-16T13:55:22.972586+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-16T13:55:22.972586+0000', 'last_undegraded': '2023-05-16T13:55:22.972586+0000', 'last_fullsized': '2023-05-16T13:55:22.972586+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'last_clean_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-16T13:55:28.257 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.22 is not active+clean 2023-05-16T13:55:28.257 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-16T13:55:22.972586+0000', 'last_change': '2023-05-16T13:55:22.972586+0000', 'last_active': '2023-05-16T13:55:22.972586+0000', 'last_peered': '2023-05-16T13:55:22.972586+0000', 'last_clean': '2023-05-16T13:55:22.972586+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-16T13:55:22.972586+0000', 'last_undegraded': '2023-05-16T13:55:22.972586+0000', 'last_fullsized': '2023-05-16T13:55:22.972586+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'last_clean_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-16T13:55:28.257 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.21 is not active+clean 2023-05-16T13:55:28.258 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-16T13:55:22.972586+0000', 'last_change': '2023-05-16T13:55:22.972586+0000', 'last_active': '2023-05-16T13:55:22.972586+0000', 'last_peered': '2023-05-16T13:55:22.972586+0000', 'last_clean': '2023-05-16T13:55:22.972586+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-16T13:55:22.972586+0000', 'last_undegraded': '2023-05-16T13:55:22.972586+0000', 'last_fullsized': '2023-05-16T13:55:22.972586+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'last_clean_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-16T13:55:28.258 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1c is not active+clean 2023-05-16T13:55:28.258 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-16T13:55:22.972586+0000', 'last_change': '2023-05-16T13:55:22.972586+0000', 'last_active': '2023-05-16T13:55:22.972586+0000', 'last_peered': '2023-05-16T13:55:22.972586+0000', 'last_clean': '2023-05-16T13:55:22.972586+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-16T13:55:22.972586+0000', 'last_undegraded': '2023-05-16T13:55:22.972586+0000', 'last_fullsized': '2023-05-16T13:55:22.972586+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'last_clean_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-16T13:55:28.259 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2023-05-16T13:55:28.259 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-16T13:55:21.955159+0000', 'last_change': '2023-05-16T13:55:21.955159+0000', 'last_active': '2023-05-16T13:55:21.955159+0000', 'last_peered': '2023-05-16T13:55:21.955159+0000', 'last_clean': '2023-05-16T13:55:21.955159+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-16T13:55:21.955159+0000', 'last_undegraded': '2023-05-16T13:55:21.955159+0000', 'last_fullsized': '2023-05-16T13:55:21.955159+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-16T13:55:21.955159+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-16T13:55:21.955159+0000', 'last_clean_scrub_stamp': '2023-05-16T13:55:21.955159+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-16T13:55:28.259 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1e is not active+clean 2023-05-16T13:55:28.260 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-16T13:55:22.972586+0000', 'last_change': '2023-05-16T13:55:22.972586+0000', 'last_active': '2023-05-16T13:55:22.972586+0000', 'last_peered': '2023-05-16T13:55:22.972586+0000', 'last_clean': '2023-05-16T13:55:22.972586+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-16T13:55:22.972586+0000', 'last_undegraded': '2023-05-16T13:55:22.972586+0000', 'last_fullsized': '2023-05-16T13:55:22.972586+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'last_clean_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-16T13:55:28.260 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2023-05-16T13:55:28.260 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-16T13:55:21.955159+0000', 'last_change': '2023-05-16T13:55:21.955159+0000', 'last_active': '2023-05-16T13:55:21.955159+0000', 'last_peered': '2023-05-16T13:55:21.955159+0000', 'last_clean': '2023-05-16T13:55:21.955159+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-16T13:55:21.955159+0000', 'last_undegraded': '2023-05-16T13:55:21.955159+0000', 'last_fullsized': '2023-05-16T13:55:21.955159+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-16T13:55:21.955159+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-16T13:55:21.955159+0000', 'last_clean_scrub_stamp': '2023-05-16T13:55:21.955159+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-16T13:55:28.261 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2023-05-16T13:55:28.261 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-16T13:55:21.955159+0000', 'last_change': '2023-05-16T13:55:21.955159+0000', 'last_active': '2023-05-16T13:55:21.955159+0000', 'last_peered': '2023-05-16T13:55:21.955159+0000', 'last_clean': '2023-05-16T13:55:21.955159+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-16T13:55:21.955159+0000', 'last_undegraded': '2023-05-16T13:55:21.955159+0000', 'last_fullsized': '2023-05-16T13:55:21.955159+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-16T13:55:21.955159+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-16T13:55:21.955159+0000', 'last_clean_scrub_stamp': '2023-05-16T13:55:21.955159+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-16T13:55:28.261 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.19 is not active+clean 2023-05-16T13:55:28.262 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-16T13:55:22.972586+0000', 'last_change': '2023-05-16T13:55:22.972586+0000', 'last_active': '2023-05-16T13:55:22.972586+0000', 'last_peered': '2023-05-16T13:55:22.972586+0000', 'last_clean': '2023-05-16T13:55:22.972586+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-16T13:55:22.972586+0000', 'last_undegraded': '2023-05-16T13:55:22.972586+0000', 'last_fullsized': '2023-05-16T13:55:22.972586+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'last_clean_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-16T13:55:28.262 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2023-05-16T13:55:28.262 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-16T13:55:21.955159+0000', 'last_change': '2023-05-16T13:55:21.955159+0000', 'last_active': '2023-05-16T13:55:21.955159+0000', 'last_peered': '2023-05-16T13:55:21.955159+0000', 'last_clean': '2023-05-16T13:55:21.955159+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-16T13:55:21.955159+0000', 'last_undegraded': '2023-05-16T13:55:21.955159+0000', 'last_fullsized': '2023-05-16T13:55:21.955159+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-16T13:55:21.955159+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-16T13:55:21.955159+0000', 'last_clean_scrub_stamp': '2023-05-16T13:55:21.955159+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-16T13:55:28.263 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1a is not active+clean 2023-05-16T13:55:28.263 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-16T13:55:22.972586+0000', 'last_change': '2023-05-16T13:55:22.972586+0000', 'last_active': '2023-05-16T13:55:22.972586+0000', 'last_peered': '2023-05-16T13:55:22.972586+0000', 'last_clean': '2023-05-16T13:55:22.972586+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-16T13:55:22.972586+0000', 'last_undegraded': '2023-05-16T13:55:22.972586+0000', 'last_fullsized': '2023-05-16T13:55:22.972586+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'last_clean_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-16T13:55:28.263 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2023-05-16T13:55:28.264 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-16T13:55:21.955159+0000', 'last_change': '2023-05-16T13:55:21.955159+0000', 'last_active': '2023-05-16T13:55:21.955159+0000', 'last_peered': '2023-05-16T13:55:21.955159+0000', 'last_clean': '2023-05-16T13:55:21.955159+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-16T13:55:21.955159+0000', 'last_undegraded': '2023-05-16T13:55:21.955159+0000', 'last_fullsized': '2023-05-16T13:55:21.955159+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-16T13:55:21.955159+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-16T13:55:21.955159+0000', 'last_clean_scrub_stamp': '2023-05-16T13:55:21.955159+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-16T13:55:28.264 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.15 is not active+clean 2023-05-16T13:55:28.264 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-16T13:55:22.972586+0000', 'last_change': '2023-05-16T13:55:22.972586+0000', 'last_active': '2023-05-16T13:55:22.972586+0000', 'last_peered': '2023-05-16T13:55:22.972586+0000', 'last_clean': '2023-05-16T13:55:22.972586+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-16T13:55:22.972586+0000', 'last_undegraded': '2023-05-16T13:55:22.972586+0000', 'last_fullsized': '2023-05-16T13:55:22.972586+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'last_clean_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-16T13:55:28.265 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2023-05-16T13:55:28.265 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-16T13:55:21.955159+0000', 'last_change': '2023-05-16T13:55:21.955159+0000', 'last_active': '2023-05-16T13:55:21.955159+0000', 'last_peered': '2023-05-16T13:55:21.955159+0000', 'last_clean': '2023-05-16T13:55:21.955159+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-16T13:55:21.955159+0000', 'last_undegraded': '2023-05-16T13:55:21.955159+0000', 'last_fullsized': '2023-05-16T13:55:21.955159+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-16T13:55:21.955159+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-16T13:55:21.955159+0000', 'last_clean_scrub_stamp': '2023-05-16T13:55:21.955159+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-16T13:55:28.265 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2023-05-16T13:55:28.266 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-16T13:55:21.955159+0000', 'last_change': '2023-05-16T13:55:21.955159+0000', 'last_active': '2023-05-16T13:55:21.955159+0000', 'last_peered': '2023-05-16T13:55:21.955159+0000', 'last_clean': '2023-05-16T13:55:21.955159+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-16T13:55:21.955159+0000', 'last_undegraded': '2023-05-16T13:55:21.955159+0000', 'last_fullsized': '2023-05-16T13:55:21.955159+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-16T13:55:21.955159+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-16T13:55:21.955159+0000', 'last_clean_scrub_stamp': '2023-05-16T13:55:21.955159+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-16T13:55:28.266 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.17 is not active+clean 2023-05-16T13:55:28.266 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-16T13:55:22.972586+0000', 'last_change': '2023-05-16T13:55:22.972586+0000', 'last_active': '2023-05-16T13:55:22.972586+0000', 'last_peered': '2023-05-16T13:55:22.972586+0000', 'last_clean': '2023-05-16T13:55:22.972586+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-16T13:55:22.972586+0000', 'last_undegraded': '2023-05-16T13:55:22.972586+0000', 'last_fullsized': '2023-05-16T13:55:22.972586+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'last_clean_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-16T13:55:28.267 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.12 is not active+clean 2023-05-16T13:55:28.267 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-16T13:55:22.972586+0000', 'last_change': '2023-05-16T13:55:22.972586+0000', 'last_active': '2023-05-16T13:55:22.972586+0000', 'last_peered': '2023-05-16T13:55:22.972586+0000', 'last_clean': '2023-05-16T13:55:22.972586+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-16T13:55:22.972586+0000', 'last_undegraded': '2023-05-16T13:55:22.972586+0000', 'last_fullsized': '2023-05-16T13:55:22.972586+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'last_clean_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-16T13:55:28.267 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2023-05-16T13:55:28.267 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-16T13:55:21.955159+0000', 'last_change': '2023-05-16T13:55:21.955159+0000', 'last_active': '2023-05-16T13:55:21.955159+0000', 'last_peered': '2023-05-16T13:55:21.955159+0000', 'last_clean': '2023-05-16T13:55:21.955159+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-16T13:55:21.955159+0000', 'last_undegraded': '2023-05-16T13:55:21.955159+0000', 'last_fullsized': '2023-05-16T13:55:21.955159+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-16T13:55:21.955159+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-16T13:55:21.955159+0000', 'last_clean_scrub_stamp': '2023-05-16T13:55:21.955159+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-16T13:55:28.268 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2023-05-16T13:55:28.268 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-16T13:55:21.955159+0000', 'last_change': '2023-05-16T13:55:21.955159+0000', 'last_active': '2023-05-16T13:55:21.955159+0000', 'last_peered': '2023-05-16T13:55:21.955159+0000', 'last_clean': '2023-05-16T13:55:21.955159+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-16T13:55:21.955159+0000', 'last_undegraded': '2023-05-16T13:55:21.955159+0000', 'last_fullsized': '2023-05-16T13:55:21.955159+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-16T13:55:21.955159+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-16T13:55:21.955159+0000', 'last_clean_scrub_stamp': '2023-05-16T13:55:21.955159+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-16T13:55:28.268 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2023-05-16T13:55:28.269 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-16T13:55:21.955159+0000', 'last_change': '2023-05-16T13:55:21.955159+0000', 'last_active': '2023-05-16T13:55:21.955159+0000', 'last_peered': '2023-05-16T13:55:21.955159+0000', 'last_clean': '2023-05-16T13:55:21.955159+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-16T13:55:21.955159+0000', 'last_undegraded': '2023-05-16T13:55:21.955159+0000', 'last_fullsized': '2023-05-16T13:55:21.955159+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-16T13:55:21.955159+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-16T13:55:21.955159+0000', 'last_clean_scrub_stamp': '2023-05-16T13:55:21.955159+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-16T13:55:28.269 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.d is not active+clean 2023-05-16T13:55:28.269 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-16T13:55:22.972586+0000', 'last_change': '2023-05-16T13:55:22.972586+0000', 'last_active': '2023-05-16T13:55:22.972586+0000', 'last_peered': '2023-05-16T13:55:22.972586+0000', 'last_clean': '2023-05-16T13:55:22.972586+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-16T13:55:22.972586+0000', 'last_undegraded': '2023-05-16T13:55:22.972586+0000', 'last_fullsized': '2023-05-16T13:55:22.972586+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'last_clean_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-16T13:55:28.270 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2023-05-16T13:55:28.271 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-16T13:55:21.955159+0000', 'last_change': '2023-05-16T13:55:21.955159+0000', 'last_active': '2023-05-16T13:55:21.955159+0000', 'last_peered': '2023-05-16T13:55:21.955159+0000', 'last_clean': '2023-05-16T13:55:21.955159+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-16T13:55:21.955159+0000', 'last_undegraded': '2023-05-16T13:55:21.955159+0000', 'last_fullsized': '2023-05-16T13:55:21.955159+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-16T13:55:21.955159+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-16T13:55:21.955159+0000', 'last_clean_scrub_stamp': '2023-05-16T13:55:21.955159+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-16T13:55:28.272 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.e is not active+clean 2023-05-16T13:55:28.272 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-16T13:55:22.972586+0000', 'last_change': '2023-05-16T13:55:22.972586+0000', 'last_active': '2023-05-16T13:55:22.972586+0000', 'last_peered': '2023-05-16T13:55:22.972586+0000', 'last_clean': '2023-05-16T13:55:22.972586+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-16T13:55:22.972586+0000', 'last_undegraded': '2023-05-16T13:55:22.972586+0000', 'last_fullsized': '2023-05-16T13:55:22.972586+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'last_clean_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-16T13:55:28.273 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.8 is not active+clean 2023-05-16T13:55:28.273 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-16T13:55:22.972586+0000', 'last_change': '2023-05-16T13:55:22.972586+0000', 'last_active': '2023-05-16T13:55:22.972586+0000', 'last_peered': '2023-05-16T13:55:22.972586+0000', 'last_clean': '2023-05-16T13:55:22.972586+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-16T13:55:22.972586+0000', 'last_undegraded': '2023-05-16T13:55:22.972586+0000', 'last_fullsized': '2023-05-16T13:55:22.972586+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'last_clean_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-16T13:55:28.273 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.a is not active+clean 2023-05-16T13:55:28.274 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-16T13:55:22.972586+0000', 'last_change': '2023-05-16T13:55:22.972586+0000', 'last_active': '2023-05-16T13:55:22.972586+0000', 'last_peered': '2023-05-16T13:55:22.972586+0000', 'last_clean': '2023-05-16T13:55:22.972586+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-16T13:55:22.972586+0000', 'last_undegraded': '2023-05-16T13:55:22.972586+0000', 'last_fullsized': '2023-05-16T13:55:22.972586+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'last_clean_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-16T13:55:28.274 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2023-05-16T13:55:28.274 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-16T13:55:21.955159+0000', 'last_change': '2023-05-16T13:55:21.955159+0000', 'last_active': '2023-05-16T13:55:21.955159+0000', 'last_peered': '2023-05-16T13:55:21.955159+0000', 'last_clean': '2023-05-16T13:55:21.955159+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-16T13:55:21.955159+0000', 'last_undegraded': '2023-05-16T13:55:21.955159+0000', 'last_fullsized': '2023-05-16T13:55:21.955159+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-16T13:55:21.955159+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-16T13:55:21.955159+0000', 'last_clean_scrub_stamp': '2023-05-16T13:55:21.955159+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-16T13:55:28.275 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.7 is not active+clean 2023-05-16T13:55:28.275 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-16T13:55:22.972586+0000', 'last_change': '2023-05-16T13:55:22.972586+0000', 'last_active': '2023-05-16T13:55:22.972586+0000', 'last_peered': '2023-05-16T13:55:22.972586+0000', 'last_clean': '2023-05-16T13:55:22.972586+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-16T13:55:22.972586+0000', 'last_undegraded': '2023-05-16T13:55:22.972586+0000', 'last_fullsized': '2023-05-16T13:55:22.972586+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'last_clean_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-16T13:55:28.275 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2023-05-16T13:55:28.276 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-16T13:55:21.955159+0000', 'last_change': '2023-05-16T13:55:21.955159+0000', 'last_active': '2023-05-16T13:55:21.955159+0000', 'last_peered': '2023-05-16T13:55:21.955159+0000', 'last_clean': '2023-05-16T13:55:21.955159+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-16T13:55:21.955159+0000', 'last_undegraded': '2023-05-16T13:55:21.955159+0000', 'last_fullsized': '2023-05-16T13:55:21.955159+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-16T13:55:21.955159+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-16T13:55:21.955159+0000', 'last_clean_scrub_stamp': '2023-05-16T13:55:21.955159+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-16T13:55:28.276 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2023-05-16T13:55:28.277 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-16T13:55:21.955159+0000', 'last_change': '2023-05-16T13:55:21.955159+0000', 'last_active': '2023-05-16T13:55:21.955159+0000', 'last_peered': '2023-05-16T13:55:21.955159+0000', 'last_clean': '2023-05-16T13:55:21.955159+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-16T13:55:21.955159+0000', 'last_undegraded': '2023-05-16T13:55:21.955159+0000', 'last_fullsized': '2023-05-16T13:55:21.955159+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-16T13:55:21.955159+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-16T13:55:21.955159+0000', 'last_clean_scrub_stamp': '2023-05-16T13:55:21.955159+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-16T13:55:28.277 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.5 is not active+clean 2023-05-16T13:55:28.277 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-16T13:55:22.972586+0000', 'last_change': '2023-05-16T13:55:22.972586+0000', 'last_active': '2023-05-16T13:55:22.972586+0000', 'last_peered': '2023-05-16T13:55:22.972586+0000', 'last_clean': '2023-05-16T13:55:22.972586+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-16T13:55:22.972586+0000', 'last_undegraded': '2023-05-16T13:55:22.972586+0000', 'last_fullsized': '2023-05-16T13:55:22.972586+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'last_clean_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-16T13:55:28.278 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2023-05-16T13:55:28.278 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-16T13:55:21.955159+0000', 'last_change': '2023-05-16T13:55:21.955159+0000', 'last_active': '2023-05-16T13:55:21.955159+0000', 'last_peered': '2023-05-16T13:55:21.955159+0000', 'last_clean': '2023-05-16T13:55:21.955159+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-16T13:55:21.955159+0000', 'last_undegraded': '2023-05-16T13:55:21.955159+0000', 'last_fullsized': '2023-05-16T13:55:21.955159+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-16T13:55:21.955159+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-16T13:55:21.955159+0000', 'last_clean_scrub_stamp': '2023-05-16T13:55:21.955159+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-16T13:55:28.278 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2 is not active+clean 2023-05-16T13:55:28.279 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-16T13:55:22.972586+0000', 'last_change': '2023-05-16T13:55:22.972586+0000', 'last_active': '2023-05-16T13:55:22.972586+0000', 'last_peered': '2023-05-16T13:55:22.972586+0000', 'last_clean': '2023-05-16T13:55:22.972586+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-16T13:55:22.972586+0000', 'last_undegraded': '2023-05-16T13:55:22.972586+0000', 'last_fullsized': '2023-05-16T13:55:22.972586+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'last_clean_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-16T13:55:28.279 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2023-05-16T13:55:28.279 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-16T13:55:21.955159+0000', 'last_change': '2023-05-16T13:55:21.955159+0000', 'last_active': '2023-05-16T13:55:21.955159+0000', 'last_peered': '2023-05-16T13:55:21.955159+0000', 'last_clean': '2023-05-16T13:55:21.955159+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-16T13:55:21.955159+0000', 'last_undegraded': '2023-05-16T13:55:21.955159+0000', 'last_fullsized': '2023-05-16T13:55:21.955159+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-16T13:55:21.955159+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-16T13:55:21.955159+0000', 'last_clean_scrub_stamp': '2023-05-16T13:55:21.955159+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-16T13:55:28.280 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3 is not active+clean 2023-05-16T13:55:28.280 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-16T13:55:22.972586+0000', 'last_change': '2023-05-16T13:55:22.972586+0000', 'last_active': '2023-05-16T13:55:22.972586+0000', 'last_peered': '2023-05-16T13:55:22.972586+0000', 'last_clean': '2023-05-16T13:55:22.972586+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-16T13:55:22.972586+0000', 'last_undegraded': '2023-05-16T13:55:22.972586+0000', 'last_fullsized': '2023-05-16T13:55:22.972586+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'last_clean_scrub_stamp': '2023-05-16T13:55:22.972586+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-16T13:55:28.281 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-05-16T13:55:28.417 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.411+0000 7fcd0617b640 1 Processor -- start 2023-05-16T13:55:28.418 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.411+0000 7fcd0617b640 1 -- start start 2023-05-16T13:55:28.419 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.411+0000 7fcd0617b640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd0015c050 0x7fcd000b1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:28.419 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.411+0000 7fcd0617b640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fcd000d2ee0 0x7fcd000d03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:28.419 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.411+0000 7fcd0617b640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fcd000d0920 0x7fcd0006b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:28.419 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.411+0000 7fcd0617b640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd000d0d70 con 0x7fcd000d0920 2023-05-16T13:55:28.419 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.411+0000 7fcd0617b640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd000afab0 con 0x7fcd000d2ee0 2023-05-16T13:55:28.419 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.411+0000 7fcd0617b640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd000af4a0 con 0x7fcd0015c050 2023-05-16T13:55:28.420 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.411+0000 7fccfffff640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fcd000d0920 0x7fcd0006b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:28.420 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.411+0000 7fccfffff640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fcd000d0920 0x7fcd0006b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44542/0 (socket says 172.21.15.39:44542) 2023-05-16T13:55:28.420 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.411+0000 7fccfffff640 1 -- 172.21.15.39:0/4219741474 learned_addr learned my addr 172.21.15.39:0/4219741474 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:28.420 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.411+0000 7fccfeffd640 1 --2- 172.21.15.39:0/4219741474 >> v2:172.21.15.118:3300/0 conn(0x7fcd000d2ee0 0x7fcd000d03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:28.420 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.411+0000 7fccff7fe640 1 --2- 172.21.15.39:0/4219741474 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd0015c050 0x7fcd000b1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:28.421 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.411+0000 7fccfffff640 1 -- 172.21.15.39:0/4219741474 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd0015c050 msgr2=0x7fcd000b1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:28.421 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.411+0000 7fccfffff640 1 --2- 172.21.15.39:0/4219741474 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd0015c050 0x7fcd000b1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:28.421 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.411+0000 7fccfffff640 1 -- 172.21.15.39:0/4219741474 >> v2:172.21.15.118:3300/0 conn(0x7fcd000d2ee0 msgr2=0x7fcd000d03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:28.421 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.411+0000 7fccfffff640 1 --2- 172.21.15.39:0/4219741474 >> v2:172.21.15.118:3300/0 conn(0x7fcd000d2ee0 0x7fcd000d03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:28.421 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.411+0000 7fccfffff640 1 -- 172.21.15.39:0/4219741474 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd000d33e0 con 0x7fcd000d0920 2023-05-16T13:55:28.422 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.415+0000 7fccfffff640 1 --2- 172.21.15.39:0/4219741474 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd000d0920 0x7fcd0006b050 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fcd000d0390 tx=0x7fccf801d140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d94c46d0d84cdacc server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:28.422 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.415+0000 7fccfe7fc640 1 -- 172.21.15.39:0/4219741474 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf80a5580 con 0x7fcd000d0920 2023-05-16T13:55:28.422 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.415+0000 7fccfe7fc640 1 -- 172.21.15.39:0/4219741474 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf80a56e0 con 0x7fcd000d0920 2023-05-16T13:55:28.423 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.415+0000 7fccfe7fc640 1 -- 172.21.15.39:0/4219741474 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf80a5a70 con 0x7fcd000d0920 2023-05-16T13:55:28.423 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.415+0000 7fcd0617b640 1 -- 172.21.15.39:0/4219741474 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd000d0920 msgr2=0x7fcd0006b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:28.423 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.415+0000 7fcd0617b640 1 --2- 172.21.15.39:0/4219741474 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd000d0920 0x7fcd0006b050 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fcd000d0390 tx=0x7fccf801d140 comp rx=0 tx=0).stop 2023-05-16T13:55:28.424 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.415+0000 7fcd0617b640 1 -- 172.21.15.39:0/4219741474 shutdown_connections 2023-05-16T13:55:28.424 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.415+0000 7fcd0617b640 1 --2- 172.21.15.39:0/4219741474 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd000d0920 0x7fcd0006b050 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:28.424 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.415+0000 7fcd0617b640 1 --2- 172.21.15.39:0/4219741474 >> v2:172.21.15.118:3300/0 conn(0x7fcd000d2ee0 0x7fcd000d03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:28.424 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.415+0000 7fcd0617b640 1 --2- 172.21.15.39:0/4219741474 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd0015c050 0x7fcd000b1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:28.424 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.415+0000 7fcd0617b640 1 -- 172.21.15.39:0/4219741474 >> 172.21.15.39:0/4219741474 conn(0x7fcd0009bba0 msgr2=0x7fcd00089fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:28.424 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.415+0000 7fcd0617b640 1 -- 172.21.15.39:0/4219741474 shutdown_connections 2023-05-16T13:55:28.425 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.415+0000 7fcd0617b640 1 -- 172.21.15.39:0/4219741474 wait complete. 2023-05-16T13:55:28.425 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.415+0000 7fcd0617b640 1 Processor -- start 2023-05-16T13:55:28.425 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.419+0000 7fcd0617b640 1 -- start start 2023-05-16T13:55:28.426 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.419+0000 7fcd0617b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd000d0920 0x7fcd0014f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:28.426 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.419+0000 7fcd0617b640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd000d2ee0 0x7fcd0009e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:28.426 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.419+0000 7fcd0617b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd0015c050 0x7fcd00158110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:28.426 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.419+0000 7fcd0617b640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd001596e0 con 0x7fcd0015c050 2023-05-16T13:55:28.427 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.419+0000 7fcd0617b640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd000a00f0 con 0x7fcd000d0920 2023-05-16T13:55:28.427 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.419+0000 7fcd0617b640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0009f050 con 0x7fcd000d2ee0 2023-05-16T13:55:28.427 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.419+0000 7fccfffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd0015c050 0x7fcd00158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:28.427 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.419+0000 7fccfffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd0015c050 0x7fcd00158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44550/0 (socket says 172.21.15.39:44550) 2023-05-16T13:55:28.427 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.419+0000 7fccfffff640 1 -- 172.21.15.39:0/2188485849 learned_addr learned my addr 172.21.15.39:0/2188485849 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:28.428 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.419+0000 7fccfffff640 1 -- 172.21.15.39:0/2188485849 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd000d2ee0 msgr2=0x7fcd0009e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:28.428 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.419+0000 7fccfffff640 1 --2- 172.21.15.39:0/2188485849 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd000d2ee0 0x7fcd0009e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:28.428 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.419+0000 7fccff7fe640 1 --2- 172.21.15.39:0/2188485849 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd000d0920 0x7fcd0014f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:28.428 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.419+0000 7fccfffff640 1 -- 172.21.15.39:0/2188485849 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd000d0920 msgr2=0x7fcd0014f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:28.429 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.419+0000 7fccfffff640 1 --2- 172.21.15.39:0/2188485849 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd000d0920 0x7fcd0014f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:28.429 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.419+0000 7fccfffff640 1 -- 172.21.15.39:0/2188485849 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf8009b30 con 0x7fcd0015c050 2023-05-16T13:55:28.429 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.419+0000 7fccff7fe640 1 --2- 172.21.15.39:0/2188485849 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd000d0920 0x7fcd0014f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-16T13:55:28.429 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.419+0000 7fccfffff640 1 --2- 172.21.15.39:0/2188485849 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd0015c050 0x7fcd00158110 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fccf80af040 tx=0x7fccf8019480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:28.429 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.419+0000 7fcce7fff640 1 -- 172.21.15.39:0/2188485849 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf80bd070 con 0x7fcd0015c050 2023-05-16T13:55:28.429 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.419+0000 7fcce7fff640 1 -- 172.21.15.39:0/2188485849 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf8009510 con 0x7fcd0015c050 2023-05-16T13:55:28.429 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.419+0000 7fcce7fff640 1 -- 172.21.15.39:0/2188485849 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf80a5580 con 0x7fcd0015c050 2023-05-16T13:55:28.429 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.419+0000 7fcd0617b640 1 -- 172.21.15.39:0/2188485849 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd0015c420 con 0x7fcd0015c050 2023-05-16T13:55:28.430 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.419+0000 7fcd0617b640 1 -- 172.21.15.39:0/2188485849 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd000b1980 con 0x7fcd0015c050 2023-05-16T13:55:28.430 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.419+0000 7fcd0617b640 1 -- 172.21.15.39:0/2188485849 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd0015c5b0 con 0x7fcd0015c050 2023-05-16T13:55:28.430 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.423+0000 7fcce7fff640 1 -- 172.21.15.39:0/2188485849 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fccf80b86b0 con 0x7fcd0015c050 2023-05-16T13:55:28.431 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.423+0000 7fcce7fff640 1 --2- 172.21.15.39:0/2188485849 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fccec0662b0 0x7fccec068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:28.431 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.423+0000 7fcce7fff640 1 -- 172.21.15.39:0/2188485849 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fccf811e6e0 con 0x7fcd0015c050 2023-05-16T13:55:28.431 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.423+0000 7fccff7fe640 1 --2- 172.21.15.39:0/2188485849 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fccec0662b0 0x7fccec068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:28.431 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.423+0000 7fccff7fe640 1 --2- 172.21.15.39:0/2188485849 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fccec0662b0 0x7fccec068760 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fccf00097c0 tx=0x7fccf0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:28.434 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.427+0000 7fcce7fff640 1 -- 172.21.15.39:0/2188485849 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fccf80ebbe0 con 0x7fcd0015c050 2023-05-16T13:55:28.643 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.635+0000 7fcd0617b640 1 -- 172.21.15.39:0/2188485849 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fcd00073c90 con 0x7fcd0015c050 2023-05-16T13:55:28.644 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.635+0000 7fcce7fff640 1 -- 172.21.15.39:0/2188485849 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1248 (secure 0 0 0) 0x7fccf80ef200 con 0x7fcd0015c050 2023-05-16T13:55:28.644 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:55:28.644 INFO:teuthology.orchestra.run.smithi039.stdout:{"fsid":"9c1e210b-c515-4ea4-a065-397956895c68","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":99,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":38,"num_osds":8,"num_up_osds":8,"osd_up_since":1684245241,"num_in_osds":8,"osd_in_since":1684245232,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":55},{"state_name":"unknown","count":50}],"num_pgs":105,"num_pools":4,"num_objects":11,"data_bytes":592036,"bytes_used":104566784,"bytes_avail":772989546496,"bytes_total":773094113280,"unknown_pgs_ratio":0.4761904776096344,"write_bytes_sec":2312,"read_op_per_sec":0,"write_op_per_sec":2},"fsmap":{"epoch":15,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":5379}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2023-05-16T13:55:12.840703+0000","services":{"mds":{"daemons":{"summary":"","c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-05-16T13:55:28.646 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.639+0000 7fcd0617b640 1 -- 172.21.15.39:0/2188485849 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fccec0662b0 msgr2=0x7fccec068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:28.646 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.639+0000 7fcd0617b640 1 --2- 172.21.15.39:0/2188485849 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fccec0662b0 0x7fccec068760 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fccf00097c0 tx=0x7fccf0008040 comp rx=0 tx=0).stop 2023-05-16T13:55:28.647 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.639+0000 7fcd0617b640 1 -- 172.21.15.39:0/2188485849 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd0015c050 msgr2=0x7fcd00158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:28.647 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.639+0000 7fcd0617b640 1 --2- 172.21.15.39:0/2188485849 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd0015c050 0x7fcd00158110 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fccf80af040 tx=0x7fccf8019480 comp rx=0 tx=0).stop 2023-05-16T13:55:28.647 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.639+0000 7fcd0617b640 1 -- 172.21.15.39:0/2188485849 shutdown_connections 2023-05-16T13:55:28.647 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.639+0000 7fcd0617b640 1 --2- 172.21.15.39:0/2188485849 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fccec0662b0 0x7fccec068760 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:28.648 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.639+0000 7fcd0617b640 1 --2- 172.21.15.39:0/2188485849 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcd000d2ee0 0x7fcd0009e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:28.648 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.639+0000 7fcd0617b640 1 --2- 172.21.15.39:0/2188485849 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd0015c050 0x7fcd00158110 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:28.648 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.639+0000 7fcd0617b640 1 --2- 172.21.15.39:0/2188485849 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcd000d0920 0x7fcd0014f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:28.648 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.639+0000 7fcd0617b640 1 -- 172.21.15.39:0/2188485849 >> 172.21.15.39:0/2188485849 conn(0x7fcd0009bba0 msgr2=0x7fcd000cfb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:28.649 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.639+0000 7fcd0617b640 1 -- 172.21.15.39:0/2188485849 shutdown_connections 2023-05-16T13:55:28.649 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.639+0000 7fcd0617b640 1 -- 172.21.15.39:0/2188485849 wait complete. 2023-05-16T13:55:28.664 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-05-16T13:55:28.665 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-16T13:55:28.803 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.795+0000 7ff4fca03640 1 Processor -- start 2023-05-16T13:55:28.803 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.795+0000 7ff4fca03640 1 -- start start 2023-05-16T13:55:28.804 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.795+0000 7ff4fca03640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff4f81598b0 0x7ff4f815cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:28.805 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.795+0000 7ff4fca03640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7ff4f80b4b00 0x7ff4f80d01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:28.805 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.795+0000 7ff4fca03640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4f8159c80 con 0x7ff4f80d06f0 2023-05-16T13:55:28.805 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.795+0000 7ff4fca03640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4f815d270 con 0x7ff4f80b4b00 2023-05-16T13:55:28.805 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.795+0000 7ff4fca03640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4f80cd390 con 0x7ff4f81598b0 2023-05-16T13:55:28.805 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.795+0000 7ff4effff640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7ff4f80b4b00 0x7ff4f80d01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:28.805 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.799+0000 7ff4effff640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7ff4f80b4b00 0x7ff4f80d01b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44566/0 (socket says 172.21.15.39:44566) 2023-05-16T13:55:28.806 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.799+0000 7ff4effff640 1 -- 172.21.15.39:0/3670577516 learned_addr learned my addr 172.21.15.39:0/3670577516 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:28.806 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.799+0000 7ff4f6d9d640 1 --2- 172.21.15.39:0/3670577516 >> v2:172.21.15.118:3300/0 conn(0x7ff4f81598b0 0x7ff4f815cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:28.806 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.799+0000 7ff4effff640 1 -- 172.21.15.39:0/3670577516 >> v2:172.21.15.118:3300/0 conn(0x7ff4f81598b0 msgr2=0x7ff4f815cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:28.806 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.799+0000 7ff4effff640 1 --2- 172.21.15.39:0/3670577516 >> v2:172.21.15.118:3300/0 conn(0x7ff4f81598b0 0x7ff4f815cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:28.807 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.799+0000 7ff4effff640 1 -- 172.21.15.39:0/3670577516 >> v1:172.21.15.118:6789/0 conn(0x7ff4f80d06f0 legacy=0x7ff4f80cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:28.807 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.799+0000 7ff4effff640 1 -- 172.21.15.39:0/3670577516 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f80ccdd0 con 0x7ff4f80b4b00 2023-05-16T13:55:28.808 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.799+0000 7ff4effff640 1 --2- 172.21.15.39:0/3670577516 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff4f80b4b00 0x7ff4f80d01b0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ff4f8066ee0 tx=0x7ff4e001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24025f819f8f882b server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:28.808 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.799+0000 7ff4f659c640 1 -- 172.21.15.39:0/3670577516 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e00ab5f0 con 0x7ff4f80b4b00 2023-05-16T13:55:28.808 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.799+0000 7ff4f659c640 1 -- 172.21.15.39:0/3670577516 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e00ab750 con 0x7ff4f80b4b00 2023-05-16T13:55:28.809 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.799+0000 7ff4f659c640 1 -- 172.21.15.39:0/3670577516 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e00abae0 con 0x7ff4f80b4b00 2023-05-16T13:55:28.809 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.803+0000 7ff4fca03640 1 -- 172.21.15.39:0/3670577516 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff4f80b4b00 msgr2=0x7ff4f80d01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:28.810 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.803+0000 7ff4fca03640 1 --2- 172.21.15.39:0/3670577516 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff4f80b4b00 0x7ff4f80d01b0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ff4f8066ee0 tx=0x7ff4e001c500 comp rx=0 tx=0).stop 2023-05-16T13:55:28.810 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.803+0000 7ff4fca03640 1 -- 172.21.15.39:0/3670577516 shutdown_connections 2023-05-16T13:55:28.810 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.803+0000 7ff4fca03640 1 --2- 172.21.15.39:0/3670577516 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff4f80b4b00 0x7ff4f80d01b0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:28.810 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.803+0000 7ff4fca03640 1 --2- 172.21.15.39:0/3670577516 >> v2:172.21.15.118:3300/0 conn(0x7ff4f81598b0 0x7ff4f815cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:28.810 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.803+0000 7ff4fca03640 1 -- 172.21.15.39:0/3670577516 >> 172.21.15.39:0/3670577516 conn(0x7ff4f806aad0 msgr2=0x7ff4f806aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:28.810 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.803+0000 7ff4fca03640 1 -- 172.21.15.39:0/3670577516 shutdown_connections 2023-05-16T13:55:28.810 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.803+0000 7ff4fca03640 1 -- 172.21.15.39:0/3670577516 wait complete. 2023-05-16T13:55:28.811 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.803+0000 7ff4fca03640 1 Processor -- start 2023-05-16T13:55:28.811 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.803+0000 7ff4fca03640 1 -- start start 2023-05-16T13:55:28.814 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.803+0000 7ff4fca03640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4f80b4b00 0x7ff4f814e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:28.814 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.803+0000 7ff4fca03640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff4f80d06f0 0x7ff4f80b1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:28.814 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.803+0000 7ff4fca03640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff4f81598b0 0x7ff4f815a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:28.814 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.803+0000 7ff4fca03640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f814eb20 con 0x7ff4f80d06f0 2023-05-16T13:55:28.815 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.803+0000 7ff4fca03640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f80b2a70 con 0x7ff4f80b4b00 2023-05-16T13:55:28.815 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.803+0000 7ff4fca03640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f8156c70 con 0x7ff4f81598b0 2023-05-16T13:55:28.815 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.803+0000 7ff4effff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff4f80d06f0 0x7ff4f80b1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:28.816 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.803+0000 7ff4effff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff4f80d06f0 0x7ff4f80b1fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44568/0 (socket says 172.21.15.39:44568) 2023-05-16T13:55:28.816 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.803+0000 7ff4effff640 1 -- 172.21.15.39:0/1233046786 learned_addr learned my addr 172.21.15.39:0/1233046786 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:28.816 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.803+0000 7ff4f6d9d640 1 --2- 172.21.15.39:0/1233046786 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4f80b4b00 0x7ff4f814e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:28.816 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.803+0000 7ff4f759e640 1 --2- 172.21.15.39:0/1233046786 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff4f81598b0 0x7ff4f815a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:28.817 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.803+0000 7ff4effff640 1 -- 172.21.15.39:0/1233046786 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff4f81598b0 msgr2=0x7ff4f815a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:28.817 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.803+0000 7ff4effff640 1 --2- 172.21.15.39:0/1233046786 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff4f81598b0 0x7ff4f815a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:28.817 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.803+0000 7ff4effff640 1 -- 172.21.15.39:0/1233046786 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4f80b4b00 msgr2=0x7ff4f814e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:28.817 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.803+0000 7ff4effff640 1 --2- 172.21.15.39:0/1233046786 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4f80b4b00 0x7ff4f814e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:28.818 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.803+0000 7ff4effff640 1 -- 172.21.15.39:0/1233046786 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e00094d0 con 0x7ff4f80d06f0 2023-05-16T13:55:28.818 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.807+0000 7ff4effff640 1 --2- 172.21.15.39:0/1233046786 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff4f80d06f0 0x7ff4f80b1fb0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ff4e0019110 tx=0x7ff4e001ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:28.818 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.807+0000 7ff4ef7fe640 1 -- 172.21.15.39:0/1233046786 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e00be5f0 con 0x7ff4f80d06f0 2023-05-16T13:55:28.818 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.807+0000 7ff4ef7fe640 1 -- 172.21.15.39:0/1233046786 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e00be750 con 0x7ff4f80d06f0 2023-05-16T13:55:28.819 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.807+0000 7ff4ef7fe640 1 -- 172.21.15.39:0/1233046786 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e00beb00 con 0x7ff4f80d06f0 2023-05-16T13:55:28.819 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.807+0000 7ff4fca03640 1 -- 172.21.15.39:0/1233046786 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4f80ce790 con 0x7ff4f80d06f0 2023-05-16T13:55:28.819 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.807+0000 7ff4fca03640 1 -- 172.21.15.39:0/1233046786 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4f80b4fa0 con 0x7ff4f80d06f0 2023-05-16T13:55:28.820 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.807+0000 7ff4fca03640 1 -- 172.21.15.39:0/1233046786 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4f8168ba0 con 0x7ff4f80d06f0 2023-05-16T13:55:28.821 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.807+0000 7ff4ef7fe640 1 -- 172.21.15.39:0/1233046786 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff4e00b43f0 con 0x7ff4f80d06f0 2023-05-16T13:55:28.821 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.807+0000 7ff4ef7fe640 1 --2- 172.21.15.39:0/1233046786 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ff4d8066280 0x7ff4d8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:28.821 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.807+0000 7ff4ef7fe640 1 -- 172.21.15.39:0/1233046786 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff4e00a8050 con 0x7ff4f80d06f0 2023-05-16T13:55:28.821 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.807+0000 7ff4f6d9d640 1 --2- 172.21.15.39:0/1233046786 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ff4d8066280 0x7ff4d8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:28.822 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.811+0000 7ff4f6d9d640 1 --2- 172.21.15.39:0/1233046786 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ff4d8066280 0x7ff4d8068730 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8009ac0 tx=0x7ff4e8009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:28.822 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.811+0000 7ff4ef7fe640 1 -- 172.21.15.39:0/1233046786 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ff4e00ebcf0 con 0x7ff4f80d06f0 2023-05-16T13:55:28.975 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.967+0000 7ff4fca03640 1 -- 172.21.15.39:0/1233046786 --> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff4f8156de0 con 0x7ff4d8066280 2023-05-16T13:55:28.983 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.975+0000 7ff4ef7fe640 1 -- 172.21.15.39:0/1233046786 <== mgr.4098 v2:172.21.15.39:6832/288296800 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311470 (secure 0 0 0) 0x7ff4f8156de0 con 0x7ff4d8066280 2023-05-16T13:55:28.986 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:55:28.987 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2023-05-16T13:55:28.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.979+0000 7ff4fca03640 1 -- 172.21.15.39:0/1233046786 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ff4d8066280 msgr2=0x7ff4d8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:28.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.979+0000 7ff4fca03640 1 --2- 172.21.15.39:0/1233046786 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ff4d8066280 0x7ff4d8068730 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8009ac0 tx=0x7ff4e8009190 comp rx=0 tx=0).stop 2023-05-16T13:55:28.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.979+0000 7ff4fca03640 1 -- 172.21.15.39:0/1233046786 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff4f80d06f0 msgr2=0x7ff4f80b1fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:28.988 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.979+0000 7ff4fca03640 1 --2- 172.21.15.39:0/1233046786 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff4f80d06f0 0x7ff4f80b1fb0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ff4e0019110 tx=0x7ff4e001ad40 comp rx=0 tx=0).stop 2023-05-16T13:55:28.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.979+0000 7ff4fca03640 1 -- 172.21.15.39:0/1233046786 shutdown_connections 2023-05-16T13:55:28.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.979+0000 7ff4fca03640 1 --2- 172.21.15.39:0/1233046786 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ff4d8066280 0x7ff4d8068730 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:28.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.979+0000 7ff4fca03640 1 --2- 172.21.15.39:0/1233046786 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff4f81598b0 0x7ff4f815a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:28.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.979+0000 7ff4fca03640 1 --2- 172.21.15.39:0/1233046786 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff4f80d06f0 0x7ff4f80b1fb0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:28.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.979+0000 7ff4fca03640 1 --2- 172.21.15.39:0/1233046786 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4f80b4b00 0x7ff4f814e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:28.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.979+0000 7ff4fca03640 1 -- 172.21.15.39:0/1233046786 >> 172.21.15.39:0/1233046786 conn(0x7ff4f806aad0 msgr2=0x7ff4f815e230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:28.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.979+0000 7ff4fca03640 1 -- 172.21.15.39:0/1233046786 shutdown_connections 2023-05-16T13:55:28.989 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:28.979+0000 7ff4fca03640 1 -- 172.21.15.39:0/1233046786 wait complete. 2023-05-16T13:55:29.006 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":75,"stamp":"2023-05-16T13:55:28.843443+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":188,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":103048,"kb_used_data":4552,"kb_used_omap":0,"kb_used_meta":98432,"kb_avail":754871672,"statfs":{"total":773094113280,"available":772988592128,"internally_reserved":0,"allocated":4661248,"data_stored":2601772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":100794368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001118"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702986+0000","last_change":"2023-05-16T13:55:23.413635+0000","last_active":"2023-05-16T13:55:24.702986+0000","last_peered":"2023-05-16T13:55:24.702986+0000","last_clean":"2023-05-16T13:55:24.702986+0000","last_became_active":"2023-05-16T13:55:23.413319+0000","last_became_peered":"2023-05-16T13:55:23.413319+0000","last_unstale":"2023-05-16T13:55:24.702986+0000","last_undegraded":"2023-05-16T13:55:24.702986+0000","last_fullsized":"2023-05-16T13:55:24.702986+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:00:44.745581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702981+0000","last_change":"2023-05-16T13:55:23.420601+0000","last_active":"2023-05-16T13:55:24.702981+0000","last_peered":"2023-05-16T13:55:24.702981+0000","last_clean":"2023-05-16T13:55:24.702981+0000","last_became_active":"2023-05-16T13:55:23.420296+0000","last_became_peered":"2023-05-16T13:55:23.420296+0000","last_unstale":"2023-05-16T13:55:24.702981+0000","last_undegraded":"2023-05-16T13:55:24.702981+0000","last_fullsized":"2023-05-16T13:55:24.702981+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T14:28:21.055179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702832+0000","last_change":"2023-05-16T13:55:23.426167+0000","last_active":"2023-05-16T13:55:24.702832+0000","last_peered":"2023-05-16T13:55:24.702832+0000","last_clean":"2023-05-16T13:55:24.702832+0000","last_became_active":"2023-05-16T13:55:23.425898+0000","last_became_peered":"2023-05-16T13:55:23.425898+0000","last_unstale":"2023-05-16T13:55:24.702832+0000","last_undegraded":"2023-05-16T13:55:24.702832+0000","last_fullsized":"2023-05-16T13:55:24.702832+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T18:12:33.397086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.389344+0000","last_change":"2023-05-16T13:55:23.410640+0000","last_active":"2023-05-16T13:55:24.389344+0000","last_peered":"2023-05-16T13:55:24.389344+0000","last_clean":"2023-05-16T13:55:24.389344+0000","last_became_active":"2023-05-16T13:55:23.410201+0000","last_became_peered":"2023-05-16T13:55:23.410201+0000","last_unstale":"2023-05-16T13:55:24.389344+0000","last_undegraded":"2023-05-16T13:55:24.389344+0000","last_fullsized":"2023-05-16T13:55:24.389344+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T23:39:16.162625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.389118+0000","last_change":"2023-05-16T13:55:23.415688+0000","last_active":"2023-05-16T13:55:24.389118+0000","last_peered":"2023-05-16T13:55:24.389118+0000","last_clean":"2023-05-16T13:55:24.389118+0000","last_became_active":"2023-05-16T13:55:23.415428+0000","last_became_peered":"2023-05-16T13:55:23.415428+0000","last_unstale":"2023-05-16T13:55:24.389118+0000","last_undegraded":"2023-05-16T13:55:24.389118+0000","last_fullsized":"2023-05-16T13:55:24.389118+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T23:22:48.021414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702788+0000","last_change":"2023-05-16T13:55:23.411124+0000","last_active":"2023-05-16T13:55:24.702788+0000","last_peered":"2023-05-16T13:55:24.702788+0000","last_clean":"2023-05-16T13:55:24.702788+0000","last_became_active":"2023-05-16T13:55:23.410870+0000","last_became_peered":"2023-05-16T13:55:23.410870+0000","last_unstale":"2023-05-16T13:55:24.702788+0000","last_undegraded":"2023-05-16T13:55:24.702788+0000","last_fullsized":"2023-05-16T13:55:24.702788+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:20:17.612621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702895+0000","last_change":"2023-05-16T13:55:23.412868+0000","last_active":"2023-05-16T13:55:24.702895+0000","last_peered":"2023-05-16T13:55:24.702895+0000","last_clean":"2023-05-16T13:55:24.702895+0000","last_became_active":"2023-05-16T13:55:23.412479+0000","last_became_peered":"2023-05-16T13:55:23.412479+0000","last_unstale":"2023-05-16T13:55:24.702895+0000","last_undegraded":"2023-05-16T13:55:24.702895+0000","last_fullsized":"2023-05-16T13:55:24.702895+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T23:46:15.133417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702869+0000","last_change":"2023-05-16T13:55:23.423785+0000","last_active":"2023-05-16T13:55:24.702869+0000","last_peered":"2023-05-16T13:55:24.702869+0000","last_clean":"2023-05-16T13:55:24.702869+0000","last_became_active":"2023-05-16T13:55:23.423521+0000","last_became_peered":"2023-05-16T13:55:23.423521+0000","last_unstale":"2023-05-16T13:55:24.702869+0000","last_undegraded":"2023-05-16T13:55:24.702869+0000","last_fullsized":"2023-05-16T13:55:24.702869+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:15:22.807920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703149+0000","last_change":"2023-05-16T13:55:23.426476+0000","last_active":"2023-05-16T13:55:24.703149+0000","last_peered":"2023-05-16T13:55:24.703149+0000","last_clean":"2023-05-16T13:55:24.703149+0000","last_became_active":"2023-05-16T13:55:23.426169+0000","last_became_peered":"2023-05-16T13:55:23.426169+0000","last_unstale":"2023-05-16T13:55:24.703149+0000","last_undegraded":"2023-05-16T13:55:24.703149+0000","last_fullsized":"2023-05-16T13:55:24.703149+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T15:01:43.692055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703265+0000","last_change":"2023-05-16T13:55:23.416140+0000","last_active":"2023-05-16T13:55:24.703265+0000","last_peered":"2023-05-16T13:55:24.703265+0000","last_clean":"2023-05-16T13:55:24.703265+0000","last_became_active":"2023-05-16T13:55:23.415821+0000","last_became_peered":"2023-05-16T13:55:23.415821+0000","last_unstale":"2023-05-16T13:55:24.703265+0000","last_undegraded":"2023-05-16T13:55:24.703265+0000","last_fullsized":"2023-05-16T13:55:24.703265+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:39:01.963378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703413+0000","last_change":"2023-05-16T13:55:23.415901+0000","last_active":"2023-05-16T13:55:24.703413+0000","last_peered":"2023-05-16T13:55:24.703413+0000","last_clean":"2023-05-16T13:55:24.703413+0000","last_became_active":"2023-05-16T13:55:23.414396+0000","last_became_peered":"2023-05-16T13:55:23.414396+0000","last_unstale":"2023-05-16T13:55:24.703413+0000","last_undegraded":"2023-05-16T13:55:24.703413+0000","last_fullsized":"2023-05-16T13:55:24.703413+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:43:30.377410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703603+0000","last_change":"2023-05-16T13:55:23.417357+0000","last_active":"2023-05-16T13:55:24.703603+0000","last_peered":"2023-05-16T13:55:24.703603+0000","last_clean":"2023-05-16T13:55:24.703603+0000","last_became_active":"2023-05-16T13:55:23.417040+0000","last_became_peered":"2023-05-16T13:55:23.417040+0000","last_unstale":"2023-05-16T13:55:24.703603+0000","last_undegraded":"2023-05-16T13:55:24.703603+0000","last_fullsized":"2023-05-16T13:55:24.703603+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:20:17.612621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703409+0000","last_change":"2023-05-16T13:55:23.402449+0000","last_active":"2023-05-16T13:55:24.703409+0000","last_peered":"2023-05-16T13:55:24.703409+0000","last_clean":"2023-05-16T13:55:24.703409+0000","last_became_active":"2023-05-16T13:55:23.402138+0000","last_became_peered":"2023-05-16T13:55:23.402138+0000","last_unstale":"2023-05-16T13:55:24.703409+0000","last_undegraded":"2023-05-16T13:55:24.703409+0000","last_fullsized":"2023-05-16T13:55:24.703409+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:59:18.092162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.390166+0000","last_change":"2023-05-16T13:55:23.404843+0000","last_active":"2023-05-16T13:55:24.390166+0000","last_peered":"2023-05-16T13:55:24.390166+0000","last_clean":"2023-05-16T13:55:24.390166+0000","last_became_active":"2023-05-16T13:55:23.404548+0000","last_became_peered":"2023-05-16T13:55:23.404548+0000","last_unstale":"2023-05-16T13:55:24.390166+0000","last_undegraded":"2023-05-16T13:55:24.390166+0000","last_fullsized":"2023-05-16T13:55:24.390166+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:59:18.092162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702978+0000","last_change":"2023-05-16T13:55:23.420693+0000","last_active":"2023-05-16T13:55:24.702978+0000","last_peered":"2023-05-16T13:55:24.702978+0000","last_clean":"2023-05-16T13:55:24.702978+0000","last_became_active":"2023-05-16T13:55:23.417293+0000","last_became_peered":"2023-05-16T13:55:23.417293+0000","last_unstale":"2023-05-16T13:55:24.702978+0000","last_undegraded":"2023-05-16T13:55:24.702978+0000","last_fullsized":"2023-05-16T13:55:24.702978+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:37:22.819141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.448449+0000","last_change":"2023-05-16T13:55:23.418489+0000","last_active":"2023-05-16T13:55:24.448449+0000","last_peered":"2023-05-16T13:55:24.448449+0000","last_clean":"2023-05-16T13:55:24.448449+0000","last_became_active":"2023-05-16T13:55:23.417994+0000","last_became_peered":"2023-05-16T13:55:23.417994+0000","last_unstale":"2023-05-16T13:55:24.448449+0000","last_undegraded":"2023-05-16T13:55:24.448449+0000","last_fullsized":"2023-05-16T13:55:24.448449+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:44:47.581169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.449259+0000","last_change":"2023-05-16T13:55:23.418574+0000","last_active":"2023-05-16T13:55:24.449259+0000","last_peered":"2023-05-16T13:55:24.449259+0000","last_clean":"2023-05-16T13:55:24.449259+0000","last_became_active":"2023-05-16T13:55:23.418248+0000","last_became_peered":"2023-05-16T13:55:23.418248+0000","last_unstale":"2023-05-16T13:55:24.449259+0000","last_undegraded":"2023-05-16T13:55:24.449259+0000","last_fullsized":"2023-05-16T13:55:24.449259+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T15:50:19.429470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.391252+0000","last_change":"2023-05-16T13:55:23.409887+0000","last_active":"2023-05-16T13:55:24.391252+0000","last_peered":"2023-05-16T13:55:24.391252+0000","last_clean":"2023-05-16T13:55:24.391252+0000","last_became_active":"2023-05-16T13:55:23.405883+0000","last_became_peered":"2023-05-16T13:55:23.405883+0000","last_unstale":"2023-05-16T13:55:24.391252+0000","last_undegraded":"2023-05-16T13:55:24.391252+0000","last_fullsized":"2023-05-16T13:55:24.391252+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T15:41:59.315083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.389374+0000","last_change":"2023-05-16T13:55:23.416396+0000","last_active":"2023-05-16T13:55:24.389374+0000","last_peered":"2023-05-16T13:55:24.389374+0000","last_clean":"2023-05-16T13:55:24.389374+0000","last_became_active":"2023-05-16T13:55:23.416171+0000","last_became_peered":"2023-05-16T13:55:23.416171+0000","last_unstale":"2023-05-16T13:55:24.389374+0000","last_undegraded":"2023-05-16T13:55:24.389374+0000","last_fullsized":"2023-05-16T13:55:24.389374+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:37:40.020154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.390390+0000","last_change":"2023-05-16T13:55:23.409607+0000","last_active":"2023-05-16T13:55:24.390390+0000","last_peered":"2023-05-16T13:55:24.390390+0000","last_clean":"2023-05-16T13:55:24.390390+0000","last_became_active":"2023-05-16T13:55:23.409310+0000","last_became_peered":"2023-05-16T13:55:23.409310+0000","last_unstale":"2023-05-16T13:55:24.390390+0000","last_undegraded":"2023-05-16T13:55:24.390390+0000","last_fullsized":"2023-05-16T13:55:24.390390+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:29:04.491246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703019+0000","last_change":"2023-05-16T13:55:23.412078+0000","last_active":"2023-05-16T13:55:24.703019+0000","last_peered":"2023-05-16T13:55:24.703019+0000","last_clean":"2023-05-16T13:55:24.703019+0000","last_became_active":"2023-05-16T13:55:23.411783+0000","last_became_peered":"2023-05-16T13:55:23.411783+0000","last_unstale":"2023-05-16T13:55:24.703019+0000","last_undegraded":"2023-05-16T13:55:24.703019+0000","last_fullsized":"2023-05-16T13:55:24.703019+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:21:24.750294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.391159+0000","last_change":"2023-05-16T13:55:23.410469+0000","last_active":"2023-05-16T13:55:24.391159+0000","last_peered":"2023-05-16T13:55:24.391159+0000","last_clean":"2023-05-16T13:55:24.391159+0000","last_became_active":"2023-05-16T13:55:23.409754+0000","last_became_peered":"2023-05-16T13:55:23.409754+0000","last_unstale":"2023-05-16T13:55:24.391159+0000","last_undegraded":"2023-05-16T13:55:24.391159+0000","last_fullsized":"2023-05-16T13:55:24.391159+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:56:31.055172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.448708+0000","last_change":"2023-05-16T13:55:23.406951+0000","last_active":"2023-05-16T13:55:24.448708+0000","last_peered":"2023-05-16T13:55:24.448708+0000","last_clean":"2023-05-16T13:55:24.448708+0000","last_became_active":"2023-05-16T13:55:23.406220+0000","last_became_peered":"2023-05-16T13:55:23.406220+0000","last_unstale":"2023-05-16T13:55:24.448708+0000","last_undegraded":"2023-05-16T13:55:24.448708+0000","last_fullsized":"2023-05-16T13:55:24.448708+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:15:01.909502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.389007+0000","last_change":"2023-05-16T13:55:23.415714+0000","last_active":"2023-05-16T13:55:24.389007+0000","last_peered":"2023-05-16T13:55:24.389007+0000","last_clean":"2023-05-16T13:55:24.389007+0000","last_became_active":"2023-05-16T13:55:23.415365+0000","last_became_peered":"2023-05-16T13:55:23.415365+0000","last_unstale":"2023-05-16T13:55:24.389007+0000","last_undegraded":"2023-05-16T13:55:24.389007+0000","last_fullsized":"2023-05-16T13:55:24.389007+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:22:31.514634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.391137+0000","last_change":"2023-05-16T13:55:23.418927+0000","last_active":"2023-05-16T13:55:24.391137+0000","last_peered":"2023-05-16T13:55:24.391137+0000","last_clean":"2023-05-16T13:55:24.391137+0000","last_became_active":"2023-05-16T13:55:23.413689+0000","last_became_peered":"2023-05-16T13:55:23.413689+0000","last_unstale":"2023-05-16T13:55:24.391137+0000","last_undegraded":"2023-05-16T13:55:24.391137+0000","last_fullsized":"2023-05-16T13:55:24.391137+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:02:17.021863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703500+0000","last_change":"2023-05-16T13:55:23.424404+0000","last_active":"2023-05-16T13:55:24.703500+0000","last_peered":"2023-05-16T13:55:24.703500+0000","last_clean":"2023-05-16T13:55:24.703500+0000","last_became_active":"2023-05-16T13:55:23.424080+0000","last_became_peered":"2023-05-16T13:55:23.424080+0000","last_unstale":"2023-05-16T13:55:24.703500+0000","last_undegraded":"2023-05-16T13:55:24.703500+0000","last_fullsized":"2023-05-16T13:55:24.703500+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T23:50:36.996209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.391012+0000","last_change":"2023-05-16T13:55:23.412434+0000","last_active":"2023-05-16T13:55:24.391012+0000","last_peered":"2023-05-16T13:55:24.391012+0000","last_clean":"2023-05-16T13:55:24.391012+0000","last_became_active":"2023-05-16T13:55:23.412160+0000","last_became_peered":"2023-05-16T13:55:23.412160+0000","last_unstale":"2023-05-16T13:55:24.391012+0000","last_undegraded":"2023-05-16T13:55:24.391012+0000","last_fullsized":"2023-05-16T13:55:24.391012+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T18:18:25.619356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703412+0000","last_change":"2023-05-16T13:55:23.412974+0000","last_active":"2023-05-16T13:55:24.703412+0000","last_peered":"2023-05-16T13:55:24.703412+0000","last_clean":"2023-05-16T13:55:24.703412+0000","last_became_active":"2023-05-16T13:55:23.412436+0000","last_became_peered":"2023-05-16T13:55:23.412436+0000","last_unstale":"2023-05-16T13:55:24.703412+0000","last_undegraded":"2023-05-16T13:55:24.703412+0000","last_fullsized":"2023-05-16T13:55:24.703412+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T14:58:31.891808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.390622+0000","last_change":"2023-05-16T13:55:23.402956+0000","last_active":"2023-05-16T13:55:24.390622+0000","last_peered":"2023-05-16T13:55:24.390622+0000","last_clean":"2023-05-16T13:55:24.390622+0000","last_became_active":"2023-05-16T13:55:23.402673+0000","last_became_peered":"2023-05-16T13:55:23.402673+0000","last_unstale":"2023-05-16T13:55:24.390622+0000","last_undegraded":"2023-05-16T13:55:24.390622+0000","last_fullsized":"2023-05-16T13:55:24.390622+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T23:43:31.377314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.390425+0000","last_change":"2023-05-16T13:55:23.405078+0000","last_active":"2023-05-16T13:55:24.390425+0000","last_peered":"2023-05-16T13:55:24.390425+0000","last_clean":"2023-05-16T13:55:24.390425+0000","last_became_active":"2023-05-16T13:55:23.404225+0000","last_became_peered":"2023-05-16T13:55:23.404225+0000","last_unstale":"2023-05-16T13:55:24.390425+0000","last_undegraded":"2023-05-16T13:55:24.390425+0000","last_fullsized":"2023-05-16T13:55:24.390425+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:50:48.578876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.448691+0000","last_change":"2023-05-16T13:55:23.406633+0000","last_active":"2023-05-16T13:55:24.448691+0000","last_peered":"2023-05-16T13:55:24.448691+0000","last_clean":"2023-05-16T13:55:24.448691+0000","last_became_active":"2023-05-16T13:55:23.405863+0000","last_became_peered":"2023-05-16T13:55:23.405863+0000","last_unstale":"2023-05-16T13:55:24.448691+0000","last_undegraded":"2023-05-16T13:55:24.448691+0000","last_fullsized":"2023-05-16T13:55:24.448691+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T18:57:23.116555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702518+0000","last_change":"2023-05-16T13:55:23.417343+0000","last_active":"2023-05-16T13:55:24.702518+0000","last_peered":"2023-05-16T13:55:24.702518+0000","last_clean":"2023-05-16T13:55:24.702518+0000","last_became_active":"2023-05-16T13:55:23.417084+0000","last_became_peered":"2023-05-16T13:55:23.417084+0000","last_unstale":"2023-05-16T13:55:24.702518+0000","last_undegraded":"2023-05-16T13:55:24.702518+0000","last_fullsized":"2023-05-16T13:55:24.702518+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:24:27.841261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.448655+0000","last_change":"2023-05-16T13:55:23.424474+0000","last_active":"2023-05-16T13:55:24.448655+0000","last_peered":"2023-05-16T13:55:24.448655+0000","last_clean":"2023-05-16T13:55:24.448655+0000","last_became_active":"2023-05-16T13:55:23.423734+0000","last_became_peered":"2023-05-16T13:55:23.423734+0000","last_unstale":"2023-05-16T13:55:24.448655+0000","last_undegraded":"2023-05-16T13:55:24.448655+0000","last_fullsized":"2023-05-16T13:55:24.448655+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:37:09.541457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.391274+0000","last_change":"2023-05-16T13:55:22.990083+0000","last_active":"2023-05-16T13:55:24.391274+0000","last_peered":"2023-05-16T13:55:24.391274+0000","last_clean":"2023-05-16T13:55:24.391274+0000","last_became_active":"2023-05-16T13:55:22.989788+0000","last_became_peered":"2023-05-16T13:55:22.989788+0000","last_unstale":"2023-05-16T13:55:24.391274+0000","last_undegraded":"2023-05-16T13:55:24.391274+0000","last_fullsized":"2023-05-16T13:55:24.391274+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T16:12:54.486301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703219+0000","last_change":"2023-05-16T13:55:23.424419+0000","last_active":"2023-05-16T13:55:24.703219+0000","last_peered":"2023-05-16T13:55:24.703219+0000","last_clean":"2023-05-16T13:55:24.703219+0000","last_became_active":"2023-05-16T13:55:23.424144+0000","last_became_peered":"2023-05-16T13:55:23.424144+0000","last_unstale":"2023-05-16T13:55:24.703219+0000","last_undegraded":"2023-05-16T13:55:24.703219+0000","last_fullsized":"2023-05-16T13:55:24.703219+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T18:54:19.739155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702809+0000","last_change":"2023-05-16T13:55:23.004839+0000","last_active":"2023-05-16T13:55:24.702809+0000","last_peered":"2023-05-16T13:55:24.702809+0000","last_clean":"2023-05-16T13:55:24.702809+0000","last_became_active":"2023-05-16T13:55:23.004519+0000","last_became_peered":"2023-05-16T13:55:23.004519+0000","last_unstale":"2023-05-16T13:55:24.702809+0000","last_undegraded":"2023-05-16T13:55:24.702809+0000","last_fullsized":"2023-05-16T13:55:24.702809+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:42:58.481159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.390843+0000","last_change":"2023-05-16T13:55:23.403927+0000","last_active":"2023-05-16T13:55:24.390843+0000","last_peered":"2023-05-16T13:55:24.390843+0000","last_clean":"2023-05-16T13:55:24.390843+0000","last_became_active":"2023-05-16T13:55:23.403631+0000","last_became_peered":"2023-05-16T13:55:23.403631+0000","last_unstale":"2023-05-16T13:55:24.390843+0000","last_undegraded":"2023-05-16T13:55:24.390843+0000","last_fullsized":"2023-05-16T13:55:24.390843+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T18:57:23.116555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703544+0000","last_change":"2023-05-16T13:55:23.003518+0000","last_active":"2023-05-16T13:55:24.703544+0000","last_peered":"2023-05-16T13:55:24.703544+0000","last_clean":"2023-05-16T13:55:24.703544+0000","last_became_active":"2023-05-16T13:55:23.003263+0000","last_became_peered":"2023-05-16T13:55:23.003263+0000","last_unstale":"2023-05-16T13:55:24.703544+0000","last_undegraded":"2023-05-16T13:55:24.703544+0000","last_fullsized":"2023-05-16T13:55:24.703544+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T20:43:50.549191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702845+0000","last_change":"2023-05-16T13:55:23.409488+0000","last_active":"2023-05-16T13:55:24.702845+0000","last_peered":"2023-05-16T13:55:24.702845+0000","last_clean":"2023-05-16T13:55:24.702845+0000","last_became_active":"2023-05-16T13:55:23.409221+0000","last_became_peered":"2023-05-16T13:55:23.409221+0000","last_unstale":"2023-05-16T13:55:24.702845+0000","last_undegraded":"2023-05-16T13:55:24.702845+0000","last_fullsized":"2023-05-16T13:55:24.702845+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T23:37:20.052995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.390995+0000","last_change":"2023-05-16T13:55:22.994796+0000","last_active":"2023-05-16T13:55:24.390995+0000","last_peered":"2023-05-16T13:55:24.390995+0000","last_clean":"2023-05-16T13:55:24.390995+0000","last_became_active":"2023-05-16T13:55:22.994520+0000","last_became_peered":"2023-05-16T13:55:22.994520+0000","last_unstale":"2023-05-16T13:55:24.390995+0000","last_undegraded":"2023-05-16T13:55:24.390995+0000","last_fullsized":"2023-05-16T13:55:24.390995+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:52:39.280919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703333+0000","last_change":"2023-05-16T13:55:23.410102+0000","last_active":"2023-05-16T13:55:24.703333+0000","last_peered":"2023-05-16T13:55:24.703333+0000","last_clean":"2023-05-16T13:55:24.703333+0000","last_became_active":"2023-05-16T13:55:23.409854+0000","last_became_peered":"2023-05-16T13:55:23.409854+0000","last_unstale":"2023-05-16T13:55:24.703333+0000","last_undegraded":"2023-05-16T13:55:24.703333+0000","last_fullsized":"2023-05-16T13:55:24.703333+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:39:33.113821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703340+0000","last_change":"2023-05-16T13:55:23.008104+0000","last_active":"2023-05-16T13:55:24.703340+0000","last_peered":"2023-05-16T13:55:24.703340+0000","last_clean":"2023-05-16T13:55:24.703340+0000","last_became_active":"2023-05-16T13:55:23.007727+0000","last_became_peered":"2023-05-16T13:55:23.007727+0000","last_unstale":"2023-05-16T13:55:24.703340+0000","last_undegraded":"2023-05-16T13:55:24.703340+0000","last_fullsized":"2023-05-16T13:55:24.703340+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:01:05.788557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703178+0000","last_change":"2023-05-16T13:55:23.416496+0000","last_active":"2023-05-16T13:55:24.703178+0000","last_peered":"2023-05-16T13:55:24.703178+0000","last_clean":"2023-05-16T13:55:24.703178+0000","last_became_active":"2023-05-16T13:55:23.414290+0000","last_became_peered":"2023-05-16T13:55:23.414290+0000","last_unstale":"2023-05-16T13:55:24.703178+0000","last_undegraded":"2023-05-16T13:55:24.703178+0000","last_fullsized":"2023-05-16T13:55:24.703178+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:20:27.455481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.448708+0000","last_change":"2023-05-16T13:55:22.991392+0000","last_active":"2023-05-16T13:55:24.448708+0000","last_peered":"2023-05-16T13:55:24.448708+0000","last_clean":"2023-05-16T13:55:24.448708+0000","last_became_active":"2023-05-16T13:55:22.991030+0000","last_became_peered":"2023-05-16T13:55:22.991030+0000","last_unstale":"2023-05-16T13:55:24.448708+0000","last_undegraded":"2023-05-16T13:55:24.448708+0000","last_fullsized":"2023-05-16T13:55:24.448708+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:43:29.359983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.390936+0000","last_change":"2023-05-16T13:55:23.423745+0000","last_active":"2023-05-16T13:55:24.390936+0000","last_peered":"2023-05-16T13:55:24.390936+0000","last_clean":"2023-05-16T13:55:24.390936+0000","last_became_active":"2023-05-16T13:55:23.423410+0000","last_became_peered":"2023-05-16T13:55:23.423410+0000","last_unstale":"2023-05-16T13:55:24.390936+0000","last_undegraded":"2023-05-16T13:55:24.390936+0000","last_fullsized":"2023-05-16T13:55:24.390936+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T18:33:52.222739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702652+0000","last_change":"2023-05-16T13:55:23.009273+0000","last_active":"2023-05-16T13:55:24.702652+0000","last_peered":"2023-05-16T13:55:24.702652+0000","last_clean":"2023-05-16T13:55:24.702652+0000","last_became_active":"2023-05-16T13:55:23.008332+0000","last_became_peered":"2023-05-16T13:55:23.008332+0000","last_unstale":"2023-05-16T13:55:24.702652+0000","last_undegraded":"2023-05-16T13:55:24.702652+0000","last_fullsized":"2023-05-16T13:55:24.702652+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:42:49.791420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703848+0000","last_change":"2023-05-16T13:55:23.414015+0000","last_active":"2023-05-16T13:55:24.703848+0000","last_peered":"2023-05-16T13:55:24.703848+0000","last_clean":"2023-05-16T13:55:24.703848+0000","last_became_active":"2023-05-16T13:55:23.413471+0000","last_became_peered":"2023-05-16T13:55:23.413471+0000","last_unstale":"2023-05-16T13:55:24.703848+0000","last_undegraded":"2023-05-16T13:55:24.703848+0000","last_fullsized":"2023-05-16T13:55:24.703848+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:45:55.863941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.390166+0000","last_change":"2023-05-16T13:55:22.990016+0000","last_active":"2023-05-16T13:55:24.390166+0000","last_peered":"2023-05-16T13:55:24.390166+0000","last_clean":"2023-05-16T13:55:24.390166+0000","last_became_active":"2023-05-16T13:55:22.989661+0000","last_became_peered":"2023-05-16T13:55:22.989661+0000","last_unstale":"2023-05-16T13:55:24.390166+0000","last_undegraded":"2023-05-16T13:55:24.390166+0000","last_fullsized":"2023-05-16T13:55:24.390166+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:43:29.359983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.389480+0000","last_change":"2023-05-16T13:55:23.410465+0000","last_active":"2023-05-16T13:55:24.389480+0000","last_peered":"2023-05-16T13:55:24.389480+0000","last_clean":"2023-05-16T13:55:24.389480+0000","last_became_active":"2023-05-16T13:55:23.409929+0000","last_became_peered":"2023-05-16T13:55:23.409929+0000","last_unstale":"2023-05-16T13:55:24.389480+0000","last_undegraded":"2023-05-16T13:55:24.389480+0000","last_fullsized":"2023-05-16T13:55:24.389480+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T15:51:40.646591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703104+0000","last_change":"2023-05-16T13:55:23.004761+0000","last_active":"2023-05-16T13:55:24.703104+0000","last_peered":"2023-05-16T13:55:24.703104+0000","last_clean":"2023-05-16T13:55:24.703104+0000","last_became_active":"2023-05-16T13:55:23.004395+0000","last_became_peered":"2023-05-16T13:55:23.004395+0000","last_unstale":"2023-05-16T13:55:24.703104+0000","last_undegraded":"2023-05-16T13:55:24.703104+0000","last_fullsized":"2023-05-16T13:55:24.703104+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:35:41.923514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.448956+0000","last_change":"2023-05-16T13:55:23.411493+0000","last_active":"2023-05-16T13:55:24.448956+0000","last_peered":"2023-05-16T13:55:24.448956+0000","last_clean":"2023-05-16T13:55:24.448956+0000","last_became_active":"2023-05-16T13:55:23.410780+0000","last_became_peered":"2023-05-16T13:55:23.410780+0000","last_unstale":"2023-05-16T13:55:24.448956+0000","last_undegraded":"2023-05-16T13:55:24.448956+0000","last_fullsized":"2023-05-16T13:55:24.448956+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:16:30.890505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703577+0000","last_change":"2023-05-16T13:55:23.007831+0000","last_active":"2023-05-16T13:55:24.703577+0000","last_peered":"2023-05-16T13:55:24.703577+0000","last_clean":"2023-05-16T13:55:24.703577+0000","last_became_active":"2023-05-16T13:55:23.007503+0000","last_became_peered":"2023-05-16T13:55:23.007503+0000","last_unstale":"2023-05-16T13:55:24.703577+0000","last_undegraded":"2023-05-16T13:55:24.703577+0000","last_fullsized":"2023-05-16T13:55:24.703577+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T18:57:22.099128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702686+0000","last_change":"2023-05-16T13:55:23.410445+0000","last_active":"2023-05-16T13:55:24.702686+0000","last_peered":"2023-05-16T13:55:24.702686+0000","last_clean":"2023-05-16T13:55:24.702686+0000","last_became_active":"2023-05-16T13:55:23.408143+0000","last_became_peered":"2023-05-16T13:55:23.408143+0000","last_unstale":"2023-05-16T13:55:24.702686+0000","last_undegraded":"2023-05-16T13:55:24.702686+0000","last_fullsized":"2023-05-16T13:55:24.702686+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:21:33.903700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703592+0000","last_change":"2023-05-16T13:55:23.008048+0000","last_active":"2023-05-16T13:55:24.703592+0000","last_peered":"2023-05-16T13:55:24.703592+0000","last_clean":"2023-05-16T13:55:24.703592+0000","last_became_active":"2023-05-16T13:55:23.007545+0000","last_became_peered":"2023-05-16T13:55:23.007545+0000","last_unstale":"2023-05-16T13:55:24.703592+0000","last_undegraded":"2023-05-16T13:55:24.703592+0000","last_fullsized":"2023-05-16T13:55:24.703592+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T18:33:51.205312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.391488+0000","last_change":"2023-05-16T13:55:23.407477+0000","last_active":"2023-05-16T13:55:24.391488+0000","last_peered":"2023-05-16T13:55:24.391488+0000","last_clean":"2023-05-16T13:55:24.391488+0000","last_became_active":"2023-05-16T13:55:23.406622+0000","last_became_peered":"2023-05-16T13:55:23.406622+0000","last_unstale":"2023-05-16T13:55:24.391488+0000","last_undegraded":"2023-05-16T13:55:24.391488+0000","last_fullsized":"2023-05-16T13:55:24.391488+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:16:30.890505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":19,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703914+0000","last_change":"2023-05-16T13:55:23.010113+0000","last_active":"2023-05-16T13:55:24.703914+0000","last_peered":"2023-05-16T13:55:24.703914+0000","last_clean":"2023-05-16T13:55:24.703914+0000","last_became_active":"2023-05-16T13:55:23.007991+0000","last_became_peered":"2023-05-16T13:55:23.007991+0000","last_unstale":"2023-05-16T13:55:24.703914+0000","last_undegraded":"2023-05-16T13:55:24.703914+0000","last_fullsized":"2023-05-16T13:55:24.703914+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:09:25.013926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703468+0000","last_change":"2023-05-16T13:55:23.426171+0000","last_active":"2023-05-16T13:55:24.703468+0000","last_peered":"2023-05-16T13:55:24.703468+0000","last_clean":"2023-05-16T13:55:24.703468+0000","last_became_active":"2023-05-16T13:55:23.425887+0000","last_became_peered":"2023-05-16T13:55:23.425887+0000","last_unstale":"2023-05-16T13:55:24.703468+0000","last_undegraded":"2023-05-16T13:55:24.703468+0000","last_fullsized":"2023-05-16T13:55:24.703468+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:36:07.932696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.704044+0000","last_change":"2023-05-16T13:55:23.005180+0000","last_active":"2023-05-16T13:55:24.704044+0000","last_peered":"2023-05-16T13:55:24.704044+0000","last_clean":"2023-05-16T13:55:24.704044+0000","last_became_active":"2023-05-16T13:55:23.004744+0000","last_became_peered":"2023-05-16T13:55:23.004744+0000","last_unstale":"2023-05-16T13:55:24.704044+0000","last_undegraded":"2023-05-16T13:55:24.704044+0000","last_fullsized":"2023-05-16T13:55:24.704044+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:37:21.801714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703851+0000","last_change":"2023-05-16T13:55:23.412436+0000","last_active":"2023-05-16T13:55:24.703851+0000","last_peered":"2023-05-16T13:55:24.703851+0000","last_clean":"2023-05-16T13:55:24.703851+0000","last_became_active":"2023-05-16T13:55:23.412200+0000","last_became_peered":"2023-05-16T13:55:23.412200+0000","last_unstale":"2023-05-16T13:55:24.703851+0000","last_undegraded":"2023-05-16T13:55:24.703851+0000","last_fullsized":"2023-05-16T13:55:24.703851+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:37:14.267206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702898+0000","last_change":"2023-05-16T13:55:23.008139+0000","last_active":"2023-05-16T13:55:24.702898+0000","last_peered":"2023-05-16T13:55:24.702898+0000","last_clean":"2023-05-16T13:55:24.702898+0000","last_became_active":"2023-05-16T13:55:23.007732+0000","last_became_peered":"2023-05-16T13:55:23.007732+0000","last_unstale":"2023-05-16T13:55:24.702898+0000","last_undegraded":"2023-05-16T13:55:24.702898+0000","last_fullsized":"2023-05-16T13:55:24.702898+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T14:02:33.296373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.448770+0000","last_change":"2023-05-16T13:55:23.412734+0000","last_active":"2023-05-16T13:55:24.448770+0000","last_peered":"2023-05-16T13:55:24.448770+0000","last_clean":"2023-05-16T13:55:24.448770+0000","last_became_active":"2023-05-16T13:55:23.412348+0000","last_became_peered":"2023-05-16T13:55:23.412348+0000","last_unstale":"2023-05-16T13:55:24.448770+0000","last_undegraded":"2023-05-16T13:55:24.448770+0000","last_fullsized":"2023-05-16T13:55:24.448770+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:52:40.298346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.390501+0000","last_change":"2023-05-16T13:55:22.989132+0000","last_active":"2023-05-16T13:55:24.390501+0000","last_peered":"2023-05-16T13:55:24.390501+0000","last_clean":"2023-05-16T13:55:24.390501+0000","last_became_active":"2023-05-16T13:55:22.988291+0000","last_became_peered":"2023-05-16T13:55:22.988291+0000","last_unstale":"2023-05-16T13:55:24.390501+0000","last_undegraded":"2023-05-16T13:55:24.390501+0000","last_fullsized":"2023-05-16T13:55:24.390501+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T18:02:59.391437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703975+0000","last_change":"2023-05-16T13:55:23.414195+0000","last_active":"2023-05-16T13:55:24.703975+0000","last_peered":"2023-05-16T13:55:24.703975+0000","last_clean":"2023-05-16T13:55:24.703975+0000","last_became_active":"2023-05-16T13:55:23.413751+0000","last_became_peered":"2023-05-16T13:55:23.413751+0000","last_unstale":"2023-05-16T13:55:24.703975+0000","last_undegraded":"2023-05-16T13:55:24.703975+0000","last_fullsized":"2023-05-16T13:55:24.703975+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T20:53:14.973983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"37'8","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.448362+0000","last_change":"2023-05-16T13:55:22.992485+0000","last_active":"2023-05-16T13:55:24.448362+0000","last_peered":"2023-05-16T13:55:24.448362+0000","last_clean":"2023-05-16T13:55:24.448362+0000","last_became_active":"2023-05-16T13:55:22.992225+0000","last_became_peered":"2023-05-16T13:55:22.992225+0000","last_unstale":"2023-05-16T13:55:24.448362+0000","last_undegraded":"2023-05-16T13:55:24.448362+0000","last_fullsized":"2023-05-16T13:55:24.448362+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T14:58:30.874381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703817+0000","last_change":"2023-05-16T13:55:23.410961+0000","last_active":"2023-05-16T13:55:24.703817+0000","last_peered":"2023-05-16T13:55:24.703817+0000","last_clean":"2023-05-16T13:55:24.703817+0000","last_became_active":"2023-05-16T13:55:23.410710+0000","last_became_peered":"2023-05-16T13:55:23.410710+0000","last_unstale":"2023-05-16T13:55:24.703817+0000","last_undegraded":"2023-05-16T13:55:24.703817+0000","last_fullsized":"2023-05-16T13:55:24.703817+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:51:42.064641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703647+0000","last_change":"2023-05-16T13:55:23.008354+0000","last_active":"2023-05-16T13:55:24.703647+0000","last_peered":"2023-05-16T13:55:24.703647+0000","last_clean":"2023-05-16T13:55:24.703647+0000","last_became_active":"2023-05-16T13:55:23.008075+0000","last_became_peered":"2023-05-16T13:55:23.008075+0000","last_unstale":"2023-05-16T13:55:24.703647+0000","last_undegraded":"2023-05-16T13:55:24.703647+0000","last_fullsized":"2023-05-16T13:55:24.703647+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:52:39.280919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703394+0000","last_change":"2023-05-16T13:55:23.420895+0000","last_active":"2023-05-16T13:55:24.703394+0000","last_peered":"2023-05-16T13:55:24.703394+0000","last_clean":"2023-05-16T13:55:24.703394+0000","last_became_active":"2023-05-16T13:55:23.416774+0000","last_became_peered":"2023-05-16T13:55:23.416774+0000","last_unstale":"2023-05-16T13:55:24.703394+0000","last_undegraded":"2023-05-16T13:55:24.703394+0000","last_fullsized":"2023-05-16T13:55:24.703394+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:44:47.581169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.391418+0000","last_change":"2023-05-16T13:55:23.009234+0000","last_active":"2023-05-16T13:55:24.391418+0000","last_peered":"2023-05-16T13:55:24.391418+0000","last_clean":"2023-05-16T13:55:24.391418+0000","last_became_active":"2023-05-16T13:55:23.008779+0000","last_became_peered":"2023-05-16T13:55:23.008779+0000","last_unstale":"2023-05-16T13:55:24.391418+0000","last_undegraded":"2023-05-16T13:55:24.391418+0000","last_fullsized":"2023-05-16T13:55:24.391418+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T15:34:36.361308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.390751+0000","last_change":"2023-05-16T13:55:23.406175+0000","last_active":"2023-05-16T13:55:24.390751+0000","last_peered":"2023-05-16T13:55:24.390751+0000","last_clean":"2023-05-16T13:55:24.390751+0000","last_became_active":"2023-05-16T13:55:23.405852+0000","last_became_peered":"2023-05-16T13:55:23.405852+0000","last_unstale":"2023-05-16T13:55:24.390751+0000","last_undegraded":"2023-05-16T13:55:24.390751+0000","last_fullsized":"2023-05-16T13:55:24.390751+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:15:01.909502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.389555+0000","last_change":"2023-05-16T13:55:23.002334+0000","last_active":"2023-05-16T13:55:24.389555+0000","last_peered":"2023-05-16T13:55:24.389555+0000","last_clean":"2023-05-16T13:55:24.389555+0000","last_became_active":"2023-05-16T13:55:23.002060+0000","last_became_peered":"2023-05-16T13:55:23.002060+0000","last_unstale":"2023-05-16T13:55:24.389555+0000","last_undegraded":"2023-05-16T13:55:24.389555+0000","last_fullsized":"2023-05-16T13:55:24.389555+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:24:10.547224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.389340+0000","last_change":"2023-05-16T13:55:23.416259+0000","last_active":"2023-05-16T13:55:24.389340+0000","last_peered":"2023-05-16T13:55:24.389340+0000","last_clean":"2023-05-16T13:55:24.389340+0000","last_became_active":"2023-05-16T13:55:23.415983+0000","last_became_peered":"2023-05-16T13:55:23.415983+0000","last_unstale":"2023-05-16T13:55:24.389340+0000","last_undegraded":"2023-05-16T13:55:24.389340+0000","last_fullsized":"2023-05-16T13:55:24.389340+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:45:04.746418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703229+0000","last_change":"2023-05-16T13:55:23.003470+0000","last_active":"2023-05-16T13:55:24.703229+0000","last_peered":"2023-05-16T13:55:24.703229+0000","last_clean":"2023-05-16T13:55:24.703229+0000","last_became_active":"2023-05-16T13:55:23.003203+0000","last_became_peered":"2023-05-16T13:55:23.003203+0000","last_unstale":"2023-05-16T13:55:24.703229+0000","last_undegraded":"2023-05-16T13:55:24.703229+0000","last_fullsized":"2023-05-16T13:55:24.703229+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T20:23:26.619277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.448881+0000","last_change":"2023-05-16T13:55:23.418998+0000","last_active":"2023-05-16T13:55:24.448881+0000","last_peered":"2023-05-16T13:55:24.448881+0000","last_clean":"2023-05-16T13:55:24.448881+0000","last_became_active":"2023-05-16T13:55:23.418628+0000","last_became_peered":"2023-05-16T13:55:23.418628+0000","last_unstale":"2023-05-16T13:55:24.448881+0000","last_undegraded":"2023-05-16T13:55:24.448881+0000","last_fullsized":"2023-05-16T13:55:24.448881+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T18:37:01.378522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.389117+0000","last_change":"2023-05-16T13:55:23.005895+0000","last_active":"2023-05-16T13:55:24.389117+0000","last_peered":"2023-05-16T13:55:24.389117+0000","last_clean":"2023-05-16T13:55:24.389117+0000","last_became_active":"2023-05-16T13:55:23.005582+0000","last_became_peered":"2023-05-16T13:55:23.005582+0000","last_unstale":"2023-05-16T13:55:24.389117+0000","last_undegraded":"2023-05-16T13:55:24.389117+0000","last_fullsized":"2023-05-16T13:55:24.389117+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:21:37.712743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703434+0000","last_change":"2023-05-16T13:55:23.411672+0000","last_active":"2023-05-16T13:55:24.703434+0000","last_peered":"2023-05-16T13:55:24.703434+0000","last_clean":"2023-05-16T13:55:24.703434+0000","last_became_active":"2023-05-16T13:55:23.408317+0000","last_became_peered":"2023-05-16T13:55:23.408317+0000","last_unstale":"2023-05-16T13:55:24.703434+0000","last_undegraded":"2023-05-16T13:55:24.703434+0000","last_fullsized":"2023-05-16T13:55:24.703434+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:24:27.841261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.389190+0000","last_change":"2023-05-16T13:55:23.001075+0000","last_active":"2023-05-16T13:55:24.389190+0000","last_peered":"2023-05-16T13:55:24.389190+0000","last_clean":"2023-05-16T13:55:24.389190+0000","last_became_active":"2023-05-16T13:55:23.000764+0000","last_became_peered":"2023-05-16T13:55:23.000764+0000","last_unstale":"2023-05-16T13:55:24.389190+0000","last_undegraded":"2023-05-16T13:55:24.389190+0000","last_fullsized":"2023-05-16T13:55:24.389190+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:25:15.075534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702914+0000","last_change":"2023-05-16T13:55:23.417031+0000","last_active":"2023-05-16T13:55:24.702914+0000","last_peered":"2023-05-16T13:55:24.702914+0000","last_clean":"2023-05-16T13:55:24.702914+0000","last_became_active":"2023-05-16T13:55:23.414376+0000","last_became_peered":"2023-05-16T13:55:23.414376+0000","last_unstale":"2023-05-16T13:55:24.702914+0000","last_undegraded":"2023-05-16T13:55:24.702914+0000","last_fullsized":"2023-05-16T13:55:24.702914+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:50:00.455412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.448937+0000","last_change":"2023-05-16T13:55:22.991669+0000","last_active":"2023-05-16T13:55:24.448937+0000","last_peered":"2023-05-16T13:55:24.448937+0000","last_clean":"2023-05-16T13:55:24.448937+0000","last_became_active":"2023-05-16T13:55:22.991279+0000","last_became_peered":"2023-05-16T13:55:22.991279+0000","last_unstale":"2023-05-16T13:55:24.448937+0000","last_undegraded":"2023-05-16T13:55:24.448937+0000","last_fullsized":"2023-05-16T13:55:24.448937+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T15:34:36.361308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.704066+0000","last_change":"2023-05-16T13:55:23.408380+0000","last_active":"2023-05-16T13:55:24.704066+0000","last_peered":"2023-05-16T13:55:24.704066+0000","last_clean":"2023-05-16T13:55:24.704066+0000","last_became_active":"2023-05-16T13:55:23.408097+0000","last_became_peered":"2023-05-16T13:55:23.408097+0000","last_unstale":"2023-05-16T13:55:24.704066+0000","last_undegraded":"2023-05-16T13:55:24.704066+0000","last_fullsized":"2023-05-16T13:55:24.704066+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T23:46:15.133417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.389006+0000","last_change":"2023-05-16T13:55:23.006029+0000","last_active":"2023-05-16T13:55:24.389006+0000","last_peered":"2023-05-16T13:55:24.389006+0000","last_clean":"2023-05-16T13:55:24.389006+0000","last_became_active":"2023-05-16T13:55:23.005646+0000","last_became_peered":"2023-05-16T13:55:23.005646+0000","last_unstale":"2023-05-16T13:55:24.389006+0000","last_undegraded":"2023-05-16T13:55:24.389006+0000","last_fullsized":"2023-05-16T13:55:24.389006+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:49:42.765347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703458+0000","last_change":"2023-05-16T13:55:23.416611+0000","last_active":"2023-05-16T13:55:24.703458+0000","last_peered":"2023-05-16T13:55:24.703458+0000","last_clean":"2023-05-16T13:55:24.703458+0000","last_became_active":"2023-05-16T13:55:23.415727+0000","last_became_peered":"2023-05-16T13:55:23.415727+0000","last_unstale":"2023-05-16T13:55:24.703458+0000","last_undegraded":"2023-05-16T13:55:24.703458+0000","last_fullsized":"2023-05-16T13:55:24.703458+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:37:09.541457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.448831+0000","last_change":"2023-05-16T13:55:23.003863+0000","last_active":"2023-05-16T13:55:24.448831+0000","last_peered":"2023-05-16T13:55:24.448831+0000","last_clean":"2023-05-16T13:55:24.448831+0000","last_became_active":"2023-05-16T13:55:23.003544+0000","last_became_peered":"2023-05-16T13:55:23.003544+0000","last_unstale":"2023-05-16T13:55:24.448831+0000","last_undegraded":"2023-05-16T13:55:24.448831+0000","last_fullsized":"2023-05-16T13:55:24.448831+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:56:30.037745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":199,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.448980+0000","last_change":"2023-05-16T13:54:03.495814+0000","last_active":"2023-05-16T13:55:24.448980+0000","last_peered":"2023-05-16T13:55:24.448980+0000","last_clean":"2023-05-16T13:55:24.448980+0000","last_became_active":"2023-05-16T13:54:03.494265+0000","last_became_peered":"2023-05-16T13:54:03.494265+0000","last_unstale":"2023-05-16T13:55:24.448980+0000","last_undegraded":"2023-05-16T13:55:24.448980+0000","last_fullsized":"2023-05-16T13:55:24.448980+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:01.722051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:01.722051+0000","last_clean_scrub_stamp":"2023-05-16T13:54:01.722051+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:41:43.408916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703470+0000","last_change":"2023-05-16T13:54:09.770727+0000","last_active":"2023-05-16T13:55:24.703470+0000","last_peered":"2023-05-16T13:55:24.703470+0000","last_clean":"2023-05-16T13:55:24.703470+0000","last_became_active":"2023-05-16T13:54:09.770179+0000","last_became_peered":"2023-05-16T13:54:09.770179+0000","last_unstale":"2023-05-16T13:55:24.703470+0000","last_undegraded":"2023-05-16T13:55:24.703470+0000","last_fullsized":"2023-05-16T13:55:24.703470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:13:47.691504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703107+0000","last_change":"2023-05-16T13:55:23.424350+0000","last_active":"2023-05-16T13:55:24.703107+0000","last_peered":"2023-05-16T13:55:24.703107+0000","last_clean":"2023-05-16T13:55:24.703107+0000","last_became_active":"2023-05-16T13:55:23.424033+0000","last_became_peered":"2023-05-16T13:55:23.424033+0000","last_unstale":"2023-05-16T13:55:24.703107+0000","last_undegraded":"2023-05-16T13:55:24.703107+0000","last_fullsized":"2023-05-16T13:55:24.703107+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T23:52:16.681043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703675+0000","last_change":"2023-05-16T13:55:23.007940+0000","last_active":"2023-05-16T13:55:24.703675+0000","last_peered":"2023-05-16T13:55:24.703675+0000","last_clean":"2023-05-16T13:55:24.703675+0000","last_became_active":"2023-05-16T13:55:23.007580+0000","last_became_peered":"2023-05-16T13:55:23.007580+0000","last_unstale":"2023-05-16T13:55:24.703675+0000","last_undegraded":"2023-05-16T13:55:24.703675+0000","last_fullsized":"2023-05-16T13:55:24.703675+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:56:30.037745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.448458+0000","last_change":"2023-05-16T13:54:09.768888+0000","last_active":"2023-05-16T13:55:24.448458+0000","last_peered":"2023-05-16T13:55:24.448458+0000","last_clean":"2023-05-16T13:55:24.448458+0000","last_became_active":"2023-05-16T13:54:09.768463+0000","last_became_peered":"2023-05-16T13:54:09.768463+0000","last_unstale":"2023-05-16T13:55:24.448458+0000","last_undegraded":"2023-05-16T13:55:24.448458+0000","last_fullsized":"2023-05-16T13:55:24.448458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:58:03.874164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.448960+0000","last_change":"2023-05-16T13:55:23.411690+0000","last_active":"2023-05-16T13:55:24.448960+0000","last_peered":"2023-05-16T13:55:24.448960+0000","last_clean":"2023-05-16T13:55:24.448960+0000","last_became_active":"2023-05-16T13:55:23.411143+0000","last_became_peered":"2023-05-16T13:55:23.411143+0000","last_unstale":"2023-05-16T13:55:24.448960+0000","last_undegraded":"2023-05-16T13:55:24.448960+0000","last_fullsized":"2023-05-16T13:55:24.448960+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:09:59.461115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.389284+0000","last_change":"2023-05-16T13:55:23.009854+0000","last_active":"2023-05-16T13:55:24.389284+0000","last_peered":"2023-05-16T13:55:24.389284+0000","last_clean":"2023-05-16T13:55:24.389284+0000","last_became_active":"2023-05-16T13:55:23.009546+0000","last_became_peered":"2023-05-16T13:55:23.009546+0000","last_unstale":"2023-05-16T13:55:24.389284+0000","last_undegraded":"2023-05-16T13:55:24.389284+0000","last_fullsized":"2023-05-16T13:55:24.389284+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T18:09:26.341219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.388996+0000","last_change":"2023-05-16T13:54:09.821010+0000","last_active":"2023-05-16T13:55:24.388996+0000","last_peered":"2023-05-16T13:55:24.388996+0000","last_clean":"2023-05-16T13:55:24.388996+0000","last_became_active":"2023-05-16T13:54:09.820636+0000","last_became_peered":"2023-05-16T13:54:09.820636+0000","last_unstale":"2023-05-16T13:55:24.388996+0000","last_undegraded":"2023-05-16T13:55:24.388996+0000","last_fullsized":"2023-05-16T13:55:24.388996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T16:40:06.160431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703115+0000","last_change":"2023-05-16T13:55:23.407818+0000","last_active":"2023-05-16T13:55:24.703115+0000","last_peered":"2023-05-16T13:55:24.703115+0000","last_clean":"2023-05-16T13:55:24.703115+0000","last_became_active":"2023-05-16T13:55:23.407568+0000","last_became_peered":"2023-05-16T13:55:23.407568+0000","last_unstale":"2023-05-16T13:55:24.703115+0000","last_undegraded":"2023-05-16T13:55:24.703115+0000","last_fullsized":"2023-05-16T13:55:24.703115+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:04:23.740266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702701+0000","last_change":"2023-05-16T13:55:23.003233+0000","last_active":"2023-05-16T13:55:24.702701+0000","last_peered":"2023-05-16T13:55:24.702701+0000","last_clean":"2023-05-16T13:55:24.702701+0000","last_became_active":"2023-05-16T13:55:23.002924+0000","last_became_peered":"2023-05-16T13:55:23.002924+0000","last_unstale":"2023-05-16T13:55:24.702701+0000","last_undegraded":"2023-05-16T13:55:24.702701+0000","last_fullsized":"2023-05-16T13:55:24.702701+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T16:42:10.128117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703027+0000","last_change":"2023-05-16T13:54:09.771040+0000","last_active":"2023-05-16T13:55:24.703027+0000","last_peered":"2023-05-16T13:55:24.703027+0000","last_clean":"2023-05-16T13:55:24.703027+0000","last_became_active":"2023-05-16T13:54:09.770433+0000","last_became_peered":"2023-05-16T13:54:09.770433+0000","last_unstale":"2023-05-16T13:55:24.703027+0000","last_undegraded":"2023-05-16T13:55:24.703027+0000","last_fullsized":"2023-05-16T13:55:24.703027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T14:24:43.948538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703572+0000","last_change":"2023-05-16T13:55:23.412124+0000","last_active":"2023-05-16T13:55:24.703572+0000","last_peered":"2023-05-16T13:55:24.703572+0000","last_clean":"2023-05-16T13:55:24.703572+0000","last_became_active":"2023-05-16T13:55:23.411824+0000","last_became_peered":"2023-05-16T13:55:23.411824+0000","last_unstale":"2023-05-16T13:55:24.703572+0000","last_undegraded":"2023-05-16T13:55:24.703572+0000","last_fullsized":"2023-05-16T13:55:24.703572+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:42:50.808847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.704046+0000","last_change":"2023-05-16T13:55:22.999434+0000","last_active":"2023-05-16T13:55:24.704046+0000","last_peered":"2023-05-16T13:55:24.704046+0000","last_clean":"2023-05-16T13:55:24.704046+0000","last_became_active":"2023-05-16T13:55:22.999152+0000","last_became_peered":"2023-05-16T13:55:22.999152+0000","last_unstale":"2023-05-16T13:55:24.704046+0000","last_undegraded":"2023-05-16T13:55:24.704046+0000","last_fullsized":"2023-05-16T13:55:24.704046+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T14:02:33.296373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703306+0000","last_change":"2023-05-16T13:54:09.813177+0000","last_active":"2023-05-16T13:55:24.703306+0000","last_peered":"2023-05-16T13:55:24.703306+0000","last_clean":"2023-05-16T13:55:24.703306+0000","last_became_active":"2023-05-16T13:54:09.812487+0000","last_became_peered":"2023-05-16T13:54:09.812487+0000","last_unstale":"2023-05-16T13:55:24.703306+0000","last_undegraded":"2023-05-16T13:55:24.703306+0000","last_fullsized":"2023-05-16T13:55:24.703306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T23:57:49.146859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702519+0000","last_change":"2023-05-16T13:55:23.410758+0000","last_active":"2023-05-16T13:55:24.702519+0000","last_peered":"2023-05-16T13:55:24.702519+0000","last_clean":"2023-05-16T13:55:24.702519+0000","last_became_active":"2023-05-16T13:55:23.410389+0000","last_became_peered":"2023-05-16T13:55:23.410389+0000","last_unstale":"2023-05-16T13:55:24.702519+0000","last_undegraded":"2023-05-16T13:55:24.702519+0000","last_fullsized":"2023-05-16T13:55:24.702519+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:36:07.932696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.390393+0000","last_change":"2023-05-16T13:55:22.999858+0000","last_active":"2023-05-16T13:55:24.390393+0000","last_peered":"2023-05-16T13:55:24.390393+0000","last_clean":"2023-05-16T13:55:24.390393+0000","last_became_active":"2023-05-16T13:55:22.999551+0000","last_became_peered":"2023-05-16T13:55:22.999551+0000","last_unstale":"2023-05-16T13:55:24.390393+0000","last_undegraded":"2023-05-16T13:55:24.390393+0000","last_fullsized":"2023-05-16T13:55:24.390393+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:28:57.237069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.449051+0000","last_change":"2023-05-16T13:54:09.813305+0000","last_active":"2023-05-16T13:55:24.449051+0000","last_peered":"2023-05-16T13:55:24.449051+0000","last_clean":"2023-05-16T13:55:24.449051+0000","last_became_active":"2023-05-16T13:54:09.812931+0000","last_became_peered":"2023-05-16T13:54:09.812931+0000","last_unstale":"2023-05-16T13:55:24.449051+0000","last_undegraded":"2023-05-16T13:55:24.449051+0000","last_fullsized":"2023-05-16T13:55:24.449051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:20:38.445502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.391162+0000","last_change":"2023-05-16T13:55:23.400824+0000","last_active":"2023-05-16T13:55:24.391162+0000","last_peered":"2023-05-16T13:55:24.391162+0000","last_clean":"2023-05-16T13:55:24.391162+0000","last_became_active":"2023-05-16T13:55:23.400555+0000","last_became_peered":"2023-05-16T13:55:23.400555+0000","last_unstale":"2023-05-16T13:55:24.391162+0000","last_undegraded":"2023-05-16T13:55:24.391162+0000","last_fullsized":"2023-05-16T13:55:24.391162+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T18:37:01.378522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.390164+0000","last_change":"2023-05-16T13:55:22.995464+0000","last_active":"2023-05-16T13:55:24.390164+0000","last_peered":"2023-05-16T13:55:24.390164+0000","last_clean":"2023-05-16T13:55:24.390164+0000","last_became_active":"2023-05-16T13:55:22.994103+0000","last_became_peered":"2023-05-16T13:55:22.994103+0000","last_unstale":"2023-05-16T13:55:24.390164+0000","last_undegraded":"2023-05-16T13:55:24.390164+0000","last_fullsized":"2023-05-16T13:55:24.390164+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:37:08.524030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703646+0000","last_change":"2023-05-16T13:54:09.768257+0000","last_active":"2023-05-16T13:55:24.703646+0000","last_peered":"2023-05-16T13:55:24.703646+0000","last_clean":"2023-05-16T13:55:24.703646+0000","last_became_active":"2023-05-16T13:54:09.767879+0000","last_became_peered":"2023-05-16T13:54:09.767879+0000","last_unstale":"2023-05-16T13:55:24.703646+0000","last_undegraded":"2023-05-16T13:55:24.703646+0000","last_fullsized":"2023-05-16T13:55:24.703646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:59:08.711793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.448768+0000","last_change":"2023-05-16T13:55:23.402679+0000","last_active":"2023-05-16T13:55:24.448768+0000","last_peered":"2023-05-16T13:55:24.448768+0000","last_clean":"2023-05-16T13:55:24.448768+0000","last_became_active":"2023-05-16T13:55:23.402384+0000","last_became_peered":"2023-05-16T13:55:23.402384+0000","last_unstale":"2023-05-16T13:55:24.448768+0000","last_undegraded":"2023-05-16T13:55:24.448768+0000","last_fullsized":"2023-05-16T13:55:24.448768+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T18:33:52.222739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702984+0000","last_change":"2023-05-16T13:55:22.998169+0000","last_active":"2023-05-16T13:55:24.702984+0000","last_peered":"2023-05-16T13:55:24.702984+0000","last_clean":"2023-05-16T13:55:24.702984+0000","last_became_active":"2023-05-16T13:55:22.997892+0000","last_became_peered":"2023-05-16T13:55:22.997892+0000","last_unstale":"2023-05-16T13:55:24.702984+0000","last_undegraded":"2023-05-16T13:55:24.702984+0000","last_fullsized":"2023-05-16T13:55:24.702984+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:03:49.235876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":45,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.391257+0000","last_change":"2023-05-16T13:54:09.768603+0000","last_active":"2023-05-16T13:55:24.391257+0000","last_peered":"2023-05-16T13:55:24.391257+0000","last_clean":"2023-05-16T13:55:24.391257+0000","last_became_active":"2023-05-16T13:54:09.768323+0000","last_became_peered":"2023-05-16T13:54:09.768323+0000","last_unstale":"2023-05-16T13:55:24.391257+0000","last_undegraded":"2023-05-16T13:55:24.391257+0000","last_fullsized":"2023-05-16T13:55:24.391257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:23:03.008131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509460,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13756,"kb_used_data":1012,"kb_used_omap":0,"kb_used_meta":12736,"kb_avail":94358084,"statfs":{"total":96636764160,"available":96622678016,"internally_reserved":0,"allocated":1036288,"data_stored":769041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13041664},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue May 16 13:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.623}]},{"osd":1,"last update":"Tue May 16 13:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.52100000000000002}]},{"osd":2,"last update":"Tue May 16 13:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.77200000000000002}]},{"osd":3,"last update":"Tue May 16 13:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.63700000000000001}]},{"osd":4,"last update":"Tue May 16 13:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.78600000000000003}]},{"osd":5,"last update":"Tue May 16 13:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.749},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.60199999999999998}]},{"osd":6,"last update":"Tue May 16 13:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.69499999999999995}]}]},{"osd":6,"up_from":15,"seq":64424509459,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12524,"kb_used_data":420,"kb_used_omap":0,"kb_used_meta":12096,"kb_avail":94359316,"statfs":{"total":96636764160,"available":96623939584,"internally_reserved":0,"allocated":430080,"data_stored":177621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12386304},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.76100000000000001}]},{"osd":1,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.79800000000000004}]},{"osd":2,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.69399999999999995}]},{"osd":3,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.78300000000000003}]},{"osd":4,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.55400000000000005}]},{"osd":5,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.59099999999999997}]},{"osd":7,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.77300000000000002}]}]},{"osd":5,"up_from":15,"seq":64424509460,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12592,"kb_used_data":424,"kb_used_omap":0,"kb_used_meta":12160,"kb_avail":94359248,"statfs":{"total":96636764160,"available":96623869952,"internally_reserved":0,"allocated":434176,"data_stored":177151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12451840},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue May 16 13:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.59399999999999997}]},{"osd":1,"last update":"Tue May 16 13:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.54200000000000004}]},{"osd":2,"last update":"Tue May 16 13:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.501}]},{"osd":3,"last update":"Tue May 16 13:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.62}]},{"osd":4,"last update":"Tue May 16 13:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.65800000000000003}]},{"osd":6,"last update":"Tue May 16 13:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.64000000000000001}]},{"osd":7,"last update":"Tue May 16 13:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.75600000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509460,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12720,"kb_used_data":424,"kb_used_omap":0,"kb_used_meta":12288,"kb_avail":94359120,"statfs":{"total":96636764160,"available":96623738880,"internally_reserved":0,"allocated":434176,"data_stored":177643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12582912},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.67100000000000004}]},{"osd":1,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.72399999999999998}]},{"osd":2,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.623}]},{"osd":3,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.75800000000000001}]},{"osd":5,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.60099999999999998}]},{"osd":6,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.57899999999999996}]},{"osd":7,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.505},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.53300000000000003}]}]},{"osd":3,"up_from":14,"seq":60129542164,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12664,"kb_used_data":432,"kb_used_omap":0,"kb_used_meta":12224,"kb_avail":94359176,"statfs":{"total":96636764160,"available":96623796224,"internally_reserved":0,"allocated":442368,"data_stored":178637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12517376},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.41599999999999998}]},{"osd":1,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.432}]},{"osd":2,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.36099999999999999}]},{"osd":4,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":0.79600000000000004}]},{"osd":5,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.631,"5min":1.631,"15min":1.631},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.72199999999999998}]},{"osd":6,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.753}]},{"osd":7,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.80500000000000005}]}]},{"osd":2,"up_from":14,"seq":60129542164,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12524,"kb_used_data":420,"kb_used_omap":0,"kb_used_meta":12096,"kb_avail":94359316,"statfs":{"total":96636764160,"available":96623939584,"internally_reserved":0,"allocated":430080,"data_stored":177109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12386304},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue May 16 13:55:01 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.48599999999999999}]},{"osd":1,"last update":"Tue May 16 13:55:01 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.54900000000000004}]},{"osd":3,"last update":"Tue May 16 13:55:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.50600000000000001}]},{"osd":4,"last update":"Tue May 16 13:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.85899999999999999}]},{"osd":5,"last update":"Tue May 16 13:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.81799999999999995}]},{"osd":6,"last update":"Tue May 16 13:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.83899999999999997}]},{"osd":7,"last update":"Tue May 16 13:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.89300000000000002}]}]},{"osd":1,"up_from":14,"seq":60129542163,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12588,"kb_used_data":420,"kb_used_omap":0,"kb_used_meta":12160,"kb_avail":94359252,"statfs":{"total":96636764160,"available":96623874048,"internally_reserved":0,"allocated":430080,"data_stored":177129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12451840},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.311},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.46999999999999997}]},{"osd":2,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.373},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.48399999999999999}]},{"osd":3,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.441}]},{"osd":4,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.59499999999999997}]},{"osd":5,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.69699999999999995}]},{"osd":6,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.67900000000000005}]},{"osd":7,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.67100000000000004}]}]},{"osd":0,"up_from":14,"seq":60129542164,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13680,"kb_used_data":1000,"kb_used_omap":0,"kb_used_meta":12672,"kb_avail":94358160,"statfs":{"total":96636764160,"available":96622755840,"internally_reserved":0,"allocated":1024000,"data_stored":767441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12976128},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue May 16 13:55:03 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.42199999999999999}]},{"osd":2,"last update":"Tue May 16 13:55:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.497},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.53900000000000003}]},{"osd":3,"last update":"Tue May 16 13:55:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.51100000000000001}]},{"osd":4,"last update":"Tue May 16 13:55:03 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.66800000000000004}]},{"osd":5,"last update":"Tue May 16 13:55:03 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":2.2639999999999998,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.77300000000000002}]},{"osd":6,"last update":"Tue May 16 13:55:03 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":2.3380000000000001,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":0.753},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.70699999999999996}]},{"osd":7,"last update":"Tue May 16 13:55:03 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":2.403,"5min":2.403,"15min":2.403},"last":0.80900000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-16T13:55:32.014 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-16T13:55:32.160 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.151+0000 7fb601f25640 1 Processor -- start 2023-05-16T13:55:32.160 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.151+0000 7fb601f25640 1 -- start start 2023-05-16T13:55:32.161 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.155+0000 7fb601f25640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb5fc158bf0 0x7fb5fc15d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:32.161 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.155+0000 7fb601f25640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb5fc0703b0 0x7fb5fc0cadb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:32.162 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.155+0000 7fb601f25640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5fc15d6a0 con 0x7fb5fc0cb2f0 2023-05-16T13:55:32.162 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.155+0000 7fb601f25640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5fc0cb730 con 0x7fb5fc0703b0 2023-05-16T13:55:32.162 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.155+0000 7fb601f25640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5fc070870 con 0x7fb5fc158bf0 2023-05-16T13:55:32.162 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.155+0000 7fb5faffd640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb5fc0703b0 0x7fb5fc0cadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:32.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.155+0000 7fb5fb7fe640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb5fc158bf0 0x7fb5fc15d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:32.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.155+0000 7fb5fb7fe640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb5fc158bf0 0x7fb5fc15d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.39:56892/0 (socket says 172.21.15.39:56892) 2023-05-16T13:55:32.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.155+0000 7fb5fb7fe640 1 -- 172.21.15.39:0/1194346485 learned_addr learned my addr 172.21.15.39:0/1194346485 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:32.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.155+0000 7fb5fb7fe640 1 -- 172.21.15.39:0/1194346485 >> v2:172.21.15.118:3300/0 conn(0x7fb5fc0703b0 msgr2=0x7fb5fc0cadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:32.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.155+0000 7fb5fb7fe640 1 --2- 172.21.15.39:0/1194346485 >> v2:172.21.15.118:3300/0 conn(0x7fb5fc0703b0 0x7fb5fc0cadb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:32.163 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.155+0000 7fb5fa7fc640 1 -- 172.21.15.39:0/1194346485 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1084958457 0 0) 0x7fb5f40014a0 con 0x7fb5fc0cb2f0 2023-05-16T13:55:32.164 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.155+0000 7fb5fb7fe640 1 -- 172.21.15.39:0/1194346485 >> v1:172.21.15.118:6789/0 conn(0x7fb5fc0cb2f0 legacy=0x7fb5fc06bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:32.164 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.155+0000 7fb5fb7fe640 1 -- 172.21.15.39:0/1194346485 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5fc070b50 con 0x7fb5fc158bf0 2023-05-16T13:55:32.165 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.159+0000 7fb5fb7fe640 1 --2- 172.21.15.39:0/1194346485 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb5fc158bf0 0x7fb5fc15d160 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec009870 tx=0x7fb5ec01e690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a12c6b5a51c8c887 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:32.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.159+0000 7fb5fa7fc640 1 -- 172.21.15.39:0/1194346485 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ec0a8660 con 0x7fb5fc158bf0 2023-05-16T13:55:32.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.159+0000 7fb5fa7fc640 1 -- 172.21.15.39:0/1194346485 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5ec0a87c0 con 0x7fb5fc158bf0 2023-05-16T13:55:32.166 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.159+0000 7fb5fa7fc640 1 -- 172.21.15.39:0/1194346485 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ec0a8b50 con 0x7fb5fc158bf0 2023-05-16T13:55:32.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.159+0000 7fb601f25640 1 -- 172.21.15.39:0/1194346485 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb5fc158bf0 msgr2=0x7fb5fc15d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:32.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.159+0000 7fb601f25640 1 --2- 172.21.15.39:0/1194346485 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb5fc158bf0 0x7fb5fc15d160 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec009870 tx=0x7fb5ec01e690 comp rx=0 tx=0).stop 2023-05-16T13:55:32.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.159+0000 7fb601f25640 1 -- 172.21.15.39:0/1194346485 shutdown_connections 2023-05-16T13:55:32.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.159+0000 7fb601f25640 1 --2- 172.21.15.39:0/1194346485 >> v2:172.21.15.118:3300/0 conn(0x7fb5fc0703b0 0x7fb5fc0cadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:32.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.159+0000 7fb601f25640 1 --2- 172.21.15.39:0/1194346485 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb5fc158bf0 0x7fb5fc15d160 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:32.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.159+0000 7fb601f25640 1 -- 172.21.15.39:0/1194346485 >> 172.21.15.39:0/1194346485 conn(0x7fb5fc069a50 msgr2=0x7fb5fc069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:32.167 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.159+0000 7fb601f25640 1 -- 172.21.15.39:0/1194346485 shutdown_connections 2023-05-16T13:55:32.168 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.159+0000 7fb601f25640 1 -- 172.21.15.39:0/1194346485 wait complete. 2023-05-16T13:55:32.168 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.159+0000 7fb601f25640 1 Processor -- start 2023-05-16T13:55:32.168 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.159+0000 7fb601f25640 1 -- start start 2023-05-16T13:55:32.169 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.163+0000 7fb601f25640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb5fc0703b0 0x7fb5fc0adb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:32.169 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.163+0000 7fb601f25640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5fc0cb2f0 0x7fb5fc0af1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:32.169 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.163+0000 7fb601f25640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb5fc158bf0 0x7fb5fc1508c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:32.170 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.163+0000 7fb601f25640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5fc0aedd0 con 0x7fb5fc0703b0 2023-05-16T13:55:32.170 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.163+0000 7fb601f25640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5fc150e00 con 0x7fb5fc0cb2f0 2023-05-16T13:55:32.170 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.163+0000 7fb601f25640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5fc0ae150 con 0x7fb5fc158bf0 2023-05-16T13:55:32.170 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.163+0000 7fb5fb7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb5fc0703b0 0x7fb5fc0adb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:32.170 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.163+0000 7fb5fb7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb5fc0703b0 0x7fb5fc0adb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38866/0 (socket says 172.21.15.39:38866) 2023-05-16T13:55:32.170 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.163+0000 7fb5fb7fe640 1 -- 172.21.15.39:0/2742015768 learned_addr learned my addr 172.21.15.39:0/2742015768 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:32.171 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.163+0000 7fb5fbfff640 1 --2- 172.21.15.39:0/2742015768 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb5fc158bf0 0x7fb5fc1508c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:32.171 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.163+0000 7fb5faffd640 1 --2- 172.21.15.39:0/2742015768 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5fc0cb2f0 0x7fb5fc0af1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:32.172 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.163+0000 7fb5fb7fe640 1 -- 172.21.15.39:0/2742015768 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb5fc158bf0 msgr2=0x7fb5fc1508c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:32.172 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.163+0000 7fb5fb7fe640 1 --2- 172.21.15.39:0/2742015768 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb5fc158bf0 0x7fb5fc1508c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:32.172 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.163+0000 7fb5fb7fe640 1 -- 172.21.15.39:0/2742015768 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5fc0cb2f0 msgr2=0x7fb5fc0af1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:32.172 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.163+0000 7fb5fb7fe640 1 --2- 172.21.15.39:0/2742015768 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5fc0cb2f0 0x7fb5fc0af1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:32.172 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.163+0000 7fb5fb7fe640 1 -- 172.21.15.39:0/2742015768 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5ec0094d0 con 0x7fb5fc0703b0 2023-05-16T13:55:32.172 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.163+0000 7fb5fb7fe640 1 --2- 172.21.15.39:0/2742015768 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb5fc0703b0 0x7fb5fc0adb70 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec01cd40 tx=0x7fb5ec01b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:32.172 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.163+0000 7fb5e3fff640 1 -- 172.21.15.39:0/2742015768 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ec0b3450 con 0x7fb5fc0703b0 2023-05-16T13:55:32.173 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.163+0000 7fb5e3fff640 1 -- 172.21.15.39:0/2742015768 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5ec0b7070 con 0x7fb5fc0703b0 2023-05-16T13:55:32.173 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.163+0000 7fb601f25640 1 -- 172.21.15.39:0/2742015768 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5fc158fc0 con 0x7fb5fc0703b0 2023-05-16T13:55:32.173 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.163+0000 7fb5e3fff640 1 -- 172.21.15.39:0/2742015768 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ec0b37f0 con 0x7fb5fc0703b0 2023-05-16T13:55:32.173 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.163+0000 7fb601f25640 1 -- 172.21.15.39:0/2742015768 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5fc0713f0 con 0x7fb5fc0703b0 2023-05-16T13:55:32.173 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.163+0000 7fb601f25640 1 -- 172.21.15.39:0/2742015768 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5fc0ad950 con 0x7fb5fc0703b0 2023-05-16T13:55:32.174 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.163+0000 7fb5e3fff640 1 -- 172.21.15.39:0/2742015768 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb5ec0b9030 con 0x7fb5fc0703b0 2023-05-16T13:55:32.174 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.167+0000 7fb5e3fff640 1 --2- 172.21.15.39:0/2742015768 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fb5e8066280 0x7fb5e8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:32.174 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.167+0000 7fb5e3fff640 1 -- 172.21.15.39:0/2742015768 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb5ec11d6d0 con 0x7fb5fc0703b0 2023-05-16T13:55:32.174 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.167+0000 7fb5faffd640 1 --2- 172.21.15.39:0/2742015768 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fb5e8066280 0x7fb5e8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:32.174 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.167+0000 7fb5faffd640 1 --2- 172.21.15.39:0/2742015768 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fb5e8066280 0x7fb5e8068730 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc0c4e50 tx=0x7fb5f0009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:32.177 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.171+0000 7fb5e3fff640 1 -- 172.21.15.39:0/2742015768 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fb5ec0eab60 con 0x7fb5fc0703b0 2023-05-16T13:55:32.327 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.319+0000 7fb601f25640 1 -- 172.21.15.39:0/2742015768 --> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb5fc073c90 con 0x7fb5e8066280 2023-05-16T13:55:32.335 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.327+0000 7fb5e3fff640 1 -- 172.21.15.39:0/2742015768 <== mgr.4098 v2:172.21.15.39:6832/288296800 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311470 (secure 0 0 0) 0x7fb5fc073c90 con 0x7fb5e8066280 2023-05-16T13:55:32.338 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:55:32.340 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2023-05-16T13:55:32.341 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.331+0000 7fb601f25640 1 -- 172.21.15.39:0/2742015768 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fb5e8066280 msgr2=0x7fb5e8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:32.341 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.331+0000 7fb601f25640 1 --2- 172.21.15.39:0/2742015768 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fb5e8066280 0x7fb5e8068730 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc0c4e50 tx=0x7fb5f0009190 comp rx=0 tx=0).stop 2023-05-16T13:55:32.341 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.331+0000 7fb601f25640 1 -- 172.21.15.39:0/2742015768 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb5fc0703b0 msgr2=0x7fb5fc0adb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:32.341 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.331+0000 7fb601f25640 1 --2- 172.21.15.39:0/2742015768 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb5fc0703b0 0x7fb5fc0adb70 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec01cd40 tx=0x7fb5ec01b430 comp rx=0 tx=0).stop 2023-05-16T13:55:32.341 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.331+0000 7fb601f25640 1 -- 172.21.15.39:0/2742015768 shutdown_connections 2023-05-16T13:55:32.341 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.331+0000 7fb601f25640 1 --2- 172.21.15.39:0/2742015768 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fb5e8066280 0x7fb5e8068730 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:32.342 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.331+0000 7fb601f25640 1 --2- 172.21.15.39:0/2742015768 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb5fc158bf0 0x7fb5fc1508c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:32.342 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.331+0000 7fb601f25640 1 --2- 172.21.15.39:0/2742015768 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5fc0cb2f0 0x7fb5fc0af1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:32.342 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.331+0000 7fb601f25640 1 --2- 172.21.15.39:0/2742015768 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb5fc0703b0 0x7fb5fc0adb70 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:32.342 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.331+0000 7fb601f25640 1 -- 172.21.15.39:0/2742015768 >> 172.21.15.39:0/2742015768 conn(0x7fb5fc069a50 msgr2=0x7fb5fc069e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:32.342 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.331+0000 7fb601f25640 1 -- 172.21.15.39:0/2742015768 shutdown_connections 2023-05-16T13:55:32.342 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.331+0000 7fb601f25640 1 -- 172.21.15.39:0/2742015768 wait complete. 2023-05-16T13:55:32.359 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":76,"stamp":"2023-05-16T13:55:30.843982+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":188,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":103048,"kb_used_data":4552,"kb_used_omap":0,"kb_used_meta":98432,"kb_avail":754871672,"statfs":{"total":773094113280,"available":772988592128,"internally_reserved":0,"allocated":4661248,"data_stored":2601772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":100794368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.859553"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702986+0000","last_change":"2023-05-16T13:55:23.413635+0000","last_active":"2023-05-16T13:55:24.702986+0000","last_peered":"2023-05-16T13:55:24.702986+0000","last_clean":"2023-05-16T13:55:24.702986+0000","last_became_active":"2023-05-16T13:55:23.413319+0000","last_became_peered":"2023-05-16T13:55:23.413319+0000","last_unstale":"2023-05-16T13:55:24.702986+0000","last_undegraded":"2023-05-16T13:55:24.702986+0000","last_fullsized":"2023-05-16T13:55:24.702986+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:00:44.745581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702981+0000","last_change":"2023-05-16T13:55:23.420601+0000","last_active":"2023-05-16T13:55:24.702981+0000","last_peered":"2023-05-16T13:55:24.702981+0000","last_clean":"2023-05-16T13:55:24.702981+0000","last_became_active":"2023-05-16T13:55:23.420296+0000","last_became_peered":"2023-05-16T13:55:23.420296+0000","last_unstale":"2023-05-16T13:55:24.702981+0000","last_undegraded":"2023-05-16T13:55:24.702981+0000","last_fullsized":"2023-05-16T13:55:24.702981+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T14:28:21.055179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702832+0000","last_change":"2023-05-16T13:55:23.426167+0000","last_active":"2023-05-16T13:55:24.702832+0000","last_peered":"2023-05-16T13:55:24.702832+0000","last_clean":"2023-05-16T13:55:24.702832+0000","last_became_active":"2023-05-16T13:55:23.425898+0000","last_became_peered":"2023-05-16T13:55:23.425898+0000","last_unstale":"2023-05-16T13:55:24.702832+0000","last_undegraded":"2023-05-16T13:55:24.702832+0000","last_fullsized":"2023-05-16T13:55:24.702832+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T18:12:33.397086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.389344+0000","last_change":"2023-05-16T13:55:23.410640+0000","last_active":"2023-05-16T13:55:24.389344+0000","last_peered":"2023-05-16T13:55:24.389344+0000","last_clean":"2023-05-16T13:55:24.389344+0000","last_became_active":"2023-05-16T13:55:23.410201+0000","last_became_peered":"2023-05-16T13:55:23.410201+0000","last_unstale":"2023-05-16T13:55:24.389344+0000","last_undegraded":"2023-05-16T13:55:24.389344+0000","last_fullsized":"2023-05-16T13:55:24.389344+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T23:39:16.162625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.389118+0000","last_change":"2023-05-16T13:55:23.415688+0000","last_active":"2023-05-16T13:55:24.389118+0000","last_peered":"2023-05-16T13:55:24.389118+0000","last_clean":"2023-05-16T13:55:24.389118+0000","last_became_active":"2023-05-16T13:55:23.415428+0000","last_became_peered":"2023-05-16T13:55:23.415428+0000","last_unstale":"2023-05-16T13:55:24.389118+0000","last_undegraded":"2023-05-16T13:55:24.389118+0000","last_fullsized":"2023-05-16T13:55:24.389118+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T23:22:48.021414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702788+0000","last_change":"2023-05-16T13:55:23.411124+0000","last_active":"2023-05-16T13:55:24.702788+0000","last_peered":"2023-05-16T13:55:24.702788+0000","last_clean":"2023-05-16T13:55:24.702788+0000","last_became_active":"2023-05-16T13:55:23.410870+0000","last_became_peered":"2023-05-16T13:55:23.410870+0000","last_unstale":"2023-05-16T13:55:24.702788+0000","last_undegraded":"2023-05-16T13:55:24.702788+0000","last_fullsized":"2023-05-16T13:55:24.702788+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:20:17.612621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702895+0000","last_change":"2023-05-16T13:55:23.412868+0000","last_active":"2023-05-16T13:55:24.702895+0000","last_peered":"2023-05-16T13:55:24.702895+0000","last_clean":"2023-05-16T13:55:24.702895+0000","last_became_active":"2023-05-16T13:55:23.412479+0000","last_became_peered":"2023-05-16T13:55:23.412479+0000","last_unstale":"2023-05-16T13:55:24.702895+0000","last_undegraded":"2023-05-16T13:55:24.702895+0000","last_fullsized":"2023-05-16T13:55:24.702895+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T23:46:15.133417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702869+0000","last_change":"2023-05-16T13:55:23.423785+0000","last_active":"2023-05-16T13:55:24.702869+0000","last_peered":"2023-05-16T13:55:24.702869+0000","last_clean":"2023-05-16T13:55:24.702869+0000","last_became_active":"2023-05-16T13:55:23.423521+0000","last_became_peered":"2023-05-16T13:55:23.423521+0000","last_unstale":"2023-05-16T13:55:24.702869+0000","last_undegraded":"2023-05-16T13:55:24.702869+0000","last_fullsized":"2023-05-16T13:55:24.702869+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:15:22.807920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703149+0000","last_change":"2023-05-16T13:55:23.426476+0000","last_active":"2023-05-16T13:55:24.703149+0000","last_peered":"2023-05-16T13:55:24.703149+0000","last_clean":"2023-05-16T13:55:24.703149+0000","last_became_active":"2023-05-16T13:55:23.426169+0000","last_became_peered":"2023-05-16T13:55:23.426169+0000","last_unstale":"2023-05-16T13:55:24.703149+0000","last_undegraded":"2023-05-16T13:55:24.703149+0000","last_fullsized":"2023-05-16T13:55:24.703149+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T15:01:43.692055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703265+0000","last_change":"2023-05-16T13:55:23.416140+0000","last_active":"2023-05-16T13:55:24.703265+0000","last_peered":"2023-05-16T13:55:24.703265+0000","last_clean":"2023-05-16T13:55:24.703265+0000","last_became_active":"2023-05-16T13:55:23.415821+0000","last_became_peered":"2023-05-16T13:55:23.415821+0000","last_unstale":"2023-05-16T13:55:24.703265+0000","last_undegraded":"2023-05-16T13:55:24.703265+0000","last_fullsized":"2023-05-16T13:55:24.703265+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:39:01.963378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703413+0000","last_change":"2023-05-16T13:55:23.415901+0000","last_active":"2023-05-16T13:55:24.703413+0000","last_peered":"2023-05-16T13:55:24.703413+0000","last_clean":"2023-05-16T13:55:24.703413+0000","last_became_active":"2023-05-16T13:55:23.414396+0000","last_became_peered":"2023-05-16T13:55:23.414396+0000","last_unstale":"2023-05-16T13:55:24.703413+0000","last_undegraded":"2023-05-16T13:55:24.703413+0000","last_fullsized":"2023-05-16T13:55:24.703413+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:43:30.377410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703603+0000","last_change":"2023-05-16T13:55:23.417357+0000","last_active":"2023-05-16T13:55:24.703603+0000","last_peered":"2023-05-16T13:55:24.703603+0000","last_clean":"2023-05-16T13:55:24.703603+0000","last_became_active":"2023-05-16T13:55:23.417040+0000","last_became_peered":"2023-05-16T13:55:23.417040+0000","last_unstale":"2023-05-16T13:55:24.703603+0000","last_undegraded":"2023-05-16T13:55:24.703603+0000","last_fullsized":"2023-05-16T13:55:24.703603+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:20:17.612621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703409+0000","last_change":"2023-05-16T13:55:23.402449+0000","last_active":"2023-05-16T13:55:24.703409+0000","last_peered":"2023-05-16T13:55:24.703409+0000","last_clean":"2023-05-16T13:55:24.703409+0000","last_became_active":"2023-05-16T13:55:23.402138+0000","last_became_peered":"2023-05-16T13:55:23.402138+0000","last_unstale":"2023-05-16T13:55:24.703409+0000","last_undegraded":"2023-05-16T13:55:24.703409+0000","last_fullsized":"2023-05-16T13:55:24.703409+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:59:18.092162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.390166+0000","last_change":"2023-05-16T13:55:23.404843+0000","last_active":"2023-05-16T13:55:24.390166+0000","last_peered":"2023-05-16T13:55:24.390166+0000","last_clean":"2023-05-16T13:55:24.390166+0000","last_became_active":"2023-05-16T13:55:23.404548+0000","last_became_peered":"2023-05-16T13:55:23.404548+0000","last_unstale":"2023-05-16T13:55:24.390166+0000","last_undegraded":"2023-05-16T13:55:24.390166+0000","last_fullsized":"2023-05-16T13:55:24.390166+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:59:18.092162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702978+0000","last_change":"2023-05-16T13:55:23.420693+0000","last_active":"2023-05-16T13:55:24.702978+0000","last_peered":"2023-05-16T13:55:24.702978+0000","last_clean":"2023-05-16T13:55:24.702978+0000","last_became_active":"2023-05-16T13:55:23.417293+0000","last_became_peered":"2023-05-16T13:55:23.417293+0000","last_unstale":"2023-05-16T13:55:24.702978+0000","last_undegraded":"2023-05-16T13:55:24.702978+0000","last_fullsized":"2023-05-16T13:55:24.702978+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:37:22.819141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.448449+0000","last_change":"2023-05-16T13:55:23.418489+0000","last_active":"2023-05-16T13:55:24.448449+0000","last_peered":"2023-05-16T13:55:24.448449+0000","last_clean":"2023-05-16T13:55:24.448449+0000","last_became_active":"2023-05-16T13:55:23.417994+0000","last_became_peered":"2023-05-16T13:55:23.417994+0000","last_unstale":"2023-05-16T13:55:24.448449+0000","last_undegraded":"2023-05-16T13:55:24.448449+0000","last_fullsized":"2023-05-16T13:55:24.448449+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:44:47.581169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.449259+0000","last_change":"2023-05-16T13:55:23.418574+0000","last_active":"2023-05-16T13:55:24.449259+0000","last_peered":"2023-05-16T13:55:24.449259+0000","last_clean":"2023-05-16T13:55:24.449259+0000","last_became_active":"2023-05-16T13:55:23.418248+0000","last_became_peered":"2023-05-16T13:55:23.418248+0000","last_unstale":"2023-05-16T13:55:24.449259+0000","last_undegraded":"2023-05-16T13:55:24.449259+0000","last_fullsized":"2023-05-16T13:55:24.449259+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T15:50:19.429470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.391252+0000","last_change":"2023-05-16T13:55:23.409887+0000","last_active":"2023-05-16T13:55:24.391252+0000","last_peered":"2023-05-16T13:55:24.391252+0000","last_clean":"2023-05-16T13:55:24.391252+0000","last_became_active":"2023-05-16T13:55:23.405883+0000","last_became_peered":"2023-05-16T13:55:23.405883+0000","last_unstale":"2023-05-16T13:55:24.391252+0000","last_undegraded":"2023-05-16T13:55:24.391252+0000","last_fullsized":"2023-05-16T13:55:24.391252+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T15:41:59.315083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.389374+0000","last_change":"2023-05-16T13:55:23.416396+0000","last_active":"2023-05-16T13:55:24.389374+0000","last_peered":"2023-05-16T13:55:24.389374+0000","last_clean":"2023-05-16T13:55:24.389374+0000","last_became_active":"2023-05-16T13:55:23.416171+0000","last_became_peered":"2023-05-16T13:55:23.416171+0000","last_unstale":"2023-05-16T13:55:24.389374+0000","last_undegraded":"2023-05-16T13:55:24.389374+0000","last_fullsized":"2023-05-16T13:55:24.389374+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:37:40.020154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.390390+0000","last_change":"2023-05-16T13:55:23.409607+0000","last_active":"2023-05-16T13:55:24.390390+0000","last_peered":"2023-05-16T13:55:24.390390+0000","last_clean":"2023-05-16T13:55:24.390390+0000","last_became_active":"2023-05-16T13:55:23.409310+0000","last_became_peered":"2023-05-16T13:55:23.409310+0000","last_unstale":"2023-05-16T13:55:24.390390+0000","last_undegraded":"2023-05-16T13:55:24.390390+0000","last_fullsized":"2023-05-16T13:55:24.390390+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:29:04.491246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703019+0000","last_change":"2023-05-16T13:55:23.412078+0000","last_active":"2023-05-16T13:55:24.703019+0000","last_peered":"2023-05-16T13:55:24.703019+0000","last_clean":"2023-05-16T13:55:24.703019+0000","last_became_active":"2023-05-16T13:55:23.411783+0000","last_became_peered":"2023-05-16T13:55:23.411783+0000","last_unstale":"2023-05-16T13:55:24.703019+0000","last_undegraded":"2023-05-16T13:55:24.703019+0000","last_fullsized":"2023-05-16T13:55:24.703019+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:21:24.750294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.391159+0000","last_change":"2023-05-16T13:55:23.410469+0000","last_active":"2023-05-16T13:55:24.391159+0000","last_peered":"2023-05-16T13:55:24.391159+0000","last_clean":"2023-05-16T13:55:24.391159+0000","last_became_active":"2023-05-16T13:55:23.409754+0000","last_became_peered":"2023-05-16T13:55:23.409754+0000","last_unstale":"2023-05-16T13:55:24.391159+0000","last_undegraded":"2023-05-16T13:55:24.391159+0000","last_fullsized":"2023-05-16T13:55:24.391159+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:56:31.055172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.448708+0000","last_change":"2023-05-16T13:55:23.406951+0000","last_active":"2023-05-16T13:55:24.448708+0000","last_peered":"2023-05-16T13:55:24.448708+0000","last_clean":"2023-05-16T13:55:24.448708+0000","last_became_active":"2023-05-16T13:55:23.406220+0000","last_became_peered":"2023-05-16T13:55:23.406220+0000","last_unstale":"2023-05-16T13:55:24.448708+0000","last_undegraded":"2023-05-16T13:55:24.448708+0000","last_fullsized":"2023-05-16T13:55:24.448708+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:15:01.909502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.389007+0000","last_change":"2023-05-16T13:55:23.415714+0000","last_active":"2023-05-16T13:55:24.389007+0000","last_peered":"2023-05-16T13:55:24.389007+0000","last_clean":"2023-05-16T13:55:24.389007+0000","last_became_active":"2023-05-16T13:55:23.415365+0000","last_became_peered":"2023-05-16T13:55:23.415365+0000","last_unstale":"2023-05-16T13:55:24.389007+0000","last_undegraded":"2023-05-16T13:55:24.389007+0000","last_fullsized":"2023-05-16T13:55:24.389007+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:22:31.514634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.391137+0000","last_change":"2023-05-16T13:55:23.418927+0000","last_active":"2023-05-16T13:55:24.391137+0000","last_peered":"2023-05-16T13:55:24.391137+0000","last_clean":"2023-05-16T13:55:24.391137+0000","last_became_active":"2023-05-16T13:55:23.413689+0000","last_became_peered":"2023-05-16T13:55:23.413689+0000","last_unstale":"2023-05-16T13:55:24.391137+0000","last_undegraded":"2023-05-16T13:55:24.391137+0000","last_fullsized":"2023-05-16T13:55:24.391137+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:02:17.021863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703500+0000","last_change":"2023-05-16T13:55:23.424404+0000","last_active":"2023-05-16T13:55:24.703500+0000","last_peered":"2023-05-16T13:55:24.703500+0000","last_clean":"2023-05-16T13:55:24.703500+0000","last_became_active":"2023-05-16T13:55:23.424080+0000","last_became_peered":"2023-05-16T13:55:23.424080+0000","last_unstale":"2023-05-16T13:55:24.703500+0000","last_undegraded":"2023-05-16T13:55:24.703500+0000","last_fullsized":"2023-05-16T13:55:24.703500+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T23:50:36.996209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.391012+0000","last_change":"2023-05-16T13:55:23.412434+0000","last_active":"2023-05-16T13:55:24.391012+0000","last_peered":"2023-05-16T13:55:24.391012+0000","last_clean":"2023-05-16T13:55:24.391012+0000","last_became_active":"2023-05-16T13:55:23.412160+0000","last_became_peered":"2023-05-16T13:55:23.412160+0000","last_unstale":"2023-05-16T13:55:24.391012+0000","last_undegraded":"2023-05-16T13:55:24.391012+0000","last_fullsized":"2023-05-16T13:55:24.391012+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T18:18:25.619356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703412+0000","last_change":"2023-05-16T13:55:23.412974+0000","last_active":"2023-05-16T13:55:24.703412+0000","last_peered":"2023-05-16T13:55:24.703412+0000","last_clean":"2023-05-16T13:55:24.703412+0000","last_became_active":"2023-05-16T13:55:23.412436+0000","last_became_peered":"2023-05-16T13:55:23.412436+0000","last_unstale":"2023-05-16T13:55:24.703412+0000","last_undegraded":"2023-05-16T13:55:24.703412+0000","last_fullsized":"2023-05-16T13:55:24.703412+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T14:58:31.891808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.390622+0000","last_change":"2023-05-16T13:55:23.402956+0000","last_active":"2023-05-16T13:55:24.390622+0000","last_peered":"2023-05-16T13:55:24.390622+0000","last_clean":"2023-05-16T13:55:24.390622+0000","last_became_active":"2023-05-16T13:55:23.402673+0000","last_became_peered":"2023-05-16T13:55:23.402673+0000","last_unstale":"2023-05-16T13:55:24.390622+0000","last_undegraded":"2023-05-16T13:55:24.390622+0000","last_fullsized":"2023-05-16T13:55:24.390622+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T23:43:31.377314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.390425+0000","last_change":"2023-05-16T13:55:23.405078+0000","last_active":"2023-05-16T13:55:24.390425+0000","last_peered":"2023-05-16T13:55:24.390425+0000","last_clean":"2023-05-16T13:55:24.390425+0000","last_became_active":"2023-05-16T13:55:23.404225+0000","last_became_peered":"2023-05-16T13:55:23.404225+0000","last_unstale":"2023-05-16T13:55:24.390425+0000","last_undegraded":"2023-05-16T13:55:24.390425+0000","last_fullsized":"2023-05-16T13:55:24.390425+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:50:48.578876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.448691+0000","last_change":"2023-05-16T13:55:23.406633+0000","last_active":"2023-05-16T13:55:24.448691+0000","last_peered":"2023-05-16T13:55:24.448691+0000","last_clean":"2023-05-16T13:55:24.448691+0000","last_became_active":"2023-05-16T13:55:23.405863+0000","last_became_peered":"2023-05-16T13:55:23.405863+0000","last_unstale":"2023-05-16T13:55:24.448691+0000","last_undegraded":"2023-05-16T13:55:24.448691+0000","last_fullsized":"2023-05-16T13:55:24.448691+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T18:57:23.116555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702518+0000","last_change":"2023-05-16T13:55:23.417343+0000","last_active":"2023-05-16T13:55:24.702518+0000","last_peered":"2023-05-16T13:55:24.702518+0000","last_clean":"2023-05-16T13:55:24.702518+0000","last_became_active":"2023-05-16T13:55:23.417084+0000","last_became_peered":"2023-05-16T13:55:23.417084+0000","last_unstale":"2023-05-16T13:55:24.702518+0000","last_undegraded":"2023-05-16T13:55:24.702518+0000","last_fullsized":"2023-05-16T13:55:24.702518+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:24:27.841261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.448655+0000","last_change":"2023-05-16T13:55:23.424474+0000","last_active":"2023-05-16T13:55:24.448655+0000","last_peered":"2023-05-16T13:55:24.448655+0000","last_clean":"2023-05-16T13:55:24.448655+0000","last_became_active":"2023-05-16T13:55:23.423734+0000","last_became_peered":"2023-05-16T13:55:23.423734+0000","last_unstale":"2023-05-16T13:55:24.448655+0000","last_undegraded":"2023-05-16T13:55:24.448655+0000","last_fullsized":"2023-05-16T13:55:24.448655+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:37:09.541457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.391274+0000","last_change":"2023-05-16T13:55:22.990083+0000","last_active":"2023-05-16T13:55:24.391274+0000","last_peered":"2023-05-16T13:55:24.391274+0000","last_clean":"2023-05-16T13:55:24.391274+0000","last_became_active":"2023-05-16T13:55:22.989788+0000","last_became_peered":"2023-05-16T13:55:22.989788+0000","last_unstale":"2023-05-16T13:55:24.391274+0000","last_undegraded":"2023-05-16T13:55:24.391274+0000","last_fullsized":"2023-05-16T13:55:24.391274+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T16:12:54.486301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703219+0000","last_change":"2023-05-16T13:55:23.424419+0000","last_active":"2023-05-16T13:55:24.703219+0000","last_peered":"2023-05-16T13:55:24.703219+0000","last_clean":"2023-05-16T13:55:24.703219+0000","last_became_active":"2023-05-16T13:55:23.424144+0000","last_became_peered":"2023-05-16T13:55:23.424144+0000","last_unstale":"2023-05-16T13:55:24.703219+0000","last_undegraded":"2023-05-16T13:55:24.703219+0000","last_fullsized":"2023-05-16T13:55:24.703219+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T18:54:19.739155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702809+0000","last_change":"2023-05-16T13:55:23.004839+0000","last_active":"2023-05-16T13:55:24.702809+0000","last_peered":"2023-05-16T13:55:24.702809+0000","last_clean":"2023-05-16T13:55:24.702809+0000","last_became_active":"2023-05-16T13:55:23.004519+0000","last_became_peered":"2023-05-16T13:55:23.004519+0000","last_unstale":"2023-05-16T13:55:24.702809+0000","last_undegraded":"2023-05-16T13:55:24.702809+0000","last_fullsized":"2023-05-16T13:55:24.702809+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:42:58.481159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.390843+0000","last_change":"2023-05-16T13:55:23.403927+0000","last_active":"2023-05-16T13:55:24.390843+0000","last_peered":"2023-05-16T13:55:24.390843+0000","last_clean":"2023-05-16T13:55:24.390843+0000","last_became_active":"2023-05-16T13:55:23.403631+0000","last_became_peered":"2023-05-16T13:55:23.403631+0000","last_unstale":"2023-05-16T13:55:24.390843+0000","last_undegraded":"2023-05-16T13:55:24.390843+0000","last_fullsized":"2023-05-16T13:55:24.390843+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T18:57:23.116555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703544+0000","last_change":"2023-05-16T13:55:23.003518+0000","last_active":"2023-05-16T13:55:24.703544+0000","last_peered":"2023-05-16T13:55:24.703544+0000","last_clean":"2023-05-16T13:55:24.703544+0000","last_became_active":"2023-05-16T13:55:23.003263+0000","last_became_peered":"2023-05-16T13:55:23.003263+0000","last_unstale":"2023-05-16T13:55:24.703544+0000","last_undegraded":"2023-05-16T13:55:24.703544+0000","last_fullsized":"2023-05-16T13:55:24.703544+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T20:43:50.549191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702845+0000","last_change":"2023-05-16T13:55:23.409488+0000","last_active":"2023-05-16T13:55:24.702845+0000","last_peered":"2023-05-16T13:55:24.702845+0000","last_clean":"2023-05-16T13:55:24.702845+0000","last_became_active":"2023-05-16T13:55:23.409221+0000","last_became_peered":"2023-05-16T13:55:23.409221+0000","last_unstale":"2023-05-16T13:55:24.702845+0000","last_undegraded":"2023-05-16T13:55:24.702845+0000","last_fullsized":"2023-05-16T13:55:24.702845+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T23:37:20.052995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.390995+0000","last_change":"2023-05-16T13:55:22.994796+0000","last_active":"2023-05-16T13:55:24.390995+0000","last_peered":"2023-05-16T13:55:24.390995+0000","last_clean":"2023-05-16T13:55:24.390995+0000","last_became_active":"2023-05-16T13:55:22.994520+0000","last_became_peered":"2023-05-16T13:55:22.994520+0000","last_unstale":"2023-05-16T13:55:24.390995+0000","last_undegraded":"2023-05-16T13:55:24.390995+0000","last_fullsized":"2023-05-16T13:55:24.390995+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:52:39.280919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703333+0000","last_change":"2023-05-16T13:55:23.410102+0000","last_active":"2023-05-16T13:55:24.703333+0000","last_peered":"2023-05-16T13:55:24.703333+0000","last_clean":"2023-05-16T13:55:24.703333+0000","last_became_active":"2023-05-16T13:55:23.409854+0000","last_became_peered":"2023-05-16T13:55:23.409854+0000","last_unstale":"2023-05-16T13:55:24.703333+0000","last_undegraded":"2023-05-16T13:55:24.703333+0000","last_fullsized":"2023-05-16T13:55:24.703333+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:39:33.113821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703340+0000","last_change":"2023-05-16T13:55:23.008104+0000","last_active":"2023-05-16T13:55:24.703340+0000","last_peered":"2023-05-16T13:55:24.703340+0000","last_clean":"2023-05-16T13:55:24.703340+0000","last_became_active":"2023-05-16T13:55:23.007727+0000","last_became_peered":"2023-05-16T13:55:23.007727+0000","last_unstale":"2023-05-16T13:55:24.703340+0000","last_undegraded":"2023-05-16T13:55:24.703340+0000","last_fullsized":"2023-05-16T13:55:24.703340+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:01:05.788557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703178+0000","last_change":"2023-05-16T13:55:23.416496+0000","last_active":"2023-05-16T13:55:24.703178+0000","last_peered":"2023-05-16T13:55:24.703178+0000","last_clean":"2023-05-16T13:55:24.703178+0000","last_became_active":"2023-05-16T13:55:23.414290+0000","last_became_peered":"2023-05-16T13:55:23.414290+0000","last_unstale":"2023-05-16T13:55:24.703178+0000","last_undegraded":"2023-05-16T13:55:24.703178+0000","last_fullsized":"2023-05-16T13:55:24.703178+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:20:27.455481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.448708+0000","last_change":"2023-05-16T13:55:22.991392+0000","last_active":"2023-05-16T13:55:24.448708+0000","last_peered":"2023-05-16T13:55:24.448708+0000","last_clean":"2023-05-16T13:55:24.448708+0000","last_became_active":"2023-05-16T13:55:22.991030+0000","last_became_peered":"2023-05-16T13:55:22.991030+0000","last_unstale":"2023-05-16T13:55:24.448708+0000","last_undegraded":"2023-05-16T13:55:24.448708+0000","last_fullsized":"2023-05-16T13:55:24.448708+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:43:29.359983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.390936+0000","last_change":"2023-05-16T13:55:23.423745+0000","last_active":"2023-05-16T13:55:24.390936+0000","last_peered":"2023-05-16T13:55:24.390936+0000","last_clean":"2023-05-16T13:55:24.390936+0000","last_became_active":"2023-05-16T13:55:23.423410+0000","last_became_peered":"2023-05-16T13:55:23.423410+0000","last_unstale":"2023-05-16T13:55:24.390936+0000","last_undegraded":"2023-05-16T13:55:24.390936+0000","last_fullsized":"2023-05-16T13:55:24.390936+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T18:33:52.222739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702652+0000","last_change":"2023-05-16T13:55:23.009273+0000","last_active":"2023-05-16T13:55:24.702652+0000","last_peered":"2023-05-16T13:55:24.702652+0000","last_clean":"2023-05-16T13:55:24.702652+0000","last_became_active":"2023-05-16T13:55:23.008332+0000","last_became_peered":"2023-05-16T13:55:23.008332+0000","last_unstale":"2023-05-16T13:55:24.702652+0000","last_undegraded":"2023-05-16T13:55:24.702652+0000","last_fullsized":"2023-05-16T13:55:24.702652+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:42:49.791420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703848+0000","last_change":"2023-05-16T13:55:23.414015+0000","last_active":"2023-05-16T13:55:24.703848+0000","last_peered":"2023-05-16T13:55:24.703848+0000","last_clean":"2023-05-16T13:55:24.703848+0000","last_became_active":"2023-05-16T13:55:23.413471+0000","last_became_peered":"2023-05-16T13:55:23.413471+0000","last_unstale":"2023-05-16T13:55:24.703848+0000","last_undegraded":"2023-05-16T13:55:24.703848+0000","last_fullsized":"2023-05-16T13:55:24.703848+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:45:55.863941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.390166+0000","last_change":"2023-05-16T13:55:22.990016+0000","last_active":"2023-05-16T13:55:24.390166+0000","last_peered":"2023-05-16T13:55:24.390166+0000","last_clean":"2023-05-16T13:55:24.390166+0000","last_became_active":"2023-05-16T13:55:22.989661+0000","last_became_peered":"2023-05-16T13:55:22.989661+0000","last_unstale":"2023-05-16T13:55:24.390166+0000","last_undegraded":"2023-05-16T13:55:24.390166+0000","last_fullsized":"2023-05-16T13:55:24.390166+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:43:29.359983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.389480+0000","last_change":"2023-05-16T13:55:23.410465+0000","last_active":"2023-05-16T13:55:24.389480+0000","last_peered":"2023-05-16T13:55:24.389480+0000","last_clean":"2023-05-16T13:55:24.389480+0000","last_became_active":"2023-05-16T13:55:23.409929+0000","last_became_peered":"2023-05-16T13:55:23.409929+0000","last_unstale":"2023-05-16T13:55:24.389480+0000","last_undegraded":"2023-05-16T13:55:24.389480+0000","last_fullsized":"2023-05-16T13:55:24.389480+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T15:51:40.646591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703104+0000","last_change":"2023-05-16T13:55:23.004761+0000","last_active":"2023-05-16T13:55:24.703104+0000","last_peered":"2023-05-16T13:55:24.703104+0000","last_clean":"2023-05-16T13:55:24.703104+0000","last_became_active":"2023-05-16T13:55:23.004395+0000","last_became_peered":"2023-05-16T13:55:23.004395+0000","last_unstale":"2023-05-16T13:55:24.703104+0000","last_undegraded":"2023-05-16T13:55:24.703104+0000","last_fullsized":"2023-05-16T13:55:24.703104+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:35:41.923514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.448956+0000","last_change":"2023-05-16T13:55:23.411493+0000","last_active":"2023-05-16T13:55:24.448956+0000","last_peered":"2023-05-16T13:55:24.448956+0000","last_clean":"2023-05-16T13:55:24.448956+0000","last_became_active":"2023-05-16T13:55:23.410780+0000","last_became_peered":"2023-05-16T13:55:23.410780+0000","last_unstale":"2023-05-16T13:55:24.448956+0000","last_undegraded":"2023-05-16T13:55:24.448956+0000","last_fullsized":"2023-05-16T13:55:24.448956+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:16:30.890505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703577+0000","last_change":"2023-05-16T13:55:23.007831+0000","last_active":"2023-05-16T13:55:24.703577+0000","last_peered":"2023-05-16T13:55:24.703577+0000","last_clean":"2023-05-16T13:55:24.703577+0000","last_became_active":"2023-05-16T13:55:23.007503+0000","last_became_peered":"2023-05-16T13:55:23.007503+0000","last_unstale":"2023-05-16T13:55:24.703577+0000","last_undegraded":"2023-05-16T13:55:24.703577+0000","last_fullsized":"2023-05-16T13:55:24.703577+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T18:57:22.099128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702686+0000","last_change":"2023-05-16T13:55:23.410445+0000","last_active":"2023-05-16T13:55:24.702686+0000","last_peered":"2023-05-16T13:55:24.702686+0000","last_clean":"2023-05-16T13:55:24.702686+0000","last_became_active":"2023-05-16T13:55:23.408143+0000","last_became_peered":"2023-05-16T13:55:23.408143+0000","last_unstale":"2023-05-16T13:55:24.702686+0000","last_undegraded":"2023-05-16T13:55:24.702686+0000","last_fullsized":"2023-05-16T13:55:24.702686+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:21:33.903700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703592+0000","last_change":"2023-05-16T13:55:23.008048+0000","last_active":"2023-05-16T13:55:24.703592+0000","last_peered":"2023-05-16T13:55:24.703592+0000","last_clean":"2023-05-16T13:55:24.703592+0000","last_became_active":"2023-05-16T13:55:23.007545+0000","last_became_peered":"2023-05-16T13:55:23.007545+0000","last_unstale":"2023-05-16T13:55:24.703592+0000","last_undegraded":"2023-05-16T13:55:24.703592+0000","last_fullsized":"2023-05-16T13:55:24.703592+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T18:33:51.205312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.391488+0000","last_change":"2023-05-16T13:55:23.407477+0000","last_active":"2023-05-16T13:55:24.391488+0000","last_peered":"2023-05-16T13:55:24.391488+0000","last_clean":"2023-05-16T13:55:24.391488+0000","last_became_active":"2023-05-16T13:55:23.406622+0000","last_became_peered":"2023-05-16T13:55:23.406622+0000","last_unstale":"2023-05-16T13:55:24.391488+0000","last_undegraded":"2023-05-16T13:55:24.391488+0000","last_fullsized":"2023-05-16T13:55:24.391488+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:16:30.890505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":19,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703914+0000","last_change":"2023-05-16T13:55:23.010113+0000","last_active":"2023-05-16T13:55:24.703914+0000","last_peered":"2023-05-16T13:55:24.703914+0000","last_clean":"2023-05-16T13:55:24.703914+0000","last_became_active":"2023-05-16T13:55:23.007991+0000","last_became_peered":"2023-05-16T13:55:23.007991+0000","last_unstale":"2023-05-16T13:55:24.703914+0000","last_undegraded":"2023-05-16T13:55:24.703914+0000","last_fullsized":"2023-05-16T13:55:24.703914+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:09:25.013926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703468+0000","last_change":"2023-05-16T13:55:23.426171+0000","last_active":"2023-05-16T13:55:24.703468+0000","last_peered":"2023-05-16T13:55:24.703468+0000","last_clean":"2023-05-16T13:55:24.703468+0000","last_became_active":"2023-05-16T13:55:23.425887+0000","last_became_peered":"2023-05-16T13:55:23.425887+0000","last_unstale":"2023-05-16T13:55:24.703468+0000","last_undegraded":"2023-05-16T13:55:24.703468+0000","last_fullsized":"2023-05-16T13:55:24.703468+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:36:07.932696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.704044+0000","last_change":"2023-05-16T13:55:23.005180+0000","last_active":"2023-05-16T13:55:24.704044+0000","last_peered":"2023-05-16T13:55:24.704044+0000","last_clean":"2023-05-16T13:55:24.704044+0000","last_became_active":"2023-05-16T13:55:23.004744+0000","last_became_peered":"2023-05-16T13:55:23.004744+0000","last_unstale":"2023-05-16T13:55:24.704044+0000","last_undegraded":"2023-05-16T13:55:24.704044+0000","last_fullsized":"2023-05-16T13:55:24.704044+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:37:21.801714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703851+0000","last_change":"2023-05-16T13:55:23.412436+0000","last_active":"2023-05-16T13:55:24.703851+0000","last_peered":"2023-05-16T13:55:24.703851+0000","last_clean":"2023-05-16T13:55:24.703851+0000","last_became_active":"2023-05-16T13:55:23.412200+0000","last_became_peered":"2023-05-16T13:55:23.412200+0000","last_unstale":"2023-05-16T13:55:24.703851+0000","last_undegraded":"2023-05-16T13:55:24.703851+0000","last_fullsized":"2023-05-16T13:55:24.703851+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:37:14.267206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702898+0000","last_change":"2023-05-16T13:55:23.008139+0000","last_active":"2023-05-16T13:55:24.702898+0000","last_peered":"2023-05-16T13:55:24.702898+0000","last_clean":"2023-05-16T13:55:24.702898+0000","last_became_active":"2023-05-16T13:55:23.007732+0000","last_became_peered":"2023-05-16T13:55:23.007732+0000","last_unstale":"2023-05-16T13:55:24.702898+0000","last_undegraded":"2023-05-16T13:55:24.702898+0000","last_fullsized":"2023-05-16T13:55:24.702898+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T14:02:33.296373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.448770+0000","last_change":"2023-05-16T13:55:23.412734+0000","last_active":"2023-05-16T13:55:24.448770+0000","last_peered":"2023-05-16T13:55:24.448770+0000","last_clean":"2023-05-16T13:55:24.448770+0000","last_became_active":"2023-05-16T13:55:23.412348+0000","last_became_peered":"2023-05-16T13:55:23.412348+0000","last_unstale":"2023-05-16T13:55:24.448770+0000","last_undegraded":"2023-05-16T13:55:24.448770+0000","last_fullsized":"2023-05-16T13:55:24.448770+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:52:40.298346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.390501+0000","last_change":"2023-05-16T13:55:22.989132+0000","last_active":"2023-05-16T13:55:24.390501+0000","last_peered":"2023-05-16T13:55:24.390501+0000","last_clean":"2023-05-16T13:55:24.390501+0000","last_became_active":"2023-05-16T13:55:22.988291+0000","last_became_peered":"2023-05-16T13:55:22.988291+0000","last_unstale":"2023-05-16T13:55:24.390501+0000","last_undegraded":"2023-05-16T13:55:24.390501+0000","last_fullsized":"2023-05-16T13:55:24.390501+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T18:02:59.391437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703975+0000","last_change":"2023-05-16T13:55:23.414195+0000","last_active":"2023-05-16T13:55:24.703975+0000","last_peered":"2023-05-16T13:55:24.703975+0000","last_clean":"2023-05-16T13:55:24.703975+0000","last_became_active":"2023-05-16T13:55:23.413751+0000","last_became_peered":"2023-05-16T13:55:23.413751+0000","last_unstale":"2023-05-16T13:55:24.703975+0000","last_undegraded":"2023-05-16T13:55:24.703975+0000","last_fullsized":"2023-05-16T13:55:24.703975+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T20:53:14.973983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"37'8","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.448362+0000","last_change":"2023-05-16T13:55:22.992485+0000","last_active":"2023-05-16T13:55:24.448362+0000","last_peered":"2023-05-16T13:55:24.448362+0000","last_clean":"2023-05-16T13:55:24.448362+0000","last_became_active":"2023-05-16T13:55:22.992225+0000","last_became_peered":"2023-05-16T13:55:22.992225+0000","last_unstale":"2023-05-16T13:55:24.448362+0000","last_undegraded":"2023-05-16T13:55:24.448362+0000","last_fullsized":"2023-05-16T13:55:24.448362+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T14:58:30.874381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703817+0000","last_change":"2023-05-16T13:55:23.410961+0000","last_active":"2023-05-16T13:55:24.703817+0000","last_peered":"2023-05-16T13:55:24.703817+0000","last_clean":"2023-05-16T13:55:24.703817+0000","last_became_active":"2023-05-16T13:55:23.410710+0000","last_became_peered":"2023-05-16T13:55:23.410710+0000","last_unstale":"2023-05-16T13:55:24.703817+0000","last_undegraded":"2023-05-16T13:55:24.703817+0000","last_fullsized":"2023-05-16T13:55:24.703817+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:51:42.064641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703647+0000","last_change":"2023-05-16T13:55:23.008354+0000","last_active":"2023-05-16T13:55:24.703647+0000","last_peered":"2023-05-16T13:55:24.703647+0000","last_clean":"2023-05-16T13:55:24.703647+0000","last_became_active":"2023-05-16T13:55:23.008075+0000","last_became_peered":"2023-05-16T13:55:23.008075+0000","last_unstale":"2023-05-16T13:55:24.703647+0000","last_undegraded":"2023-05-16T13:55:24.703647+0000","last_fullsized":"2023-05-16T13:55:24.703647+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:52:39.280919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703394+0000","last_change":"2023-05-16T13:55:23.420895+0000","last_active":"2023-05-16T13:55:24.703394+0000","last_peered":"2023-05-16T13:55:24.703394+0000","last_clean":"2023-05-16T13:55:24.703394+0000","last_became_active":"2023-05-16T13:55:23.416774+0000","last_became_peered":"2023-05-16T13:55:23.416774+0000","last_unstale":"2023-05-16T13:55:24.703394+0000","last_undegraded":"2023-05-16T13:55:24.703394+0000","last_fullsized":"2023-05-16T13:55:24.703394+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:44:47.581169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.391418+0000","last_change":"2023-05-16T13:55:23.009234+0000","last_active":"2023-05-16T13:55:24.391418+0000","last_peered":"2023-05-16T13:55:24.391418+0000","last_clean":"2023-05-16T13:55:24.391418+0000","last_became_active":"2023-05-16T13:55:23.008779+0000","last_became_peered":"2023-05-16T13:55:23.008779+0000","last_unstale":"2023-05-16T13:55:24.391418+0000","last_undegraded":"2023-05-16T13:55:24.391418+0000","last_fullsized":"2023-05-16T13:55:24.391418+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T15:34:36.361308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.390751+0000","last_change":"2023-05-16T13:55:23.406175+0000","last_active":"2023-05-16T13:55:24.390751+0000","last_peered":"2023-05-16T13:55:24.390751+0000","last_clean":"2023-05-16T13:55:24.390751+0000","last_became_active":"2023-05-16T13:55:23.405852+0000","last_became_peered":"2023-05-16T13:55:23.405852+0000","last_unstale":"2023-05-16T13:55:24.390751+0000","last_undegraded":"2023-05-16T13:55:24.390751+0000","last_fullsized":"2023-05-16T13:55:24.390751+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:15:01.909502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.389555+0000","last_change":"2023-05-16T13:55:23.002334+0000","last_active":"2023-05-16T13:55:24.389555+0000","last_peered":"2023-05-16T13:55:24.389555+0000","last_clean":"2023-05-16T13:55:24.389555+0000","last_became_active":"2023-05-16T13:55:23.002060+0000","last_became_peered":"2023-05-16T13:55:23.002060+0000","last_unstale":"2023-05-16T13:55:24.389555+0000","last_undegraded":"2023-05-16T13:55:24.389555+0000","last_fullsized":"2023-05-16T13:55:24.389555+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:24:10.547224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.389340+0000","last_change":"2023-05-16T13:55:23.416259+0000","last_active":"2023-05-16T13:55:24.389340+0000","last_peered":"2023-05-16T13:55:24.389340+0000","last_clean":"2023-05-16T13:55:24.389340+0000","last_became_active":"2023-05-16T13:55:23.415983+0000","last_became_peered":"2023-05-16T13:55:23.415983+0000","last_unstale":"2023-05-16T13:55:24.389340+0000","last_undegraded":"2023-05-16T13:55:24.389340+0000","last_fullsized":"2023-05-16T13:55:24.389340+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:45:04.746418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703229+0000","last_change":"2023-05-16T13:55:23.003470+0000","last_active":"2023-05-16T13:55:24.703229+0000","last_peered":"2023-05-16T13:55:24.703229+0000","last_clean":"2023-05-16T13:55:24.703229+0000","last_became_active":"2023-05-16T13:55:23.003203+0000","last_became_peered":"2023-05-16T13:55:23.003203+0000","last_unstale":"2023-05-16T13:55:24.703229+0000","last_undegraded":"2023-05-16T13:55:24.703229+0000","last_fullsized":"2023-05-16T13:55:24.703229+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T20:23:26.619277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.448881+0000","last_change":"2023-05-16T13:55:23.418998+0000","last_active":"2023-05-16T13:55:24.448881+0000","last_peered":"2023-05-16T13:55:24.448881+0000","last_clean":"2023-05-16T13:55:24.448881+0000","last_became_active":"2023-05-16T13:55:23.418628+0000","last_became_peered":"2023-05-16T13:55:23.418628+0000","last_unstale":"2023-05-16T13:55:24.448881+0000","last_undegraded":"2023-05-16T13:55:24.448881+0000","last_fullsized":"2023-05-16T13:55:24.448881+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T18:37:01.378522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.389117+0000","last_change":"2023-05-16T13:55:23.005895+0000","last_active":"2023-05-16T13:55:24.389117+0000","last_peered":"2023-05-16T13:55:24.389117+0000","last_clean":"2023-05-16T13:55:24.389117+0000","last_became_active":"2023-05-16T13:55:23.005582+0000","last_became_peered":"2023-05-16T13:55:23.005582+0000","last_unstale":"2023-05-16T13:55:24.389117+0000","last_undegraded":"2023-05-16T13:55:24.389117+0000","last_fullsized":"2023-05-16T13:55:24.389117+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:21:37.712743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703434+0000","last_change":"2023-05-16T13:55:23.411672+0000","last_active":"2023-05-16T13:55:24.703434+0000","last_peered":"2023-05-16T13:55:24.703434+0000","last_clean":"2023-05-16T13:55:24.703434+0000","last_became_active":"2023-05-16T13:55:23.408317+0000","last_became_peered":"2023-05-16T13:55:23.408317+0000","last_unstale":"2023-05-16T13:55:24.703434+0000","last_undegraded":"2023-05-16T13:55:24.703434+0000","last_fullsized":"2023-05-16T13:55:24.703434+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:24:27.841261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.389190+0000","last_change":"2023-05-16T13:55:23.001075+0000","last_active":"2023-05-16T13:55:24.389190+0000","last_peered":"2023-05-16T13:55:24.389190+0000","last_clean":"2023-05-16T13:55:24.389190+0000","last_became_active":"2023-05-16T13:55:23.000764+0000","last_became_peered":"2023-05-16T13:55:23.000764+0000","last_unstale":"2023-05-16T13:55:24.389190+0000","last_undegraded":"2023-05-16T13:55:24.389190+0000","last_fullsized":"2023-05-16T13:55:24.389190+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:25:15.075534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702914+0000","last_change":"2023-05-16T13:55:23.417031+0000","last_active":"2023-05-16T13:55:24.702914+0000","last_peered":"2023-05-16T13:55:24.702914+0000","last_clean":"2023-05-16T13:55:24.702914+0000","last_became_active":"2023-05-16T13:55:23.414376+0000","last_became_peered":"2023-05-16T13:55:23.414376+0000","last_unstale":"2023-05-16T13:55:24.702914+0000","last_undegraded":"2023-05-16T13:55:24.702914+0000","last_fullsized":"2023-05-16T13:55:24.702914+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:50:00.455412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.448937+0000","last_change":"2023-05-16T13:55:22.991669+0000","last_active":"2023-05-16T13:55:24.448937+0000","last_peered":"2023-05-16T13:55:24.448937+0000","last_clean":"2023-05-16T13:55:24.448937+0000","last_became_active":"2023-05-16T13:55:22.991279+0000","last_became_peered":"2023-05-16T13:55:22.991279+0000","last_unstale":"2023-05-16T13:55:24.448937+0000","last_undegraded":"2023-05-16T13:55:24.448937+0000","last_fullsized":"2023-05-16T13:55:24.448937+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T15:34:36.361308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.704066+0000","last_change":"2023-05-16T13:55:23.408380+0000","last_active":"2023-05-16T13:55:24.704066+0000","last_peered":"2023-05-16T13:55:24.704066+0000","last_clean":"2023-05-16T13:55:24.704066+0000","last_became_active":"2023-05-16T13:55:23.408097+0000","last_became_peered":"2023-05-16T13:55:23.408097+0000","last_unstale":"2023-05-16T13:55:24.704066+0000","last_undegraded":"2023-05-16T13:55:24.704066+0000","last_fullsized":"2023-05-16T13:55:24.704066+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T23:46:15.133417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.389006+0000","last_change":"2023-05-16T13:55:23.006029+0000","last_active":"2023-05-16T13:55:24.389006+0000","last_peered":"2023-05-16T13:55:24.389006+0000","last_clean":"2023-05-16T13:55:24.389006+0000","last_became_active":"2023-05-16T13:55:23.005646+0000","last_became_peered":"2023-05-16T13:55:23.005646+0000","last_unstale":"2023-05-16T13:55:24.389006+0000","last_undegraded":"2023-05-16T13:55:24.389006+0000","last_fullsized":"2023-05-16T13:55:24.389006+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:49:42.765347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703458+0000","last_change":"2023-05-16T13:55:23.416611+0000","last_active":"2023-05-16T13:55:24.703458+0000","last_peered":"2023-05-16T13:55:24.703458+0000","last_clean":"2023-05-16T13:55:24.703458+0000","last_became_active":"2023-05-16T13:55:23.415727+0000","last_became_peered":"2023-05-16T13:55:23.415727+0000","last_unstale":"2023-05-16T13:55:24.703458+0000","last_undegraded":"2023-05-16T13:55:24.703458+0000","last_fullsized":"2023-05-16T13:55:24.703458+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:37:09.541457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.448831+0000","last_change":"2023-05-16T13:55:23.003863+0000","last_active":"2023-05-16T13:55:24.448831+0000","last_peered":"2023-05-16T13:55:24.448831+0000","last_clean":"2023-05-16T13:55:24.448831+0000","last_became_active":"2023-05-16T13:55:23.003544+0000","last_became_peered":"2023-05-16T13:55:23.003544+0000","last_unstale":"2023-05-16T13:55:24.448831+0000","last_undegraded":"2023-05-16T13:55:24.448831+0000","last_fullsized":"2023-05-16T13:55:24.448831+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:56:30.037745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":199,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.448980+0000","last_change":"2023-05-16T13:54:03.495814+0000","last_active":"2023-05-16T13:55:24.448980+0000","last_peered":"2023-05-16T13:55:24.448980+0000","last_clean":"2023-05-16T13:55:24.448980+0000","last_became_active":"2023-05-16T13:54:03.494265+0000","last_became_peered":"2023-05-16T13:54:03.494265+0000","last_unstale":"2023-05-16T13:55:24.448980+0000","last_undegraded":"2023-05-16T13:55:24.448980+0000","last_fullsized":"2023-05-16T13:55:24.448980+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:01.722051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:01.722051+0000","last_clean_scrub_stamp":"2023-05-16T13:54:01.722051+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T01:41:43.408916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703470+0000","last_change":"2023-05-16T13:54:09.770727+0000","last_active":"2023-05-16T13:55:24.703470+0000","last_peered":"2023-05-16T13:55:24.703470+0000","last_clean":"2023-05-16T13:55:24.703470+0000","last_became_active":"2023-05-16T13:54:09.770179+0000","last_became_peered":"2023-05-16T13:54:09.770179+0000","last_unstale":"2023-05-16T13:55:24.703470+0000","last_undegraded":"2023-05-16T13:55:24.703470+0000","last_fullsized":"2023-05-16T13:55:24.703470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:13:47.691504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703107+0000","last_change":"2023-05-16T13:55:23.424350+0000","last_active":"2023-05-16T13:55:24.703107+0000","last_peered":"2023-05-16T13:55:24.703107+0000","last_clean":"2023-05-16T13:55:24.703107+0000","last_became_active":"2023-05-16T13:55:23.424033+0000","last_became_peered":"2023-05-16T13:55:23.424033+0000","last_unstale":"2023-05-16T13:55:24.703107+0000","last_undegraded":"2023-05-16T13:55:24.703107+0000","last_fullsized":"2023-05-16T13:55:24.703107+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T23:52:16.681043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703675+0000","last_change":"2023-05-16T13:55:23.007940+0000","last_active":"2023-05-16T13:55:24.703675+0000","last_peered":"2023-05-16T13:55:24.703675+0000","last_clean":"2023-05-16T13:55:24.703675+0000","last_became_active":"2023-05-16T13:55:23.007580+0000","last_became_peered":"2023-05-16T13:55:23.007580+0000","last_unstale":"2023-05-16T13:55:24.703675+0000","last_undegraded":"2023-05-16T13:55:24.703675+0000","last_fullsized":"2023-05-16T13:55:24.703675+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:56:30.037745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.448458+0000","last_change":"2023-05-16T13:54:09.768888+0000","last_active":"2023-05-16T13:55:24.448458+0000","last_peered":"2023-05-16T13:55:24.448458+0000","last_clean":"2023-05-16T13:55:24.448458+0000","last_became_active":"2023-05-16T13:54:09.768463+0000","last_became_peered":"2023-05-16T13:54:09.768463+0000","last_unstale":"2023-05-16T13:55:24.448458+0000","last_undegraded":"2023-05-16T13:55:24.448458+0000","last_fullsized":"2023-05-16T13:55:24.448458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:58:03.874164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.448960+0000","last_change":"2023-05-16T13:55:23.411690+0000","last_active":"2023-05-16T13:55:24.448960+0000","last_peered":"2023-05-16T13:55:24.448960+0000","last_clean":"2023-05-16T13:55:24.448960+0000","last_became_active":"2023-05-16T13:55:23.411143+0000","last_became_peered":"2023-05-16T13:55:23.411143+0000","last_unstale":"2023-05-16T13:55:24.448960+0000","last_undegraded":"2023-05-16T13:55:24.448960+0000","last_fullsized":"2023-05-16T13:55:24.448960+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:09:59.461115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.389284+0000","last_change":"2023-05-16T13:55:23.009854+0000","last_active":"2023-05-16T13:55:24.389284+0000","last_peered":"2023-05-16T13:55:24.389284+0000","last_clean":"2023-05-16T13:55:24.389284+0000","last_became_active":"2023-05-16T13:55:23.009546+0000","last_became_peered":"2023-05-16T13:55:23.009546+0000","last_unstale":"2023-05-16T13:55:24.389284+0000","last_undegraded":"2023-05-16T13:55:24.389284+0000","last_fullsized":"2023-05-16T13:55:24.389284+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T18:09:26.341219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.388996+0000","last_change":"2023-05-16T13:54:09.821010+0000","last_active":"2023-05-16T13:55:24.388996+0000","last_peered":"2023-05-16T13:55:24.388996+0000","last_clean":"2023-05-16T13:55:24.388996+0000","last_became_active":"2023-05-16T13:54:09.820636+0000","last_became_peered":"2023-05-16T13:54:09.820636+0000","last_unstale":"2023-05-16T13:55:24.388996+0000","last_undegraded":"2023-05-16T13:55:24.388996+0000","last_fullsized":"2023-05-16T13:55:24.388996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T16:40:06.160431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703115+0000","last_change":"2023-05-16T13:55:23.407818+0000","last_active":"2023-05-16T13:55:24.703115+0000","last_peered":"2023-05-16T13:55:24.703115+0000","last_clean":"2023-05-16T13:55:24.703115+0000","last_became_active":"2023-05-16T13:55:23.407568+0000","last_became_peered":"2023-05-16T13:55:23.407568+0000","last_unstale":"2023-05-16T13:55:24.703115+0000","last_undegraded":"2023-05-16T13:55:24.703115+0000","last_fullsized":"2023-05-16T13:55:24.703115+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:04:23.740266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702701+0000","last_change":"2023-05-16T13:55:23.003233+0000","last_active":"2023-05-16T13:55:24.702701+0000","last_peered":"2023-05-16T13:55:24.702701+0000","last_clean":"2023-05-16T13:55:24.702701+0000","last_became_active":"2023-05-16T13:55:23.002924+0000","last_became_peered":"2023-05-16T13:55:23.002924+0000","last_unstale":"2023-05-16T13:55:24.702701+0000","last_undegraded":"2023-05-16T13:55:24.702701+0000","last_fullsized":"2023-05-16T13:55:24.702701+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T16:42:10.128117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703027+0000","last_change":"2023-05-16T13:54:09.771040+0000","last_active":"2023-05-16T13:55:24.703027+0000","last_peered":"2023-05-16T13:55:24.703027+0000","last_clean":"2023-05-16T13:55:24.703027+0000","last_became_active":"2023-05-16T13:54:09.770433+0000","last_became_peered":"2023-05-16T13:54:09.770433+0000","last_unstale":"2023-05-16T13:55:24.703027+0000","last_undegraded":"2023-05-16T13:55:24.703027+0000","last_fullsized":"2023-05-16T13:55:24.703027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T14:24:43.948538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703572+0000","last_change":"2023-05-16T13:55:23.412124+0000","last_active":"2023-05-16T13:55:24.703572+0000","last_peered":"2023-05-16T13:55:24.703572+0000","last_clean":"2023-05-16T13:55:24.703572+0000","last_became_active":"2023-05-16T13:55:23.411824+0000","last_became_peered":"2023-05-16T13:55:23.411824+0000","last_unstale":"2023-05-16T13:55:24.703572+0000","last_undegraded":"2023-05-16T13:55:24.703572+0000","last_fullsized":"2023-05-16T13:55:24.703572+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:42:50.808847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.704046+0000","last_change":"2023-05-16T13:55:22.999434+0000","last_active":"2023-05-16T13:55:24.704046+0000","last_peered":"2023-05-16T13:55:24.704046+0000","last_clean":"2023-05-16T13:55:24.704046+0000","last_became_active":"2023-05-16T13:55:22.999152+0000","last_became_peered":"2023-05-16T13:55:22.999152+0000","last_unstale":"2023-05-16T13:55:24.704046+0000","last_undegraded":"2023-05-16T13:55:24.704046+0000","last_fullsized":"2023-05-16T13:55:24.704046+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T14:02:33.296373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703306+0000","last_change":"2023-05-16T13:54:09.813177+0000","last_active":"2023-05-16T13:55:24.703306+0000","last_peered":"2023-05-16T13:55:24.703306+0000","last_clean":"2023-05-16T13:55:24.703306+0000","last_became_active":"2023-05-16T13:54:09.812487+0000","last_became_peered":"2023-05-16T13:54:09.812487+0000","last_unstale":"2023-05-16T13:55:24.703306+0000","last_undegraded":"2023-05-16T13:55:24.703306+0000","last_fullsized":"2023-05-16T13:55:24.703306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T23:57:49.146859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702519+0000","last_change":"2023-05-16T13:55:23.410758+0000","last_active":"2023-05-16T13:55:24.702519+0000","last_peered":"2023-05-16T13:55:24.702519+0000","last_clean":"2023-05-16T13:55:24.702519+0000","last_became_active":"2023-05-16T13:55:23.410389+0000","last_became_peered":"2023-05-16T13:55:23.410389+0000","last_unstale":"2023-05-16T13:55:24.702519+0000","last_undegraded":"2023-05-16T13:55:24.702519+0000","last_fullsized":"2023-05-16T13:55:24.702519+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T17:36:07.932696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.390393+0000","last_change":"2023-05-16T13:55:22.999858+0000","last_active":"2023-05-16T13:55:24.390393+0000","last_peered":"2023-05-16T13:55:24.390393+0000","last_clean":"2023-05-16T13:55:24.390393+0000","last_became_active":"2023-05-16T13:55:22.999551+0000","last_became_peered":"2023-05-16T13:55:22.999551+0000","last_unstale":"2023-05-16T13:55:24.390393+0000","last_undegraded":"2023-05-16T13:55:24.390393+0000","last_fullsized":"2023-05-16T13:55:24.390393+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:28:57.237069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.449051+0000","last_change":"2023-05-16T13:54:09.813305+0000","last_active":"2023-05-16T13:55:24.449051+0000","last_peered":"2023-05-16T13:55:24.449051+0000","last_clean":"2023-05-16T13:55:24.449051+0000","last_became_active":"2023-05-16T13:54:09.812931+0000","last_became_peered":"2023-05-16T13:54:09.812931+0000","last_unstale":"2023-05-16T13:55:24.449051+0000","last_undegraded":"2023-05-16T13:55:24.449051+0000","last_fullsized":"2023-05-16T13:55:24.449051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T21:20:38.445502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.391162+0000","last_change":"2023-05-16T13:55:23.400824+0000","last_active":"2023-05-16T13:55:24.391162+0000","last_peered":"2023-05-16T13:55:24.391162+0000","last_clean":"2023-05-16T13:55:24.391162+0000","last_became_active":"2023-05-16T13:55:23.400555+0000","last_became_peered":"2023-05-16T13:55:23.400555+0000","last_unstale":"2023-05-16T13:55:24.391162+0000","last_undegraded":"2023-05-16T13:55:24.391162+0000","last_fullsized":"2023-05-16T13:55:24.391162+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T18:37:01.378522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.390164+0000","last_change":"2023-05-16T13:55:22.995464+0000","last_active":"2023-05-16T13:55:24.390164+0000","last_peered":"2023-05-16T13:55:24.390164+0000","last_clean":"2023-05-16T13:55:24.390164+0000","last_became_active":"2023-05-16T13:55:22.994103+0000","last_became_peered":"2023-05-16T13:55:22.994103+0000","last_unstale":"2023-05-16T13:55:24.390164+0000","last_undegraded":"2023-05-16T13:55:24.390164+0000","last_fullsized":"2023-05-16T13:55:24.390164+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T22:37:08.524030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.703646+0000","last_change":"2023-05-16T13:54:09.768257+0000","last_active":"2023-05-16T13:55:24.703646+0000","last_peered":"2023-05-16T13:55:24.703646+0000","last_clean":"2023-05-16T13:55:24.703646+0000","last_became_active":"2023-05-16T13:54:09.767879+0000","last_became_peered":"2023-05-16T13:54:09.767879+0000","last_unstale":"2023-05-16T13:55:24.703646+0000","last_undegraded":"2023-05-16T13:55:24.703646+0000","last_fullsized":"2023-05-16T13:55:24.703646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T19:59:08.711793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.448768+0000","last_change":"2023-05-16T13:55:23.402679+0000","last_active":"2023-05-16T13:55:24.448768+0000","last_peered":"2023-05-16T13:55:24.448768+0000","last_clean":"2023-05-16T13:55:24.448768+0000","last_became_active":"2023-05-16T13:55:23.402384+0000","last_became_peered":"2023-05-16T13:55:23.402384+0000","last_unstale":"2023-05-16T13:55:24.448768+0000","last_undegraded":"2023-05-16T13:55:24.448768+0000","last_fullsized":"2023-05-16T13:55:24.448768+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:22.972586+0000","last_clean_scrub_stamp":"2023-05-16T13:55:22.972586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T18:33:52.222739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.702984+0000","last_change":"2023-05-16T13:55:22.998169+0000","last_active":"2023-05-16T13:55:24.702984+0000","last_peered":"2023-05-16T13:55:24.702984+0000","last_clean":"2023-05-16T13:55:24.702984+0000","last_became_active":"2023-05-16T13:55:22.997892+0000","last_became_peered":"2023-05-16T13:55:22.997892+0000","last_unstale":"2023-05-16T13:55:24.702984+0000","last_undegraded":"2023-05-16T13:55:24.702984+0000","last_fullsized":"2023-05-16T13:55:24.702984+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:55:21.955159+0000","last_clean_scrub_stamp":"2023-05-16T13:55:21.955159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:03:49.235876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":45,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-05-16T13:55:24.391257+0000","last_change":"2023-05-16T13:54:09.768603+0000","last_active":"2023-05-16T13:55:24.391257+0000","last_peered":"2023-05-16T13:55:24.391257+0000","last_clean":"2023-05-16T13:55:24.391257+0000","last_became_active":"2023-05-16T13:54:09.768323+0000","last_became_peered":"2023-05-16T13:54:09.768323+0000","last_unstale":"2023-05-16T13:55:24.391257+0000","last_undegraded":"2023-05-16T13:55:24.391257+0000","last_fullsized":"2023-05-16T13:55:24.391257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-16T13:54:08.754589+0000","last_clean_scrub_stamp":"2023-05-16T13:54:08.754589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T00:23:03.008131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509460,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13756,"kb_used_data":1012,"kb_used_omap":0,"kb_used_meta":12736,"kb_avail":94358084,"statfs":{"total":96636764160,"available":96622678016,"internally_reserved":0,"allocated":1036288,"data_stored":769041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13041664},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue May 16 13:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.623}]},{"osd":1,"last update":"Tue May 16 13:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.52100000000000002}]},{"osd":2,"last update":"Tue May 16 13:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.77200000000000002}]},{"osd":3,"last update":"Tue May 16 13:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.63700000000000001}]},{"osd":4,"last update":"Tue May 16 13:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.78600000000000003}]},{"osd":5,"last update":"Tue May 16 13:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.749},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.60199999999999998}]},{"osd":6,"last update":"Tue May 16 13:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.69499999999999995}]}]},{"osd":6,"up_from":15,"seq":64424509459,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12524,"kb_used_data":420,"kb_used_omap":0,"kb_used_meta":12096,"kb_avail":94359316,"statfs":{"total":96636764160,"available":96623939584,"internally_reserved":0,"allocated":430080,"data_stored":177621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12386304},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.76100000000000001}]},{"osd":1,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.79800000000000004}]},{"osd":2,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.69399999999999995}]},{"osd":3,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.78300000000000003}]},{"osd":4,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.55400000000000005}]},{"osd":5,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.59099999999999997}]},{"osd":7,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.77300000000000002}]}]},{"osd":5,"up_from":15,"seq":64424509460,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12592,"kb_used_data":424,"kb_used_omap":0,"kb_used_meta":12160,"kb_avail":94359248,"statfs":{"total":96636764160,"available":96623869952,"internally_reserved":0,"allocated":434176,"data_stored":177151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12451840},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue May 16 13:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.59399999999999997}]},{"osd":1,"last update":"Tue May 16 13:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.54200000000000004}]},{"osd":2,"last update":"Tue May 16 13:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.501}]},{"osd":3,"last update":"Tue May 16 13:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.62}]},{"osd":4,"last update":"Tue May 16 13:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.65800000000000003}]},{"osd":6,"last update":"Tue May 16 13:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.64000000000000001}]},{"osd":7,"last update":"Tue May 16 13:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.75600000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509460,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12720,"kb_used_data":424,"kb_used_omap":0,"kb_used_meta":12288,"kb_avail":94359120,"statfs":{"total":96636764160,"available":96623738880,"internally_reserved":0,"allocated":434176,"data_stored":177643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12582912},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.67100000000000004}]},{"osd":1,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.72399999999999998}]},{"osd":2,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.623}]},{"osd":3,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.75800000000000001}]},{"osd":5,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.60099999999999998}]},{"osd":6,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.57899999999999996}]},{"osd":7,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.505},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.53300000000000003}]}]},{"osd":3,"up_from":14,"seq":60129542164,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12664,"kb_used_data":432,"kb_used_omap":0,"kb_used_meta":12224,"kb_avail":94359176,"statfs":{"total":96636764160,"available":96623796224,"internally_reserved":0,"allocated":442368,"data_stored":178637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12517376},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.41599999999999998}]},{"osd":1,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.432}]},{"osd":2,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.36099999999999999}]},{"osd":4,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":0.79600000000000004}]},{"osd":5,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.631,"5min":1.631,"15min":1.631},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.72199999999999998}]},{"osd":6,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.753}]},{"osd":7,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.80500000000000005}]}]},{"osd":2,"up_from":14,"seq":60129542164,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12524,"kb_used_data":420,"kb_used_omap":0,"kb_used_meta":12096,"kb_avail":94359316,"statfs":{"total":96636764160,"available":96623939584,"internally_reserved":0,"allocated":430080,"data_stored":177109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12386304},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue May 16 13:55:01 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.48599999999999999}]},{"osd":1,"last update":"Tue May 16 13:55:01 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.54900000000000004}]},{"osd":3,"last update":"Tue May 16 13:55:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.50600000000000001}]},{"osd":4,"last update":"Tue May 16 13:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.85899999999999999}]},{"osd":5,"last update":"Tue May 16 13:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.81799999999999995}]},{"osd":6,"last update":"Tue May 16 13:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.83899999999999997}]},{"osd":7,"last update":"Tue May 16 13:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.89300000000000002}]}]},{"osd":1,"up_from":14,"seq":60129542163,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12588,"kb_used_data":420,"kb_used_omap":0,"kb_used_meta":12160,"kb_avail":94359252,"statfs":{"total":96636764160,"available":96623874048,"internally_reserved":0,"allocated":430080,"data_stored":177129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12451840},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.311},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.46999999999999997}]},{"osd":2,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.373},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.48399999999999999}]},{"osd":3,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.441}]},{"osd":4,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.59499999999999997}]},{"osd":5,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.69699999999999995}]},{"osd":6,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.67900000000000005}]},{"osd":7,"last update":"Tue May 16 13:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.67100000000000004}]}]},{"osd":0,"up_from":14,"seq":60129542164,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13680,"kb_used_data":1000,"kb_used_omap":0,"kb_used_meta":12672,"kb_avail":94358160,"statfs":{"total":96636764160,"available":96622755840,"internally_reserved":0,"allocated":1024000,"data_stored":767441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12976128},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue May 16 13:55:03 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.42199999999999999}]},{"osd":2,"last update":"Tue May 16 13:55:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.497},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.53900000000000003}]},{"osd":3,"last update":"Tue May 16 13:55:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.51100000000000001}]},{"osd":4,"last update":"Tue May 16 13:55:03 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.66800000000000004}]},{"osd":5,"last update":"Tue May 16 13:55:03 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":2.2639999999999998,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.77300000000000002}]},{"osd":6,"last update":"Tue May 16 13:55:03 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":2.3380000000000001,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":0.753},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.70699999999999996}]},{"osd":7,"last update":"Tue May 16 13:55:03 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":2.403,"5min":2.403,"15min":2.403},"last":0.80900000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-16T13:55:32.366 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-05-16T13:55:32.366 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-05-16T13:55:32.543 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.535+0000 7f6eaf7bc640 1 Processor -- start 2023-05-16T13:55:32.544 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.535+0000 7f6eaf7bc640 1 -- start start 2023-05-16T13:55:32.545 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.539+0000 7f6eaf7bc640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f6ea80cb940 0x7f6ea806fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:32.545 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.539+0000 7f6eaf7bc640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f6ea8070090 0x7f6ea80afdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:32.545 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.539+0000 7f6eaf7bc640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ea80ca000 con 0x7f6ea8159e60 2023-05-16T13:55:32.545 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.539+0000 7f6eaf7bc640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ea8070510 con 0x7f6ea80cb940 2023-05-16T13:55:32.545 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.539+0000 7f6eaf7bc640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ea809c110 con 0x7f6ea8070090 2023-05-16T13:55:32.545 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.539+0000 7f6eacd57640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f6ea80cb940 0x7f6ea806fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:32.546 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.539+0000 7f6eacd57640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f6ea80cb940 0x7f6ea806fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38876/0 (socket says 172.21.15.39:38876) 2023-05-16T13:55:32.546 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.539+0000 7f6eacd57640 1 -- 172.21.15.39:0/4072090070 learned_addr learned my addr 172.21.15.39:0/4072090070 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:32.546 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.539+0000 7f6eadd59640 1 --2- 172.21.15.39:0/4072090070 >> v2:172.21.15.118:3300/0 conn(0x7f6ea8070090 0x7f6ea80afdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:32.546 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.539+0000 7f6eacd57640 1 -- 172.21.15.39:0/4072090070 >> v2:172.21.15.118:3300/0 conn(0x7f6ea8070090 msgr2=0x7f6ea80afdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:32.547 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.539+0000 7f6eacd57640 1 --2- 172.21.15.39:0/4072090070 >> v2:172.21.15.118:3300/0 conn(0x7f6ea8070090 0x7f6ea80afdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:32.547 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.539+0000 7f6eacd57640 1 -- 172.21.15.39:0/4072090070 >> v1:172.21.15.39:6789/0 conn(0x7f6ea8159e60 legacy=0x7f6ea806cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:32.547 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.539+0000 7f6eacd57640 1 -- 172.21.15.39:0/4072090070 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ea809be30 con 0x7f6ea80cb940 2023-05-16T13:55:32.547 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.539+0000 7f6e9ffff640 1 -- 172.21.15.39:0/4072090070 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3604281631 0 0) 0x7f6ea80ca000 con 0x7f6ea8159e60 2023-05-16T13:55:32.548 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.539+0000 7f6eacd57640 1 --2- 172.21.15.39:0/4072090070 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6ea80cb940 0x7f6ea806fb50 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f6ea80add50 tx=0x7f6e9801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7293a4caac35c64 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:32.548 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.539+0000 7f6e9ffff640 1 -- 172.21.15.39:0/4072090070 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e980a89f0 con 0x7f6ea80cb940 2023-05-16T13:55:32.549 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.539+0000 7f6e9ffff640 1 -- 172.21.15.39:0/4072090070 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e980a8b50 con 0x7f6ea80cb940 2023-05-16T13:55:32.549 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.539+0000 7f6e9ffff640 1 -- 172.21.15.39:0/4072090070 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e980b0440 con 0x7f6ea80cb940 2023-05-16T13:55:32.549 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.543+0000 7f6eaf7bc640 1 -- 172.21.15.39:0/4072090070 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6ea80cb940 msgr2=0x7f6ea806fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:32.550 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.543+0000 7f6eaf7bc640 1 --2- 172.21.15.39:0/4072090070 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6ea80cb940 0x7f6ea806fb50 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f6ea80add50 tx=0x7f6e9801ecf0 comp rx=0 tx=0).stop 2023-05-16T13:55:32.550 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.543+0000 7f6eaf7bc640 1 -- 172.21.15.39:0/4072090070 shutdown_connections 2023-05-16T13:55:32.550 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.543+0000 7f6eaf7bc640 1 --2- 172.21.15.39:0/4072090070 >> v2:172.21.15.118:3300/0 conn(0x7f6ea8070090 0x7f6ea80afdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:32.550 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.543+0000 7f6eaf7bc640 1 --2- 172.21.15.39:0/4072090070 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6ea80cb940 0x7f6ea806fb50 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:32.550 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.543+0000 7f6eaf7bc640 1 -- 172.21.15.39:0/4072090070 >> 172.21.15.39:0/4072090070 conn(0x7f6ea80cadc0 msgr2=0x7f6ea80cb1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:32.550 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.543+0000 7f6eaf7bc640 1 -- 172.21.15.39:0/4072090070 shutdown_connections 2023-05-16T13:55:32.551 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.543+0000 7f6eaf7bc640 1 -- 172.21.15.39:0/4072090070 wait complete. 2023-05-16T13:55:32.551 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.543+0000 7f6eaf7bc640 1 Processor -- start 2023-05-16T13:55:32.551 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.543+0000 7f6eaf7bc640 1 -- start start 2023-05-16T13:55:32.552 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.543+0000 7f6eaf7bc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ea8070090 0x7f6ea81f5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:32.552 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.543+0000 7f6eaf7bc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6ea80cb940 0x7f6ea809b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:32.552 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.543+0000 7f6eaf7bc640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ea8159e60 0x7f6ea8154400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:32.553 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.543+0000 7f6eaf7bc640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea809b640 con 0x7f6ea80cb940 2023-05-16T13:55:32.553 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.543+0000 7f6eaf7bc640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea8154c70 con 0x7f6ea8070090 2023-05-16T13:55:32.553 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.543+0000 7f6eaf7bc640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea81f4e20 con 0x7f6ea8159e60 2023-05-16T13:55:32.553 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.543+0000 7f6eacd57640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6ea80cb940 0x7f6ea809b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:32.553 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.543+0000 7f6eacd57640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6ea80cb940 0x7f6ea809b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38892/0 (socket says 172.21.15.39:38892) 2023-05-16T13:55:32.553 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.543+0000 7f6eacd57640 1 -- 172.21.15.39:0/2849977351 learned_addr learned my addr 172.21.15.39:0/2849977351 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:32.554 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.543+0000 7f6ead558640 1 --2- 172.21.15.39:0/2849977351 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ea8070090 0x7f6ea81f5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:32.554 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.543+0000 7f6eadd59640 1 --2- 172.21.15.39:0/2849977351 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ea8159e60 0x7f6ea8154400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:32.555 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.543+0000 7f6eacd57640 1 -- 172.21.15.39:0/2849977351 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ea8159e60 msgr2=0x7f6ea8154400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:32.555 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.543+0000 7f6eacd57640 1 --2- 172.21.15.39:0/2849977351 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ea8159e60 0x7f6ea8154400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:32.555 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.543+0000 7f6eacd57640 1 -- 172.21.15.39:0/2849977351 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ea8070090 msgr2=0x7f6ea81f5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:32.555 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.547+0000 7f6eacd57640 1 --2- 172.21.15.39:0/2849977351 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ea8070090 0x7f6ea81f5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:32.555 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.547+0000 7f6eacd57640 1 -- 172.21.15.39:0/2849977351 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e980094d0 con 0x7f6ea80cb940 2023-05-16T13:55:32.555 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.547+0000 7f6eacd57640 1 --2- 172.21.15.39:0/2849977351 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6ea80cb940 0x7f6ea809b100 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f6e9801b900 tx=0x7f6e9801ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:32.556 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.547+0000 7f6e9dffb640 1 -- 172.21.15.39:0/2849977351 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e980b0df0 con 0x7f6ea80cb940 2023-05-16T13:55:32.556 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.547+0000 7f6e9dffb640 1 -- 172.21.15.39:0/2849977351 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e98004030 con 0x7f6ea80cb940 2023-05-16T13:55:32.556 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.547+0000 7f6e9dffb640 1 -- 172.21.15.39:0/2849977351 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e980043e0 con 0x7f6ea80cb940 2023-05-16T13:55:32.556 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.547+0000 7f6eaf7bc640 1 -- 172.21.15.39:0/2849977351 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ea80c9d20 con 0x7f6ea80cb940 2023-05-16T13:55:32.556 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.547+0000 7f6eaf7bc640 1 -- 172.21.15.39:0/2849977351 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ea80c9a40 con 0x7f6ea80cb940 2023-05-16T13:55:32.556 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.547+0000 7f6eaf7bc640 1 -- 172.21.15.39:0/2849977351 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ea806d230 con 0x7f6ea80cb940 2023-05-16T13:55:32.557 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.547+0000 7f6e9dffb640 1 -- 172.21.15.39:0/2849977351 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6e98003620 con 0x7f6ea80cb940 2023-05-16T13:55:32.557 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.547+0000 7f6e9dffb640 1 --2- 172.21.15.39:0/2849977351 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f6e8c066280 0x7f6e8c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:32.557 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.547+0000 7f6e9dffb640 1 -- 172.21.15.39:0/2849977351 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6e98121100 con 0x7f6ea80cb940 2023-05-16T13:55:32.557 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.547+0000 7f6ead558640 1 --2- 172.21.15.39:0/2849977351 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f6e8c066280 0x7f6e8c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:32.558 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.551+0000 7f6ead558640 1 --2- 172.21.15.39:0/2849977351 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f6e8c066280 0x7f6e8c068730 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6ea4007fd0 tx=0x7f6ea4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:32.560 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.551+0000 7f6e9dffb640 1 -- 172.21.15.39:0/2849977351 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f6e980ee590 con 0x7f6ea80cb940 2023-05-16T13:55:32.770 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.763+0000 7f6eaf7bc640 1 -- 172.21.15.39:0/2849977351 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f6ea8073c90 con 0x7f6ea80cb940 2023-05-16T13:55:32.776 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.767+0000 7f6e9dffb640 1 -- 172.21.15.39:0/2849977351 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v9) v1 ==== 190+0+0 (secure 0 0 0) 0x7f6e980f1bb0 con 0x7f6ea80cb940 2023-05-16T13:55:32.776 INFO:teuthology.orchestra.run.smithi039.stderr:updated caps for client.0 2023-05-16T13:55:32.778 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.771+0000 7f6eaf7bc640 1 -- 172.21.15.39:0/2849977351 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f6e8c066280 msgr2=0x7f6e8c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:32.778 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.771+0000 7f6eaf7bc640 1 --2- 172.21.15.39:0/2849977351 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f6e8c066280 0x7f6e8c068730 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6ea4007fd0 tx=0x7f6ea4009040 comp rx=0 tx=0).stop 2023-05-16T13:55:32.779 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.771+0000 7f6eaf7bc640 1 -- 172.21.15.39:0/2849977351 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6ea80cb940 msgr2=0x7f6ea809b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:32.779 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.771+0000 7f6eaf7bc640 1 --2- 172.21.15.39:0/2849977351 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6ea80cb940 0x7f6ea809b100 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f6e9801b900 tx=0x7f6e9801ba90 comp rx=0 tx=0).stop 2023-05-16T13:55:32.779 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.771+0000 7f6eaf7bc640 1 -- 172.21.15.39:0/2849977351 shutdown_connections 2023-05-16T13:55:32.779 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.771+0000 7f6eaf7bc640 1 --2- 172.21.15.39:0/2849977351 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f6e8c066280 0x7f6e8c068730 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:32.779 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.771+0000 7f6eaf7bc640 1 --2- 172.21.15.39:0/2849977351 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ea8159e60 0x7f6ea8154400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:32.779 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.771+0000 7f6eaf7bc640 1 --2- 172.21.15.39:0/2849977351 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6ea80cb940 0x7f6ea809b100 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:32.779 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.771+0000 7f6eaf7bc640 1 --2- 172.21.15.39:0/2849977351 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ea8070090 0x7f6ea81f5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:32.780 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.771+0000 7f6eaf7bc640 1 -- 172.21.15.39:0/2849977351 >> 172.21.15.39:0/2849977351 conn(0x7f6ea80cadc0 msgr2=0x7f6ea8157c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:32.780 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.771+0000 7f6eaf7bc640 1 -- 172.21.15.39:0/2849977351 shutdown_connections 2023-05-16T13:55:32.780 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.771+0000 7f6eaf7bc640 1 -- 172.21.15.39:0/2849977351 wait complete. 2023-05-16T13:55:32.797 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-16T13:55:32.935 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.927+0000 7ff89f674640 1 Processor -- start 2023-05-16T13:55:32.936 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.927+0000 7ff89f674640 1 -- start start 2023-05-16T13:55:32.937 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.927+0000 7ff89f674640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7ff898158bf0 0x7ff89815d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:32.937 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.927+0000 7ff89f674640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff8980cb4c0 0x7ff8980ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:32.937 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.927+0000 7ff89f674640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff89815d6a0 con 0x7ff8980703b0 2023-05-16T13:55:32.938 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.927+0000 7ff89f674640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff898070870 con 0x7ff898158bf0 2023-05-16T13:55:32.938 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.927+0000 7ff89f674640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff898070b50 con 0x7ff8980cb4c0 2023-05-16T13:55:32.938 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.927+0000 7ff89d410640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7ff898158bf0 0x7ff89815d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:32.938 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.927+0000 7ff89d410640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7ff898158bf0 0x7ff89815d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38902/0 (socket says 172.21.15.39:38902) 2023-05-16T13:55:32.938 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.927+0000 7ff89d410640 1 -- 172.21.15.39:0/1848237765 learned_addr learned my addr 172.21.15.39:0/1848237765 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:32.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.927+0000 7ff89dc11640 1 --2- 172.21.15.39:0/1848237765 >> v2:172.21.15.118:3300/0 conn(0x7ff8980cb4c0 0x7ff8980ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:32.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.931+0000 7ff89d410640 1 -- 172.21.15.39:0/1848237765 >> v2:172.21.15.118:3300/0 conn(0x7ff8980cb4c0 msgr2=0x7ff8980ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:32.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.931+0000 7ff89d410640 1 --2- 172.21.15.39:0/1848237765 >> v2:172.21.15.118:3300/0 conn(0x7ff8980cb4c0 0x7ff8980ccda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:32.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.931+0000 7ff89d410640 1 -- 172.21.15.39:0/1848237765 >> v1:172.21.15.118:6789/0 conn(0x7ff8980703b0 legacy=0x7ff8980cadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:32.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.931+0000 7ff89d410640 1 -- 172.21.15.39:0/1848237765 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff898070e30 con 0x7ff898158bf0 2023-05-16T13:55:32.939 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.931+0000 7ff89dc11640 1 --2- 172.21.15.39:0/1848237765 >> v2:172.21.15.118:3300/0 conn(0x7ff8980cb4c0 0x7ff8980ccda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:55:32.940 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.931+0000 7ff89d410640 1 --2- 172.21.15.39:0/1848237765 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff898158bf0 0x7ff89815d160 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7ff8980ce340 tx=0x7ff89401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9647839a0938c30 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:32.940 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.931+0000 7ff88ffff640 1 -- 172.21.15.39:0/1848237765 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8940ab640 con 0x7ff898158bf0 2023-05-16T13:55:32.940 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.931+0000 7ff88ffff640 1 -- 172.21.15.39:0/1848237765 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8940a7070 con 0x7ff898158bf0 2023-05-16T13:55:32.940 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.931+0000 7ff88ffff640 1 -- 172.21.15.39:0/1848237765 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8940ab9c0 con 0x7ff898158bf0 2023-05-16T13:55:32.941 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.931+0000 7ff89f674640 1 -- 172.21.15.39:0/1848237765 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff898158bf0 msgr2=0x7ff89815d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:32.941 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.931+0000 7ff89f674640 1 --2- 172.21.15.39:0/1848237765 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff898158bf0 0x7ff89815d160 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7ff8980ce340 tx=0x7ff89401c440 comp rx=0 tx=0).stop 2023-05-16T13:55:32.942 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.931+0000 7ff89f674640 1 -- 172.21.15.39:0/1848237765 shutdown_connections 2023-05-16T13:55:32.942 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.931+0000 7ff89f674640 1 --2- 172.21.15.39:0/1848237765 >> v2:172.21.15.118:3300/0 conn(0x7ff8980cb4c0 0x7ff8980ccda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:32.942 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.931+0000 7ff89f674640 1 --2- 172.21.15.39:0/1848237765 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff898158bf0 0x7ff89815d160 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:32.942 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.935+0000 7ff89f674640 1 -- 172.21.15.39:0/1848237765 >> 172.21.15.39:0/1848237765 conn(0x7ff898069a50 msgr2=0x7ff898069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:32.942 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.935+0000 7ff89f674640 1 -- 172.21.15.39:0/1848237765 shutdown_connections 2023-05-16T13:55:32.942 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.935+0000 7ff89f674640 1 -- 172.21.15.39:0/1848237765 wait complete. 2023-05-16T13:55:32.943 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.935+0000 7ff89f674640 1 Processor -- start 2023-05-16T13:55:32.943 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.935+0000 7ff89f674640 1 -- start start 2023-05-16T13:55:32.944 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.935+0000 7ff89f674640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff8980703b0 0x7ff89814f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:32.944 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.935+0000 7ff89f674640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff8980cb4c0 0x7ff898145cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:32.944 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.935+0000 7ff89f674640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff898158bf0 0x7ff898159730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:32.944 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.935+0000 7ff89f674640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff89814fa40 con 0x7ff898158bf0 2023-05-16T13:55:32.945 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.935+0000 7ff89f674640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff89814e460 con 0x7ff8980703b0 2023-05-16T13:55:32.945 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.935+0000 7ff89f674640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff89814e740 con 0x7ff8980cb4c0 2023-05-16T13:55:32.945 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.935+0000 7ff89dc11640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff898158bf0 0x7ff898159730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:32.945 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.935+0000 7ff89dc11640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff898158bf0 0x7ff898159730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38910/0 (socket says 172.21.15.39:38910) 2023-05-16T13:55:32.945 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.935+0000 7ff89dc11640 1 -- 172.21.15.39:0/159681631 learned_addr learned my addr 172.21.15.39:0/159681631 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:32.945 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.935+0000 7ff89cc0f640 1 --2- 172.21.15.39:0/159681631 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff8980cb4c0 0x7ff898145cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:32.945 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.935+0000 7ff89d410640 1 --2- 172.21.15.39:0/159681631 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff8980703b0 0x7ff89814f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:32.946 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.935+0000 7ff89dc11640 1 -- 172.21.15.39:0/159681631 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff8980cb4c0 msgr2=0x7ff898145cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:32.946 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.935+0000 7ff89dc11640 1 --2- 172.21.15.39:0/159681631 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff8980cb4c0 0x7ff898145cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:32.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.935+0000 7ff89dc11640 1 -- 172.21.15.39:0/159681631 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff8980703b0 msgr2=0x7ff89814f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:32.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.935+0000 7ff89dc11640 1 --2- 172.21.15.39:0/159681631 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff8980703b0 0x7ff89814f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:32.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.935+0000 7ff89dc11640 1 -- 172.21.15.39:0/159681631 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8940094d0 con 0x7ff898158bf0 2023-05-16T13:55:32.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.935+0000 7ff89dc11640 1 --2- 172.21.15.39:0/159681631 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff898158bf0 0x7ff898159730 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7ff890009f70 tx=0x7ff89000d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:32.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.939+0000 7ff88dffb640 1 -- 172.21.15.39:0/159681631 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff890003ba0 con 0x7ff898158bf0 2023-05-16T13:55:32.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.939+0000 7ff88dffb640 1 -- 172.21.15.39:0/159681631 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff89000f040 con 0x7ff898158bf0 2023-05-16T13:55:32.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.939+0000 7ff89f674640 1 -- 172.21.15.39:0/159681631 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8980ad950 con 0x7ff898158bf0 2023-05-16T13:55:32.947 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.939+0000 7ff88dffb640 1 -- 172.21.15.39:0/159681631 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff890004030 con 0x7ff898158bf0 2023-05-16T13:55:32.948 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.939+0000 7ff89f674640 1 -- 172.21.15.39:0/159681631 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff898158fc0 con 0x7ff898158bf0 2023-05-16T13:55:32.948 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.939+0000 7ff89f674640 1 -- 172.21.15.39:0/159681631 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8980cdaf0 con 0x7ff898158bf0 2023-05-16T13:55:32.948 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.939+0000 7ff88dffb640 1 -- 172.21.15.39:0/159681631 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff890004190 con 0x7ff898158bf0 2023-05-16T13:55:32.949 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.939+0000 7ff88dffb640 1 --2- 172.21.15.39:0/159681631 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ff87c066280 0x7ff87c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:32.949 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.939+0000 7ff88dffb640 1 -- 172.21.15.39:0/159681631 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff890084070 con 0x7ff898158bf0 2023-05-16T13:55:32.949 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.939+0000 7ff89d410640 1 --2- 172.21.15.39:0/159681631 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ff87c066280 0x7ff87c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:32.950 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.943+0000 7ff89d410640 1 --2- 172.21.15.39:0/159681631 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ff87c066280 0x7ff87c068730 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff8940af000 tx=0x7ff8940b6040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:32.952 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:32.943+0000 7ff88dffb640 1 -- 172.21.15.39:0/159681631 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7ff8900b46f0 con 0x7ff898158bf0 2023-05-16T13:55:33.139 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.131+0000 7ff89f674640 1 -- 172.21.15.39:0/159681631 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff898073c90 con 0x7ff898158bf0 2023-05-16T13:55:33.140 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.131+0000 7ff88dffb640 1 -- 172.21.15.39:0/159681631 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4671 (secure 0 0 0) 0x7ff89001a090 con 0x7ff898158bf0 2023-05-16T13:55:33.140 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:55:33.140 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5248,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/2560977732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":2560977732},{"type":"v1","addr":"172.21.15.118:6834","nonce":2560977732}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5251,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/376752431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":376752431},{"type":"v1","addr":"172.21.15.118:6835","nonce":376752431}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5376,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6836/315984146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6835","nonce":315984146},{"type":"v1","addr":"172.21.15.39:6836","nonce":315984146}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-16T13:55:23.381170+0000","modified":"2023-05-16T13:55:26.393759+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5379":{"gid":5379,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.39:6837/4211566764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":4211566764},{"type":"v1","addr":"172.21.15.39:6837","nonce":4211566764}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-05-16T13:55:33.141 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 15 2023-05-16T13:55:33.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.135+0000 7ff89f674640 1 -- 172.21.15.39:0/159681631 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ff87c066280 msgr2=0x7ff87c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:33.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.135+0000 7ff89f674640 1 --2- 172.21.15.39:0/159681631 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ff87c066280 0x7ff87c068730 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff8940af000 tx=0x7ff8940b6040 comp rx=0 tx=0).stop 2023-05-16T13:55:33.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.135+0000 7ff89f674640 1 -- 172.21.15.39:0/159681631 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff898158bf0 msgr2=0x7ff898159730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:33.142 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.135+0000 7ff89f674640 1 --2- 172.21.15.39:0/159681631 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff898158bf0 0x7ff898159730 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7ff890009f70 tx=0x7ff89000d560 comp rx=0 tx=0).stop 2023-05-16T13:55:33.143 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.135+0000 7ff89f674640 1 -- 172.21.15.39:0/159681631 shutdown_connections 2023-05-16T13:55:33.143 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.135+0000 7ff89f674640 1 --2- 172.21.15.39:0/159681631 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7ff87c066280 0x7ff87c068730 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:33.143 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.135+0000 7ff89f674640 1 --2- 172.21.15.39:0/159681631 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff8980cb4c0 0x7ff898145cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:33.143 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.135+0000 7ff89f674640 1 --2- 172.21.15.39:0/159681631 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff898158bf0 0x7ff898159730 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:33.143 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.135+0000 7ff89f674640 1 --2- 172.21.15.39:0/159681631 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff8980703b0 0x7ff89814f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:33.143 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.135+0000 7ff89f674640 1 -- 172.21.15.39:0/159681631 >> 172.21.15.39:0/159681631 conn(0x7ff898069a50 msgr2=0x7ff8980b20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:33.143 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.135+0000 7ff89f674640 1 -- 172.21.15.39:0/159681631 shutdown_connections 2023-05-16T13:55:33.143 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.135+0000 7ff89f674640 1 -- 172.21.15.39:0/159681631 wait complete. 2023-05-16T13:55:33.563 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-05-16T13:55:23.381170+0000', 'modified': '2023-05-16T13:55:26.393759+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5379}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5379': {'gid': 5379, 'name': 'a', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.39:6837/4211566764', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.39:6834', 'nonce': 4211566764}, {'type': 'v1', 'addr': '172.21.15.39:6837', 'nonce': 4211566764}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-05-16T13:55:33.564 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-05-16T13:55:33.564 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-05-16T13:55:33.705 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.699+0000 7f46374c4640 1 Processor -- start 2023-05-16T13:55:33.706 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.699+0000 7f46374c4640 1 -- start start 2023-05-16T13:55:33.707 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.699+0000 7f46374c4640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f46300cde40 0x7f46300cc380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:33.707 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.699+0000 7f46374c4640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f46300aff00 0x7f46300b0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:33.707 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.699+0000 7f46374c4640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46300c8be0 con 0x7f4630071500 2023-05-16T13:55:33.707 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.699+0000 7f46374c4640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46300b08c0 con 0x7f46300aff00 2023-05-16T13:55:33.707 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.699+0000 7f46374c4640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46300c8ec0 con 0x7f46300cde40 2023-05-16T13:55:33.708 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.699+0000 7f4634a5f640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f46300cde40 0x7f46300cc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:33.708 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.699+0000 7f4634a5f640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f46300cde40 0x7f46300cc380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.39:56914/0 (socket says 172.21.15.39:56914) 2023-05-16T13:55:33.708 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.699+0000 7f4634a5f640 1 -- 172.21.15.39:0/1577020108 learned_addr learned my addr 172.21.15.39:0/1577020108 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:33.709 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.699+0000 7f4635a61640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f46300aff00 0x7f46300b0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:33.709 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.699+0000 7f4634a5f640 1 -- 172.21.15.39:0/1577020108 >> v2:172.21.15.118:3300/0 conn(0x7f46300aff00 msgr2=0x7f46300b0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:33.709 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.699+0000 7f4634a5f640 1 --2- 172.21.15.39:0/1577020108 >> v2:172.21.15.118:3300/0 conn(0x7f46300aff00 0x7f46300b0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:33.709 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.699+0000 7f4634a5f640 1 -- 172.21.15.39:0/1577020108 >> v1:172.21.15.118:6789/0 conn(0x7f4630071500 legacy=0x7f463015d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:33.709 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.699+0000 7f4634a5f640 1 -- 172.21.15.39:0/1577020108 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46300ca8a0 con 0x7f46300cde40 2023-05-16T13:55:33.711 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.703+0000 7f4634a5f640 1 --2- 172.21.15.39:0/1577020108 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f46300cde40 0x7f46300cc380 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f46200098a0 tx=0x7f462001c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71e8019ea5e65066 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:33.711 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.703+0000 7f4627fff640 1 -- 172.21.15.39:0/1577020108 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46200a7070 con 0x7f46300cde40 2023-05-16T13:55:33.711 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.703+0000 7f4627fff640 1 -- 172.21.15.39:0/1577020108 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46200ab430 con 0x7f46300cde40 2023-05-16T13:55:33.712 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.703+0000 7f4627fff640 1 -- 172.21.15.39:0/1577020108 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46200ab7c0 con 0x7f46300cde40 2023-05-16T13:55:33.712 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.703+0000 7f46374c4640 1 -- 172.21.15.39:0/1577020108 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f46300cde40 msgr2=0x7f46300cc380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:33.712 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.703+0000 7f46374c4640 1 --2- 172.21.15.39:0/1577020108 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f46300cde40 0x7f46300cc380 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f46200098a0 tx=0x7f462001c520 comp rx=0 tx=0).stop 2023-05-16T13:55:33.713 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.703+0000 7f46374c4640 1 -- 172.21.15.39:0/1577020108 shutdown_connections 2023-05-16T13:55:33.713 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.703+0000 7f46374c4640 1 --2- 172.21.15.39:0/1577020108 >> v2:172.21.15.118:3300/0 conn(0x7f46300aff00 0x7f46300b0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:33.713 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.703+0000 7f46374c4640 1 --2- 172.21.15.39:0/1577020108 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f46300cde40 0x7f46300cc380 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:33.713 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.703+0000 7f46374c4640 1 -- 172.21.15.39:0/1577020108 >> 172.21.15.39:0/1577020108 conn(0x7f4630069a50 msgr2=0x7f4630069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:33.713 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.703+0000 7f46374c4640 1 -- 172.21.15.39:0/1577020108 shutdown_connections 2023-05-16T13:55:33.713 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.703+0000 7f46374c4640 1 -- 172.21.15.39:0/1577020108 wait complete. 2023-05-16T13:55:33.714 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.707+0000 7f46374c4640 1 Processor -- start 2023-05-16T13:55:33.714 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.707+0000 7f46374c4640 1 -- start start 2023-05-16T13:55:33.715 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.707+0000 7f46374c4640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4630071500 0x7f4630155b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:33.715 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.707+0000 7f46374c4640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f46300aff00 0x7f4630150c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:33.715 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.707+0000 7f46374c4640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f46300cde40 0x7f463015f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:33.715 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.707+0000 7f46374c4640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46301453f0 con 0x7f46300cde40 2023-05-16T13:55:33.715 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.707+0000 7f46374c4640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f463015f900 con 0x7f46300aff00 2023-05-16T13:55:33.716 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.707+0000 7f46374c4640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46300ada90 con 0x7f4630071500 2023-05-16T13:55:33.716 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.707+0000 7f4635a61640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f46300cde40 0x7f463015f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:33.716 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.707+0000 7f4635a61640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f46300cde40 0x7f463015f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38920/0 (socket says 172.21.15.39:38920) 2023-05-16T13:55:33.716 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.707+0000 7f4635a61640 1 -- 172.21.15.39:0/1077451717 learned_addr learned my addr 172.21.15.39:0/1077451717 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:33.716 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.707+0000 7f4635260640 1 --2- 172.21.15.39:0/1077451717 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4630071500 0x7f4630155b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:33.716 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.707+0000 7f4634a5f640 1 --2- 172.21.15.39:0/1077451717 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f46300aff00 0x7f4630150c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:33.717 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.707+0000 7f4635a61640 1 -- 172.21.15.39:0/1077451717 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4630071500 msgr2=0x7f4630155b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:33.717 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.707+0000 7f4635a61640 1 --2- 172.21.15.39:0/1077451717 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4630071500 0x7f4630155b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:33.717 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.707+0000 7f4635a61640 1 -- 172.21.15.39:0/1077451717 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f46300aff00 msgr2=0x7f4630150c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:33.718 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.707+0000 7f4635a61640 1 --2- 172.21.15.39:0/1077451717 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f46300aff00 0x7f4630150c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:33.718 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.707+0000 7f4635a61640 1 -- 172.21.15.39:0/1077451717 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46200094d0 con 0x7f46300cde40 2023-05-16T13:55:33.718 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.707+0000 7f4635a61640 1 --2- 172.21.15.39:0/1077451717 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f46300cde40 0x7f463015f3c0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f462800efc0 tx=0x7f462800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:33.718 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.707+0000 7f4625ffb640 1 -- 172.21.15.39:0/1077451717 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462800ced0 con 0x7f46300cde40 2023-05-16T13:55:33.718 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.707+0000 7f4625ffb640 1 -- 172.21.15.39:0/1077451717 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f462800f040 con 0x7f46300cde40 2023-05-16T13:55:33.718 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.707+0000 7f4625ffb640 1 -- 172.21.15.39:0/1077451717 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46280146c0 con 0x7f46300cde40 2023-05-16T13:55:33.718 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.707+0000 7f46374c4640 1 -- 172.21.15.39:0/1077451717 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46301568c0 con 0x7f46300cde40 2023-05-16T13:55:33.719 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.707+0000 7f46374c4640 1 -- 172.21.15.39:0/1077451717 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46300718d0 con 0x7f46300cde40 2023-05-16T13:55:33.719 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.711+0000 7f4625ffb640 1 -- 172.21.15.39:0/1077451717 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4628014820 con 0x7f46300cde40 2023-05-16T13:55:33.719 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.711+0000 7f4625ffb640 1 --2- 172.21.15.39:0/1077451717 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f4614066280 0x7f4614068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:33.720 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.711+0000 7f4625ffb640 1 -- 172.21.15.39:0/1077451717 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f46280848c0 con 0x7f46300cde40 2023-05-16T13:55:33.720 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.711+0000 7f4635260640 1 --2- 172.21.15.39:0/1077451717 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f4614066280 0x7f4614068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:33.720 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.711+0000 7f463a825000 1 Processor -- start 2023-05-16T13:55:33.720 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.711+0000 7f463a825000 1 -- start start 2023-05-16T13:55:33.720 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.711+0000 7f4635260640 1 --2- 172.21.15.39:0/1077451717 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f4614066280 0x7f4614068730 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f462c007fd0 tx=0x7f462c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:33.722 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.715+0000 7f463a825000 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557024394760 0x557024394b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:33.722 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.715+0000 7f463a825000 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x557024395070 0x557024347ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:33.722 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.715+0000 7f463a825000 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557024348020 0x5570243483f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:33.722 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.715+0000 7f463a825000 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x557024212310 con 0x557024394760 2023-05-16T13:55:33.722 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.715+0000 7f463a825000 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55702414c980 con 0x557024348020 2023-05-16T13:55:33.723 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.715+0000 7f463a825000 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x5570241a0040 con 0x557024395070 2023-05-16T13:55:33.723 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.715+0000 7f4635260640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557024394760 0x557024394b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:33.723 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.715+0000 7f4635260640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557024394760 0x557024394b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38930/0 (socket says 172.21.15.39:38930) 2023-05-16T13:55:33.723 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.715+0000 7f4635260640 1 -- 172.21.15.39:0/238115096 learned_addr learned my addr 172.21.15.39:0/238115096 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:33.723 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.715+0000 7f4635a61640 1 --2- 172.21.15.39:0/238115096 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557024348020 0x5570243483f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:33.723 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.715+0000 7f4634a5f640 1 --2- 172.21.15.39:0/238115096 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x557024395070 0x557024347ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:33.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.715+0000 7f4635260640 1 -- 172.21.15.39:0/238115096 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x557024395070 msgr2=0x557024347ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:33.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.715+0000 7f4635260640 1 --2- 172.21.15.39:0/238115096 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x557024395070 0x557024347ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:33.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.715+0000 7f4635260640 1 -- 172.21.15.39:0/238115096 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557024348020 msgr2=0x5570243483f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:33.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.715+0000 7f4635260640 1 --2- 172.21.15.39:0/238115096 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557024348020 0x5570243483f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:33.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.715+0000 7f4635260640 1 -- 172.21.15.39:0/238115096 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55702415e0b0 con 0x557024394760 2023-05-16T13:55:33.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.715+0000 7f4634a5f640 1 --2- 172.21.15.39:0/238115096 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x557024395070 0x557024347ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:55:33.724 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.715+0000 7f4635260640 1 --2- 172.21.15.39:0/238115096 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557024394760 0x557024394b30 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f462c00f950 tx=0x7f462c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf5f6f3da785b36a server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:33.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.715+0000 7f4612ffd640 1 -- 172.21.15.39:0/238115096 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462c00fed0 con 0x557024394760 2023-05-16T13:55:33.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.715+0000 7f4612ffd640 1 -- 172.21.15.39:0/238115096 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f462c014be0 con 0x557024394760 2023-05-16T13:55:33.725 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.715+0000 7f4612ffd640 1 -- 172.21.15.39:0/238115096 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462c020410 con 0x557024394760 2023-05-16T13:55:33.727 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.715+0000 7f463a825000 1 -- 172.21.15.39:0/238115096 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557024394760 msgr2=0x557024394b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:33.728 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.715+0000 7f463a825000 1 --2- 172.21.15.39:0/238115096 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557024394760 0x557024394b30 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f462c00f950 tx=0x7f462c012000 comp rx=0 tx=0).stop 2023-05-16T13:55:33.728 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.715+0000 7f463a825000 1 -- 172.21.15.39:0/238115096 shutdown_connections 2023-05-16T13:55:33.728 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.715+0000 7f463a825000 1 --2- 172.21.15.39:0/238115096 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x557024395070 0x557024347ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:33.728 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.715+0000 7f463a825000 1 --2- 172.21.15.39:0/238115096 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557024348020 0x5570243483f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:33.728 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.715+0000 7f463a825000 1 --2- 172.21.15.39:0/238115096 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557024394760 0x557024394b30 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:33.728 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.715+0000 7f463a825000 1 -- 172.21.15.39:0/238115096 >> 172.21.15.39:0/238115096 conn(0x557024375710 msgr2=0x557024377af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:33.728 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.715+0000 7f463a825000 1 -- 172.21.15.39:0/238115096 shutdown_connections 2023-05-16T13:55:33.729 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.715+0000 7f463a825000 1 -- 172.21.15.39:0/238115096 wait complete. 2023-05-16T13:55:33.729 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.715+0000 7f463a825000 1 -- start start 2023-05-16T13:55:33.729 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.715+0000 7f463a825000 1 Processor -- start 2023-05-16T13:55:33.729 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.719+0000 7f463a825000 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x557024348020 0x55702434d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:33.729 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.719+0000 7f463a825000 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557024394760 0x55702434dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:33.729 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.719+0000 7f463a825000 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557024395070 0x55702434e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:33.729 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.719+0000 7f463a825000 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570241990e0 con 0x557024395070 2023-05-16T13:55:33.730 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.719+0000 7f463a825000 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x557024155bd0 con 0x557024394760 2023-05-16T13:55:33.730 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.719+0000 7f463a825000 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x557024155870 con 0x557024348020 2023-05-16T13:55:33.730 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.719+0000 7f463a825000 10 client.0 _ll_register_callbacks cb 0x557024335c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-16T13:55:33.730 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.719+0000 7f4635a61640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557024395070 0x55702434e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:33.730 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.719+0000 7f4635a61640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557024395070 0x55702434e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38946/0 (socket says 172.21.15.39:38946) 2023-05-16T13:55:33.730 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.719+0000 7f4635a61640 1 -- 172.21.15.39:0/2216489536 learned_addr learned my addr 172.21.15.39:0/2216489536 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:33.730 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.719+0000 7f4635260640 1 --2- 172.21.15.39:0/2216489536 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x557024348020 0x55702434d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:33.730 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.719+0000 7f4634a5f640 1 --2- 172.21.15.39:0/2216489536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557024394760 0x55702434dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:33.731 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.719+0000 7f4635a61640 1 -- 172.21.15.39:0/2216489536 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x557024348020 msgr2=0x55702434d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:33.731 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.719+0000 7f4635a61640 1 --2- 172.21.15.39:0/2216489536 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x557024348020 0x55702434d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:33.731 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.719+0000 7f4635a61640 1 -- 172.21.15.39:0/2216489536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557024394760 msgr2=0x55702434dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:33.731 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.719+0000 7f4635a61640 1 --2- 172.21.15.39:0/2216489536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557024394760 0x55702434dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:33.731 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.719+0000 7f4635a61640 1 -- 172.21.15.39:0/2216489536 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46300c8be0 con 0x557024395070 2023-05-16T13:55:33.731 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.719+0000 7f4634a5f640 1 --2- 172.21.15.39:0/2216489536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557024394760 0x55702434dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:55:33.731 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.719+0000 7f4635a61640 1 --2- 172.21.15.39:0/2216489536 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557024395070 0x55702434e010 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f4628009a40 tx=0x7f4628053e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57dac5d1d879056b server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:33.731 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.719+0000 7f460bfff640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-05-16T13:55:33.732 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.719+0000 7f460bfff640 1 -- 172.21.15.39:0/2216489536 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4628059d80 con 0x557024395070 2023-05-16T13:55:33.732 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.719+0000 7f460bfff640 1 -- 172.21.15.39:0/2216489536 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4628051800 con 0x557024395070 2023-05-16T13:55:33.732 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.719+0000 7f463a825000 1 -- 172.21.15.39:0/2216489536 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5570241948b0 con 0x557024395070 2023-05-16T13:55:33.732 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.719+0000 7f460bfff640 1 -- 172.21.15.39:0/2216489536 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f46280519c0 con 0x557024395070 2023-05-16T13:55:33.732 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.719+0000 7f463a825000 10 client.5571 fetch_fsmap learned FSMap version 15 2023-05-16T13:55:33.732 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.719+0000 7f463a825000 1 -- 172.21.15.39:0/2216489536 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x557023e95890 con 0x557024395070 2023-05-16T13:55:33.732 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.719+0000 7f460bfff640 1 -- 172.21.15.39:0/2216489536 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5570241948b0 con 0x557024395070 2023-05-16T13:55:33.732 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.719+0000 7f460bfff640 1 -- 172.21.15.39:0/2216489536 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 15) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f4628005d20 con 0x557024395070 2023-05-16T13:55:33.733 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.719+0000 7f463a825000 10 client.5571 fetch_fsmap finished waiting for FSMap version 15 2023-05-16T13:55:33.733 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.719+0000 7f463a825000 10 client.5571 resolve_mds: resolved name 'a' to daemon mds.a 2023-05-16T13:55:33.733 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.719+0000 7f463a825000 20 client.5571 populate_metadata read hostname 'smithi039' 2023-05-16T13:55:33.733 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.719+0000 7f463a825000 1 --2- 172.21.15.39:0/2216489536 >> [v2:172.21.15.39:6834/4211566764,v1:172.21.15.39:6837/4211566764] conn(0x5570243a39e0 0x5570243a5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:33.733 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.719+0000 7f463a825000 4 client.5571 mds_command: new command op to 5379 tid=0[{"prefix": "get_command_descriptions"}] 2023-05-16T13:55:33.733 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.719+0000 7f463a825000 1 -- 172.21.15.39:0/2216489536 --> [v2:172.21.15.39:6834/4211566764,v1:172.21.15.39:6837/4211566764] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5570241c7f70 con 0x5570243a39e0 2023-05-16T13:55:33.733 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.719+0000 7f4635260640 1 --2- 172.21.15.39:0/2216489536 >> [v2:172.21.15.39:6834/4211566764,v1:172.21.15.39:6837/4211566764] conn(0x5570243a39e0 0x5570243a5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:33.734 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.719+0000 7f460bfff640 10 client.5571 ms_handle_connect on v2:172.21.15.39:6834/4211566764 2023-05-16T13:55:33.734 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.719+0000 7f4635260640 1 --2- 172.21.15.39:0/2216489536 >> [v2:172.21.15.39:6834/4211566764,v1:172.21.15.39:6837/4211566764] conn(0x5570243a39e0 0x5570243a5dc0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84c03f75400d8a88 server_cookie=5187d5fd93c5ee01 in_seq=0 out_seq=0 2023-05-16T13:55:33.734 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.719+0000 7f460bfff640 1 -- 172.21.15.39:0/2216489536 <== mds.0 v2:172.21.15.39:6834/4211566764 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5570241c7f70 con 0x5570243a39e0 2023-05-16T13:55:33.735 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.719+0000 7f460bfff640 10 client.5571 handle_command_reply: tid=0 2023-05-16T13:55:33.735 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.719+0000 7f463a825000 1 client.5571 shutdown 2023-05-16T13:55:33.735 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.719+0000 7f463a825000 1 -- 172.21.15.39:0/2216489536 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557024395070 msgr2=0x55702434e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:33.735 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.719+0000 7f463a825000 1 --2- 172.21.15.39:0/2216489536 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557024395070 0x55702434e010 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f4628009a40 tx=0x7f4628053e70 comp rx=0 tx=0).stop 2023-05-16T13:55:33.735 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.719+0000 7f463a825000 1 -- 172.21.15.39:0/2216489536 shutdown_connections 2023-05-16T13:55:33.735 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.719+0000 7f463a825000 1 --2- 172.21.15.39:0/2216489536 >> [v2:172.21.15.39:6834/4211566764,v1:172.21.15.39:6837/4211566764] conn(0x5570243a39e0 0x5570243a5dc0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:33.736 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.719+0000 7f463a825000 1 --2- 172.21.15.39:0/2216489536 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557024395070 0x55702434e010 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:33.736 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.719+0000 7f463a825000 1 --2- 172.21.15.39:0/2216489536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557024394760 0x55702434dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:33.736 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.719+0000 7f463a825000 1 --2- 172.21.15.39:0/2216489536 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x557024348020 0x55702434d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:33.736 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.719+0000 7f460bfff640 0 client.5571 ms_handle_reset on v2:172.21.15.39:6834/4211566764 2023-05-16T13:55:33.736 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.719+0000 7f463a825000 1 -- 172.21.15.39:0/2216489536 >> 172.21.15.39:0/2216489536 conn(0x557024375710 msgr2=0x557024377af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:33.736 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.723+0000 7f463a825000 1 -- 172.21.15.39:0/2216489536 shutdown_connections 2023-05-16T13:55:33.736 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.723+0000 7f463a825000 1 -- 172.21.15.39:0/2216489536 wait complete. 2023-05-16T13:55:33.736 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.723+0000 7f463a825000 20 client.5571 trim_cache size 0 max 16384 2023-05-16T13:55:33.745 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.739+0000 7f463a825000 1 Processor -- start 2023-05-16T13:55:33.745 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.739+0000 7f463a825000 1 -- start start 2023-05-16T13:55:33.746 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.739+0000 7f463a825000 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x557024348020 0x55702434fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:33.746 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.739+0000 7f463a825000 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557024394760 0x557024350290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:33.746 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.739+0000 7f463a825000 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557024395070 0x5570243a3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:33.746 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.739+0000 7f463a825000 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x557023e56940 con 0x557024395070 2023-05-16T13:55:33.747 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.739+0000 7f463a825000 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x557024168cd0 con 0x557024394760 2023-05-16T13:55:33.747 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.739+0000 7f463a825000 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x557023e961b0 con 0x557024348020 2023-05-16T13:55:33.748 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.739+0000 7f4635a61640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557024395070 0x5570243a3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:33.748 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.739+0000 7f4635a61640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557024395070 0x5570243a3db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38948/0 (socket says 172.21.15.39:38948) 2023-05-16T13:55:33.748 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.739+0000 7f4635a61640 1 -- 172.21.15.39:0/3654936519 learned_addr learned my addr 172.21.15.39:0/3654936519 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:33.748 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.739+0000 7f4635260640 1 --2- 172.21.15.39:0/3654936519 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x557024348020 0x55702434fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:33.749 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.739+0000 7f4634a5f640 1 --2- 172.21.15.39:0/3654936519 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557024394760 0x557024350290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:33.749 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.739+0000 7f4635a61640 1 -- 172.21.15.39:0/3654936519 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x557024348020 msgr2=0x55702434fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:33.749 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.739+0000 7f4635a61640 1 --2- 172.21.15.39:0/3654936519 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x557024348020 0x55702434fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:33.749 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.739+0000 7f4635a61640 1 -- 172.21.15.39:0/3654936519 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557024394760 msgr2=0x557024350290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:33.749 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.739+0000 7f4635a61640 1 --2- 172.21.15.39:0/3654936519 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557024394760 0x557024350290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:33.749 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.739+0000 7f4635a61640 1 -- 172.21.15.39:0/3654936519 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55702415e360 con 0x557024395070 2023-05-16T13:55:33.749 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.739+0000 7f4635a61640 1 --2- 172.21.15.39:0/3654936519 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557024395070 0x5570243a3db0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f4628055800 tx=0x7f4628059000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9595a54cd0da943d server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:33.749 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.739+0000 7f46137fe640 1 -- 172.21.15.39:0/3654936519 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4628059b80 con 0x557024395070 2023-05-16T13:55:33.750 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.739+0000 7f46137fe640 1 -- 172.21.15.39:0/3654936519 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4628059d00 con 0x557024395070 2023-05-16T13:55:33.750 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.739+0000 7f46137fe640 1 -- 172.21.15.39:0/3654936519 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4628051a40 con 0x557024395070 2023-05-16T13:55:33.750 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.739+0000 7f463a825000 1 -- 172.21.15.39:0/3654936519 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557024395070 msgr2=0x5570243a3db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:33.750 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.739+0000 7f463a825000 1 --2- 172.21.15.39:0/3654936519 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557024395070 0x5570243a3db0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f4628055800 tx=0x7f4628059000 comp rx=0 tx=0).stop 2023-05-16T13:55:33.750 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.739+0000 7f463a825000 1 -- 172.21.15.39:0/3654936519 shutdown_connections 2023-05-16T13:55:33.750 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.739+0000 7f463a825000 1 --2- 172.21.15.39:0/3654936519 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557024395070 0x5570243a3db0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:33.750 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.739+0000 7f463a825000 1 --2- 172.21.15.39:0/3654936519 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557024394760 0x557024350290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:33.751 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.739+0000 7f463a825000 1 --2- 172.21.15.39:0/3654936519 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x557024348020 0x55702434fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:33.751 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.739+0000 7f463a825000 1 -- 172.21.15.39:0/3654936519 >> 172.21.15.39:0/3654936519 conn(0x557024375710 msgr2=0x55702434f640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:33.751 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.739+0000 7f463a825000 1 -- 172.21.15.39:0/3654936519 shutdown_connections 2023-05-16T13:55:33.751 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.739+0000 7f463a825000 1 -- 172.21.15.39:0/3654936519 wait complete. 2023-05-16T13:55:33.754 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.739+0000 7f463a825000 1 -- start start 2023-05-16T13:55:33.754 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.743+0000 7f463a825000 1 Processor -- start 2023-05-16T13:55:33.754 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.743+0000 7f463a825000 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x557024348020 0x5570243f2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:33.754 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.743+0000 7f463a825000 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557024394760 0x5570243f3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:33.755 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.743+0000 7f463a825000 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557024395070 0x5570243a69f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:33.755 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.743+0000 7f463a825000 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570241dc150 con 0x557024394760 2023-05-16T13:55:33.755 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.743+0000 7f463a825000 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x557024160310 con 0x557024395070 2023-05-16T13:55:33.755 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.743+0000 7f463a825000 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x55702415ced0 con 0x557024348020 2023-05-16T13:55:33.755 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.743+0000 7f463a825000 10 client.0 _ll_register_callbacks cb 0x5570241643e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-16T13:55:33.755 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.743+0000 7f4634a5f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557024394760 0x5570243f3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:33.755 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.743+0000 7f4634a5f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557024394760 0x5570243f3300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38954/0 (socket says 172.21.15.39:38954) 2023-05-16T13:55:33.756 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.743+0000 7f4634a5f640 1 -- 172.21.15.39:0/1172909684 learned_addr learned my addr 172.21.15.39:0/1172909684 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:33.756 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.743+0000 7f4635260640 1 --2- 172.21.15.39:0/1172909684 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x557024348020 0x5570243f2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:33.756 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.743+0000 7f4635a61640 1 --2- 172.21.15.39:0/1172909684 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557024395070 0x5570243a69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:33.756 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.743+0000 7f4634a5f640 1 -- 172.21.15.39:0/1172909684 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x557024348020 msgr2=0x5570243f2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:33.756 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.743+0000 7f4634a5f640 1 --2- 172.21.15.39:0/1172909684 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x557024348020 0x5570243f2dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:33.756 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.743+0000 7f4634a5f640 1 -- 172.21.15.39:0/1172909684 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557024395070 msgr2=0x5570243a69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:33.756 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.743+0000 7f4634a5f640 1 --2- 172.21.15.39:0/1172909684 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557024395070 0x5570243a69f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:33.756 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.743+0000 7f4634a5f640 1 -- 172.21.15.39:0/1172909684 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557023e95890 con 0x557024394760 2023-05-16T13:55:33.757 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.743+0000 7f4635a61640 1 --2- 172.21.15.39:0/1172909684 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557024395070 0x5570243a69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:55:33.757 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.743+0000 7f4634a5f640 1 --2- 172.21.15.39:0/1172909684 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557024394760 0x5570243f3300 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f462001c560 tx=0x7f462001ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=399075bd10027dfa server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:33.757 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.743+0000 7f460bfff640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2023-05-16T13:55:33.757 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.743+0000 7f460bfff640 1 -- 172.21.15.39:0/1172909684 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46200b9040 con 0x557024394760 2023-05-16T13:55:33.757 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.743+0000 7f460bfff640 1 -- 172.21.15.39:0/1172909684 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f46200c1c80 con 0x557024394760 2023-05-16T13:55:33.757 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.743+0000 7f463a825000 1 -- 172.21.15.39:0/1172909684 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557024378090 con 0x557024394760 2023-05-16T13:55:33.757 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.743+0000 7f460bfff640 1 -- 172.21.15.39:0/1172909684 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f46200c1e40 con 0x557024394760 2023-05-16T13:55:33.758 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.743+0000 7f463a825000 10 client.5577 fetch_fsmap learned FSMap version 15 2023-05-16T13:55:33.758 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.743+0000 7f463a825000 1 -- 172.21.15.39:0/1172909684 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x557024143be0 con 0x557024394760 2023-05-16T13:55:33.758 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.743+0000 7f460bfff640 1 -- 172.21.15.39:0/1172909684 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557024378090 con 0x557024394760 2023-05-16T13:55:33.758 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.743+0000 7f460bfff640 1 -- 172.21.15.39:0/1172909684 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 15) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f46200c0470 con 0x557024394760 2023-05-16T13:55:33.758 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.743+0000 7f463a825000 10 client.5577 fetch_fsmap finished waiting for FSMap version 15 2023-05-16T13:55:33.758 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.743+0000 7f463a825000 10 client.5577 resolve_mds: resolved name 'a' to daemon mds.a 2023-05-16T13:55:33.758 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.743+0000 7f463a825000 20 client.5577 populate_metadata read hostname 'smithi039' 2023-05-16T13:55:33.758 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.743+0000 7f463a825000 1 --2- 172.21.15.39:0/1172909684 >> [v2:172.21.15.39:6834/4211566764,v1:172.21.15.39:6837/4211566764] conn(0x5570243f9c20 0x5570243fc000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:33.759 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.743+0000 7f463a825000 4 client.5577 mds_command: new command op to 5379 tid=0[{"prefix": "status"}] 2023-05-16T13:55:33.759 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.743+0000 7f463a825000 1 -- 172.21.15.39:0/1172909684 --> [v2:172.21.15.39:6834/4211566764,v1:172.21.15.39:6837/4211566764] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55702434b780 con 0x5570243f9c20 2023-05-16T13:55:33.759 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.743+0000 7f4635260640 1 --2- 172.21.15.39:0/1172909684 >> [v2:172.21.15.39:6834/4211566764,v1:172.21.15.39:6837/4211566764] conn(0x5570243f9c20 0x5570243fc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:33.759 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.743+0000 7f4635260640 1 --2- 172.21.15.39:0/1172909684 >> [v2:172.21.15.39:6834/4211566764,v1:172.21.15.39:6837/4211566764] conn(0x5570243f9c20 0x5570243fc000 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e869ca8b5152b69 server_cookie=e72b6e590c092ffc in_seq=0 out_seq=0 2023-05-16T13:55:33.759 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.743+0000 7f460bfff640 10 client.5577 ms_handle_connect on v2:172.21.15.39:6834/4211566764 2023-05-16T13:55:33.759 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.747+0000 7f460bfff640 1 -- 172.21.15.39:0/1172909684 <== mds.0 v2:172.21.15.39:6834/4211566764 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55702434b780 con 0x5570243f9c20 2023-05-16T13:55:33.759 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.747+0000 7f460bfff640 10 client.5577 handle_command_reply: tid=0 2023-05-16T13:55:33.759 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.747+0000 7f463a825000 1 client.5577 shutdown 2023-05-16T13:55:33.760 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.747+0000 7f463a825000 1 -- 172.21.15.39:0/1172909684 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557024394760 msgr2=0x5570243f3300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:33.760 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.747+0000 7f463a825000 1 --2- 172.21.15.39:0/1172909684 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557024394760 0x5570243f3300 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f462001c560 tx=0x7f462001ad60 comp rx=0 tx=0).stop 2023-05-16T13:55:33.760 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.747+0000 7f463a825000 1 -- 172.21.15.39:0/1172909684 shutdown_connections 2023-05-16T13:55:33.760 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.747+0000 7f463a825000 1 --2- 172.21.15.39:0/1172909684 >> [v2:172.21.15.39:6834/4211566764,v1:172.21.15.39:6837/4211566764] conn(0x5570243f9c20 0x5570243fc000 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:33.760 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.747+0000 7f463a825000 1 --2- 172.21.15.39:0/1172909684 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557024395070 0x5570243a69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:33.760 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.747+0000 7f463a825000 1 --2- 172.21.15.39:0/1172909684 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557024394760 0x5570243f3300 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:33.760 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.747+0000 7f463a825000 1 --2- 172.21.15.39:0/1172909684 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x557024348020 0x5570243f2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:33.761 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.747+0000 7f460bfff640 0 client.5577 ms_handle_reset on v2:172.21.15.39:6834/4211566764 2023-05-16T13:55:33.761 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.747+0000 7f463a825000 1 -- 172.21.15.39:0/1172909684 >> 172.21.15.39:0/1172909684 conn(0x557024375710 msgr2=0x557024392a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:33.761 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.747+0000 7f463a825000 1 -- 172.21.15.39:0/1172909684 shutdown_connections 2023-05-16T13:55:33.761 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.747+0000 7f463a825000 1 -- 172.21.15.39:0/1172909684 wait complete. 2023-05-16T13:55:33.761 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.747+0000 7f463a825000 20 client.5577 trim_cache size 0 max 16384 2023-05-16T13:55:33.761 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2023-05-16T13:55:33.762 INFO:teuthology.orchestra.run.smithi039.stdout: "cluster_fsid": "9c1e210b-c515-4ea4-a065-397956895c68", 2023-05-16T13:55:33.762 INFO:teuthology.orchestra.run.smithi039.stdout: "whoami": 0, 2023-05-16T13:55:33.762 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 5379, 2023-05-16T13:55:33.762 INFO:teuthology.orchestra.run.smithi039.stdout: "want_state": "up:active", 2023-05-16T13:55:33.762 INFO:teuthology.orchestra.run.smithi039.stdout: "state": "up:active", 2023-05-16T13:55:33.762 INFO:teuthology.orchestra.run.smithi039.stdout: "fs_name": "cephfs", 2023-05-16T13:55:33.762 INFO:teuthology.orchestra.run.smithi039.stdout: "rank_uptime": 10.365149665000001, 2023-05-16T13:55:33.762 INFO:teuthology.orchestra.run.smithi039.stdout: "mdsmap_epoch": 15, 2023-05-16T13:55:33.763 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch": 38, 2023-05-16T13:55:33.763 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch_barrier": 38, 2023-05-16T13:55:33.763 INFO:teuthology.orchestra.run.smithi039.stdout: "uptime": 17.649043224 2023-05-16T13:55:33.763 INFO:teuthology.orchestra.run.smithi039.stdout:} 2023-05-16T13:55:33.764 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.747+0000 7f46374c4640 1 -- 172.21.15.39:0/1077451717 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f4614066280 msgr2=0x7f4614068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:33.764 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.747+0000 7f46374c4640 1 --2- 172.21.15.39:0/1077451717 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f4614066280 0x7f4614068730 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f462c007fd0 tx=0x7f462c009040 comp rx=0 tx=0).stop 2023-05-16T13:55:33.764 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.747+0000 7f46374c4640 1 -- 172.21.15.39:0/1077451717 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f46300cde40 msgr2=0x7f463015f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:33.764 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.747+0000 7f46374c4640 1 --2- 172.21.15.39:0/1077451717 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f46300cde40 0x7f463015f3c0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f462800efc0 tx=0x7f462800c490 comp rx=0 tx=0).stop 2023-05-16T13:55:33.764 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.747+0000 7f46374c4640 1 -- 172.21.15.39:0/1077451717 shutdown_connections 2023-05-16T13:55:33.764 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.747+0000 7f46374c4640 1 --2- 172.21.15.39:0/1077451717 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f46300cde40 0x7f463015f3c0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:33.765 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.747+0000 7f46374c4640 1 --2- 172.21.15.39:0/1077451717 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f46300aff00 0x7f4630150c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:33.765 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.747+0000 7f46374c4640 1 --2- 172.21.15.39:0/1077451717 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f4614066280 0x7f4614068730 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:33.765 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.747+0000 7f46374c4640 1 --2- 172.21.15.39:0/1077451717 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4630071500 0x7f4630155b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:33.765 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.747+0000 7f46374c4640 1 -- 172.21.15.39:0/1077451717 >> 172.21.15.39:0/1077451717 conn(0x7f4630069a50 msgr2=0x7f46301519a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:33.765 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.747+0000 7f46374c4640 1 -- 172.21.15.39:0/1077451717 shutdown_connections 2023-05-16T13:55:33.765 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.747+0000 7f46374c4640 1 -- 172.21.15.39:0/1077451717 wait complete. 2023-05-16T13:55:33.773 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-05-16T13:55:33.910 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.903+0000 7f08c028c640 1 Processor -- start 2023-05-16T13:55:33.910 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.903+0000 7f08c028c640 1 -- start start 2023-05-16T13:55:33.911 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.903+0000 7f08c028c640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f08b80b28c0 0x7f08b80cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:33.912 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.903+0000 7f08c028c640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f08b80ca620 0x7f08b806c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:33.912 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.903+0000 7f08c028c640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08b806d100 con 0x7f08b806cb90 2023-05-16T13:55:33.912 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.903+0000 7f08c028c640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08b80b2c90 con 0x7f08b80ca620 2023-05-16T13:55:33.912 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.903+0000 7f08c028c640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08b806d3a0 con 0x7f08b80b28c0 2023-05-16T13:55:33.913 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.903+0000 7f08bd827640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f08b80ca620 0x7f08b806c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:33.913 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.903+0000 7f08bd827640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f08b80ca620 0x7f08b806c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38958/0 (socket says 172.21.15.39:38958) 2023-05-16T13:55:33.913 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.903+0000 7f08be028640 1 --2- 172.21.15.39:0/828838302 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f08b80b28c0 0x7f08b80cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:33.913 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.903+0000 7f08bd827640 1 -- 172.21.15.39:0/828838302 learned_addr learned my addr 172.21.15.39:0/828838302 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:33.914 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.903+0000 7f08bd827640 1 -- 172.21.15.39:0/828838302 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f08b80b28c0 msgr2=0x7f08b80cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:33.914 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.903+0000 7f08bd827640 1 --2- 172.21.15.39:0/828838302 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f08b80b28c0 0x7f08b80cbe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:33.914 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.903+0000 7f08bd827640 1 -- 172.21.15.39:0/828838302 >> v1:172.21.15.118:6789/0 conn(0x7f08b806cb90 legacy=0x7f08b806b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:33.914 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.903+0000 7f08bd026640 1 -- 172.21.15.39:0/828838302 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2011265194 0 0) 0x7f08b806d100 con 0x7f08b806cb90 2023-05-16T13:55:33.915 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.903+0000 7f08bd827640 1 -- 172.21.15.39:0/828838302 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b80cb5e0 con 0x7f08b80ca620 2023-05-16T13:55:33.915 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.903+0000 7f08be028640 1 --2- 172.21.15.39:0/828838302 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f08b80b28c0 0x7f08b80cbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-16T13:55:33.915 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.907+0000 7f08bd827640 1 --2- 172.21.15.39:0/828838302 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f08b80ca620 0x7f08b806c650 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f08a8009870 tx=0x7f08a801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41ca0879e6bde9b3 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:33.915 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.907+0000 7f08bd026640 1 -- 172.21.15.39:0/828838302 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a80ab600 con 0x7f08b80ca620 2023-05-16T13:55:33.916 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.907+0000 7f08bd026640 1 -- 172.21.15.39:0/828838302 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08a80a7050 con 0x7f08b80ca620 2023-05-16T13:55:33.916 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.907+0000 7f08bd026640 1 -- 172.21.15.39:0/828838302 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a80ab980 con 0x7f08b80ca620 2023-05-16T13:55:33.917 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.907+0000 7f08c028c640 1 -- 172.21.15.39:0/828838302 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f08b80ca620 msgr2=0x7f08b806c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:33.917 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.907+0000 7f08c028c640 1 --2- 172.21.15.39:0/828838302 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f08b80ca620 0x7f08b806c650 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f08a8009870 tx=0x7f08a801c540 comp rx=0 tx=0).stop 2023-05-16T13:55:33.917 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.907+0000 7f08c028c640 1 -- 172.21.15.39:0/828838302 shutdown_connections 2023-05-16T13:55:33.917 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.907+0000 7f08c028c640 1 --2- 172.21.15.39:0/828838302 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f08b80ca620 0x7f08b806c650 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:33.917 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.907+0000 7f08c028c640 1 --2- 172.21.15.39:0/828838302 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f08b80b28c0 0x7f08b80cbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:33.917 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.907+0000 7f08c028c640 1 -- 172.21.15.39:0/828838302 >> 172.21.15.39:0/828838302 conn(0x7f08b806a6a0 msgr2=0x7f08b80cad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:33.917 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.907+0000 7f08c028c640 1 -- 172.21.15.39:0/828838302 shutdown_connections 2023-05-16T13:55:33.918 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.907+0000 7f08c028c640 1 -- 172.21.15.39:0/828838302 wait complete. 2023-05-16T13:55:33.918 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.911+0000 7f08c028c640 1 Processor -- start 2023-05-16T13:55:33.918 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.911+0000 7f08c028c640 1 -- start start 2023-05-16T13:55:33.919 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.911+0000 7f08c028c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f08b806cb90 0x7f08b8156020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:33.919 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.911+0000 7f08c028c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f08b80b28c0 0x7f08b80c7b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:33.920 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.911+0000 7f08c028c640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f08b80ca620 0x7f08b80c3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:33.920 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.911+0000 7f08c028c640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b8160cf0 con 0x7f08b806cb90 2023-05-16T13:55:33.920 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.911+0000 7f08c028c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b80c6540 con 0x7f08b80b28c0 2023-05-16T13:55:33.920 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.911+0000 7f08c028c640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08b80c6820 con 0x7f08b80ca620 2023-05-16T13:55:33.920 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.911+0000 7f08be028640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f08b806cb90 0x7f08b8156020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:33.920 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.911+0000 7f08be028640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f08b806cb90 0x7f08b8156020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38968/0 (socket says 172.21.15.39:38968) 2023-05-16T13:55:33.920 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.911+0000 7f08be028640 1 -- 172.21.15.39:0/3063223625 learned_addr learned my addr 172.21.15.39:0/3063223625 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:33.921 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.911+0000 7f08bd827640 1 --2- 172.21.15.39:0/3063223625 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f08b80b28c0 0x7f08b80c7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:33.921 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.911+0000 7f08be829640 1 --2- 172.21.15.39:0/3063223625 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f08b80ca620 0x7f08b80c3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:33.922 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.911+0000 7f08be028640 1 -- 172.21.15.39:0/3063223625 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f08b80ca620 msgr2=0x7f08b80c3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:33.922 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.911+0000 7f08be028640 1 --2- 172.21.15.39:0/3063223625 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f08b80ca620 0x7f08b80c3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:33.922 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.911+0000 7f08be028640 1 -- 172.21.15.39:0/3063223625 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f08b80b28c0 msgr2=0x7f08b80c7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:33.922 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.911+0000 7f08be028640 1 --2- 172.21.15.39:0/3063223625 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f08b80b28c0 0x7f08b80c7b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:33.922 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.911+0000 7f08be028640 1 -- 172.21.15.39:0/3063223625 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b4009420 con 0x7f08b806cb90 2023-05-16T13:55:33.922 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.911+0000 7f08bd827640 1 --2- 172.21.15.39:0/3063223625 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f08b80b28c0 0x7f08b80c7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-16T13:55:33.923 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.911+0000 7f08be028640 1 --2- 172.21.15.39:0/3063223625 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f08b806cb90 0x7f08b8156020 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f08b400ebe0 tx=0x7f08b400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:33.923 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.911+0000 7f08aeffd640 1 -- 172.21.15.39:0/3063223625 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b400eee0 con 0x7f08b806cb90 2023-05-16T13:55:33.923 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.911+0000 7f08aeffd640 1 -- 172.21.15.39:0/3063223625 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b400cc30 con 0x7f08b806cb90 2023-05-16T13:55:33.923 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.911+0000 7f08aeffd640 1 -- 172.21.15.39:0/3063223625 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b4013470 con 0x7f08b806cb90 2023-05-16T13:55:33.923 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.911+0000 7f08c028c640 1 -- 172.21.15.39:0/3063223625 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08a80094d0 con 0x7f08b806cb90 2023-05-16T13:55:33.923 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.911+0000 7f08c028c640 1 -- 172.21.15.39:0/3063223625 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08b8165b30 con 0x7f08b806cb90 2023-05-16T13:55:33.923 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.915+0000 7f08c028c640 1 -- 172.21.15.39:0/3063223625 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08b81659a0 con 0x7f08b806cb90 2023-05-16T13:55:33.924 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.915+0000 7f08aeffd640 1 -- 172.21.15.39:0/3063223625 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f08b40135d0 con 0x7f08b806cb90 2023-05-16T13:55:33.924 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.915+0000 7f08aeffd640 1 --2- 172.21.15.39:0/3063223625 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f089c066280 0x7f089c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:33.924 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.915+0000 7f08aeffd640 1 -- 172.21.15.39:0/3063223625 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f08b4083ff0 con 0x7f08b806cb90 2023-05-16T13:55:33.924 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.915+0000 7f08bd827640 1 --2- 172.21.15.39:0/3063223625 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f089c066280 0x7f089c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:33.925 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.915+0000 7f08bd827640 1 --2- 172.21.15.39:0/3063223625 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f089c066280 0x7f089c068730 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f08b80cd4e0 tx=0x7f08a80a6000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:33.927 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:33.919+0000 7f08aeffd640 1 -- 172.21.15.39:0/3063223625 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7f08b40b46f0 con 0x7f08b806cb90 2023-05-16T13:55:34.115 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:34.107+0000 7f08c028c640 1 -- 172.21.15.39:0/3063223625 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f08b8165cc0 con 0x7f08b806cb90 2023-05-16T13:55:34.116 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:34.107+0000 7f08aeffd640 1 -- 172.21.15.39:0/3063223625 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+73 (secure 0 0 0) 0x7f08b4017060 con 0x7f08b806cb90 2023-05-16T13:55:34.116 INFO:teuthology.orchestra.run.smithi039.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-05-16T13:55:34.118 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:34.111+0000 7f08c028c640 1 -- 172.21.15.39:0/3063223625 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f089c066280 msgr2=0x7f089c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:34.118 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:34.111+0000 7f08c028c640 1 --2- 172.21.15.39:0/3063223625 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f089c066280 0x7f089c068730 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f08b80cd4e0 tx=0x7f08a80a6000 comp rx=0 tx=0).stop 2023-05-16T13:55:34.118 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:34.111+0000 7f08c028c640 1 -- 172.21.15.39:0/3063223625 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f08b806cb90 msgr2=0x7f08b8156020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:34.118 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:34.111+0000 7f08c028c640 1 --2- 172.21.15.39:0/3063223625 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f08b806cb90 0x7f08b8156020 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f08b400ebe0 tx=0x7f08b400c520 comp rx=0 tx=0).stop 2023-05-16T13:55:34.118 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:34.111+0000 7f08c028c640 1 -- 172.21.15.39:0/3063223625 shutdown_connections 2023-05-16T13:55:34.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:34.111+0000 7f08c028c640 1 --2- 172.21.15.39:0/3063223625 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7f089c066280 0x7f089c068730 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:34.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:34.111+0000 7f08c028c640 1 --2- 172.21.15.39:0/3063223625 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f08b80ca620 0x7f08b80c3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:34.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:34.111+0000 7f08c028c640 1 --2- 172.21.15.39:0/3063223625 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f08b80b28c0 0x7f08b80c7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:34.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:34.111+0000 7f08c028c640 1 --2- 172.21.15.39:0/3063223625 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f08b806cb90 0x7f08b8156020 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:34.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:34.111+0000 7f08c028c640 1 -- 172.21.15.39:0/3063223625 >> 172.21.15.39:0/3063223625 conn(0x7f08b806a6a0 msgr2=0x7f08b8072980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:34.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:34.111+0000 7f08c028c640 1 -- 172.21.15.39:0/3063223625 shutdown_connections 2023-05-16T13:55:34.119 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:34.111+0000 7f08c028c640 1 -- 172.21.15.39:0/3063223625 wait complete. 2023-05-16T13:55:34.136 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-16T13:55:34.137 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-16T13:55:34.137 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi039.front.sepia.ceph.com 2023-05-16T13:55:34.137 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-05-16T13:55:34.137 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-05-16T13:55:34.138 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-16T13:55:34.138 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-05-16T13:55:34.138 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-16T13:55:34.138 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-05-16T13:55:34.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:55:34.139 DEBUG:teuthology.orchestra.run.smithi039:> ip addr 2023-05-16T13:55:34.148 INFO:teuthology.orchestra.run.smithi039.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-16T13:55:34.149 INFO:teuthology.orchestra.run.smithi039.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-16T13:55:34.149 INFO:teuthology.orchestra.run.smithi039.stdout: inet 127.0.0.1/8 scope host lo 2023-05-16T13:55:34.149 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-05-16T13:55:34.149 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 ::1/128 scope host 2023-05-16T13:55:34.149 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-05-16T13:55:34.150 INFO:teuthology.orchestra.run.smithi039.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-05-16T13:55:34.150 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:6b:fe:c6 brd ff:ff:ff:ff:ff:ff 2023-05-16T13:55:34.150 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp7s0f0 2023-05-16T13:55:34.150 INFO:teuthology.orchestra.run.smithi039.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-05-16T13:55:34.150 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:6b:fe:c7 brd ff:ff:ff:ff:ff:ff 2023-05-16T13:55:34.150 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp7s0f1 2023-05-16T13:55:34.150 INFO:teuthology.orchestra.run.smithi039.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-16T13:55:34.150 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:bd:13:70 brd ff:ff:ff:ff:ff:ff 2023-05-16T13:55:34.151 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp1s0f0 2023-05-16T13:55:34.151 INFO:teuthology.orchestra.run.smithi039.stdout: inet 172.21.15.39/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-05-16T13:55:34.151 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft 42267sec preferred_lft 42267sec 2023-05-16T13:55:34.151 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 fe80::ec4:7aff:febd:1370/64 scope link 2023-05-16T13:55:34.151 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-05-16T13:55:34.151 INFO:teuthology.orchestra.run.smithi039.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-05-16T13:55:34.151 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:bd:13:71 brd ff:ff:ff:ff:ff:ff 2023-05-16T13:55:34.151 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp1s0f1 2023-05-16T13:55:34.152 INFO:teuthology.orchestra.run.smithi039.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-05-16T13:55:34.152 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 02:42:f1:77:1b:cd brd ff:ff:ff:ff:ff:ff 2023-05-16T13:55:34.152 INFO:teuthology.orchestra.run.smithi039.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-05-16T13:55:34.152 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-05-16T13:55:34.152 INFO:teuthology.orchestra.run.smithi039.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-16T13:55:34.152 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-05-16T13:55:34.152 INFO:teuthology.orchestra.run.smithi039.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-05-16T13:55:34.153 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-05-16T13:55:34.153 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-05-16T13:55:34.153 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-05-16T13:55:34.153 INFO:teuthology.orchestra.run.smithi039.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-16T13:55:34.153 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-05-16T13:55:34.153 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-05-16T13:55:34.153 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-05-16T13:55:34.153 INFO:teuthology.orchestra.run.smithi039.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-16T13:55:34.154 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-05-16T13:55:34.154 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-05-16T13:55:34.154 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2023-05-16T13:55:34.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:55:34.155 DEBUG:teuthology.orchestra.run.smithi039:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-16T13:55:34.209 INFO:teuthology.orchestra.run.smithi039.stdout:1 2023-05-16T13:55:34.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:55:34.212 DEBUG:teuthology.orchestra.run.smithi039:> route 2023-05-16T13:55:34.261 INFO:teuthology.orchestra.run.smithi039.stdout:Kernel IP routing table 2023-05-16T13:55:34.262 INFO:teuthology.orchestra.run.smithi039.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-16T13:55:34.262 INFO:teuthology.orchestra.run.smithi039.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-05-16T13:55:34.262 INFO:teuthology.orchestra.run.smithi039.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-05-16T13:55:34.263 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-05-16T13:55:34.263 INFO:teuthology.orchestra.run.smithi039.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-16T13:55:34.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:55:34.264 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec bash -c ' 2023-05-16T13:55:34.265 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2023-05-16T13:55:34.265 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-05-16T13:55:34.266 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-05-16T13:55:34.266 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-05-16T13:55:34.267 DEBUG:teuthology.orchestra.run.smithi039:> ') 2023-05-16T13:55:34.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:55:34.352 DEBUG:teuthology.orchestra.run.smithi039:> ip netns list 2023-05-16T13:55:34.360 INFO:teuthology.orchestra.run.smithi039.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-05-16T13:55:34.361 INFO:teuthology.orchestra.run.smithi039.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-05-16T13:55:34.361 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-05-16T13:55:34.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:55:34.362 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link set brx.0 up 2023-05-16T13:55:34.427 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-05-16T13:55:34.428 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-16T13:55:34.428 DEBUG:teuthology.orchestra.run.smithi039:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-05-16T13:55:34.480 INFO:teuthology.orchestra.run.smithi039.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-05-16T13:55:34.480 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-16T13:55:34.480 DEBUG:teuthology.orchestra.run.smithi039:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-05-16T13:55:34.527 DEBUG:teuthology.orchestra.run.smithi039:> sudo modprobe fuse 2023-05-16T13:55:34.587 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-16T13:55:34.588 DEBUG:teuthology.orchestra.run.smithi039:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-16T13:55:34.649 INFO:teuthology.orchestra.run.smithi039.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-16T13:55:34.651 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-16T13:55:34.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:55:34.652 DEBUG:teuthology.orchestra.run.smithi039:> ls /sys/fs/fuse/connections 2023-05-16T13:55:34.699 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-05-16T13:55:34.700 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-05-16T13:55:34.743 DEBUG:teuthology.orchestra.run.smithi039:> sudo modprobe fuse 2023-05-16T13:55:34.763 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-16T13:55:34.764 DEBUG:teuthology.orchestra.run.smithi039:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-16T13:55:34.822 INFO:teuthology.orchestra.run.smithi039.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-16T13:55:34.823 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-16T13:55:34.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:55:34.825 DEBUG:teuthology.orchestra.run.smithi039:> ls /sys/fs/fuse/connections 2023-05-16T13:55:34.836 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi039.stderr:2023-05-16T13:55:34.827+0000 7f950e9e8580 -1 init, newargv = 0x558a9a9e95a0 newargc=15 2023-05-16T13:55:34.836 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi039.stderr:ceph-fuse[47263]: starting ceph client 2023-05-16T13:55:34.843 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi039.stderr:ceph-fuse[47263]: starting fuse 2023-05-16T13:55:34.844 INFO:teuthology.orchestra.run.smithi039.stdout:42 2023-05-16T13:55:34.844 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2023-05-16T13:55:34.845 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-05-16T13:55:34.845 DEBUG:teuthology.orchestra.run.smithi039:> import glob 2023-05-16T13:55:34.846 DEBUG:teuthology.orchestra.run.smithi039:> import re 2023-05-16T13:55:34.846 DEBUG:teuthology.orchestra.run.smithi039:> import os 2023-05-16T13:55:34.847 DEBUG:teuthology.orchestra.run.smithi039:> import subprocess 2023-05-16T13:55:34.847 DEBUG:teuthology.orchestra.run.smithi039:> 2023-05-16T13:55:34.847 DEBUG:teuthology.orchestra.run.smithi039:> def _find_admin_socket(client_name): 2023-05-16T13:55:34.848 DEBUG:teuthology.orchestra.run.smithi039:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-05-16T13:55:34.848 DEBUG:teuthology.orchestra.run.smithi039:> files = glob.glob(asok_path) 2023-05-16T13:55:34.849 DEBUG:teuthology.orchestra.run.smithi039:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-05-16T13:55:34.849 DEBUG:teuthology.orchestra.run.smithi039:> 2023-05-16T13:55:34.849 DEBUG:teuthology.orchestra.run.smithi039:> # Given a non-glob path, it better be there 2023-05-16T13:55:34.850 DEBUG:teuthology.orchestra.run.smithi039:> if "*" not in asok_path: 2023-05-16T13:55:34.850 DEBUG:teuthology.orchestra.run.smithi039:> assert(len(files) == 1) 2023-05-16T13:55:34.850 DEBUG:teuthology.orchestra.run.smithi039:> return files[0] 2023-05-16T13:55:34.851 DEBUG:teuthology.orchestra.run.smithi039:> 2023-05-16T13:55:34.851 DEBUG:teuthology.orchestra.run.smithi039:> for f in files: 2023-05-16T13:55:34.852 DEBUG:teuthology.orchestra.run.smithi039:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-05-16T13:55:34.853 DEBUG:teuthology.orchestra.run.smithi039:> if os.path.exists("/proc/{0}".format(pid)): 2023-05-16T13:55:34.853 DEBUG:teuthology.orchestra.run.smithi039:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-05-16T13:55:34.854 DEBUG:teuthology.orchestra.run.smithi039:> contents = proc_f.read() 2023-05-16T13:55:34.855 DEBUG:teuthology.orchestra.run.smithi039:> if mountpoint in contents: 2023-05-16T13:55:34.856 DEBUG:teuthology.orchestra.run.smithi039:> return f 2023-05-16T13:55:34.857 DEBUG:teuthology.orchestra.run.smithi039:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-05-16T13:55:34.857 DEBUG:teuthology.orchestra.run.smithi039:> 2023-05-16T13:55:34.857 DEBUG:teuthology.orchestra.run.smithi039:> print(_find_admin_socket("client.0")) 2023-05-16T13:55:34.858 DEBUG:teuthology.orchestra.run.smithi039:> ' 2023-05-16T13:55:34.971 INFO:teuthology.orchestra.run.smithi039.stdout:/var/run/ceph/ceph-client.0.47263.asok 2023-05-16T13:55:35.155 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.47263.asok 2023-05-16T13:55:35.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:55:35.156 DEBUG:teuthology.orchestra.run.smithi039:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.47263.asok status 2023-05-16T13:55:35.325 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2023-05-16T13:55:35.325 INFO:teuthology.orchestra.run.smithi039.stdout: "metadata": { 2023-05-16T13:55:35.326 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_sha1": "27be51263d3d0c721b6d1ca9f42550bf0ab3c97b", 2023-05-16T13:55:35.326 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_version": "ceph version 18.0.0-3926-g27be5126 (27be51263d3d0c721b6d1ca9f42550bf0ab3c97b) reef (dev)", 2023-05-16T13:55:35.326 INFO:teuthology.orchestra.run.smithi039.stdout: "entity_id": "0", 2023-05-16T13:55:35.326 INFO:teuthology.orchestra.run.smithi039.stdout: "hostname": "smithi039", 2023-05-16T13:55:35.326 INFO:teuthology.orchestra.run.smithi039.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-05-16T13:55:35.326 INFO:teuthology.orchestra.run.smithi039.stdout: "pid": "47263", 2023-05-16T13:55:35.327 INFO:teuthology.orchestra.run.smithi039.stdout: "root": "/" 2023-05-16T13:55:35.327 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-05-16T13:55:35.327 INFO:teuthology.orchestra.run.smithi039.stdout: "dentry_count": 0, 2023-05-16T13:55:35.327 INFO:teuthology.orchestra.run.smithi039.stdout: "dentry_pinned_count": 0, 2023-05-16T13:55:35.327 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 5589, 2023-05-16T13:55:35.327 INFO:teuthology.orchestra.run.smithi039.stdout: "inst": { 2023-05-16T13:55:35.327 INFO:teuthology.orchestra.run.smithi039.stdout: "name": { 2023-05-16T13:55:35.328 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "client", 2023-05-16T13:55:35.328 INFO:teuthology.orchestra.run.smithi039.stdout: "num": 5589 2023-05-16T13:55:35.328 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-05-16T13:55:35.328 INFO:teuthology.orchestra.run.smithi039.stdout: "addr": { 2023-05-16T13:55:35.328 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "v1", 2023-05-16T13:55:35.328 INFO:teuthology.orchestra.run.smithi039.stdout: "addr": "192.168.0.1:0", 2023-05-16T13:55:35.328 INFO:teuthology.orchestra.run.smithi039.stdout: "nonce": 3321204679 2023-05-16T13:55:35.329 INFO:teuthology.orchestra.run.smithi039.stdout: } 2023-05-16T13:55:35.329 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-05-16T13:55:35.329 INFO:teuthology.orchestra.run.smithi039.stdout: "addr": { 2023-05-16T13:55:35.329 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "v1", 2023-05-16T13:55:35.329 INFO:teuthology.orchestra.run.smithi039.stdout: "addr": "192.168.0.1:0", 2023-05-16T13:55:35.329 INFO:teuthology.orchestra.run.smithi039.stdout: "nonce": 3321204679 2023-05-16T13:55:35.329 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2023-05-16T13:55:35.329 INFO:teuthology.orchestra.run.smithi039.stdout: "inst_str": "client.5589 192.168.0.1:0/3321204679", 2023-05-16T13:55:35.330 INFO:teuthology.orchestra.run.smithi039.stdout: "addr_str": "192.168.0.1:0/3321204679", 2023-05-16T13:55:35.330 INFO:teuthology.orchestra.run.smithi039.stdout: "inode_count": 1, 2023-05-16T13:55:35.330 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_epoch": 15, 2023-05-16T13:55:35.330 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_epoch": 38, 2023-05-16T13:55:35.330 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_epoch_barrier": 0, 2023-05-16T13:55:35.330 INFO:teuthology.orchestra.run.smithi039.stdout: "blocklisted": false, 2023-05-16T13:55:35.330 INFO:teuthology.orchestra.run.smithi039.stdout: "fs_name": "cephfs" 2023-05-16T13:55:35.330 INFO:teuthology.orchestra.run.smithi039.stdout:} 2023-05-16T13:55:35.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:55:35.340 DEBUG:teuthology.orchestra.run.smithi039:> stat --file-system '--printf=%T 2023-05-16T13:55:35.340 DEBUG:teuthology.orchestra.run.smithi039:> ' -- /home/ubuntu/cephtest/mnt.0 2023-05-16T13:55:35.349 INFO:teuthology.orchestra.run.smithi039.stdout:fuseblk 2023-05-16T13:55:35.349 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-05-16T13:55:35.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:55:35.350 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-05-16T13:55:35.415 DEBUG:teuthology.orchestra.run.smithi039:> mktemp -d --suffix=xfstests-dev 2023-05-16T13:55:35.463 INFO:teuthology.orchestra.run.smithi039.stdout:/tmp/tmp.lZk1FbzUP3xfstests-dev 2023-05-16T13:55:35.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:55:35.464 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.lZk1FbzUP3xfstests-dev) 2023-05-16T13:55:35.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:55:35.525 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.lZk1FbzUP3xfstests-dev) 2023-05-16T13:55:35.581 INFO:teuthology.orchestra.run.smithi039.stderr:Cloning into '/tmp/tmp.lZk1FbzUP3xfstests-dev'... 2023-05-16T13:55:36.234 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T13:55:36.238 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T13:55:36.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:55:36.474 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-05-16T13:55:36.489 DEBUG:teuthology.orchestra.run.smithi039:> mktemp -d --suffix=test 2023-05-16T13:55:36.544 INFO:teuthology.orchestra.run.smithi039.stdout:/tmp/tmp.Hue5pMxMSztest 2023-05-16T13:55:36.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:55:36.545 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-05-16T13:55:36.600 DEBUG:teuthology.orchestra.run.smithi039:> mktemp -d --suffix=scratch 2023-05-16T13:55:36.647 INFO:teuthology.orchestra.run.smithi039.stdout:/tmp/tmp.72TDYBUBjWscratch 2023-05-16T13:55:36.648 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "ubuntu" and "22.04". 2023-05-16T13:55:36.648 DEBUG:teuthology.orchestra.run.smithi039:> sudo apt-get install -y xfslibs-dev uuid-dev libtool-bin e2fsprogs automake gcc libuuid1 quota attr libattr1-dev make libacl1-dev libaio-dev xfsprogs libgdbm-dev gawk fio dbench uuid-runtime python2 sqlite3 2023-05-16T13:55:36.765 INFO:teuthology.orchestra.run.smithi039.stdout:Reading package lists... 2023-05-16T13:55:36.925 INFO:teuthology.orchestra.run.smithi039.stdout:Building dependency tree... 2023-05-16T13:55:36.925 INFO:teuthology.orchestra.run.smithi039.stdout:Reading state information... 2023-05-16T13:55:37.069 INFO:teuthology.orchestra.run.smithi039.stdout:attr is already the newest version (1:2.5.1-1build1). 2023-05-16T13:55:37.070 INFO:teuthology.orchestra.run.smithi039.stdout:automake is already the newest version (1:1.16.5-1.3). 2023-05-16T13:55:37.070 INFO:teuthology.orchestra.run.smithi039.stdout:gawk is already the newest version (1:5.1.0-1build3). 2023-05-16T13:55:37.070 INFO:teuthology.orchestra.run.smithi039.stdout:gcc is already the newest version (4:11.2.0-1ubuntu1). 2023-05-16T13:55:37.070 INFO:teuthology.orchestra.run.smithi039.stdout:gcc set to manually installed. 2023-05-16T13:55:37.070 INFO:teuthology.orchestra.run.smithi039.stdout:libacl1-dev is already the newest version (2.3.1-1). 2023-05-16T13:55:37.070 INFO:teuthology.orchestra.run.smithi039.stdout:libaio-dev is already the newest version (0.3.112-13build1). 2023-05-16T13:55:37.071 INFO:teuthology.orchestra.run.smithi039.stdout:libattr1-dev is already the newest version (1:2.5.1-1build1). 2023-05-16T13:55:37.071 INFO:teuthology.orchestra.run.smithi039.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-05-16T13:55:37.071 INFO:teuthology.orchestra.run.smithi039.stdout:libuuid1 is already the newest version (2.37.2-4ubuntu3). 2023-05-16T13:55:37.071 INFO:teuthology.orchestra.run.smithi039.stdout:make is already the newest version (4.3-4.1build1). 2023-05-16T13:55:37.071 INFO:teuthology.orchestra.run.smithi039.stdout:make set to manually installed. 2023-05-16T13:55:37.071 INFO:teuthology.orchestra.run.smithi039.stdout:quota is already the newest version (4.06-1build2). 2023-05-16T13:55:37.071 INFO:teuthology.orchestra.run.smithi039.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-05-16T13:55:37.071 INFO:teuthology.orchestra.run.smithi039.stdout:uuid-runtime is already the newest version (2.37.2-4ubuntu3). 2023-05-16T13:55:37.072 INFO:teuthology.orchestra.run.smithi039.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-05-16T13:55:37.072 INFO:teuthology.orchestra.run.smithi039.stdout:xfsprogs is already the newest version (5.13.0-1ubuntu2). 2023-05-16T13:55:37.072 INFO:teuthology.orchestra.run.smithi039.stdout:dbench is already the newest version (4.0-2build1). 2023-05-16T13:55:37.072 INFO:teuthology.orchestra.run.smithi039.stdout:python2 is already the newest version (2.7.18-3). 2023-05-16T13:55:37.072 INFO:teuthology.orchestra.run.smithi039.stdout:python2 set to manually installed. 2023-05-16T13:55:37.072 INFO:teuthology.orchestra.run.smithi039.stdout:e2fsprogs is already the newest version (1.46.5-2ubuntu1.1). 2023-05-16T13:55:37.072 INFO:teuthology.orchestra.run.smithi039.stdout:The following packages were automatically installed and are no longer required: 2023-05-16T13:55:37.072 INFO:teuthology.orchestra.run.smithi039.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libiscsi7 libpmemobj1 2023-05-16T13:55:37.073 INFO:teuthology.orchestra.run.smithi039.stdout: libpython2-dev libpython2.7 libpython2.7-dev linux-image-5.4.0-135-generic 2023-05-16T13:55:37.073 INFO:teuthology.orchestra.run.smithi039.stdout: linux-modules-5.4.0-135-generic python2-dev python2.7-dev 2023-05-16T13:55:37.073 INFO:teuthology.orchestra.run.smithi039.stdout:Use 'sudo apt autoremove' to remove them. 2023-05-16T13:55:37.074 INFO:teuthology.orchestra.run.smithi039.stdout:The following additional packages will be installed: 2023-05-16T13:55:37.074 INFO:teuthology.orchestra.run.smithi039.stdout: libpmemblk1 2023-05-16T13:55:37.074 INFO:teuthology.orchestra.run.smithi039.stdout:Suggested packages: 2023-05-16T13:55:37.074 INFO:teuthology.orchestra.run.smithi039.stdout: gnuplot gfio python-scipy sqlite3-doc 2023-05-16T13:55:37.104 INFO:teuthology.orchestra.run.smithi039.stdout:The following NEW packages will be installed: 2023-05-16T13:55:37.105 INFO:teuthology.orchestra.run.smithi039.stdout: fio libgdbm-dev libpmemblk1 sqlite3 2023-05-16T13:55:37.242 INFO:teuthology.orchestra.run.smithi039.stdout:0 upgraded, 4 newly installed, 0 to remove and 144 not upgraded. 2023-05-16T13:55:37.242 INFO:teuthology.orchestra.run.smithi039.stdout:Need to get 4,997 kB of archives. 2023-05-16T13:55:37.242 INFO:teuthology.orchestra.run.smithi039.stdout:After this operation, 9,949 kB of additional disk space will be used. 2023-05-16T13:55:37.242 INFO:teuthology.orchestra.run.smithi039.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libpmemblk1 amd64 1.11.1-3build1 [65.6 kB] 2023-05-16T13:55:37.302 INFO:teuthology.orchestra.run.smithi039.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 fio amd64 3.28-1 [4,047 kB] 2023-05-16T13:55:37.412 INFO:teuthology.orchestra.run.smithi039.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 libgdbm-dev amd64 1.23-1 [117 kB] 2023-05-16T13:55:37.414 INFO:teuthology.orchestra.run.smithi039.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 sqlite3 amd64 3.37.2-2ubuntu0.1 [768 kB] 2023-05-16T13:55:37.687 INFO:teuthology.orchestra.run.smithi039.stderr:debconf: unable to initialize frontend: Dialog 2023-05-16T13:55:37.687 INFO:teuthology.orchestra.run.smithi039.stderr:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2023-05-16T13:55:37.687 INFO:teuthology.orchestra.run.smithi039.stderr:debconf: falling back to frontend: Readline 2023-05-16T13:55:37.702 INFO:teuthology.orchestra.run.smithi039.stderr:debconf: unable to initialize frontend: Readline 2023-05-16T13:55:37.702 INFO:teuthology.orchestra.run.smithi039.stderr:debconf: (This frontend requires a controlling tty.) 2023-05-16T13:55:37.702 INFO:teuthology.orchestra.run.smithi039.stderr:debconf: falling back to frontend: Teletype 2023-05-16T13:55:37.710 INFO:teuthology.orchestra.run.smithi039.stderr:dpkg-preconfigure: unable to re-open stdin: 2023-05-16T13:55:37.749 INFO:teuthology.orchestra.run.smithi039.stdout:Fetched 4,997 kB in 0s (16.1 MB/s) 2023-05-16T13:55:38.048 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libpmemblk1:amd64. 2023-05-16T13:55:38.125 INFO:teuthology.orchestra.run.smithi039.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 142706 files and directories currently installed.) 2023-05-16T13:55:38.129 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../libpmemblk1_1.11.1-3build1_amd64.deb ... 2023-05-16T13:55:38.214 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libpmemblk1:amd64 (1.11.1-3build1) ... 2023-05-16T13:55:38.509 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package fio. 2023-05-16T13:55:38.522 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../archives/fio_3.28-1_amd64.deb ... 2023-05-16T13:55:38.551 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking fio (3.28-1) ... 2023-05-16T13:55:38.955 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libgdbm-dev:amd64. 2023-05-16T13:55:38.968 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../libgdbm-dev_1.23-1_amd64.deb ... 2023-05-16T13:55:39.005 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libgdbm-dev:amd64 (1.23-1) ... 2023-05-16T13:55:39.334 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package sqlite3. 2023-05-16T13:55:39.347 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../sqlite3_3.37.2-2ubuntu0.1_amd64.deb ... 2023-05-16T13:55:39.392 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking sqlite3 (3.37.2-2ubuntu0.1) ... 2023-05-16T13:55:39.797 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libpmemblk1:amd64 (1.11.1-3build1) ... 2023-05-16T13:55:39.912 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libgdbm-dev:amd64 (1.23-1) ... 2023-05-16T13:55:40.013 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up sqlite3 (3.37.2-2ubuntu0.1) ... 2023-05-16T13:55:40.139 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up fio (3.28-1) ... 2023-05-16T13:55:40.759 INFO:teuthology.orchestra.run.smithi039.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-05-16T13:55:40.910 INFO:teuthology.orchestra.run.smithi039.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-05-16T13:55:42.146 INFO:teuthology.orchestra.run.smithi039.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-05-16T13:55:42.685 DEBUG:teuthology.orchestra.run.smithi039:> sudo useradd -m fsgqa 2023-05-16T13:55:42.703 INFO:teuthology.orchestra.run.smithi039.stderr:useradd: user 'fsgqa' already exists 2023-05-16T13:55:42.705 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-05-16T13:55:42.705 DEBUG:teuthology.orchestra.run.smithi039:> sudo groupadd fsgqa 2023-05-16T13:55:42.769 INFO:teuthology.orchestra.run.smithi039.stderr:groupadd: group 'fsgqa' already exists 2023-05-16T13:55:42.770 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-05-16T13:55:42.771 DEBUG:teuthology.orchestra.run.smithi039:> sudo useradd fsgqa2 2023-05-16T13:55:43.217 DEBUG:teuthology.orchestra.run.smithi039:> sudo useradd 123456-fsgqa 2023-05-16T13:55:43.612 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-05-16T13:55:43.753 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.747+0000 7fbdbda04640 1 Processor -- start 2023-05-16T13:55:43.753 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.747+0000 7fbdbda04640 1 -- start start 2023-05-16T13:55:43.754 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.747+0000 7fbdbda04640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbdb815bd50 0x7fbdb806c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:43.754 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.747+0000 7fbdbda04640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbdb806b770 0x7fbdb8160310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:43.754 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.747+0000 7fbdbda04640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fbdb80cf5a0 0x7fbdb80cfa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:43.754 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.747+0000 7fbdbda04640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdb806bba0 con 0x7fbdb80cf5a0 2023-05-16T13:55:43.754 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.747+0000 7fbdbda04640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdb8160850 con 0x7fbdb806b770 2023-05-16T13:55:43.755 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.747+0000 7fbdbda04640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb806cb70 con 0x7fbdb815bd50 2023-05-16T13:55:43.755 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.747+0000 7fbdb77fe640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fbdb80cf5a0 0x7fbdb80cfa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:43.755 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.747+0000 7fbdb77fe640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fbdb80cf5a0 0x7fbdb80cfa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:52522/0 (socket says 172.21.15.39:52522) 2023-05-16T13:55:43.756 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.747+0000 7fbdb77fe640 1 -- 172.21.15.39:0/1640516664 learned_addr learned my addr 172.21.15.39:0/1640516664 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:43.756 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.747+0000 7fbdb6ffd640 1 --2- 172.21.15.39:0/1640516664 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbdb815bd50 0x7fbdb806c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:43.756 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.747+0000 7fbdaffff640 1 --2- 172.21.15.39:0/1640516664 >> v2:172.21.15.118:3300/0 conn(0x7fbdb806b770 0x7fbdb8160310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:43.756 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.747+0000 7fbdb77fe640 1 -- 172.21.15.39:0/1640516664 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbdb815bd50 msgr2=0x7fbdb806c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:43.756 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.747+0000 7fbdb77fe640 1 --2- 172.21.15.39:0/1640516664 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbdb815bd50 0x7fbdb806c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:43.756 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.747+0000 7fbdb77fe640 1 -- 172.21.15.39:0/1640516664 >> v2:172.21.15.118:3300/0 conn(0x7fbdb806b770 msgr2=0x7fbdb8160310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:43.757 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.747+0000 7fbdb77fe640 1 --2- 172.21.15.39:0/1640516664 >> v2:172.21.15.118:3300/0 conn(0x7fbdb806b770 0x7fbdb8160310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:43.757 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.747+0000 7fbdb77fe640 1 -- 172.21.15.39:0/1640516664 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdb806c890 con 0x7fbdb80cf5a0 2023-05-16T13:55:43.757 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.751+0000 7fbdb77fe640 1 --2- 172.21.15.39:0/1640516664 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbdb80cf5a0 0x7fbdb80cfa20 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fbdb80cdf70 tx=0x7fbdb001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc58b6bdd72be1e7 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:43.758 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.751+0000 7fbdb67fc640 1 -- 172.21.15.39:0/1640516664 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb00a5820 con 0x7fbdb80cf5a0 2023-05-16T13:55:43.758 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.751+0000 7fbdb67fc640 1 -- 172.21.15.39:0/1640516664 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdb00a5980 con 0x7fbdb80cf5a0 2023-05-16T13:55:43.758 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.751+0000 7fbdb67fc640 1 -- 172.21.15.39:0/1640516664 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb00a5d10 con 0x7fbdb80cf5a0 2023-05-16T13:55:43.759 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.751+0000 7fbdbda04640 1 -- 172.21.15.39:0/1640516664 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbdb80cf5a0 msgr2=0x7fbdb80cfa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:43.759 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.751+0000 7fbdbda04640 1 --2- 172.21.15.39:0/1640516664 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbdb80cf5a0 0x7fbdb80cfa20 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fbdb80cdf70 tx=0x7fbdb001c9a0 comp rx=0 tx=0).stop 2023-05-16T13:55:43.759 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.751+0000 7fbdbda04640 1 -- 172.21.15.39:0/1640516664 shutdown_connections 2023-05-16T13:55:43.759 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.751+0000 7fbdbda04640 1 --2- 172.21.15.39:0/1640516664 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbdb80cf5a0 0x7fbdb80cfa20 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:43.760 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.751+0000 7fbdbda04640 1 --2- 172.21.15.39:0/1640516664 >> v2:172.21.15.118:3300/0 conn(0x7fbdb806b770 0x7fbdb8160310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:43.760 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.751+0000 7fbdbda04640 1 --2- 172.21.15.39:0/1640516664 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbdb815bd50 0x7fbdb806c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:43.760 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.751+0000 7fbdbda04640 1 -- 172.21.15.39:0/1640516664 >> 172.21.15.39:0/1640516664 conn(0x7fbdb806dcf0 msgr2=0x7fbdb806e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:43.760 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.751+0000 7fbdbda04640 1 -- 172.21.15.39:0/1640516664 shutdown_connections 2023-05-16T13:55:43.760 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.751+0000 7fbdbda04640 1 -- 172.21.15.39:0/1640516664 wait complete. 2023-05-16T13:55:43.761 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.751+0000 7fbdbda04640 1 Processor -- start 2023-05-16T13:55:43.761 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.751+0000 7fbdbda04640 1 -- start start 2023-05-16T13:55:43.762 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.755+0000 7fbdbda04640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbdb806b770 0x7fbdb80c3de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:43.762 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.755+0000 7fbdbda04640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbdb80cf5a0 0x7fbdb8148990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:43.762 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.755+0000 7fbdbda04640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbdb815bd50 0x7fbdb8149230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:43.762 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.755+0000 7fbdbda04640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb814ab40 con 0x7fbdb80cf5a0 2023-05-16T13:55:43.762 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.755+0000 7fbdbda04640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb814eac0 con 0x7fbdb806b770 2023-05-16T13:55:43.762 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.755+0000 7fbdbda04640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb80c4430 con 0x7fbdb815bd50 2023-05-16T13:55:43.763 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.755+0000 7fbdaffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbdb80cf5a0 0x7fbdb8148990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:43.763 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.755+0000 7fbdaffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbdb80cf5a0 0x7fbdb8148990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:52526/0 (socket says 172.21.15.39:52526) 2023-05-16T13:55:43.763 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.755+0000 7fbdaffff640 1 -- 172.21.15.39:0/4154111986 learned_addr learned my addr 172.21.15.39:0/4154111986 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:43.763 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.755+0000 7fbdb6ffd640 1 --2- 172.21.15.39:0/4154111986 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbdb806b770 0x7fbdb80c3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:43.763 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.755+0000 7fbdb77fe640 1 --2- 172.21.15.39:0/4154111986 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbdb815bd50 0x7fbdb8149230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:43.764 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.755+0000 7fbdaffff640 1 -- 172.21.15.39:0/4154111986 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbdb815bd50 msgr2=0x7fbdb8149230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:43.764 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.755+0000 7fbdaffff640 1 --2- 172.21.15.39:0/4154111986 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbdb815bd50 0x7fbdb8149230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:43.764 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.755+0000 7fbdaffff640 1 -- 172.21.15.39:0/4154111986 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbdb806b770 msgr2=0x7fbdb80c3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:43.764 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.755+0000 7fbdaffff640 1 --2- 172.21.15.39:0/4154111986 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbdb806b770 0x7fbdb80c3de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:43.765 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.755+0000 7fbdaffff640 1 -- 172.21.15.39:0/4154111986 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdb0009b30 con 0x7fbdb80cf5a0 2023-05-16T13:55:43.765 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.755+0000 7fbdaffff640 1 --2- 172.21.15.39:0/4154111986 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbdb80cf5a0 0x7fbdb8148990 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fbda000e8a0 tx=0x7fbda000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:43.765 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.755+0000 7fbdb4ff9640 1 -- 172.21.15.39:0/4154111986 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda0009510 con 0x7fbdb80cf5a0 2023-05-16T13:55:43.765 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.755+0000 7fbdb4ff9640 1 -- 172.21.15.39:0/4154111986 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda000c940 con 0x7fbdb80cf5a0 2023-05-16T13:55:43.765 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.755+0000 7fbdb4ff9640 1 -- 172.21.15.39:0/4154111986 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda000ccb0 con 0x7fbdb80cf5a0 2023-05-16T13:55:43.765 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.755+0000 7fbdbda04640 1 -- 172.21.15.39:0/4154111986 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdb80cff60 con 0x7fbdb80cf5a0 2023-05-16T13:55:43.765 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.755+0000 7fbdbda04640 1 -- 172.21.15.39:0/4154111986 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdb806b250 con 0x7fbdb80cf5a0 2023-05-16T13:55:43.766 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.755+0000 7fbdbda04640 1 -- 172.21.15.39:0/4154111986 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdb815c120 con 0x7fbdb80cf5a0 2023-05-16T13:55:43.766 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.759+0000 7fbdb4ff9640 1 -- 172.21.15.39:0/4154111986 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbda0013470 con 0x7fbdb80cf5a0 2023-05-16T13:55:43.766 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.759+0000 7fbdb4ff9640 1 --2- 172.21.15.39:0/4154111986 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fbd98066280 0x7fbd98068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:43.767 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.759+0000 7fbdb4ff9640 1 -- 172.21.15.39:0/4154111986 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbda00841b0 con 0x7fbdb80cf5a0 2023-05-16T13:55:43.767 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.759+0000 7fbdb6ffd640 1 --2- 172.21.15.39:0/4154111986 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fbd98066280 0x7fbd98068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:43.767 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.759+0000 7fbdb6ffd640 1 --2- 172.21.15.39:0/4154111986 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fbd98066280 0x7fbd98068730 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fbda8009ae0 tx=0x7fbda8009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:43.770 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.763+0000 7fbdb4ff9640 1 -- 172.21.15.39:0/4154111986 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fbda0051640 con 0x7fbdb80cf5a0 2023-05-16T13:55:43.983 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.975+0000 7fbdbda04640 1 -- 172.21.15.39:0/4154111986 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fbdb804ed20 con 0x7fbdb80cf5a0 2023-05-16T13:55:43.984 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.975+0000 7fbdb4ff9640 1 -- 172.21.15.39:0/4154111986 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1276 (secure 0 0 0) 0x7fbda0054c60 con 0x7fbdb80cf5a0 2023-05-16T13:55:43.984 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:55:43.985 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":1,"fsid":"9c1e210b-c515-4ea4-a065-397956895c68","modified":"2023-05-16T13:53:07.713823Z","created":"2023-05-16T13:53:07.713823Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:3300","nonce":0},{"type":"v1","addr":"172.21.15.39:6789","nonce":0}]},"addr":"172.21.15.39:6789/0","public_addr":"172.21.15.39:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:3300","nonce":0},{"type":"v1","addr":"172.21.15.118:6789","nonce":0}]},"addr":"172.21.15.118:6789/0","public_addr":"172.21.15.118:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:3301","nonce":0},{"type":"v1","addr":"172.21.15.118:6790","nonce":0}]},"addr":"172.21.15.118:6790/0","public_addr":"172.21.15.118:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-05-16T13:55:43.985 INFO:teuthology.orchestra.run.smithi039.stderr:dumped monmap epoch 1 2023-05-16T13:55:43.986 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.979+0000 7fbdbda04640 1 -- 172.21.15.39:0/4154111986 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fbd98066280 msgr2=0x7fbd98068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:43.986 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.979+0000 7fbdbda04640 1 --2- 172.21.15.39:0/4154111986 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fbd98066280 0x7fbd98068730 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fbda8009ae0 tx=0x7fbda8009190 comp rx=0 tx=0).stop 2023-05-16T13:55:43.986 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.979+0000 7fbdbda04640 1 -- 172.21.15.39:0/4154111986 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbdb80cf5a0 msgr2=0x7fbdb8148990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:43.986 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.979+0000 7fbdbda04640 1 --2- 172.21.15.39:0/4154111986 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbdb80cf5a0 0x7fbdb8148990 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fbda000e8a0 tx=0x7fbda000eca0 comp rx=0 tx=0).stop 2023-05-16T13:55:43.986 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.979+0000 7fbdbda04640 1 -- 172.21.15.39:0/4154111986 shutdown_connections 2023-05-16T13:55:43.986 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.979+0000 7fbdbda04640 1 --2- 172.21.15.39:0/4154111986 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fbd98066280 0x7fbd98068730 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:43.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.979+0000 7fbdbda04640 1 --2- 172.21.15.39:0/4154111986 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbdb815bd50 0x7fbdb8149230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:43.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.979+0000 7fbdbda04640 1 --2- 172.21.15.39:0/4154111986 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbdb80cf5a0 0x7fbdb8148990 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:43.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.979+0000 7fbdbda04640 1 --2- 172.21.15.39:0/4154111986 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbdb806b770 0x7fbdb80c3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:43.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.979+0000 7fbdbda04640 1 -- 172.21.15.39:0/4154111986 >> 172.21.15.39:0/4154111986 conn(0x7fbdb806dcf0 msgr2=0x7fbdb80b27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:43.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.979+0000 7fbdbda04640 1 -- 172.21.15.39:0/4154111986 shutdown_connections 2023-05-16T13:55:43.987 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:43.979+0000 7fbdbda04640 1 -- 172.21.15.39:0/4154111986 wait complete. 2023-05-16T13:55:44.005 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.admin 2023-05-16T13:55:44.143 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.135+0000 7fa174139640 1 Processor -- start 2023-05-16T13:55:44.144 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.135+0000 7fa174139640 1 -- start start 2023-05-16T13:55:44.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.139+0000 7fa174139640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fa16c0aff00 0x7fa16c0cc380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:44.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.139+0000 7fa174139640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa16c161210 0x7fa16c0caf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:44.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.139+0000 7fa174139640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa16c0ca550 con 0x7fa16c0cde70 2023-05-16T13:55:44.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.139+0000 7fa174139640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa16c0ca050 con 0x7fa16c0aff00 2023-05-16T13:55:44.145 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.139+0000 7fa174139640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa16c06c7f0 con 0x7fa16c161210 2023-05-16T13:55:44.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.139+0000 7fa171ed5640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fa16c0aff00 0x7fa16c0cc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:44.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.139+0000 7fa171ed5640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fa16c0aff00 0x7fa16c0cc380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:52542/0 (socket says 172.21.15.39:52542) 2023-05-16T13:55:44.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.139+0000 7fa171ed5640 1 -- 172.21.15.39:0/1359467212 learned_addr learned my addr 172.21.15.39:0/1359467212 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:44.146 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.139+0000 7fa171ed5640 1 -- 172.21.15.39:0/1359467212 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa16c161210 msgr2=0x7fa16c0caf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-16T13:55:44.147 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.139+0000 7fa1726d6640 1 --2- 172.21.15.39:0/1359467212 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa16c161210 0x7fa16c0caf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:44.147 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.139+0000 7fa171ed5640 1 --2- 172.21.15.39:0/1359467212 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa16c161210 0x7fa16c0caf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:44.147 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.139+0000 7fa171ed5640 1 -- 172.21.15.39:0/1359467212 >> v1:172.21.15.39:6789/0 conn(0x7fa16c0cde70 legacy=0x7fa16c0b02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:44.147 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.139+0000 7fa170ed3640 1 -- 172.21.15.39:0/1359467212 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2314792082 0 0) 0x7fa16c0ca550 con 0x7fa16c0cde70 2023-05-16T13:55:44.147 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.139+0000 7fa171ed5640 1 -- 172.21.15.39:0/1359467212 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa16c0c9050 con 0x7fa16c0aff00 2023-05-16T13:55:44.147 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.139+0000 7fa1726d6640 1 --2- 172.21.15.39:0/1359467212 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa16c161210 0x7fa16c0caf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-16T13:55:44.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.139+0000 7fa171ed5640 1 --2- 172.21.15.39:0/1359467212 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa16c0aff00 0x7fa16c0cc380 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fa1680098a0 tx=0x7fa16801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61b8f093e292b19e server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:44.148 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.139+0000 7fa170ed3640 1 -- 172.21.15.39:0/1359467212 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1680ab600 con 0x7fa16c0aff00 2023-05-16T13:55:44.149 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.139+0000 7fa170ed3640 1 -- 172.21.15.39:0/1359467212 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1680a7050 con 0x7fa16c0aff00 2023-05-16T13:55:44.149 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.139+0000 7fa170ed3640 1 -- 172.21.15.39:0/1359467212 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1680ab980 con 0x7fa16c0aff00 2023-05-16T13:55:44.149 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.143+0000 7fa174139640 1 -- 172.21.15.39:0/1359467212 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa16c0aff00 msgr2=0x7fa16c0cc380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:44.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.143+0000 7fa174139640 1 --2- 172.21.15.39:0/1359467212 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa16c0aff00 0x7fa16c0cc380 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fa1680098a0 tx=0x7fa16801c520 comp rx=0 tx=0).stop 2023-05-16T13:55:44.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.143+0000 7fa174139640 1 -- 172.21.15.39:0/1359467212 shutdown_connections 2023-05-16T13:55:44.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.143+0000 7fa174139640 1 --2- 172.21.15.39:0/1359467212 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa16c161210 0x7fa16c0caf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:44.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.143+0000 7fa174139640 1 --2- 172.21.15.39:0/1359467212 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa16c0aff00 0x7fa16c0cc380 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:44.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.143+0000 7fa174139640 1 -- 172.21.15.39:0/1359467212 >> 172.21.15.39:0/1359467212 conn(0x7fa16c069a50 msgr2=0x7fa16c069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:44.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.143+0000 7fa174139640 1 -- 172.21.15.39:0/1359467212 shutdown_connections 2023-05-16T13:55:44.150 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.143+0000 7fa174139640 1 -- 172.21.15.39:0/1359467212 wait complete. 2023-05-16T13:55:44.152 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.143+0000 7fa174139640 1 Processor -- start 2023-05-16T13:55:44.152 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.143+0000 7fa174139640 1 -- start start 2023-05-16T13:55:44.152 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.143+0000 7fa174139640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa16c0aff00 0x7fa16c0c6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:44.153 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.143+0000 7fa174139640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa16c0cde70 0x7fa16c153990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:44.153 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.143+0000 7fa174139640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa16c161210 0x7fa16c151c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:44.153 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.143+0000 7fa174139640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa16c153500 con 0x7fa16c0aff00 2023-05-16T13:55:44.153 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.143+0000 7fa174139640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa16c1528f0 con 0x7fa16c161210 2023-05-16T13:55:44.153 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.143+0000 7fa174139640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa16c152bd0 con 0x7fa16c0cde70 2023-05-16T13:55:44.153 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.143+0000 7fa171ed5640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa16c0aff00 0x7fa16c0c6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:44.153 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.143+0000 7fa171ed5640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa16c0aff00 0x7fa16c0c6980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:52548/0 (socket says 172.21.15.39:52548) 2023-05-16T13:55:44.154 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.143+0000 7fa171ed5640 1 -- 172.21.15.39:0/484542967 learned_addr learned my addr 172.21.15.39:0/484542967 (peer_addr_for_me v2:172.21.15.39:0/0) 2023-05-16T13:55:44.154 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.143+0000 7fa1726d6640 1 --2- 172.21.15.39:0/484542967 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa16c161210 0x7fa16c151c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:44.154 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.143+0000 7fa1716d4640 1 --2- 172.21.15.39:0/484542967 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa16c0cde70 0x7fa16c153990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:44.154 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.143+0000 7fa171ed5640 1 -- 172.21.15.39:0/484542967 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa16c0cde70 msgr2=0x7fa16c153990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:44.154 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.143+0000 7fa171ed5640 1 --2- 172.21.15.39:0/484542967 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa16c0cde70 0x7fa16c153990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:44.154 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.143+0000 7fa171ed5640 1 -- 172.21.15.39:0/484542967 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa16c161210 msgr2=0x7fa16c151c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:44.154 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.143+0000 7fa171ed5640 1 --2- 172.21.15.39:0/484542967 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa16c161210 0x7fa16c151c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:44.155 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.143+0000 7fa171ed5640 1 -- 172.21.15.39:0/484542967 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1680094d0 con 0x7fa16c0aff00 2023-05-16T13:55:44.155 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.143+0000 7fa1716d4640 1 --2- 172.21.15.39:0/484542967 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa16c0cde70 0x7fa16c153990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-16T13:55:44.155 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.143+0000 7fa1726d6640 1 --2- 172.21.15.39:0/484542967 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa16c161210 0x7fa16c151c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-16T13:55:44.156 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.147+0000 7fa171ed5640 1 --2- 172.21.15.39:0/484542967 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa16c0aff00 0x7fa16c0c6980 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fa16801a150 tx=0x7fa16801ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:44.156 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.147+0000 7fa1627fc640 1 -- 172.21.15.39:0/484542967 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa168004220 con 0x7fa16c0aff00 2023-05-16T13:55:44.156 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.147+0000 7fa1627fc640 1 -- 172.21.15.39:0/484542967 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa168004380 con 0x7fa16c0aff00 2023-05-16T13:55:44.156 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.147+0000 7fa1627fc640 1 -- 172.21.15.39:0/484542967 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa168003840 con 0x7fa16c0aff00 2023-05-16T13:55:44.156 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.147+0000 7fa174139640 1 -- 172.21.15.39:0/484542967 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa16c0c8ad0 con 0x7fa16c0aff00 2023-05-16T13:55:44.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.147+0000 7fa174139640 1 -- 172.21.15.39:0/484542967 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa16c161a20 con 0x7fa16c0aff00 2023-05-16T13:55:44.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.147+0000 7fa174139640 1 -- 172.21.15.39:0/484542967 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa16c16d480 con 0x7fa16c0aff00 2023-05-16T13:55:44.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.147+0000 7fa1627fc640 1 -- 172.21.15.39:0/484542967 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa1680b2050 con 0x7fa16c0aff00 2023-05-16T13:55:44.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.147+0000 7fa1627fc640 1 --2- 172.21.15.39:0/484542967 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fa150066280 0x7fa150068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-16T13:55:44.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.147+0000 7fa1627fc640 1 -- 172.21.15.39:0/484542967 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa16811e9f0 con 0x7fa16c0aff00 2023-05-16T13:55:44.157 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.147+0000 7fa1716d4640 1 --2- 172.21.15.39:0/484542967 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fa150066280 0x7fa150068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-16T13:55:44.158 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.151+0000 7fa1716d4640 1 --2- 172.21.15.39:0/484542967 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fa150066280 0x7fa150068730 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa16c0b24d0 tx=0x7fa15c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-16T13:55:44.158 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.151+0000 7fa1627fc640 1 -- 172.21.15.39:0/484542967 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169682 (secure 0 0 0) 0x7fa1680ebee0 con 0x7fa16c0aff00 2023-05-16T13:55:44.366 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.359+0000 7fa174139640 1 -- 172.21.15.39:0/484542967 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.admin"} v 0) v1 -- 0x7fa16c073c90 con 0x7fa16c0aff00 2023-05-16T13:55:44.367 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.359+0000 7fa1627fc640 1 -- 172.21.15.39:0/484542967 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.admin"}]=0 v9) v1 ==== 82+0+151 (secure 0 0 0) 0x7fa1680b0090 con 0x7fa16c0aff00 2023-05-16T13:55:44.367 INFO:teuthology.orchestra.run.smithi039.stdout:[client.admin] 2023-05-16T13:55:44.367 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQDDimNkGVCHNxAAY5W7pu9G6EdzHytSty0dWg== 2023-05-16T13:55:44.367 INFO:teuthology.orchestra.run.smithi039.stdout: caps mds = "allow *" 2023-05-16T13:55:44.367 INFO:teuthology.orchestra.run.smithi039.stdout: caps mgr = "allow *" 2023-05-16T13:55:44.368 INFO:teuthology.orchestra.run.smithi039.stdout: caps mon = "allow *" 2023-05-16T13:55:44.368 INFO:teuthology.orchestra.run.smithi039.stdout: caps osd = "allow *" 2023-05-16T13:55:44.368 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.359+0000 7fa174139640 1 -- 172.21.15.39:0/484542967 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fa150066280 msgr2=0x7fa150068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:44.369 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.359+0000 7fa174139640 1 --2- 172.21.15.39:0/484542967 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fa150066280 0x7fa150068730 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa16c0b24d0 tx=0x7fa15c009040 comp rx=0 tx=0).stop 2023-05-16T13:55:44.369 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.359+0000 7fa174139640 1 -- 172.21.15.39:0/484542967 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa16c0aff00 msgr2=0x7fa16c0c6980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-16T13:55:44.369 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.359+0000 7fa174139640 1 --2- 172.21.15.39:0/484542967 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa16c0aff00 0x7fa16c0c6980 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fa16801a150 tx=0x7fa16801ad60 comp rx=0 tx=0).stop 2023-05-16T13:55:44.369 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.359+0000 7fa174139640 1 -- 172.21.15.39:0/484542967 shutdown_connections 2023-05-16T13:55:44.369 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.359+0000 7fa174139640 1 --2- 172.21.15.39:0/484542967 >> [v2:172.21.15.39:6832/288296800,v1:172.21.15.39:6833/288296800] conn(0x7fa150066280 0x7fa150068730 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:44.369 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.359+0000 7fa174139640 1 --2- 172.21.15.39:0/484542967 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa16c0cde70 0x7fa16c153990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:44.370 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.359+0000 7fa174139640 1 --2- 172.21.15.39:0/484542967 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa16c161210 0x7fa16c151c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:44.370 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.359+0000 7fa174139640 1 --2- 172.21.15.39:0/484542967 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa16c0aff00 0x7fa16c0c6980 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-16T13:55:44.370 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.359+0000 7fa174139640 1 -- 172.21.15.39:0/484542967 >> 172.21.15.39:0/484542967 conn(0x7fa16c069a50 msgr2=0x7fa16c0ccc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-16T13:55:44.370 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.359+0000 7fa174139640 1 -- 172.21.15.39:0/484542967 shutdown_connections 2023-05-16T13:55:44.370 INFO:teuthology.orchestra.run.smithi039.stderr:2023-05-16T13:55:44.359+0000 7fa174139640 1 -- 172.21.15.39:0/484542967 wait complete. 2023-05-16T13:55:44.387 DEBUG:teuthology.orchestra.run.smithi039:> mktemp 2023-05-16T13:55:44.395 INFO:teuthology.orchestra.run.smithi039.stdout:/tmp/tmp.ogku6NbYyf 2023-05-16T13:55:44.395 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-05-16T13:55:44.396 DEBUG:teuthology.orchestra.run.smithi039:> dd of=/tmp/tmp.ogku6NbYyf 2023-05-16T13:55:44.448 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-05-16T13:55:44.448 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/tmp/tmp.lZk1FbzUP3xfstests-dev/local.config 2023-05-16T13:55:44.506 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph-fuse export CEPH_FUSE_BIN_PATH=ceph-fuse export TEST_DEV=ceph-fuse # without this tests won't get started export TEST_DIR=/tmp/tmp.Hue5pMxMSztest export SCRATCH_DEV= export SCRATCH_MNT=/tmp/tmp.72TDYBUBjWscratch export CEPHFS_MOUNT_OPTIONS="-m 172.21.15.39:6789 -k /tmp/tmp.ogku6NbYyf --client_mountpoint /test" 2023-05-16T13:55:44.506 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2023-05-16T13:55:44.507 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/tmp/tmp.lZk1FbzUP3xfstests-dev/ceph.exclude 2023-05-16T13:55:44.570 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.lZk1FbzUP3xfstests-dev && exec sudo make) 2023-05-16T13:55:44.639 INFO:teuthology.orchestra.run.smithi039.stdout:libtoolize -cfi 2023-05-16T13:55:44.965 INFO:teuthology.orchestra.run.smithi039.stdout:libtoolize: putting auxiliary files in '.'. 2023-05-16T13:55:44.965 INFO:teuthology.orchestra.run.smithi039.stdout:libtoolize: copying file './config.guess' 2023-05-16T13:55:44.974 INFO:teuthology.orchestra.run.smithi039.stdout:libtoolize: copying file './config.sub' 2023-05-16T13:55:44.990 INFO:teuthology.orchestra.run.smithi039.stdout:libtoolize: copying file './install-sh' 2023-05-16T13:55:45.001 INFO:teuthology.orchestra.run.smithi039.stdout:libtoolize: copying file './ltmain.sh' 2023-05-16T13:55:45.040 INFO:teuthology.orchestra.run.smithi039.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-05-16T13:55:45.040 INFO:teuthology.orchestra.run.smithi039.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-05-16T13:55:45.056 INFO:teuthology.orchestra.run.smithi039.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-05-16T13:55:45.077 INFO:teuthology.orchestra.run.smithi039.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-05-16T13:55:45.087 INFO:teuthology.orchestra.run.smithi039.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-05-16T13:55:45.096 INFO:teuthology.orchestra.run.smithi039.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-05-16T13:55:45.105 INFO:teuthology.orchestra.run.smithi039.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-05-16T13:55:45.107 INFO:teuthology.orchestra.run.smithi039.stdout:cp include/install-sh . 2023-05-16T13:55:45.109 INFO:teuthology.orchestra.run.smithi039.stdout:aclocal -I m4 2023-05-16T13:55:46.152 INFO:teuthology.orchestra.run.smithi039.stdout:autoheader 2023-05-16T13:55:46.522 INFO:teuthology.orchestra.run.smithi039.stdout:autoconf 2023-05-16T13:55:46.954 INFO:teuthology.orchestra.run.smithi039.stdout:./configure \ 2023-05-16T13:55:46.954 INFO:teuthology.orchestra.run.smithi039.stdout: --libexecdir=/usr/lib \ 2023-05-16T13:55:46.955 INFO:teuthology.orchestra.run.smithi039.stdout: --exec_prefix=/var/lib 2023-05-16T13:55:47.452 INFO:teuthology.orchestra.run.smithi039.stdout:checking build system type... x86_64-pc-linux-gnu 2023-05-16T13:55:47.452 INFO:teuthology.orchestra.run.smithi039.stdout:checking host system type... x86_64-pc-linux-gnu 2023-05-16T13:55:47.503 INFO:teuthology.orchestra.run.smithi039.stdout:checking how to print strings... printf 2023-05-16T13:55:47.503 INFO:teuthology.orchestra.run.smithi039.stdout:checking for gcc... gcc 2023-05-16T13:55:47.763 INFO:teuthology.orchestra.run.smithi039.stdout:checking whether the C compiler works... yes 2023-05-16T13:55:47.763 INFO:teuthology.orchestra.run.smithi039.stdout:checking for C compiler default output file name... a.out 2023-05-16T13:55:47.804 INFO:teuthology.orchestra.run.smithi039.stdout:checking for suffix of executables... 2023-05-16T13:55:47.888 INFO:teuthology.orchestra.run.smithi039.stdout:checking whether we are cross compiling... no 2023-05-16T13:55:47.913 INFO:teuthology.orchestra.run.smithi039.stdout:checking for suffix of object files... o 2023-05-16T13:55:47.935 INFO:teuthology.orchestra.run.smithi039.stdout:checking whether the compiler supports GNU C... yes 2023-05-16T13:55:47.959 INFO:teuthology.orchestra.run.smithi039.stdout:checking whether gcc accepts -g... yes 2023-05-16T13:55:48.092 INFO:teuthology.orchestra.run.smithi039.stdout:checking for gcc option to enable C11 features... none needed 2023-05-16T13:55:48.098 INFO:teuthology.orchestra.run.smithi039.stdout:checking for a sed that does not truncate output... /usr/bin/sed 2023-05-16T13:55:48.103 INFO:teuthology.orchestra.run.smithi039.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2023-05-16T13:55:48.105 INFO:teuthology.orchestra.run.smithi039.stdout:checking for egrep... /usr/bin/grep -E 2023-05-16T13:55:48.108 INFO:teuthology.orchestra.run.smithi039.stdout:checking for fgrep... /usr/bin/grep -F 2023-05-16T13:55:48.114 INFO:teuthology.orchestra.run.smithi039.stdout:checking for ld used by gcc... /usr/bin/ld 2023-05-16T13:55:48.118 INFO:teuthology.orchestra.run.smithi039.stdout:checking if the linker (/usr/bin/ld) is GNU ld... yes 2023-05-16T13:55:48.130 INFO:teuthology.orchestra.run.smithi039.stdout:checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B 2023-05-16T13:55:48.160 INFO:teuthology.orchestra.run.smithi039.stdout:checking the name lister (/usr/bin/nm -B) interface... BSD nm 2023-05-16T13:55:48.161 INFO:teuthology.orchestra.run.smithi039.stdout:checking whether ln -s works... yes 2023-05-16T13:55:48.173 INFO:teuthology.orchestra.run.smithi039.stdout:checking the maximum length of command line arguments... 1572864 2023-05-16T13:55:48.178 INFO:teuthology.orchestra.run.smithi039.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-05-16T13:55:48.178 INFO:teuthology.orchestra.run.smithi039.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-05-16T13:55:48.178 INFO:teuthology.orchestra.run.smithi039.stdout:checking for /usr/bin/ld option to reload object files... -r 2023-05-16T13:55:48.179 INFO:teuthology.orchestra.run.smithi039.stdout:checking for objdump... objdump 2023-05-16T13:55:48.179 INFO:teuthology.orchestra.run.smithi039.stdout:checking how to recognize dependent libraries... pass_all 2023-05-16T13:55:48.179 INFO:teuthology.orchestra.run.smithi039.stdout:checking for dlltool... no 2023-05-16T13:55:48.179 INFO:teuthology.orchestra.run.smithi039.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-05-16T13:55:48.180 INFO:teuthology.orchestra.run.smithi039.stdout:checking for ar... ar 2023-05-16T13:55:48.215 INFO:teuthology.orchestra.run.smithi039.stdout:checking for archiver @FILE support... @ 2023-05-16T13:55:48.215 INFO:teuthology.orchestra.run.smithi039.stdout:checking for strip... strip 2023-05-16T13:55:48.216 INFO:teuthology.orchestra.run.smithi039.stdout:checking for ranlib... ranlib 2023-05-16T13:55:48.216 INFO:teuthology.orchestra.run.smithi039.stdout:checking for gawk... gawk 2023-05-16T13:55:48.301 INFO:teuthology.orchestra.run.smithi039.stdout:checking command to parse /usr/bin/nm -B output from gcc object... ok 2023-05-16T13:55:48.303 INFO:teuthology.orchestra.run.smithi039.stdout:checking for sysroot... no 2023-05-16T13:55:48.310 INFO:teuthology.orchestra.run.smithi039.stdout:checking for a working dd... /usr/bin/dd 2023-05-16T13:55:48.317 INFO:teuthology.orchestra.run.smithi039.stdout:checking how to truncate binary pipes... /usr/bin/dd bs=4096 count=1 2023-05-16T13:55:48.335 INFO:teuthology.orchestra.run.smithi039.stdout:checking for mt... mt 2023-05-16T13:55:48.351 INFO:teuthology.orchestra.run.smithi039.stdout:checking if mt is a manifest tool... no 2023-05-16T13:55:48.376 INFO:teuthology.orchestra.run.smithi039.stdout:checking for stdio.h... yes 2023-05-16T13:55:48.430 INFO:teuthology.orchestra.run.smithi039.stdout:checking for stdlib.h... yes 2023-05-16T13:55:48.474 INFO:teuthology.orchestra.run.smithi039.stdout:checking for string.h... yes 2023-05-16T13:55:48.508 INFO:teuthology.orchestra.run.smithi039.stdout:checking for inttypes.h... yes 2023-05-16T13:55:48.540 INFO:teuthology.orchestra.run.smithi039.stdout:checking for stdint.h... yes 2023-05-16T13:55:48.571 INFO:teuthology.orchestra.run.smithi039.stdout:checking for strings.h... yes 2023-05-16T13:55:48.607 INFO:teuthology.orchestra.run.smithi039.stdout:checking for sys/stat.h... yes 2023-05-16T13:55:48.639 INFO:teuthology.orchestra.run.smithi039.stdout:checking for sys/types.h... yes 2023-05-16T13:55:48.680 INFO:teuthology.orchestra.run.smithi039.stdout:checking for unistd.h... yes 2023-05-16T13:55:48.718 INFO:teuthology.orchestra.run.smithi039.stdout:checking for dlfcn.h... yes 2023-05-16T13:55:48.723 INFO:teuthology.orchestra.run.smithi039.stdout:checking for objdir... .libs 2023-05-16T13:55:48.829 INFO:teuthology.orchestra.run.smithi039.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-05-16T13:55:48.830 INFO:teuthology.orchestra.run.smithi039.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-05-16T13:55:48.855 INFO:teuthology.orchestra.run.smithi039.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-05-16T13:55:49.065 INFO:teuthology.orchestra.run.smithi039.stdout:checking if gcc static flag -static works... yes 2023-05-16T13:55:49.104 INFO:teuthology.orchestra.run.smithi039.stdout:checking if gcc supports -c -o file.o... yes 2023-05-16T13:55:49.104 INFO:teuthology.orchestra.run.smithi039.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-05-16T13:55:49.117 INFO:teuthology.orchestra.run.smithi039.stdout:checking whether the gcc linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-05-16T13:55:49.151 INFO:teuthology.orchestra.run.smithi039.stdout:checking whether -lc should be explicitly linked in... no 2023-05-16T13:55:49.250 INFO:teuthology.orchestra.run.smithi039.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-05-16T13:55:49.250 INFO:teuthology.orchestra.run.smithi039.stdout:checking how to hardcode library paths into programs... immediate 2023-05-16T13:55:49.273 INFO:teuthology.orchestra.run.smithi039.stdout:checking whether stripping libraries is possible... yes 2023-05-16T13:55:49.273 INFO:teuthology.orchestra.run.smithi039.stdout:checking if libtool supports shared libraries... yes 2023-05-16T13:55:49.274 INFO:teuthology.orchestra.run.smithi039.stdout:checking whether to build shared libraries... yes 2023-05-16T13:55:49.274 INFO:teuthology.orchestra.run.smithi039.stdout:checking whether to build static libraries... yes 2023-05-16T13:55:49.288 INFO:teuthology.orchestra.run.smithi039.stdout:checking for gcc... (cached) gcc 2023-05-16T13:55:49.327 INFO:teuthology.orchestra.run.smithi039.stdout:checking whether the compiler supports GNU C... (cached) yes 2023-05-16T13:55:49.327 INFO:teuthology.orchestra.run.smithi039.stdout:checking whether gcc accepts -g... (cached) yes 2023-05-16T13:55:49.328 INFO:teuthology.orchestra.run.smithi039.stdout:checking for gcc option to enable C11 features... (cached) none needed 2023-05-16T13:55:49.328 INFO:teuthology.orchestra.run.smithi039.stdout:checking for gmake... /usr/bin/gmake 2023-05-16T13:55:49.329 INFO:teuthology.orchestra.run.smithi039.stderr:./configure: line 12753: test: $(SHELL): binary operator expected 2023-05-16T13:55:49.330 INFO:teuthology.orchestra.run.smithi039.stdout:checking for tar... /bin/tar 2023-05-16T13:55:49.330 INFO:teuthology.orchestra.run.smithi039.stdout:checking for gzip... /bin/gzip 2023-05-16T13:55:49.343 INFO:teuthology.orchestra.run.smithi039.stdout:checking whether gcc -MM is supported... yes 2023-05-16T13:55:49.343 INFO:teuthology.orchestra.run.smithi039.stdout:checking for sort... /bin/sort 2023-05-16T13:55:49.344 INFO:teuthology.orchestra.run.smithi039.stdout:checking whether ln -s works... yes 2023-05-16T13:55:49.344 INFO:teuthology.orchestra.run.smithi039.stdout:checking for rpm... no 2023-05-16T13:55:49.381 INFO:teuthology.orchestra.run.smithi039.stdout:checking for assert.h... yes 2023-05-16T13:55:49.422 INFO:teuthology.orchestra.run.smithi039.stdout:checking for bstring.h... no 2023-05-16T13:55:49.459 INFO:teuthology.orchestra.run.smithi039.stdout:checking for libgen.h... yes 2023-05-16T13:55:49.524 INFO:teuthology.orchestra.run.smithi039.stdout:checking for dirent.h... yes 2023-05-16T13:55:49.610 INFO:teuthology.orchestra.run.smithi039.stdout:checking for errno.h... yes 2023-05-16T13:55:49.648 INFO:teuthology.orchestra.run.smithi039.stdout:checking for malloc.h... yes 2023-05-16T13:55:49.689 INFO:teuthology.orchestra.run.smithi039.stdout:checking for uuid.h... no 2023-05-16T13:55:49.745 INFO:teuthology.orchestra.run.smithi039.stdout:checking for uuid/uuid.h... yes 2023-05-16T13:55:49.786 INFO:teuthology.orchestra.run.smithi039.stdout:checking for sys/uuid.h... no 2023-05-16T13:55:49.826 INFO:teuthology.orchestra.run.smithi039.stdout:checking for sys/file.h... yes 2023-05-16T13:55:49.865 INFO:teuthology.orchestra.run.smithi039.stdout:checking for sys/fcntl.h... yes 2023-05-16T13:55:49.906 INFO:teuthology.orchestra.run.smithi039.stdout:checking for sys/syssgi.h... no 2023-05-16T13:55:49.973 INFO:teuthology.orchestra.run.smithi039.stdout:checking for sys/param.h... yes 2023-05-16T13:55:49.973 INFO:teuthology.orchestra.run.smithi039.stdout:checking for sys/stat.h... (cached) yes 2023-05-16T13:55:50.012 INFO:teuthology.orchestra.run.smithi039.stdout:checking for sys/statvfs.h... yes 2023-05-16T13:55:50.050 INFO:teuthology.orchestra.run.smithi039.stdout:checking for sys/time.h... yes 2023-05-16T13:55:50.112 INFO:teuthology.orchestra.run.smithi039.stdout:checking for sys/ioctl.h... yes 2023-05-16T13:55:50.153 INFO:teuthology.orchestra.run.smithi039.stdout:checking for sys/wait.h... yes 2023-05-16T13:55:50.154 INFO:teuthology.orchestra.run.smithi039.stdout:checking for sys/types.h... (cached) yes 2023-05-16T13:55:50.154 INFO:teuthology.orchestra.run.smithi039.stdout:checking for strings.h... (cached) yes 2023-05-16T13:55:50.190 INFO:teuthology.orchestra.run.smithi039.stdout:checking for err.h... yes 2023-05-16T13:55:50.227 INFO:teuthology.orchestra.run.smithi039.stdout:checking for linux/falloc.h... yes 2023-05-16T13:55:50.268 INFO:teuthology.orchestra.run.smithi039.stdout:checking for sys/fs/xfs_fsops.h... no 2023-05-16T13:55:50.308 INFO:teuthology.orchestra.run.smithi039.stdout:checking for sys/fs/xfs_itable.h... no 2023-05-16T13:55:50.349 INFO:teuthology.orchestra.run.smithi039.stdout:checking for xfs/platform_defs.h... no 2023-05-16T13:55:50.390 INFO:teuthology.orchestra.run.smithi039.stdout:checking for btrfs/ioctl.h... no 2023-05-16T13:55:50.430 INFO:teuthology.orchestra.run.smithi039.stdout:checking for cifs/ioctl.h... no 2023-05-16T13:55:50.469 INFO:teuthology.orchestra.run.smithi039.stdout:checking for sys/mman.h... yes 2023-05-16T13:55:50.491 INFO:teuthology.orchestra.run.smithi039.stdout:checking for xfs/xfs_log_format.h... no 2023-05-16T13:55:50.547 INFO:teuthology.orchestra.run.smithi039.stdout:checking for uuid_compare... no 2023-05-16T13:55:50.593 INFO:teuthology.orchestra.run.smithi039.stdout:checking for uuid_compare in -luuid... yes 2023-05-16T13:55:50.722 INFO:teuthology.orchestra.run.smithi039.stdout:checking for xfs/xfs.h... yes 2023-05-16T13:55:50.744 INFO:teuthology.orchestra.run.smithi039.stdout:checking for xfs/libxfs.h... no 2023-05-16T13:55:50.790 INFO:teuthology.orchestra.run.smithi039.stdout:checking for gcc options needed to detect all undeclared functions... none needed 2023-05-16T13:55:50.820 INFO:teuthology.orchestra.run.smithi039.stdout:checking whether xlog_assign_lsn is declared... no 2023-05-16T13:55:50.868 INFO:teuthology.orchestra.run.smithi039.stdout:checking for xfs/xqm.h... yes 2023-05-16T13:55:50.941 INFO:teuthology.orchestra.run.smithi039.stdout:checking xfsctl from xfs/xfs.h... ok 2023-05-16T13:55:50.980 INFO:teuthology.orchestra.run.smithi039.stdout:checking for xfs/handle.h... yes 2023-05-16T13:55:51.028 INFO:teuthology.orchestra.run.smithi039.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-05-16T13:55:51.075 INFO:teuthology.orchestra.run.smithi039.stdout:checking for sys/acl.h... yes 2023-05-16T13:55:51.117 INFO:teuthology.orchestra.run.smithi039.stdout:checking for acl/libacl.h... yes 2023-05-16T13:55:51.164 INFO:teuthology.orchestra.run.smithi039.stdout:checking for acl_init in -lacl... yes 2023-05-16T13:55:51.204 INFO:teuthology.orchestra.run.smithi039.stdout:checking for gdbm-ndbm.h... no 2023-05-16T13:55:51.244 INFO:teuthology.orchestra.run.smithi039.stdout:checking for gdbm/ndbm.h... no 2023-05-16T13:55:51.285 INFO:teuthology.orchestra.run.smithi039.stdout:checking for ndbm.h... no 2023-05-16T13:55:51.326 INFO:teuthology.orchestra.run.smithi039.stdout:checking for libaio.h... yes 2023-05-16T13:55:51.366 INFO:teuthology.orchestra.run.smithi039.stdout:checking for liburing.h... no 2023-05-16T13:55:51.407 INFO:teuthology.orchestra.run.smithi039.stdout:checking for sys/capability.h... no 2023-05-16T13:55:51.446 INFO:teuthology.orchestra.run.smithi039.stdout:checking for linux/fiemap.h... yes 2023-05-16T13:55:51.495 INFO:teuthology.orchestra.run.smithi039.stdout:checking for fallocate... yes 2023-05-16T13:55:51.548 INFO:teuthology.orchestra.run.smithi039.stdout:checking for open_by_handle_at... yes 2023-05-16T13:55:51.588 INFO:teuthology.orchestra.run.smithi039.stdout:checking for sys/prctl.h... yes 2023-05-16T13:55:51.627 INFO:teuthology.orchestra.run.smithi039.stdout:checking for linux/fs.h... yes 2023-05-16T13:55:51.668 INFO:teuthology.orchestra.run.smithi039.stdout:checking for btrfsutil.h... no 2023-05-16T13:55:51.722 INFO:teuthology.orchestra.run.smithi039.stdout:checking for copy_file_range... yes 2023-05-16T13:55:51.779 INFO:teuthology.orchestra.run.smithi039.stdout:checking for SEEK_DATA... yes 2023-05-16T13:55:51.854 INFO:teuthology.orchestra.run.smithi039.stdout:checking for BMV_OF_SHARED... yes 2023-05-16T13:55:51.909 INFO:teuthology.orchestra.run.smithi039.stdout:checking for nftw... yes 2023-05-16T13:55:51.961 INFO:teuthology.orchestra.run.smithi039.stdout:checking for RLIMIT_NOFILE... yes 2023-05-16T13:55:51.996 INFO:teuthology.orchestra.run.smithi039.stdout:checking for FIEXCHANGE_RANGE... no 2023-05-16T13:55:52.046 INFO:teuthology.orchestra.run.smithi039.stdout:checking for renameat2... yes 2023-05-16T13:55:52.096 INFO:teuthology.orchestra.run.smithi039.stdout:checking for reallocarray... yes 2023-05-16T13:55:52.145 INFO:teuthology.orchestra.run.smithi039.stdout:checking for struct mount_attr... yes 2023-05-16T13:55:52.196 INFO:teuthology.orchestra.run.smithi039.stdout:checking for struct btrfs_qgroup_limit... yes 2023-05-16T13:55:52.246 INFO:teuthology.orchestra.run.smithi039.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-05-16T13:55:52.296 INFO:teuthology.orchestra.run.smithi039.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-05-16T13:55:52.347 INFO:teuthology.orchestra.run.smithi039.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-05-16T13:55:52.398 INFO:teuthology.orchestra.run.smithi039.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-05-16T13:55:52.448 INFO:teuthology.orchestra.run.smithi039.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-05-16T13:55:52.499 INFO:teuthology.orchestra.run.smithi039.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-05-16T13:55:52.538 INFO:teuthology.orchestra.run.smithi039.stdout:checking for linux/btrfs.h... yes 2023-05-16T13:55:52.578 INFO:teuthology.orchestra.run.smithi039.stdout:checking for linux/btrfs_tree.h... yes 2023-05-16T13:55:52.605 INFO:teuthology.orchestra.run.smithi039.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... yes 2023-05-16T13:55:52.631 INFO:teuthology.orchestra.run.smithi039.stdout:configure: creating ./config.status 2023-05-16T13:55:53.378 INFO:teuthology.orchestra.run.smithi039.stdout:config.status: creating include/builddefs 2023-05-16T13:55:53.403 INFO:teuthology.orchestra.run.smithi039.stdout:config.status: creating include/config.h 2023-05-16T13:55:53.423 INFO:teuthology.orchestra.run.smithi039.stdout:config.status: executing libtool commands 2023-05-16T13:55:53.489 INFO:teuthology.orchestra.run.smithi039.stdout:Building include 2023-05-16T13:55:53.495 INFO:teuthology.orchestra.run.smithi039.stdout:Building lib 2023-05-16T13:55:53.500 INFO:teuthology.orchestra.run.smithi039.stdout: [LTDEP] 2023-05-16T13:55:53.697 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] dataascii.lo 2023-05-16T13:55:53.840 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] databin.lo 2023-05-16T13:55:54.025 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] datapid.lo 2023-05-16T13:55:54.160 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] file_lock.lo 2023-05-16T13:55:54.349 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] forker.lo 2023-05-16T13:55:54.520 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] pattern.lo 2023-05-16T13:55:54.660 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] open_flags.lo 2023-05-16T13:55:54.834 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] random_range.lo 2023-05-16T13:55:55.094 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] string_to_tokens.lo 2023-05-16T13:55:55.218 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] str_to_bytes.lo 2023-05-16T13:55:55.384 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] tlibio.lo 2023-05-16T13:55:55.673 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] write_log.lo 2023-05-16T13:55:55.757 INFO:teuthology.orchestra.run.smithi039.stderr:write_log.c: In function 'wlog_record_write': 2023-05-16T13:55:55.757 INFO:teuthology.orchestra.run.smithi039.stderr:write_log.c:205:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:55:55.757 INFO:teuthology.orchestra.run.smithi039.stderr: 205 | write(wfile->w_afd, wbuf, reclen); 2023-05-16T13:55:55.758 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:55:55.758 INFO:teuthology.orchestra.run.smithi039.stderr:write_log.c:209:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:55:55.758 INFO:teuthology.orchestra.run.smithi039.stderr: 209 | write(wfile->w_rfd, wbuf, reclen); 2023-05-16T13:55:55.758 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:55:55.960 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] random.lo 2023-05-16T13:55:56.084 INFO:teuthology.orchestra.run.smithi039.stdout: [LD] 2023-05-16T13:55:56.202 INFO:teuthology.orchestra.run.smithi039.stdout:Building ltp 2023-05-16T13:55:56.207 INFO:teuthology.orchestra.run.smithi039.stdout: [DEP] 2023-05-16T13:55:56.405 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] doio 2023-05-16T13:55:57.152 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] fsstress 2023-05-16T13:55:58.704 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] fsx 2023-05-16T13:55:59.521 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] growfiles 2023-05-16T13:56:00.117 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] iogen 2023-05-16T13:56:00.275 INFO:teuthology.orchestra.run.smithi039.stderr:iogen.c: In function 'main': 2023-05-16T13:56:00.276 INFO:teuthology.orchestra.run.smithi039.stderr:iogen.c:280:9: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:00.276 INFO:teuthology.orchestra.run.smithi039.stderr: 280 | write(outfd, (char *)&req, sizeof(req)); 2023-05-16T13:56:00.276 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:00.278 INFO:teuthology.orchestra.run.smithi039.stderr:iogen.c: In function 'parse_cmdline': 2023-05-16T13:56:00.278 INFO:teuthology.orchestra.run.smithi039.stderr:iogen.c:1535:17: warning: ignoring return value of 'getcwd' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:00.279 INFO:teuthology.orchestra.run.smithi039.stderr: 1535 | getcwd(fptr->f_path, 2023-05-16T13:56:00.279 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:00.279 INFO:teuthology.orchestra.run.smithi039.stderr: 1536 | sizeof(fptr->f_path)-1); 2023-05-16T13:56:00.280 INFO:teuthology.orchestra.run.smithi039.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:00.571 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] aio-stress 2023-05-16T13:56:00.725 INFO:teuthology.orchestra.run.smithi039.stderr:aio-stress.c: In function 'setup_shared_mem': 2023-05-16T13:56:00.726 INFO:teuthology.orchestra.run.smithi039.stderr:aio-stress.c:1013:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:00.726 INFO:teuthology.orchestra.run.smithi039.stderr: 1013 | ftruncate(fd, total_ram); 2023-05-16T13:56:00.726 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:01.065 INFO:teuthology.orchestra.run.smithi039.stdout:Building src 2023-05-16T13:56:01.073 INFO:teuthology.orchestra.run.smithi039.stdout: [DEP] 2023-05-16T13:56:03.551 INFO:teuthology.orchestra.run.smithi039.stdout: [DEP] 2023-05-16T13:56:03.597 INFO:teuthology.orchestra.run.smithi039.stdout: [DEP] 2023-05-16T13:56:03.610 INFO:teuthology.orchestra.run.smithi039.stdout: [DEP] 2023-05-16T13:56:03.945 INFO:teuthology.orchestra.run.smithi039.stdout: [DEP] 2023-05-16T13:56:03.980 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] dirstress 2023-05-16T13:56:04.269 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] fill 2023-05-16T13:56:04.452 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] fill2 2023-05-16T13:56:04.725 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] getpagesize 2023-05-16T13:56:04.891 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] holes 2023-05-16T13:56:05.128 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] lstat64 2023-05-16T13:56:05.347 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] nametest 2023-05-16T13:56:05.502 INFO:teuthology.orchestra.run.smithi039.stderr:nametest.c: In function 'main': 2023-05-16T13:56:05.502 INFO:teuthology.orchestra.run.smithi039.stderr:nametest.c:236:33: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:05.503 INFO:teuthology.orchestra.run.smithi039.stderr: 236 | write(1, "\n", 1); 2023-05-16T13:56:05.503 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~ 2023-05-16T13:56:05.503 INFO:teuthology.orchestra.run.smithi039.stderr:nametest.c:238:25: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:05.503 INFO:teuthology.orchestra.run.smithi039.stderr: 238 | write(1, ".", 1); 2023-05-16T13:56:05.503 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~ 2023-05-16T13:56:05.503 INFO:teuthology.orchestra.run.smithi039.stderr:nametest.c:288:33: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:05.504 INFO:teuthology.orchestra.run.smithi039.stderr: 288 | write(1, ".", 1); 2023-05-16T13:56:05.504 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~ 2023-05-16T13:56:05.631 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] permname 2023-05-16T13:56:05.870 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] randholes 2023-05-16T13:56:06.162 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] runas 2023-05-16T13:56:06.291 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T13:56:06.296 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T13:56:06.376 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] truncfile 2023-05-16T13:56:06.592 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] usemem 2023-05-16T13:56:06.776 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] mmapcat 2023-05-16T13:56:06.914 INFO:teuthology.orchestra.run.smithi039.stderr:mmapcat.c: In function 'main': 2023-05-16T13:56:06.915 INFO:teuthology.orchestra.run.smithi039.stderr:mmapcat.c:29:9: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:06.915 INFO:teuthology.orchestra.run.smithi039.stderr: 29 | write(1,ptr2,ptr - ptr2); 2023-05-16T13:56:06.915 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:06.957 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] append_reader 2023-05-16T13:56:07.144 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] append_writer 2023-05-16T13:56:07.329 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] dirperf 2023-05-16T13:56:07.599 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] metaperf 2023-05-16T13:56:07.745 INFO:teuthology.orchestra.run.smithi039.stderr:metaperf.c: In function 'crfiles': 2023-05-16T13:56:07.746 INFO:teuthology.orchestra.run.smithi039.stderr:metaperf.c:166:25: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:07.746 INFO:teuthology.orchestra.run.smithi039.stderr: 166 | write(fd, buf, fsize); 2023-05-16T13:56:07.746 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:07.747 INFO:teuthology.orchestra.run.smithi039.stderr:metaperf.c: In function 't_linkun': 2023-05-16T13:56:07.747 INFO:teuthology.orchestra.run.smithi039.stderr:metaperf.c:454:25: warning: ignoring return value of 'link' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:07.747 INFO:teuthology.orchestra.run.smithi039.stderr: 454 | link("a", *fnp); 2023-05-16T13:56:07.747 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~ 2023-05-16T13:56:07.747 INFO:teuthology.orchestra.run.smithi039.stderr:metaperf.c: In function 't_chown': 2023-05-16T13:56:07.748 INFO:teuthology.orchestra.run.smithi039.stderr:metaperf.c:404:33: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:07.748 INFO:teuthology.orchestra.run.smithi039.stderr: 404 | chown(*fnp, 2, -1); 2023-05-16T13:56:07.748 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:07.748 INFO:teuthology.orchestra.run.smithi039.stderr:metaperf.c:406:33: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:07.748 INFO:teuthology.orchestra.run.smithi039.stderr: 406 | chown(*fnp, 1, -1); 2023-05-16T13:56:07.748 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:07.748 INFO:teuthology.orchestra.run.smithi039.stderr:metaperf.c: In function 'i_chown': 2023-05-16T13:56:07.748 INFO:teuthology.orchestra.run.smithi039.stderr:metaperf.c:291:17: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:07.749 INFO:teuthology.orchestra.run.smithi039.stderr: 291 | chown(*fnp, 1, -1); 2023-05-16T13:56:07.749 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:07.749 INFO:teuthology.orchestra.run.smithi039.stderr:metaperf.c: In function 'main': 2023-05-16T13:56:07.749 INFO:teuthology.orchestra.run.smithi039.stderr:metaperf.c:152:9: warning: ignoring return value of 'chdir' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:07.749 INFO:teuthology.orchestra.run.smithi039.stderr: 152 | chdir(".."); 2023-05-16T13:56:07.749 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~ 2023-05-16T13:56:07.912 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] devzero 2023-05-16T13:56:08.125 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] feature 2023-05-16T13:56:08.381 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] alloc 2023-05-16T13:56:08.535 INFO:teuthology.orchestra.run.smithi039.stderr:alloc.c: In function 'main': 2023-05-16T13:56:08.536 INFO:teuthology.orchestra.run.smithi039.stderr:alloc.c:247:17: warning: ignoring return value of 'mkstemp' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:08.536 INFO:teuthology.orchestra.run.smithi039.stderr: 247 | mkstemp(tmpfile); 2023-05-16T13:56:08.536 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~ 2023-05-16T13:56:08.635 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] fault 2023-05-16T13:56:08.834 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] fstest 2023-05-16T13:56:09.115 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_access_root 2023-05-16T13:56:09.254 INFO:teuthology.orchestra.run.smithi039.stderr:t_access_root.c: In function 'main': 2023-05-16T13:56:09.254 INFO:teuthology.orchestra.run.smithi039.stderr:t_access_root.c:55:5: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:09.254 INFO:teuthology.orchestra.run.smithi039.stderr: 55 | system(cmd); 2023-05-16T13:56:09.254 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~ 2023-05-16T13:56:09.304 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] godown 2023-05-16T13:56:09.513 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] resvtest 2023-05-16T13:56:09.737 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] writemod 2023-05-16T13:56:09.915 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] writev_on_pagefault 2023-05-16T13:56:10.111 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] makeextents 2023-05-16T13:56:10.326 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] itrash 2023-05-16T13:56:10.511 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] rename 2023-05-16T13:56:10.678 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] multi_open_unlink 2023-05-16T13:56:10.880 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] unwritten_sync 2023-05-16T13:56:11.100 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] genhashnames 2023-05-16T13:56:11.322 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_holes 2023-05-16T13:56:11.505 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_mmap_writev 2023-05-16T13:56:11.686 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_truncate_cmtime 2023-05-16T13:56:11.878 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] dirhash_collide 2023-05-16T13:56:12.095 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_rename_overwrite 2023-05-16T13:56:12.265 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] holetest 2023-05-16T13:56:12.412 INFO:teuthology.orchestra.run.smithi039.stderr:holetest.c: In function 'pt_write_marker': 2023-05-16T13:56:12.412 INFO:teuthology.orchestra.run.smithi039.stderr:holetest.c:140:17: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:12.413 INFO:teuthology.orchestra.run.smithi039.stderr: 140 | pwrite(fd, &tid, sizeof(tid), i * page_size + pgoff); 2023-05-16T13:56:12.413 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:12.530 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_truncate_self 2023-05-16T13:56:12.701 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] af_unix 2023-05-16T13:56:12.896 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_mmap_stale_pmd 2023-05-16T13:56:13.037 INFO:teuthology.orchestra.run.smithi039.stderr:t_mmap_stale_pmd.c: In function 'main': 2023-05-16T13:56:13.037 INFO:teuthology.orchestra.run.smithi039.stderr:t_mmap_stale_pmd.c:42:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:13.037 INFO:teuthology.orchestra.run.smithi039.stderr: 42 | ftruncate(fd, 0); 2023-05-16T13:56:13.037 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~ 2023-05-16T13:56:13.037 INFO:teuthology.orchestra.run.smithi039.stderr:t_mmap_stale_pmd.c:43:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:13.038 INFO:teuthology.orchestra.run.smithi039.stderr: 43 | ftruncate(fd, MiB(4)); 2023-05-16T13:56:13.038 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:13.038 INFO:teuthology.orchestra.run.smithi039.stderr:t_mmap_stale_pmd.c:55:9: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:13.038 INFO:teuthology.orchestra.run.smithi039.stderr: 55 | pwrite(fd, buffer, strlen(buffer), MiB(2)); 2023-05-16T13:56:13.038 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:13.082 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_mmap_cow_race 2023-05-16T13:56:13.227 INFO:teuthology.orchestra.run.smithi039.stderr:t_mmap_cow_race.c: In function 'main': 2023-05-16T13:56:13.228 INFO:teuthology.orchestra.run.smithi039.stderr:t_mmap_cow_race.c:61:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:13.228 INFO:teuthology.orchestra.run.smithi039.stderr: 61 | ftruncate(fd, 0); 2023-05-16T13:56:13.228 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~ 2023-05-16T13:56:13.228 INFO:teuthology.orchestra.run.smithi039.stderr:t_mmap_cow_race.c:62:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:13.229 INFO:teuthology.orchestra.run.smithi039.stderr: 62 | ftruncate(fd, MiB(2)); 2023-05-16T13:56:13.229 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:13.283 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_mmap_fallocate 2023-05-16T13:56:13.467 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] fsync-err 2023-05-16T13:56:13.689 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_mmap_write_ro 2023-05-16T13:56:13.876 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_ext4_dax_journal_corruption 2023-05-16T13:56:14.019 INFO:teuthology.orchestra.run.smithi039.stderr:t_ext4_dax_journal_corruption.c: In function 'main': 2023-05-16T13:56:14.019 INFO:teuthology.orchestra.run.smithi039.stderr:t_ext4_dax_journal_corruption.c:61:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:14.019 INFO:teuthology.orchestra.run.smithi039.stderr: 61 | ftruncate(fd, 0); 2023-05-16T13:56:14.019 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~ 2023-05-16T13:56:14.071 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_ext4_dax_inline_corruption 2023-05-16T13:56:14.261 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_ofd_locks 2023-05-16T13:56:14.500 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_mmap_collision 2023-05-16T13:56:14.777 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] mmap-write-concurrent 2023-05-16T13:56:14.984 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_get_file_time 2023-05-16T13:56:15.162 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_create_short_dirs 2023-05-16T13:56:15.364 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_create_long_dirs 2023-05-16T13:56:15.563 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_enospc 2023-05-16T13:56:15.806 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_mmap_writev_overlap 2023-05-16T13:56:16.012 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] checkpoint_journal 2023-05-16T13:56:16.202 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] mmap-rw-fault 2023-05-16T13:56:16.417 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] allocstale 2023-05-16T13:56:16.624 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_mmap_cow_memory_failure 2023-05-16T13:56:16.831 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] fake-dump-rootino 2023-05-16T13:56:17.015 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] dio-buf-fault 2023-05-16T13:56:17.202 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] xfsctl 2023-05-16T13:56:17.430 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] bstat 2023-05-16T13:56:17.677 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_mtab 2023-05-16T13:56:17.823 INFO:teuthology.orchestra.run.smithi039.stderr:t_mtab.c: In function 'update_mtab': 2023-05-16T13:56:17.823 INFO:teuthology.orchestra.run.smithi039.stderr:t_mtab.c:256:17: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:17.823 INFO:teuthology.orchestra.run.smithi039.stderr: 256 | chown (mounted_temp, sbuf.st_uid, sbuf.st_gid); 2023-05-16T13:56:17.824 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:17.904 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] getdevicesize 2023-05-16T13:56:18.080 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] preallo_rw_pattern_reader 2023-05-16T13:56:18.241 INFO:teuthology.orchestra.run.smithi039.stderr:In file included from preallo_rw_pattern_reader.c:2: 2023-05-16T13:56:18.242 INFO:teuthology.orchestra.run.smithi039.stderr:iopat.c: In function 'main': 2023-05-16T13:56:18.242 INFO:teuthology.orchestra.run.smithi039.stderr:iopat.c:38:4: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:18.242 INFO:teuthology.orchestra.run.smithi039.stderr: 38 | read(fd, &x, 1048576); 2023-05-16T13:56:18.242 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:18.284 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] preallo_rw_pattern_writer 2023-05-16T13:56:18.436 INFO:teuthology.orchestra.run.smithi039.stderr:In file included from preallo_rw_pattern_writer.c:2: 2023-05-16T13:56:18.436 INFO:teuthology.orchestra.run.smithi039.stderr:iopat.c: In function 'main': 2023-05-16T13:56:18.436 INFO:teuthology.orchestra.run.smithi039.stderr:iopat.c:34:4: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:18.436 INFO:teuthology.orchestra.run.smithi039.stderr: 34 | write(fd, &x, 1048576); 2023-05-16T13:56:18.437 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:18.478 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] ftrunc 2023-05-16T13:56:18.659 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] trunc 2023-05-16T13:56:18.860 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] fs_perms 2023-05-16T13:56:19.003 INFO:teuthology.orchestra.run.smithi039.stderr:fs_perms.c: In function 'main': 2023-05-16T13:56:19.003 INFO:teuthology.orchestra.run.smithi039.stderr:fs_perms.c:54:4: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:19.003 INFO:teuthology.orchestra.run.smithi039.stderr: 54 | system("rm -f test.file"); 2023-05-16T13:56:19.003 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:19.004 INFO:teuthology.orchestra.run.smithi039.stderr:fs_perms.c: In function 'testsetup': 2023-05-16T13:56:19.004 INFO:teuthology.orchestra.run.smithi039.stderr:fs_perms.c:67:4: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:19.004 INFO:teuthology.orchestra.run.smithi039.stderr: 67 | system("cp testx.file test.file"); 2023-05-16T13:56:19.004 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:19.004 INFO:teuthology.orchestra.run.smithi039.stderr:fs_perms.c:69:4: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:19.004 INFO:teuthology.orchestra.run.smithi039.stderr: 69 | chown("test.file",cuserId,cgroupId); 2023-05-16T13:56:19.004 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:19.005 INFO:teuthology.orchestra.run.smithi039.stderr:fs_perms.c: In function 'testfperm': 2023-05-16T13:56:19.005 INFO:teuthology.orchestra.run.smithi039.stderr:fs_perms.c:123:5: warning: ignoring return value of 'seteuid' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:19.005 INFO:teuthology.orchestra.run.smithi039.stderr: 123 | seteuid(0); 2023-05-16T13:56:19.005 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~ 2023-05-16T13:56:19.005 INFO:teuthology.orchestra.run.smithi039.stderr:fs_perms.c:124:5: warning: ignoring return value of 'setegid' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:19.005 INFO:teuthology.orchestra.run.smithi039.stderr: 124 | setegid(0); 2023-05-16T13:56:19.005 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~ 2023-05-16T13:56:19.059 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] testx 2023-05-16T13:56:19.217 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] looptest 2023-05-16T13:56:19.452 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] locktest 2023-05-16T13:56:19.810 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] unwritten_mmap 2023-05-16T13:56:20.011 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] bulkstat_unlink_test 2023-05-16T13:56:20.163 INFO:teuthology.orchestra.run.smithi039.stderr:bulkstat_unlink_test.c: In function 'main': 2023-05-16T13:56:20.163 INFO:teuthology.orchestra.run.smithi039.stderr:bulkstat_unlink_test.c:106:25: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:20.163 INFO:teuthology.orchestra.run.smithi039.stderr: 106 | write(fd[i], fname, sizeof(fname)); 2023-05-16T13:56:20.163 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:20.164 INFO:teuthology.orchestra.run.smithi039.stderr:bulkstat_unlink_test.c:178:17: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:20.164 INFO:teuthology.orchestra.run.smithi039.stderr: 178 | system(fname); 2023-05-16T13:56:20.164 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~ 2023-05-16T13:56:20.253 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] deduperace 2023-05-16T13:56:20.488 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] bulkstat_unlink_test_modified 2023-05-16T13:56:20.640 INFO:teuthology.orchestra.run.smithi039.stderr:bulkstat_unlink_test_modified.c: In function 'main': 2023-05-16T13:56:20.641 INFO:teuthology.orchestra.run.smithi039.stderr:bulkstat_unlink_test_modified.c:83:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:20.641 INFO:teuthology.orchestra.run.smithi039.stderr: 83 | write(fd, fname, sizeof(fname)); 2023-05-16T13:56:20.641 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:20.642 INFO:teuthology.orchestra.run.smithi039.stderr:bulkstat_unlink_test_modified.c:139:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:20.642 INFO:teuthology.orchestra.run.smithi039.stderr: 139 | write(fd, fname, sizeof(fname)); 2023-05-16T13:56:20.642 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:20.642 INFO:teuthology.orchestra.run.smithi039.stderr:bulkstat_unlink_test_modified.c:185:9: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:20.643 INFO:teuthology.orchestra.run.smithi039.stderr: 185 | system(fname); 2023-05-16T13:56:20.643 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~ 2023-05-16T13:56:20.725 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_dir_offset 2023-05-16T13:56:20.908 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_futimens 2023-05-16T13:56:21.079 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_immutable 2023-05-16T13:56:21.244 INFO:teuthology.orchestra.run.smithi039.stderr:t_immutable.c: In function 'create_test_area': 2023-05-16T13:56:21.244 INFO:teuthology.orchestra.run.smithi039.stderr:t_immutable.c:2061:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:21.245 INFO:teuthology.orchestra.run.smithi039.stderr: 2061 | asprintf(&path, "%s/immutable.d", dir); 2023-05-16T13:56:21.245 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:21.245 INFO:teuthology.orchestra.run.smithi039.stderr:t_immutable.c:2096:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:21.245 INFO:teuthology.orchestra.run.smithi039.stderr: 2096 | asprintf(&path, "%s/append-only.d", dir); 2023-05-16T13:56:21.245 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:21.246 INFO:teuthology.orchestra.run.smithi039.stderr:t_immutable.c: In function 'remove_test_area': 2023-05-16T13:56:21.246 INFO:teuthology.orchestra.run.smithi039.stderr:t_immutable.c:2152:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:21.246 INFO:teuthology.orchestra.run.smithi039.stderr: 2152 | asprintf(&path, "%s/immutable.d", dir); 2023-05-16T13:56:21.247 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:21.247 INFO:teuthology.orchestra.run.smithi039.stderr:t_immutable.c:2163:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:21.247 INFO:teuthology.orchestra.run.smithi039.stderr: 2163 | asprintf(&path, "%s/empty-immutable.d", dir); 2023-05-16T13:56:21.247 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:21.247 INFO:teuthology.orchestra.run.smithi039.stderr:t_immutable.c:2175:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:21.247 INFO:teuthology.orchestra.run.smithi039.stderr: 2175 | asprintf(&path, "%s/append-only.d", dir); 2023-05-16T13:56:21.247 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:21.247 INFO:teuthology.orchestra.run.smithi039.stderr:t_immutable.c:2186:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:21.248 INFO:teuthology.orchestra.run.smithi039.stderr: 2186 | asprintf(&path, "%s/empty-append-only.d", dir); 2023-05-16T13:56:21.248 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:21.248 INFO:teuthology.orchestra.run.smithi039.stderr:t_immutable.c:2197:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:21.248 INFO:teuthology.orchestra.run.smithi039.stderr: 2197 | asprintf(&path, "%s/append-only.f", dir); 2023-05-16T13:56:21.248 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:21.248 INFO:teuthology.orchestra.run.smithi039.stderr:t_immutable.c:2209:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:21.248 INFO:teuthology.orchestra.run.smithi039.stderr: 2209 | asprintf(&path, "%s/immutable.f", dir); 2023-05-16T13:56:21.249 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:21.250 INFO:teuthology.orchestra.run.smithi039.stderr:t_immutable.c: In function 'check_test_area': 2023-05-16T13:56:21.251 INFO:teuthology.orchestra.run.smithi039.stderr:t_immutable.c:1788:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:21.251 INFO:teuthology.orchestra.run.smithi039.stderr: 1788 | asprintf(&path, "%s/", dir); 2023-05-16T13:56:21.251 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:21.251 INFO:teuthology.orchestra.run.smithi039.stderr:t_immutable.c:1800:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:21.251 INFO:teuthology.orchestra.run.smithi039.stderr: 1800 | asprintf(&path, "%s/immutable.f", dir); 2023-05-16T13:56:21.251 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:21.252 INFO:teuthology.orchestra.run.smithi039.stderr:t_immutable.c:1812:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:21.252 INFO:teuthology.orchestra.run.smithi039.stderr: 1812 | asprintf(&path, "%s/append-only.f", dir); 2023-05-16T13:56:21.252 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:21.252 INFO:teuthology.orchestra.run.smithi039.stderr:t_immutable.c:1824:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:21.252 INFO:teuthology.orchestra.run.smithi039.stderr: 1824 | asprintf(&path, "%s/immutable.d", dir); 2023-05-16T13:56:21.252 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:21.252 INFO:teuthology.orchestra.run.smithi039.stderr:t_immutable.c:1837:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:21.253 INFO:teuthology.orchestra.run.smithi039.stderr: 1837 | asprintf(&path, "%s/append-only.d", dir); 2023-05-16T13:56:21.253 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:21.253 INFO:teuthology.orchestra.run.smithi039.stderr:t_immutable.c:1850:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:21.253 INFO:teuthology.orchestra.run.smithi039.stderr: 1850 | asprintf(&path, "%s/immutable.d/file", dir); 2023-05-16T13:56:21.253 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:21.253 INFO:teuthology.orchestra.run.smithi039.stderr:t_immutable.c:1862:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:21.253 INFO:teuthology.orchestra.run.smithi039.stderr: 1862 | asprintf(&path, "%s/append-only.d/file", dir); 2023-05-16T13:56:21.253 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:21.254 INFO:teuthology.orchestra.run.smithi039.stderr:t_immutable.c:1874:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:21.254 INFO:teuthology.orchestra.run.smithi039.stderr: 1874 | asprintf(&path, "%s/immutable.d/dir", dir); 2023-05-16T13:56:21.254 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:21.254 INFO:teuthology.orchestra.run.smithi039.stderr:t_immutable.c:1887:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:21.254 INFO:teuthology.orchestra.run.smithi039.stderr: 1887 | asprintf(&path, "%s/append-only.d/dir", dir); 2023-05-16T13:56:21.254 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:21.254 INFO:teuthology.orchestra.run.smithi039.stderr:t_immutable.c: In function 'test_immutable': 2023-05-16T13:56:21.255 INFO:teuthology.orchestra.run.smithi039.stderr:t_immutable.c:151:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:21.255 INFO:teuthology.orchestra.run.smithi039.stderr: 151 | asprintf(&path, "%s/immutable.f", dir); 2023-05-16T13:56:21.255 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:21.255 INFO:teuthology.orchestra.run.smithi039.stderr:t_immutable.c:381:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:21.255 INFO:teuthology.orchestra.run.smithi039.stderr: 381 | asprintf(&linkpath, "%s/immutable.f.hardlink", dir); 2023-05-16T13:56:21.255 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:21.255 INFO:teuthology.orchestra.run.smithi039.stderr:t_immutable.c:408:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:21.255 INFO:teuthology.orchestra.run.smithi039.stderr: 408 | chown(path, 0, 0); 2023-05-16T13:56:21.256 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~ 2023-05-16T13:56:21.256 INFO:teuthology.orchestra.run.smithi039.stderr:t_immutable.c:485:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:21.256 INFO:teuthology.orchestra.run.smithi039.stderr: 485 | asprintf(&linkpath, "%s/immutable.f.newname", dir); 2023-05-16T13:56:21.256 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:21.256 INFO:teuthology.orchestra.run.smithi039.stderr:t_immutable.c:532:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:21.256 INFO:teuthology.orchestra.run.smithi039.stderr: 532 | asprintf(&path, "%s/immutable.d/file", dir); 2023-05-16T13:56:21.256 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:21.256 INFO:teuthology.orchestra.run.smithi039.stderr:t_immutable.c:553:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:21.257 INFO:teuthology.orchestra.run.smithi039.stderr: 553 | chown(path, 0, 0); 2023-05-16T13:56:21.257 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~ 2023-05-16T13:56:21.257 INFO:teuthology.orchestra.run.smithi039.stderr:t_immutable.c:556:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:21.257 INFO:teuthology.orchestra.run.smithi039.stderr: 556 | asprintf(&linkpath, "%s/immutable.d/file.link", dir); 2023-05-16T13:56:21.257 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:21.257 INFO:teuthology.orchestra.run.smithi039.stderr:t_immutable.c:575:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:21.257 INFO:teuthology.orchestra.run.smithi039.stderr: 575 | asprintf(&linkpath, "%s/immutable.d/file.newname", dir); 2023-05-16T13:56:21.258 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:21.258 INFO:teuthology.orchestra.run.smithi039.stderr:t_immutable.c:595:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:21.258 INFO:teuthology.orchestra.run.smithi039.stderr: 595 | asprintf(&path, "%s/immutable.d/newfile", dir); 2023-05-16T13:56:21.258 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:21.258 INFO:teuthology.orchestra.run.smithi039.stderr:t_immutable.c:619:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:21.258 INFO:teuthology.orchestra.run.smithi039.stderr: 619 | asprintf(&path, "%s/immutable.d/newdir", dir); 2023-05-16T13:56:21.258 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:21.258 INFO:teuthology.orchestra.run.smithi039.stderr:t_immutable.c:631:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:21.259 INFO:teuthology.orchestra.run.smithi039.stderr: 631 | asprintf(&path, "%s/immutable.d/dir/newfile-%d", dir, getuid()); 2023-05-16T13:56:21.259 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:21.259 INFO:teuthology.orchestra.run.smithi039.stderr:t_immutable.c:653:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:21.259 INFO:teuthology.orchestra.run.smithi039.stderr: 653 | chown(path, 0, 0); 2023-05-16T13:56:21.259 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~ 2023-05-16T13:56:21.259 INFO:teuthology.orchestra.run.smithi039.stderr:t_immutable.c:657:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:21.259 INFO:teuthology.orchestra.run.smithi039.stderr: 657 | asprintf(&path, "%s/immutable.d/dir", dir); 2023-05-16T13:56:21.259 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:21.260 INFO:teuthology.orchestra.run.smithi039.stderr:t_immutable.c:668:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:21.260 INFO:teuthology.orchestra.run.smithi039.stderr: 668 | asprintf(&path, "%s/immutable.d", dir); 2023-05-16T13:56:21.260 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:21.260 INFO:teuthology.orchestra.run.smithi039.stderr:t_immutable.c:705:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:21.260 INFO:teuthology.orchestra.run.smithi039.stderr: 705 | chown(path, 0, 0); 2023-05-16T13:56:21.260 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~ 2023-05-16T13:56:21.260 INFO:teuthology.orchestra.run.smithi039.stderr:t_immutable.c:782:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:21.260 INFO:teuthology.orchestra.run.smithi039.stderr: 782 | asprintf(&path, "%s/empty-immutable.d", dir); 2023-05-16T13:56:21.261 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:21.262 INFO:teuthology.orchestra.run.smithi039.stderr:t_immutable.c: In function 'test_append': 2023-05-16T13:56:21.263 INFO:teuthology.orchestra.run.smithi039.stderr:t_immutable.c:822:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:21.263 INFO:teuthology.orchestra.run.smithi039.stderr: 822 | asprintf(&path, "%s/append-only.f", dir); 2023-05-16T13:56:21.263 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:21.263 INFO:teuthology.orchestra.run.smithi039.stderr:t_immutable.c:1024:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:21.263 INFO:teuthology.orchestra.run.smithi039.stderr: 1024 | asprintf(&linkpath, "%s/append-only.f.hardlink", dir); 2023-05-16T13:56:21.263 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:21.264 INFO:teuthology.orchestra.run.smithi039.stderr:t_immutable.c:1051:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:21.264 INFO:teuthology.orchestra.run.smithi039.stderr: 1051 | chown(path, 0, 0); 2023-05-16T13:56:21.264 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~ 2023-05-16T13:56:21.264 INFO:teuthology.orchestra.run.smithi039.stderr:t_immutable.c:1126:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:21.264 INFO:teuthology.orchestra.run.smithi039.stderr: 1126 | asprintf(&linkpath, "%s/append-only.f.newname", dir); 2023-05-16T13:56:21.264 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:21.264 INFO:teuthology.orchestra.run.smithi039.stderr:t_immutable.c:1495:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:21.264 INFO:teuthology.orchestra.run.smithi039.stderr: 1495 | asprintf(&path, "%s/append-only.d/file", dir); 2023-05-16T13:56:21.265 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:21.265 INFO:teuthology.orchestra.run.smithi039.stderr:t_immutable.c:1516:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:21.265 INFO:teuthology.orchestra.run.smithi039.stderr: 1516 | chown(path, 0, 0); 2023-05-16T13:56:21.265 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~ 2023-05-16T13:56:21.265 INFO:teuthology.orchestra.run.smithi039.stderr:t_immutable.c:1519:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:21.265 INFO:teuthology.orchestra.run.smithi039.stderr: 1519 | asprintf(&linkpath, "%s/append-only.d/file.link-%d", dir, getuid()); 2023-05-16T13:56:21.265 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:21.265 INFO:teuthology.orchestra.run.smithi039.stderr:t_immutable.c:1529:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:21.266 INFO:teuthology.orchestra.run.smithi039.stderr: 1529 | asprintf(&linkpath, "%s/append-only.d/file.symlink-%d", dir, getuid()); 2023-05-16T13:56:21.266 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:21.266 INFO:teuthology.orchestra.run.smithi039.stderr:t_immutable.c:1539:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:21.266 INFO:teuthology.orchestra.run.smithi039.stderr: 1539 | asprintf(&linkpath, "%s/append-only.d/file.newname", dir); 2023-05-16T13:56:21.266 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:21.266 INFO:teuthology.orchestra.run.smithi039.stderr:t_immutable.c:1559:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:21.266 INFO:teuthology.orchestra.run.smithi039.stderr: 1559 | asprintf(&path, "%s/append-only.d/newfile-%d", dir, getuid()); 2023-05-16T13:56:21.266 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:21.267 INFO:teuthology.orchestra.run.smithi039.stderr:t_immutable.c:1573:11: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:21.267 INFO:teuthology.orchestra.run.smithi039.stderr: 1573 | asprintf(&path, "%s/append-only.d/newdev-%d", dir, getuid()); 2023-05-16T13:56:21.267 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:21.267 INFO:teuthology.orchestra.run.smithi039.stderr:t_immutable.c:1586:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:21.267 INFO:teuthology.orchestra.run.smithi039.stderr: 1586 | asprintf(&path, "%s/append-only.d/newdir-%d", dir, getuid()); 2023-05-16T13:56:21.267 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:21.267 INFO:teuthology.orchestra.run.smithi039.stderr:t_immutable.c:1596:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:21.267 INFO:teuthology.orchestra.run.smithi039.stderr: 1596 | asprintf(&path, "%s/append-only.d/newdir-%d/newfile-%d", dir, getuid(), getuid()); 2023-05-16T13:56:21.268 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:21.268 INFO:teuthology.orchestra.run.smithi039.stderr:t_immutable.c:1618:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:21.268 INFO:teuthology.orchestra.run.smithi039.stderr: 1618 | chown(path, 0, 0); 2023-05-16T13:56:21.268 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~ 2023-05-16T13:56:21.268 INFO:teuthology.orchestra.run.smithi039.stderr:t_immutable.c:1622:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:21.268 INFO:teuthology.orchestra.run.smithi039.stderr: 1622 | asprintf(&path, "%s/append-only.d/dir/newfile-%d", dir, getuid()); 2023-05-16T13:56:21.268 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:21.269 INFO:teuthology.orchestra.run.smithi039.stderr:t_immutable.c:1644:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:21.269 INFO:teuthology.orchestra.run.smithi039.stderr: 1644 | chown(path, 0, 0); 2023-05-16T13:56:21.269 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~ 2023-05-16T13:56:21.269 INFO:teuthology.orchestra.run.smithi039.stderr:t_immutable.c:1648:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:21.269 INFO:teuthology.orchestra.run.smithi039.stderr: 1648 | asprintf(&path, "%s/append-only.d/dir", dir); 2023-05-16T13:56:21.269 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:21.269 INFO:teuthology.orchestra.run.smithi039.stderr:t_immutable.c:1659:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:21.269 INFO:teuthology.orchestra.run.smithi039.stderr: 1659 | asprintf(&path, "%s/append-only.d", dir); 2023-05-16T13:56:21.270 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:21.270 INFO:teuthology.orchestra.run.smithi039.stderr:t_immutable.c:1692:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:21.270 INFO:teuthology.orchestra.run.smithi039.stderr: 1692 | chown(path, 0, 0); 2023-05-16T13:56:21.270 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~ 2023-05-16T13:56:21.270 INFO:teuthology.orchestra.run.smithi039.stderr:t_immutable.c:1769:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:21.270 INFO:teuthology.orchestra.run.smithi039.stderr: 1769 | asprintf(&path, "%s/empty-append-only.d", dir); 2023-05-16T13:56:21.270 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:21.834 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] stale_handle 2023-05-16T13:56:21.986 INFO:teuthology.orchestra.run.smithi039.stderr:stale_handle.c: In function 'main': 2023-05-16T13:56:21.987 INFO:teuthology.orchestra.run.smithi039.stderr:stale_handle.c:102:9: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:21.987 INFO:teuthology.orchestra.run.smithi039.stderr: 102 | system("echo 3 > /proc/sys/vm/drop_caches"); 2023-05-16T13:56:21.987 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:22.043 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] pwrite_mmap_blocked 2023-05-16T13:56:22.231 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_dir_offset2 2023-05-16T13:56:22.460 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] seek_sanity_test 2023-05-16T13:56:22.621 INFO:teuthology.orchestra.run.smithi039.stderr:seek_sanity_test.c: In function 'test18': 2023-05-16T13:56:22.621 INFO:teuthology.orchestra.run.smithi039.stderr:seek_sanity_test.c:460:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:22.621 INFO:teuthology.orchestra.run.smithi039.stderr: 460 | ftruncate(fd, 0); 2023-05-16T13:56:22.622 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~ 2023-05-16T13:56:22.623 INFO:teuthology.orchestra.run.smithi039.stderr:seek_sanity_test.c: In function 'test_basic_support': 2023-05-16T13:56:22.623 INFO:teuthology.orchestra.run.smithi039.stderr:seek_sanity_test.c:1207:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:22.623 INFO:teuthology.orchestra.run.smithi039.stderr: 1207 | ftruncate(fd, 0); 2023-05-16T13:56:22.624 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~ 2023-05-16T13:56:22.624 INFO:teuthology.orchestra.run.smithi039.stderr:seek_sanity_test.c:1256:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:22.624 INFO:teuthology.orchestra.run.smithi039.stderr: 1256 | ftruncate(fd, 0); 2023-05-16T13:56:22.624 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~ 2023-05-16T13:56:22.625 INFO:teuthology.orchestra.run.smithi039.stderr:seek_sanity_test.c: In function 'get_io_sizes': 2023-05-16T13:56:22.625 INFO:teuthology.orchestra.run.smithi039.stderr:seek_sanity_test.c:88:17: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:22.625 INFO:teuthology.orchestra.run.smithi039.stderr: 88 | ftruncate(fd, 0); 2023-05-16T13:56:22.625 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~ 2023-05-16T13:56:22.625 INFO:teuthology.orchestra.run.smithi039.stderr:seek_sanity_test.c:89:17: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:22.625 INFO:teuthology.orchestra.run.smithi039.stderr: 89 | pwrite(fd, "a", 1, offset); 2023-05-16T13:56:22.626 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:22.626 INFO:teuthology.orchestra.run.smithi039.stderr:seek_sanity_test.c:98:17: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:22.626 INFO:teuthology.orchestra.run.smithi039.stderr: 98 | ftruncate(fd, 0); 2023-05-16T13:56:22.626 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~ 2023-05-16T13:56:22.626 INFO:teuthology.orchestra.run.smithi039.stderr:seek_sanity_test.c:99:17: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:22.626 INFO:teuthology.orchestra.run.smithi039.stderr: 99 | pwrite(fd, "a", 1, offset); 2023-05-16T13:56:22.626 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:22.951 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] seek_copy_test 2023-05-16T13:56:23.166 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_readdir_1 2023-05-16T13:56:23.307 INFO:teuthology.orchestra.run.smithi039.stderr:t_readdir_1.c: In function 'main': 2023-05-16T13:56:23.307 INFO:teuthology.orchestra.run.smithi039.stderr:t_readdir_1.c:30:25: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:23.307 INFO:teuthology.orchestra.run.smithi039.stderr: 30 | read(fd, buf, 100); 2023-05-16T13:56:23.307 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:23.348 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_readdir_2 2023-05-16T13:56:23.531 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] fsync-tester 2023-05-16T13:56:23.673 INFO:teuthology.orchestra.run.smithi039.stderr:fsync-tester.c: In function 'main': 2023-05-16T13:56:23.673 INFO:teuthology.orchestra.run.smithi039.stderr:fsync-tester.c:391:17: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:23.673 INFO:teuthology.orchestra.run.smithi039.stderr: 391 | read(fd, &seed, sizeof(seed)); 2023-05-16T13:56:23.674 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:23.674 INFO:teuthology.orchestra.run.smithi039.stderr:fsync-tester.c:541:17: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:23.674 INFO:teuthology.orchestra.run.smithi039.stderr: 541 | system("reboot -fn"); 2023-05-16T13:56:23.674 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:23.675 INFO:teuthology.orchestra.run.smithi039.stderr:fsync-tester.c: In function 'drop_all_caches': 2023-05-16T13:56:23.675 INFO:teuthology.orchestra.run.smithi039.stderr:fsync-tester.c:90:9: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:23.675 INFO:teuthology.orchestra.run.smithi039.stderr: 90 | write(fd, value, sizeof(value)-1); 2023-05-16T13:56:23.675 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:23.826 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] nsexec 2023-05-16T13:56:24.042 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] cloner 2023-05-16T13:56:24.255 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] renameat2 2023-05-16T13:56:24.458 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_getcwd 2023-05-16T13:56:24.599 INFO:teuthology.orchestra.run.smithi039.stderr:t_getcwd.c: In function 'test_getcwd': 2023-05-16T13:56:24.599 INFO:teuthology.orchestra.run.smithi039.stderr:t_getcwd.c:21:17: warning: ignoring return value of 'getcwd' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:24.599 INFO:teuthology.orchestra.run.smithi039.stderr: 21 | getcwd(cur_cwd, BUF_SIZE); 2023-05-16T13:56:24.599 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:24.654 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] e4compact 2023-05-16T13:56:24.898 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] test-nextquota 2023-05-16T13:56:25.109 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] punch-alternating 2023-05-16T13:56:25.318 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] attr-list-by-handle-cursor-test 2023-05-16T13:56:25.522 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] listxattr 2023-05-16T13:56:25.701 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] dio-interleaved 2023-05-16T13:56:25.900 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_dir_type 2023-05-16T13:56:26.090 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] dio-invalidate-cache 2023-05-16T13:56:26.232 INFO:teuthology.orchestra.run.smithi039.stderr:dio-invalidate-cache.c: In function 'main': 2023-05-16T13:56:26.232 INFO:teuthology.orchestra.run.smithi039.stderr:dio-invalidate-cache.c:286:17: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:26.233 INFO:teuthology.orchestra.run.smithi039.stderr: 286 | write(fd, buf, blksz * nr_child); 2023-05-16T13:56:26.233 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:26.332 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] stat_test 2023-05-16T13:56:26.670 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_encrypted_d_revalidate 2023-05-16T13:56:26.871 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] attr_replace_test 2023-05-16T13:56:27.072 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] swapon 2023-05-16T13:56:27.274 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] mkswap 2023-05-16T13:56:27.461 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_attr_corruption 2023-05-16T13:56:27.645 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_open_tmpfiles 2023-05-16T13:56:27.862 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] fscrypt-crypt-util 2023-05-16T13:56:28.575 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] bulkstat_null_ocount 2023-05-16T13:56:28.769 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] splice-test 2023-05-16T13:56:28.989 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] chprojid_fail 2023-05-16T13:56:29.189 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] detached_mounts_propagation 2023-05-16T13:56:29.412 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] ext4_resize 2023-05-16T13:56:29.595 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_readdir_3 2023-05-16T13:56:29.828 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] splice2pipe 2023-05-16T13:56:29.968 INFO:teuthology.orchestra.run.smithi039.stderr:splice2pipe.c: In function 'prepare_pipe': 2023-05-16T13:56:29.968 INFO:teuthology.orchestra.run.smithi039.stderr:splice2pipe.c:56:17: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:29.969 INFO:teuthology.orchestra.run.smithi039.stderr: 56 | write(p[1], buffer, n); 2023-05-16T13:56:29.969 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:29.969 INFO:teuthology.orchestra.run.smithi039.stderr:splice2pipe.c:64:17: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:29.969 INFO:teuthology.orchestra.run.smithi039.stderr: 64 | read(p[0], buffer, n); 2023-05-16T13:56:29.969 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:30.026 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] uuid_ioctl 2023-05-16T13:56:30.217 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] fiemap-tester 2023-05-16T13:56:30.529 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_stripealign 2023-05-16T13:56:30.718 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] open_by_handle 2023-05-16T13:56:31.009 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_mmap_dio 2023-05-16T13:56:31.208 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] xfsfind 2023-05-16T13:56:31.445 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] fssum 2023-05-16T13:56:31.930 INFO:teuthology.orchestra.run.smithi039.stdout:Building log-writes 2023-05-16T13:56:31.938 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] replay-log 2023-05-16T13:56:32.316 INFO:teuthology.orchestra.run.smithi039.stdout:Building perf 2023-05-16T13:56:32.322 INFO:teuthology.orchestra.run.smithi039.stdout:Building aio-dio-regress 2023-05-16T13:56:32.331 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] aiocp 2023-05-16T13:56:32.608 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] aio-dio-append-write-fallocate-race 2023-05-16T13:56:32.823 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] aio-dio-append-write-read-race 2023-05-16T13:56:33.045 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] aio-dio-cow-race 2023-05-16T13:56:33.242 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] aio-dio-cycle-write 2023-05-16T13:56:33.382 INFO:teuthology.orchestra.run.smithi039.stderr:aio-dio-cycle-write.c: In function 'init_test': 2023-05-16T13:56:33.383 INFO:teuthology.orchestra.run.smithi039.stderr:aio-dio-cycle-write.c:83:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:33.383 INFO:teuthology.orchestra.run.smithi039.stderr: 83 | ftruncate(fd, buf_size); 2023-05-16T13:56:33.383 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:33.474 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] aio-dio-eof-race 2023-05-16T13:56:33.703 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] aio-dio-extend-stat 2023-05-16T13:56:33.912 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] aio-dio-fcntl-race 2023-05-16T13:56:34.117 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] aio-dio-hole-filling-race 2023-05-16T13:56:34.310 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] aio-dio-invalidate-failure 2023-05-16T13:56:34.516 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] aio-dio-invalidate-readahead 2023-05-16T13:56:34.724 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] aiodio_sparse2 2023-05-16T13:56:34.866 INFO:teuthology.orchestra.run.smithi039.stderr:aiodio_sparse2.c: In function 'aiodio_sparse': 2023-05-16T13:56:34.867 INFO:teuthology.orchestra.run.smithi039.stderr:aiodio_sparse2.c:111:17: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:34.867 INFO:teuthology.orchestra.run.smithi039.stderr: 111 | ftruncate(fd, filesize); 2023-05-16T13:56:34.867 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:34.867 INFO:teuthology.orchestra.run.smithi039.stderr:aiodio_sparse2.c: In function 'dirty_freeblocks': 2023-05-16T13:56:34.868 INFO:teuthology.orchestra.run.smithi039.stderr:aiodio_sparse2.c:274:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-16T13:56:34.868 INFO:teuthology.orchestra.run.smithi039.stderr: 274 | ftruncate(fd, size); 2023-05-16T13:56:34.868 INFO:teuthology.orchestra.run.smithi039.stderr: | ^~~~~~~~~~~~~~~~~~~ 2023-05-16T13:56:34.992 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] aio-dio-subblock-eof-read 2023-05-16T13:56:35.180 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] aio-dio-write-verify 2023-05-16T13:56:35.421 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-05-16T13:56:35.595 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-05-16T13:56:35.768 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] aio-last-ref-held-by-io 2023-05-16T13:56:35.990 INFO:teuthology.orchestra.run.smithi039.stdout:Building vfs 2023-05-16T13:56:35.999 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] vfstest 2023-05-16T13:56:36.345 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T13:56:36.349 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T13:56:38.321 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] mount-idmapped 2023-05-16T13:56:38.767 INFO:teuthology.orchestra.run.smithi039.stdout:Building m4 2023-05-16T13:56:38.773 INFO:teuthology.orchestra.run.smithi039.stdout:Building common 2023-05-16T13:56:38.779 INFO:teuthology.orchestra.run.smithi039.stdout:Building tests 2023-05-16T13:56:38.788 INFO:teuthology.orchestra.run.smithi039.stdout:Building btrfs 2023-05-16T13:56:38.798 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.lZk1FbzUP3xfstests-dev/tests/btrfs/group.list 2023-05-16T13:56:38.918 INFO:teuthology.orchestra.run.smithi039.stdout:Building ceph 2023-05-16T13:56:38.926 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.lZk1FbzUP3xfstests-dev/tests/ceph/group.list 2023-05-16T13:56:38.956 INFO:teuthology.orchestra.run.smithi039.stdout:Building cifs 2023-05-16T13:56:38.964 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.lZk1FbzUP3xfstests-dev/tests/cifs/group.list 2023-05-16T13:56:38.990 INFO:teuthology.orchestra.run.smithi039.stdout:Building ext4 2023-05-16T13:56:38.998 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.lZk1FbzUP3xfstests-dev/tests/ext4/group.list 2023-05-16T13:56:39.077 INFO:teuthology.orchestra.run.smithi039.stdout:Building f2fs 2023-05-16T13:56:39.085 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.lZk1FbzUP3xfstests-dev/tests/f2fs/group.list 2023-05-16T13:56:39.122 INFO:teuthology.orchestra.run.smithi039.stdout:Building generic 2023-05-16T13:56:39.132 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.lZk1FbzUP3xfstests-dev/tests/generic/group.list 2023-05-16T13:56:39.336 INFO:teuthology.orchestra.run.smithi039.stdout:Building nfs 2023-05-16T13:56:39.344 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.lZk1FbzUP3xfstests-dev/tests/nfs/group.list 2023-05-16T13:56:39.374 INFO:teuthology.orchestra.run.smithi039.stdout:Building ocfs2 2023-05-16T13:56:39.382 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.lZk1FbzUP3xfstests-dev/tests/ocfs2/group.list 2023-05-16T13:56:39.410 INFO:teuthology.orchestra.run.smithi039.stdout:Building overlay 2023-05-16T13:56:39.419 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.lZk1FbzUP3xfstests-dev/tests/overlay/group.list 2023-05-16T13:56:39.500 INFO:teuthology.orchestra.run.smithi039.stdout:Building perf 2023-05-16T13:56:39.508 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.lZk1FbzUP3xfstests-dev/tests/perf/group.list 2023-05-16T13:56:39.532 INFO:teuthology.orchestra.run.smithi039.stdout:Building selftest 2023-05-16T13:56:39.540 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.lZk1FbzUP3xfstests-dev/tests/selftest/group.list 2023-05-16T13:56:39.566 INFO:teuthology.orchestra.run.smithi039.stdout:Building shared 2023-05-16T13:56:39.575 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.lZk1FbzUP3xfstests-dev/tests/shared/group.list 2023-05-16T13:56:39.611 INFO:teuthology.orchestra.run.smithi039.stdout:Building tmpfs 2023-05-16T13:56:39.619 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.lZk1FbzUP3xfstests-dev/tests/tmpfs/group.list 2023-05-16T13:56:39.646 INFO:teuthology.orchestra.run.smithi039.stdout:Building udf 2023-05-16T13:56:39.655 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.lZk1FbzUP3xfstests-dev/tests/udf/group.list 2023-05-16T13:56:39.678 INFO:teuthology.orchestra.run.smithi039.stdout:Building xfs 2023-05-16T13:56:39.689 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.lZk1FbzUP3xfstests-dev/tests/xfs/group.list 2023-05-16T13:56:39.896 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.lZk1FbzUP3xfstests-dev && exec sudo make install) 2023-05-16T13:56:39.937 INFO:teuthology.orchestra.run.smithi039.stdout:Building include 2023-05-16T13:56:39.942 INFO:teuthology.orchestra.run.smithi039.stdout:Building lib 2023-05-16T13:56:39.949 INFO:teuthology.orchestra.run.smithi039.stdout:Building ltp 2023-05-16T13:56:39.956 INFO:teuthology.orchestra.run.smithi039.stdout:Building src 2023-05-16T13:56:40.009 INFO:teuthology.orchestra.run.smithi039.stdout:Building log-writes 2023-05-16T13:56:40.014 INFO:teuthology.orchestra.run.smithi039.stdout:Building perf 2023-05-16T13:56:40.020 INFO:teuthology.orchestra.run.smithi039.stdout:Building aio-dio-regress 2023-05-16T13:56:40.027 INFO:teuthology.orchestra.run.smithi039.stdout:Building vfs 2023-05-16T13:56:40.034 INFO:teuthology.orchestra.run.smithi039.stdout:Building m4 2023-05-16T13:56:40.040 INFO:teuthology.orchestra.run.smithi039.stdout:Building common 2023-05-16T13:56:40.046 INFO:teuthology.orchestra.run.smithi039.stdout:Building tests 2023-05-16T13:56:40.054 INFO:teuthology.orchestra.run.smithi039.stdout:Building btrfs 2023-05-16T13:56:40.064 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.lZk1FbzUP3xfstests-dev/tests/btrfs/group.list 2023-05-16T13:56:40.181 INFO:teuthology.orchestra.run.smithi039.stdout:Building ceph 2023-05-16T13:56:40.190 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.lZk1FbzUP3xfstests-dev/tests/ceph/group.list 2023-05-16T13:56:40.220 INFO:teuthology.orchestra.run.smithi039.stdout:Building cifs 2023-05-16T13:56:40.228 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.lZk1FbzUP3xfstests-dev/tests/cifs/group.list 2023-05-16T13:56:40.254 INFO:teuthology.orchestra.run.smithi039.stdout:Building ext4 2023-05-16T13:56:40.263 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.lZk1FbzUP3xfstests-dev/tests/ext4/group.list 2023-05-16T13:56:40.342 INFO:teuthology.orchestra.run.smithi039.stdout:Building f2fs 2023-05-16T13:56:40.350 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.lZk1FbzUP3xfstests-dev/tests/f2fs/group.list 2023-05-16T13:56:40.386 INFO:teuthology.orchestra.run.smithi039.stdout:Building generic 2023-05-16T13:56:40.396 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.lZk1FbzUP3xfstests-dev/tests/generic/group.list 2023-05-16T13:56:40.595 INFO:teuthology.orchestra.run.smithi039.stdout:Building nfs 2023-05-16T13:56:40.603 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.lZk1FbzUP3xfstests-dev/tests/nfs/group.list 2023-05-16T13:56:40.633 INFO:teuthology.orchestra.run.smithi039.stdout:Building ocfs2 2023-05-16T13:56:40.642 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.lZk1FbzUP3xfstests-dev/tests/ocfs2/group.list 2023-05-16T13:56:40.670 INFO:teuthology.orchestra.run.smithi039.stdout:Building overlay 2023-05-16T13:56:40.678 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.lZk1FbzUP3xfstests-dev/tests/overlay/group.list 2023-05-16T13:56:40.758 INFO:teuthology.orchestra.run.smithi039.stdout:Building perf 2023-05-16T13:56:40.767 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.lZk1FbzUP3xfstests-dev/tests/perf/group.list 2023-05-16T13:56:40.791 INFO:teuthology.orchestra.run.smithi039.stdout:Building selftest 2023-05-16T13:56:40.799 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.lZk1FbzUP3xfstests-dev/tests/selftest/group.list 2023-05-16T13:56:40.825 INFO:teuthology.orchestra.run.smithi039.stdout:Building shared 2023-05-16T13:56:40.834 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.lZk1FbzUP3xfstests-dev/tests/shared/group.list 2023-05-16T13:56:40.870 INFO:teuthology.orchestra.run.smithi039.stdout:Building tmpfs 2023-05-16T13:56:40.878 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.lZk1FbzUP3xfstests-dev/tests/tmpfs/group.list 2023-05-16T13:56:40.906 INFO:teuthology.orchestra.run.smithi039.stdout:Building udf 2023-05-16T13:56:40.915 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.lZk1FbzUP3xfstests-dev/tests/udf/group.list 2023-05-16T13:56:40.939 INFO:teuthology.orchestra.run.smithi039.stdout:Building xfs 2023-05-16T13:56:40.949 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.lZk1FbzUP3xfstests-dev/tests/xfs/group.list 2023-05-16T13:56:41.150 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2023-05-16T13:56:41.154 INFO:teuthology.orchestra.run.smithi039.stdout:gmake[1]: Nothing to be done for 'install'. 2023-05-16T13:56:41.154 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2023-05-16T13:56:41.159 INFO:teuthology.orchestra.run.smithi039.stdout:gmake[1]: Nothing to be done for 'install'. 2023-05-16T13:56:41.159 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2023-05-16T13:56:41.163 INFO:teuthology.orchestra.run.smithi039.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-05-16T13:56:41.183 INFO:teuthology.orchestra.run.smithi039.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-05-16T13:56:41.329 INFO:teuthology.orchestra.run.smithi039.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-05-16T13:56:41.348 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2023-05-16T13:56:41.375 INFO:teuthology.orchestra.run.smithi039.stdout:Building log-writes 2023-05-16T13:56:41.381 INFO:teuthology.orchestra.run.smithi039.stdout:Building perf 2023-05-16T13:56:41.387 INFO:teuthology.orchestra.run.smithi039.stdout:Building aio-dio-regress 2023-05-16T13:56:41.394 INFO:teuthology.orchestra.run.smithi039.stdout:Building vfs 2023-05-16T13:56:41.399 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/gmake -C log-writes install 2023-05-16T13:56:41.402 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-05-16T13:56:41.421 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-05-16T13:56:41.440 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/gmake -C perf install 2023-05-16T13:56:41.444 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-05-16T13:56:41.462 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 FioCompare.py fio-insert-and-compare.py FioResultDecoder.py generate-schema.py ResultData.py fio-results.sql /var/lib/xfstests/src/perf 2023-05-16T13:56:41.507 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/gmake -C aio-dio-regress install 2023-05-16T13:56:41.512 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-05-16T13:56:41.530 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 aiocp aio-dio-append-write-fallocate-race aio-dio-append-write-read-race aio-dio-cow-race aio-dio-cycle-write aio-dio-eof-race aio-dio-extend-stat aio-dio-fcntl-race aio-dio-hole-filling-race aio-dio-invalidate-failure aio-dio-invalidate-readahead aiodio_sparse2 aio-dio-subblock-eof-read aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-io-setup-with-nonwritable-context-pointer aio-last-ref-held-by-io /var/lib/xfstests/src/aio-dio-regress 2023-05-16T13:56:41.636 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/gmake -C vfs install 2023-05-16T13:56:41.638 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-05-16T13:56:41.657 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-05-16T13:56:41.683 INFO:teuthology.orchestra.run.smithi039.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-05-16T13:56:41.701 INFO:teuthology.orchestra.run.smithi039.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle t_mmap_dio xfsfind fssum /var/lib/xfstests/src 2023-05-16T13:56:44.220 INFO:teuthology.orchestra.run.smithi039.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py /var/lib/xfstests/src 2023-05-16T13:56:44.404 INFO:teuthology.orchestra.run.smithi039.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-05-16T13:56:44.447 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2023-05-16T13:56:44.451 INFO:teuthology.orchestra.run.smithi039.stdout:gmake[1]: Nothing to be done for 'install'. 2023-05-16T13:56:44.451 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2023-05-16T13:56:44.455 INFO:teuthology.orchestra.run.smithi039.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-05-16T13:56:44.473 INFO:teuthology.orchestra.run.smithi039.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-05-16T13:56:44.727 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2023-05-16T13:56:44.731 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.lZk1FbzUP3xfstests-dev/tests/btrfs/ install 2023-05-16T13:56:44.736 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-05-16T13:56:44.755 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 290 291 299 /var/lib/xfstests/tests/btrfs 2023-05-16T13:56:46.291 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-05-16T13:56:46.310 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 290.out 291.out 299.out /var/lib/xfstests/tests/btrfs 2023-05-16T13:56:47.850 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.lZk1FbzUP3xfstests-dev/tests/ceph/ install 2023-05-16T13:56:47.853 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-05-16T13:56:47.872 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-05-16T13:56:47.912 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-05-16T13:56:47.930 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out /var/lib/xfstests/tests/ceph 2023-05-16T13:56:47.970 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.lZk1FbzUP3xfstests-dev/tests/cifs/ install 2023-05-16T13:56:47.974 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-05-16T13:56:47.993 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-05-16T13:56:48.011 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-05-16T13:56:48.030 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-05-16T13:56:48.049 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.lZk1FbzUP3xfstests-dev/tests/ext4/ install 2023-05-16T13:56:48.053 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-05-16T13:56:48.072 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-05-16T13:56:48.439 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-05-16T13:56:48.458 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 644 001.out.default 001.out.nodelalloc 001.out.nozero 001.cfg 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 271.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out /var/lib/xfstests/tests/ext4 2023-05-16T13:56:48.846 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.lZk1FbzUP3xfstests-dev/tests/f2fs/ install 2023-05-16T13:56:48.850 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-05-16T13:56:48.868 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-05-16T13:56:48.892 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-05-16T13:56:48.911 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-05-16T13:56:48.935 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.lZk1FbzUP3xfstests-dev/tests/generic/ install 2023-05-16T13:56:48.943 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-05-16T13:56:48.961 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 /var/lib/xfstests/tests/generic 2023-05-16T13:56:52.794 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-05-16T13:56:52.813 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 644 035.out.default 035.out.nfs 050.out.default 050.out.nojournal 050.out.xfsquota 035.cfg 050.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 608.out 609.out 610.out 611.out 612.out 613.out 614.out 615.out 616.out 617.out 618.out 619.out 620.out 621.out 622.out 623.out 624.out 625.out 626.out 627.out 628.out 629.out 630.out 631.out 632.out 633.out 634.out 635.out 636.out 637.out 638.out 639.out 640.out 641.out 642.out 643.out 644.out 645.out 646.out 647.out 648.out 649.out 650.out 651.out 652.out 653.out 654.out 655.out 656.out 657.out 658.out 659.out 660.out 661.out 662.out 663.out 664.out 665.out 666.out 667.out 668.out 669.out 670.out 671.out 672.out 673.out 674.out 675.out 676.out 677.out 678.out 679.out 680.out 681.out 682.out 683.out 684.out 685.out 686.out 687.out 688.out 689.out 690.out 691.out 692.out 693.out 694.out 695.out 696.out 697.out 698.out 699.out 700.out 701.out 702.out 703.out 704.out 705.out 706.out 707.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out /var/lib/xfstests/tests/generic 2023-05-16T13:56:56.682 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.lZk1FbzUP3xfstests-dev/tests/nfs/ install 2023-05-16T13:56:56.685 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-05-16T13:56:56.704 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-05-16T13:56:56.723 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-05-16T13:56:56.741 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-05-16T13:56:56.761 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.lZk1FbzUP3xfstests-dev/tests/ocfs2/ install 2023-05-16T13:56:56.765 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-05-16T13:56:56.784 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-05-16T13:56:56.803 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-05-16T13:56:56.822 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-05-16T13:56:56.841 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.lZk1FbzUP3xfstests-dev/tests/overlay/ install 2023-05-16T13:56:56.845 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-05-16T13:56:56.864 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-05-16T13:56:57.380 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-05-16T13:56:57.399 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out /var/lib/xfstests/tests/overlay 2023-05-16T13:56:57.917 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.lZk1FbzUP3xfstests-dev/tests/perf/ install 2023-05-16T13:56:57.921 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-05-16T13:56:57.940 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-05-16T13:56:57.958 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-05-16T13:56:57.977 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-05-16T13:56:57.996 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.lZk1FbzUP3xfstests-dev/tests/selftest/ install 2023-05-16T13:56:58.000 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-05-16T13:56:58.019 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-05-16T13:56:58.063 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-05-16T13:56:58.082 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out /var/lib/xfstests/tests/selftest 2023-05-16T13:56:58.127 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.lZk1FbzUP3xfstests-dev/tests/shared/ install 2023-05-16T13:56:58.131 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-05-16T13:56:58.150 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-05-16T13:56:58.179 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-05-16T13:56:58.198 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 644 002.out 032.out 298.out /var/lib/xfstests/tests/shared 2023-05-16T13:56:58.227 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.lZk1FbzUP3xfstests-dev/tests/tmpfs/ install 2023-05-16T13:56:58.231 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-05-16T13:56:58.250 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-05-16T13:56:58.268 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-05-16T13:56:58.287 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-05-16T13:56:58.306 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.lZk1FbzUP3xfstests-dev/tests/udf/ install 2023-05-16T13:56:58.310 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-05-16T13:56:58.328 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-05-16T13:56:58.347 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-05-16T13:56:58.366 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-05-16T13:56:58.384 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.lZk1FbzUP3xfstests-dev/tests/xfs/ install 2023-05-16T13:56:58.392 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-05-16T13:56:58.410 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-05-16T13:57:02.036 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-05-16T13:57:02.055 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 644 033.out.crc 033.out.default 071.out.32 071.out.64 096.out.external 096.out.internal 216.out.64mblog 216.out.classic 033.cfg 216.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out 740.out 741.out 742.out 743.out 744.out 745.out 746.out 747.out 748.out 749.out 750.out 751.out 752.out 753.out 754.out 755.out 756.out 757.out 758.out 759.out 760.out 761.out 762.out 763.out 764.out 765.out 766.out 767.out 768.out 769.out 770.out 771.out 772.out 773.out 774.out 775.out 776.out 777.out 778.out 779.out 780.out 781.out 782.out 783.out 784.out 785.out 786.out 787.out 788.out 789.out 790.out 791.out 792.out 793.out 794.out 795.out 796.out 797.out 798.out 799.out 800.out /var/lib/xfstests/tests/xfs 2023-05-16T13:57:05.734 INFO:teuthology.orchestra.run.smithi039.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-05-16T13:57:05.762 INFO:teuthology.orchestra.run.smithi039.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-05-16T13:57:05.780 INFO:teuthology.orchestra.run.smithi039.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-05-16T13:57:05.799 INFO:teuthology.orchestra.run.smithi039.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-05-16T13:57:05.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-16T13:57:05.821 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.lZk1FbzUP3xfstests-dev && exec ls tests/generic) 2023-05-16T13:57:05.872 INFO:teuthology.orchestra.run.smithi039.stdout:001 2023-05-16T13:57:05.873 INFO:teuthology.orchestra.run.smithi039.stdout:001.out 2023-05-16T13:57:05.873 INFO:teuthology.orchestra.run.smithi039.stdout:002 2023-05-16T13:57:05.873 INFO:teuthology.orchestra.run.smithi039.stdout:002.out 2023-05-16T13:57:05.873 INFO:teuthology.orchestra.run.smithi039.stdout:003 2023-05-16T13:57:05.873 INFO:teuthology.orchestra.run.smithi039.stdout:003.out 2023-05-16T13:57:05.873 INFO:teuthology.orchestra.run.smithi039.stdout:004 2023-05-16T13:57:05.873 INFO:teuthology.orchestra.run.smithi039.stdout:004.out 2023-05-16T13:57:05.873 INFO:teuthology.orchestra.run.smithi039.stdout:005 2023-05-16T13:57:05.874 INFO:teuthology.orchestra.run.smithi039.stdout:005.out 2023-05-16T13:57:05.874 INFO:teuthology.orchestra.run.smithi039.stdout:006 2023-05-16T13:57:05.874 INFO:teuthology.orchestra.run.smithi039.stdout:006.out 2023-05-16T13:57:05.874 INFO:teuthology.orchestra.run.smithi039.stdout:007 2023-05-16T13:57:05.874 INFO:teuthology.orchestra.run.smithi039.stdout:007.out 2023-05-16T13:57:05.874 INFO:teuthology.orchestra.run.smithi039.stdout:008 2023-05-16T13:57:05.874 INFO:teuthology.orchestra.run.smithi039.stdout:008.out 2023-05-16T13:57:05.875 INFO:teuthology.orchestra.run.smithi039.stdout:009 2023-05-16T13:57:05.875 INFO:teuthology.orchestra.run.smithi039.stdout:009.out 2023-05-16T13:57:05.875 INFO:teuthology.orchestra.run.smithi039.stdout:010 2023-05-16T13:57:05.875 INFO:teuthology.orchestra.run.smithi039.stdout:010.out 2023-05-16T13:57:05.875 INFO:teuthology.orchestra.run.smithi039.stdout:011 2023-05-16T13:57:05.875 INFO:teuthology.orchestra.run.smithi039.stdout:011.out 2023-05-16T13:57:05.875 INFO:teuthology.orchestra.run.smithi039.stdout:012 2023-05-16T13:57:05.875 INFO:teuthology.orchestra.run.smithi039.stdout:012.out 2023-05-16T13:57:05.876 INFO:teuthology.orchestra.run.smithi039.stdout:013 2023-05-16T13:57:05.876 INFO:teuthology.orchestra.run.smithi039.stdout:013.out 2023-05-16T13:57:05.876 INFO:teuthology.orchestra.run.smithi039.stdout:014 2023-05-16T13:57:05.876 INFO:teuthology.orchestra.run.smithi039.stdout:014.out 2023-05-16T13:57:05.876 INFO:teuthology.orchestra.run.smithi039.stdout:015 2023-05-16T13:57:05.876 INFO:teuthology.orchestra.run.smithi039.stdout:015.out 2023-05-16T13:57:05.876 INFO:teuthology.orchestra.run.smithi039.stdout:016 2023-05-16T13:57:05.876 INFO:teuthology.orchestra.run.smithi039.stdout:016.out 2023-05-16T13:57:05.877 INFO:teuthology.orchestra.run.smithi039.stdout:017 2023-05-16T13:57:05.877 INFO:teuthology.orchestra.run.smithi039.stdout:017.out 2023-05-16T13:57:05.877 INFO:teuthology.orchestra.run.smithi039.stdout:018 2023-05-16T13:57:05.877 INFO:teuthology.orchestra.run.smithi039.stdout:018.out 2023-05-16T13:57:05.877 INFO:teuthology.orchestra.run.smithi039.stdout:019 2023-05-16T13:57:05.877 INFO:teuthology.orchestra.run.smithi039.stdout:019.out 2023-05-16T13:57:05.877 INFO:teuthology.orchestra.run.smithi039.stdout:020 2023-05-16T13:57:05.877 INFO:teuthology.orchestra.run.smithi039.stdout:020.out 2023-05-16T13:57:05.878 INFO:teuthology.orchestra.run.smithi039.stdout:021 2023-05-16T13:57:05.878 INFO:teuthology.orchestra.run.smithi039.stdout:021.out 2023-05-16T13:57:05.878 INFO:teuthology.orchestra.run.smithi039.stdout:022 2023-05-16T13:57:05.878 INFO:teuthology.orchestra.run.smithi039.stdout:022.out 2023-05-16T13:57:05.878 INFO:teuthology.orchestra.run.smithi039.stdout:023 2023-05-16T13:57:05.878 INFO:teuthology.orchestra.run.smithi039.stdout:023.out 2023-05-16T13:57:05.878 INFO:teuthology.orchestra.run.smithi039.stdout:024 2023-05-16T13:57:05.878 INFO:teuthology.orchestra.run.smithi039.stdout:024.out 2023-05-16T13:57:05.879 INFO:teuthology.orchestra.run.smithi039.stdout:025 2023-05-16T13:57:05.879 INFO:teuthology.orchestra.run.smithi039.stdout:025.out 2023-05-16T13:57:05.879 INFO:teuthology.orchestra.run.smithi039.stdout:026 2023-05-16T13:57:05.879 INFO:teuthology.orchestra.run.smithi039.stdout:026.out 2023-05-16T13:57:05.879 INFO:teuthology.orchestra.run.smithi039.stdout:027 2023-05-16T13:57:05.879 INFO:teuthology.orchestra.run.smithi039.stdout:027.out 2023-05-16T13:57:05.879 INFO:teuthology.orchestra.run.smithi039.stdout:028 2023-05-16T13:57:05.879 INFO:teuthology.orchestra.run.smithi039.stdout:028.out 2023-05-16T13:57:05.880 INFO:teuthology.orchestra.run.smithi039.stdout:029 2023-05-16T13:57:05.880 INFO:teuthology.orchestra.run.smithi039.stdout:029.out 2023-05-16T13:57:05.880 INFO:teuthology.orchestra.run.smithi039.stdout:030 2023-05-16T13:57:05.880 INFO:teuthology.orchestra.run.smithi039.stdout:030.out 2023-05-16T13:57:05.880 INFO:teuthology.orchestra.run.smithi039.stdout:031 2023-05-16T13:57:05.880 INFO:teuthology.orchestra.run.smithi039.stdout:031.out 2023-05-16T13:57:05.880 INFO:teuthology.orchestra.run.smithi039.stdout:032 2023-05-16T13:57:05.880 INFO:teuthology.orchestra.run.smithi039.stdout:032.out 2023-05-16T13:57:05.881 INFO:teuthology.orchestra.run.smithi039.stdout:033 2023-05-16T13:57:05.881 INFO:teuthology.orchestra.run.smithi039.stdout:033.out 2023-05-16T13:57:05.881 INFO:teuthology.orchestra.run.smithi039.stdout:034 2023-05-16T13:57:05.881 INFO:teuthology.orchestra.run.smithi039.stdout:034.out 2023-05-16T13:57:05.881 INFO:teuthology.orchestra.run.smithi039.stdout:035 2023-05-16T13:57:05.881 INFO:teuthology.orchestra.run.smithi039.stdout:035.cfg 2023-05-16T13:57:05.881 INFO:teuthology.orchestra.run.smithi039.stdout:035.out.default 2023-05-16T13:57:05.881 INFO:teuthology.orchestra.run.smithi039.stdout:035.out.nfs 2023-05-16T13:57:05.882 INFO:teuthology.orchestra.run.smithi039.stdout:036 2023-05-16T13:57:05.882 INFO:teuthology.orchestra.run.smithi039.stdout:036.out 2023-05-16T13:57:05.882 INFO:teuthology.orchestra.run.smithi039.stdout:037 2023-05-16T13:57:05.882 INFO:teuthology.orchestra.run.smithi039.stdout:037.out 2023-05-16T13:57:05.882 INFO:teuthology.orchestra.run.smithi039.stdout:038 2023-05-16T13:57:05.882 INFO:teuthology.orchestra.run.smithi039.stdout:038.out 2023-05-16T13:57:05.882 INFO:teuthology.orchestra.run.smithi039.stdout:039 2023-05-16T13:57:05.883 INFO:teuthology.orchestra.run.smithi039.stdout:039.out 2023-05-16T13:57:05.883 INFO:teuthology.orchestra.run.smithi039.stdout:040 2023-05-16T13:57:05.883 INFO:teuthology.orchestra.run.smithi039.stdout:040.out 2023-05-16T13:57:05.883 INFO:teuthology.orchestra.run.smithi039.stdout:041 2023-05-16T13:57:05.883 INFO:teuthology.orchestra.run.smithi039.stdout:041.out 2023-05-16T13:57:05.883 INFO:teuthology.orchestra.run.smithi039.stdout:042 2023-05-16T13:57:05.883 INFO:teuthology.orchestra.run.smithi039.stdout:042.out 2023-05-16T13:57:05.883 INFO:teuthology.orchestra.run.smithi039.stdout:043 2023-05-16T13:57:05.884 INFO:teuthology.orchestra.run.smithi039.stdout:043.out 2023-05-16T13:57:05.884 INFO:teuthology.orchestra.run.smithi039.stdout:044 2023-05-16T13:57:05.884 INFO:teuthology.orchestra.run.smithi039.stdout:044.out 2023-05-16T13:57:05.884 INFO:teuthology.orchestra.run.smithi039.stdout:045 2023-05-16T13:57:05.884 INFO:teuthology.orchestra.run.smithi039.stdout:045.out 2023-05-16T13:57:05.884 INFO:teuthology.orchestra.run.smithi039.stdout:046 2023-05-16T13:57:05.884 INFO:teuthology.orchestra.run.smithi039.stdout:046.out 2023-05-16T13:57:05.884 INFO:teuthology.orchestra.run.smithi039.stdout:047 2023-05-16T13:57:05.885 INFO:teuthology.orchestra.run.smithi039.stdout:047.out 2023-05-16T13:57:05.885 INFO:teuthology.orchestra.run.smithi039.stdout:048 2023-05-16T13:57:05.885 INFO:teuthology.orchestra.run.smithi039.stdout:048.out 2023-05-16T13:57:05.885 INFO:teuthology.orchestra.run.smithi039.stdout:049 2023-05-16T13:57:05.885 INFO:teuthology.orchestra.run.smithi039.stdout:049.out 2023-05-16T13:57:05.885 INFO:teuthology.orchestra.run.smithi039.stdout:050 2023-05-16T13:57:05.885 INFO:teuthology.orchestra.run.smithi039.stdout:050.cfg 2023-05-16T13:57:05.885 INFO:teuthology.orchestra.run.smithi039.stdout:050.out.default 2023-05-16T13:57:05.886 INFO:teuthology.orchestra.run.smithi039.stdout:050.out.nojournal 2023-05-16T13:57:05.886 INFO:teuthology.orchestra.run.smithi039.stdout:050.out.xfsquota 2023-05-16T13:57:05.886 INFO:teuthology.orchestra.run.smithi039.stdout:051 2023-05-16T13:57:05.886 INFO:teuthology.orchestra.run.smithi039.stdout:051.out 2023-05-16T13:57:05.886 INFO:teuthology.orchestra.run.smithi039.stdout:052 2023-05-16T13:57:05.886 INFO:teuthology.orchestra.run.smithi039.stdout:052.out 2023-05-16T13:57:05.886 INFO:teuthology.orchestra.run.smithi039.stdout:053 2023-05-16T13:57:05.886 INFO:teuthology.orchestra.run.smithi039.stdout:053.out 2023-05-16T13:57:05.887 INFO:teuthology.orchestra.run.smithi039.stdout:054 2023-05-16T13:57:05.887 INFO:teuthology.orchestra.run.smithi039.stdout:054.out 2023-05-16T13:57:05.887 INFO:teuthology.orchestra.run.smithi039.stdout:055 2023-05-16T13:57:05.887 INFO:teuthology.orchestra.run.smithi039.stdout:055.out 2023-05-16T13:57:05.887 INFO:teuthology.orchestra.run.smithi039.stdout:056 2023-05-16T13:57:05.887 INFO:teuthology.orchestra.run.smithi039.stdout:056.out 2023-05-16T13:57:05.887 INFO:teuthology.orchestra.run.smithi039.stdout:057 2023-05-16T13:57:05.887 INFO:teuthology.orchestra.run.smithi039.stdout:057.out 2023-05-16T13:57:05.888 INFO:teuthology.orchestra.run.smithi039.stdout:058 2023-05-16T13:57:05.888 INFO:teuthology.orchestra.run.smithi039.stdout:058.out 2023-05-16T13:57:05.888 INFO:teuthology.orchestra.run.smithi039.stdout:059 2023-05-16T13:57:05.888 INFO:teuthology.orchestra.run.smithi039.stdout:059.out 2023-05-16T13:57:05.888 INFO:teuthology.orchestra.run.smithi039.stdout:060 2023-05-16T13:57:05.888 INFO:teuthology.orchestra.run.smithi039.stdout:060.out 2023-05-16T13:57:05.888 INFO:teuthology.orchestra.run.smithi039.stdout:061 2023-05-16T13:57:05.888 INFO:teuthology.orchestra.run.smithi039.stdout:061.out 2023-05-16T13:57:05.889 INFO:teuthology.orchestra.run.smithi039.stdout:062 2023-05-16T13:57:05.889 INFO:teuthology.orchestra.run.smithi039.stdout:062.out 2023-05-16T13:57:05.889 INFO:teuthology.orchestra.run.smithi039.stdout:063 2023-05-16T13:57:05.889 INFO:teuthology.orchestra.run.smithi039.stdout:063.out 2023-05-16T13:57:05.889 INFO:teuthology.orchestra.run.smithi039.stdout:064 2023-05-16T13:57:05.889 INFO:teuthology.orchestra.run.smithi039.stdout:064.out 2023-05-16T13:57:05.889 INFO:teuthology.orchestra.run.smithi039.stdout:065 2023-05-16T13:57:05.889 INFO:teuthology.orchestra.run.smithi039.stdout:065.out 2023-05-16T13:57:05.890 INFO:teuthology.orchestra.run.smithi039.stdout:066 2023-05-16T13:57:05.890 INFO:teuthology.orchestra.run.smithi039.stdout:066.out 2023-05-16T13:57:05.890 INFO:teuthology.orchestra.run.smithi039.stdout:067 2023-05-16T13:57:05.890 INFO:teuthology.orchestra.run.smithi039.stdout:067.out 2023-05-16T13:57:05.890 INFO:teuthology.orchestra.run.smithi039.stdout:068 2023-05-16T13:57:05.890 INFO:teuthology.orchestra.run.smithi039.stdout:068.out 2023-05-16T13:57:05.890 INFO:teuthology.orchestra.run.smithi039.stdout:069 2023-05-16T13:57:05.890 INFO:teuthology.orchestra.run.smithi039.stdout:069.out 2023-05-16T13:57:05.891 INFO:teuthology.orchestra.run.smithi039.stdout:070 2023-05-16T13:57:05.891 INFO:teuthology.orchestra.run.smithi039.stdout:070.out 2023-05-16T13:57:05.891 INFO:teuthology.orchestra.run.smithi039.stdout:071 2023-05-16T13:57:05.891 INFO:teuthology.orchestra.run.smithi039.stdout:071.out 2023-05-16T13:57:05.891 INFO:teuthology.orchestra.run.smithi039.stdout:072 2023-05-16T13:57:05.891 INFO:teuthology.orchestra.run.smithi039.stdout:072.out 2023-05-16T13:57:05.891 INFO:teuthology.orchestra.run.smithi039.stdout:073 2023-05-16T13:57:05.891 INFO:teuthology.orchestra.run.smithi039.stdout:073.out 2023-05-16T13:57:05.892 INFO:teuthology.orchestra.run.smithi039.stdout:074 2023-05-16T13:57:05.892 INFO:teuthology.orchestra.run.smithi039.stdout:074.out 2023-05-16T13:57:05.892 INFO:teuthology.orchestra.run.smithi039.stdout:075 2023-05-16T13:57:05.892 INFO:teuthology.orchestra.run.smithi039.stdout:075.out 2023-05-16T13:57:05.892 INFO:teuthology.orchestra.run.smithi039.stdout:076 2023-05-16T13:57:05.892 INFO:teuthology.orchestra.run.smithi039.stdout:076.out 2023-05-16T13:57:05.892 INFO:teuthology.orchestra.run.smithi039.stdout:077 2023-05-16T13:57:05.892 INFO:teuthology.orchestra.run.smithi039.stdout:077.out 2023-05-16T13:57:05.893 INFO:teuthology.orchestra.run.smithi039.stdout:078 2023-05-16T13:57:05.893 INFO:teuthology.orchestra.run.smithi039.stdout:078.out 2023-05-16T13:57:05.893 INFO:teuthology.orchestra.run.smithi039.stdout:079 2023-05-16T13:57:05.893 INFO:teuthology.orchestra.run.smithi039.stdout:079.out 2023-05-16T13:57:05.893 INFO:teuthology.orchestra.run.smithi039.stdout:080 2023-05-16T13:57:05.893 INFO:teuthology.orchestra.run.smithi039.stdout:080.out 2023-05-16T13:57:05.893 INFO:teuthology.orchestra.run.smithi039.stdout:081 2023-05-16T13:57:05.893 INFO:teuthology.orchestra.run.smithi039.stdout:081.out 2023-05-16T13:57:05.894 INFO:teuthology.orchestra.run.smithi039.stdout:082 2023-05-16T13:57:05.894 INFO:teuthology.orchestra.run.smithi039.stdout:082.out 2023-05-16T13:57:05.894 INFO:teuthology.orchestra.run.smithi039.stdout:083 2023-05-16T13:57:05.894 INFO:teuthology.orchestra.run.smithi039.stdout:083.out 2023-05-16T13:57:05.894 INFO:teuthology.orchestra.run.smithi039.stdout:084 2023-05-16T13:57:05.894 INFO:teuthology.orchestra.run.smithi039.stdout:084.out 2023-05-16T13:57:05.894 INFO:teuthology.orchestra.run.smithi039.stdout:085 2023-05-16T13:57:05.895 INFO:teuthology.orchestra.run.smithi039.stdout:085.out 2023-05-16T13:57:05.895 INFO:teuthology.orchestra.run.smithi039.stdout:086 2023-05-16T13:57:05.895 INFO:teuthology.orchestra.run.smithi039.stdout:086.out 2023-05-16T13:57:05.895 INFO:teuthology.orchestra.run.smithi039.stdout:087 2023-05-16T13:57:05.895 INFO:teuthology.orchestra.run.smithi039.stdout:087.out 2023-05-16T13:57:05.895 INFO:teuthology.orchestra.run.smithi039.stdout:088 2023-05-16T13:57:05.895 INFO:teuthology.orchestra.run.smithi039.stdout:088.out 2023-05-16T13:57:05.895 INFO:teuthology.orchestra.run.smithi039.stdout:089 2023-05-16T13:57:05.896 INFO:teuthology.orchestra.run.smithi039.stdout:089.out 2023-05-16T13:57:05.896 INFO:teuthology.orchestra.run.smithi039.stdout:090 2023-05-16T13:57:05.896 INFO:teuthology.orchestra.run.smithi039.stdout:090.out 2023-05-16T13:57:05.896 INFO:teuthology.orchestra.run.smithi039.stdout:091 2023-05-16T13:57:05.896 INFO:teuthology.orchestra.run.smithi039.stdout:091.out 2023-05-16T13:57:05.896 INFO:teuthology.orchestra.run.smithi039.stdout:092 2023-05-16T13:57:05.896 INFO:teuthology.orchestra.run.smithi039.stdout:092.out 2023-05-16T13:57:05.896 INFO:teuthology.orchestra.run.smithi039.stdout:093 2023-05-16T13:57:05.897 INFO:teuthology.orchestra.run.smithi039.stdout:093.out 2023-05-16T13:57:05.897 INFO:teuthology.orchestra.run.smithi039.stdout:094 2023-05-16T13:57:05.897 INFO:teuthology.orchestra.run.smithi039.stdout:094.out 2023-05-16T13:57:05.897 INFO:teuthology.orchestra.run.smithi039.stdout:095 2023-05-16T13:57:05.897 INFO:teuthology.orchestra.run.smithi039.stdout:095.out 2023-05-16T13:57:05.897 INFO:teuthology.orchestra.run.smithi039.stdout:096 2023-05-16T13:57:05.897 INFO:teuthology.orchestra.run.smithi039.stdout:096.out 2023-05-16T13:57:05.897 INFO:teuthology.orchestra.run.smithi039.stdout:097 2023-05-16T13:57:05.898 INFO:teuthology.orchestra.run.smithi039.stdout:097.out 2023-05-16T13:57:05.898 INFO:teuthology.orchestra.run.smithi039.stdout:098 2023-05-16T13:57:05.898 INFO:teuthology.orchestra.run.smithi039.stdout:098.out 2023-05-16T13:57:05.898 INFO:teuthology.orchestra.run.smithi039.stdout:099 2023-05-16T13:57:05.898 INFO:teuthology.orchestra.run.smithi039.stdout:099.out 2023-05-16T13:57:05.898 INFO:teuthology.orchestra.run.smithi039.stdout:100 2023-05-16T13:57:05.898 INFO:teuthology.orchestra.run.smithi039.stdout:100.out 2023-05-16T13:57:05.898 INFO:teuthology.orchestra.run.smithi039.stdout:101 2023-05-16T13:57:05.899 INFO:teuthology.orchestra.run.smithi039.stdout:101.out 2023-05-16T13:57:05.899 INFO:teuthology.orchestra.run.smithi039.stdout:102 2023-05-16T13:57:05.899 INFO:teuthology.orchestra.run.smithi039.stdout:102.out 2023-05-16T13:57:05.899 INFO:teuthology.orchestra.run.smithi039.stdout:103 2023-05-16T13:57:05.899 INFO:teuthology.orchestra.run.smithi039.stdout:103.out 2023-05-16T13:57:05.899 INFO:teuthology.orchestra.run.smithi039.stdout:104 2023-05-16T13:57:05.899 INFO:teuthology.orchestra.run.smithi039.stdout:104.out 2023-05-16T13:57:05.899 INFO:teuthology.orchestra.run.smithi039.stdout:105 2023-05-16T13:57:05.900 INFO:teuthology.orchestra.run.smithi039.stdout:105.out 2023-05-16T13:57:05.900 INFO:teuthology.orchestra.run.smithi039.stdout:106 2023-05-16T13:57:05.900 INFO:teuthology.orchestra.run.smithi039.stdout:106.out 2023-05-16T13:57:05.900 INFO:teuthology.orchestra.run.smithi039.stdout:107 2023-05-16T13:57:05.900 INFO:teuthology.orchestra.run.smithi039.stdout:107.out 2023-05-16T13:57:05.900 INFO:teuthology.orchestra.run.smithi039.stdout:108 2023-05-16T13:57:05.900 INFO:teuthology.orchestra.run.smithi039.stdout:108.out 2023-05-16T13:57:05.900 INFO:teuthology.orchestra.run.smithi039.stdout:109 2023-05-16T13:57:05.901 INFO:teuthology.orchestra.run.smithi039.stdout:109.out 2023-05-16T13:57:05.901 INFO:teuthology.orchestra.run.smithi039.stdout:110 2023-05-16T13:57:05.901 INFO:teuthology.orchestra.run.smithi039.stdout:110.out 2023-05-16T13:57:05.901 INFO:teuthology.orchestra.run.smithi039.stdout:111 2023-05-16T13:57:05.901 INFO:teuthology.orchestra.run.smithi039.stdout:111.out 2023-05-16T13:57:05.901 INFO:teuthology.orchestra.run.smithi039.stdout:112 2023-05-16T13:57:05.901 INFO:teuthology.orchestra.run.smithi039.stdout:112.out 2023-05-16T13:57:05.901 INFO:teuthology.orchestra.run.smithi039.stdout:113 2023-05-16T13:57:05.902 INFO:teuthology.orchestra.run.smithi039.stdout:113.out 2023-05-16T13:57:05.902 INFO:teuthology.orchestra.run.smithi039.stdout:114 2023-05-16T13:57:05.902 INFO:teuthology.orchestra.run.smithi039.stdout:114.out 2023-05-16T13:57:05.902 INFO:teuthology.orchestra.run.smithi039.stdout:115 2023-05-16T13:57:05.902 INFO:teuthology.orchestra.run.smithi039.stdout:115.out 2023-05-16T13:57:05.902 INFO:teuthology.orchestra.run.smithi039.stdout:116 2023-05-16T13:57:05.902 INFO:teuthology.orchestra.run.smithi039.stdout:116.out 2023-05-16T13:57:05.902 INFO:teuthology.orchestra.run.smithi039.stdout:117 2023-05-16T13:57:05.903 INFO:teuthology.orchestra.run.smithi039.stdout:117.out 2023-05-16T13:57:05.903 INFO:teuthology.orchestra.run.smithi039.stdout:118 2023-05-16T13:57:05.903 INFO:teuthology.orchestra.run.smithi039.stdout:118.out 2023-05-16T13:57:05.903 INFO:teuthology.orchestra.run.smithi039.stdout:119 2023-05-16T13:57:05.903 INFO:teuthology.orchestra.run.smithi039.stdout:119.out 2023-05-16T13:57:05.903 INFO:teuthology.orchestra.run.smithi039.stdout:120 2023-05-16T13:57:05.903 INFO:teuthology.orchestra.run.smithi039.stdout:120.out 2023-05-16T13:57:05.903 INFO:teuthology.orchestra.run.smithi039.stdout:121 2023-05-16T13:57:05.904 INFO:teuthology.orchestra.run.smithi039.stdout:121.out 2023-05-16T13:57:05.904 INFO:teuthology.orchestra.run.smithi039.stdout:122 2023-05-16T13:57:05.904 INFO:teuthology.orchestra.run.smithi039.stdout:122.out 2023-05-16T13:57:05.904 INFO:teuthology.orchestra.run.smithi039.stdout:123 2023-05-16T13:57:05.904 INFO:teuthology.orchestra.run.smithi039.stdout:123.out 2023-05-16T13:57:05.904 INFO:teuthology.orchestra.run.smithi039.stdout:124 2023-05-16T13:57:05.904 INFO:teuthology.orchestra.run.smithi039.stdout:124.out 2023-05-16T13:57:05.904 INFO:teuthology.orchestra.run.smithi039.stdout:125 2023-05-16T13:57:05.905 INFO:teuthology.orchestra.run.smithi039.stdout:125.out 2023-05-16T13:57:05.905 INFO:teuthology.orchestra.run.smithi039.stdout:126 2023-05-16T13:57:05.905 INFO:teuthology.orchestra.run.smithi039.stdout:126.out 2023-05-16T13:57:05.905 INFO:teuthology.orchestra.run.smithi039.stdout:127 2023-05-16T13:57:05.905 INFO:teuthology.orchestra.run.smithi039.stdout:127.out 2023-05-16T13:57:05.905 INFO:teuthology.orchestra.run.smithi039.stdout:128 2023-05-16T13:57:05.905 INFO:teuthology.orchestra.run.smithi039.stdout:128.out 2023-05-16T13:57:05.905 INFO:teuthology.orchestra.run.smithi039.stdout:129 2023-05-16T13:57:05.906 INFO:teuthology.orchestra.run.smithi039.stdout:129.out 2023-05-16T13:57:05.906 INFO:teuthology.orchestra.run.smithi039.stdout:130 2023-05-16T13:57:05.906 INFO:teuthology.orchestra.run.smithi039.stdout:130.out 2023-05-16T13:57:05.906 INFO:teuthology.orchestra.run.smithi039.stdout:131 2023-05-16T13:57:05.906 INFO:teuthology.orchestra.run.smithi039.stdout:131.out 2023-05-16T13:57:05.906 INFO:teuthology.orchestra.run.smithi039.stdout:132 2023-05-16T13:57:05.906 INFO:teuthology.orchestra.run.smithi039.stdout:132.out 2023-05-16T13:57:05.906 INFO:teuthology.orchestra.run.smithi039.stdout:133 2023-05-16T13:57:05.907 INFO:teuthology.orchestra.run.smithi039.stdout:133.out 2023-05-16T13:57:05.907 INFO:teuthology.orchestra.run.smithi039.stdout:134 2023-05-16T13:57:05.907 INFO:teuthology.orchestra.run.smithi039.stdout:134.out 2023-05-16T13:57:05.907 INFO:teuthology.orchestra.run.smithi039.stdout:135 2023-05-16T13:57:05.907 INFO:teuthology.orchestra.run.smithi039.stdout:135.out 2023-05-16T13:57:05.907 INFO:teuthology.orchestra.run.smithi039.stdout:136 2023-05-16T13:57:05.907 INFO:teuthology.orchestra.run.smithi039.stdout:136.out 2023-05-16T13:57:05.907 INFO:teuthology.orchestra.run.smithi039.stdout:137 2023-05-16T13:57:05.907 INFO:teuthology.orchestra.run.smithi039.stdout:137.out 2023-05-16T13:57:05.908 INFO:teuthology.orchestra.run.smithi039.stdout:138 2023-05-16T13:57:05.908 INFO:teuthology.orchestra.run.smithi039.stdout:138.out 2023-05-16T13:57:05.908 INFO:teuthology.orchestra.run.smithi039.stdout:139 2023-05-16T13:57:05.908 INFO:teuthology.orchestra.run.smithi039.stdout:139.out 2023-05-16T13:57:05.908 INFO:teuthology.orchestra.run.smithi039.stdout:140 2023-05-16T13:57:05.908 INFO:teuthology.orchestra.run.smithi039.stdout:140.out 2023-05-16T13:57:05.908 INFO:teuthology.orchestra.run.smithi039.stdout:141 2023-05-16T13:57:05.909 INFO:teuthology.orchestra.run.smithi039.stdout:141.out 2023-05-16T13:57:05.909 INFO:teuthology.orchestra.run.smithi039.stdout:142 2023-05-16T13:57:05.909 INFO:teuthology.orchestra.run.smithi039.stdout:142.out 2023-05-16T13:57:05.909 INFO:teuthology.orchestra.run.smithi039.stdout:143 2023-05-16T13:57:05.909 INFO:teuthology.orchestra.run.smithi039.stdout:143.out 2023-05-16T13:57:05.909 INFO:teuthology.orchestra.run.smithi039.stdout:144 2023-05-16T13:57:05.909 INFO:teuthology.orchestra.run.smithi039.stdout:144.out 2023-05-16T13:57:05.909 INFO:teuthology.orchestra.run.smithi039.stdout:145 2023-05-16T13:57:05.910 INFO:teuthology.orchestra.run.smithi039.stdout:145.out 2023-05-16T13:57:05.910 INFO:teuthology.orchestra.run.smithi039.stdout:146 2023-05-16T13:57:05.910 INFO:teuthology.orchestra.run.smithi039.stdout:146.out 2023-05-16T13:57:05.910 INFO:teuthology.orchestra.run.smithi039.stdout:147 2023-05-16T13:57:05.910 INFO:teuthology.orchestra.run.smithi039.stdout:147.out 2023-05-16T13:57:05.910 INFO:teuthology.orchestra.run.smithi039.stdout:148 2023-05-16T13:57:05.910 INFO:teuthology.orchestra.run.smithi039.stdout:148.out 2023-05-16T13:57:05.910 INFO:teuthology.orchestra.run.smithi039.stdout:149 2023-05-16T13:57:05.911 INFO:teuthology.orchestra.run.smithi039.stdout:149.out 2023-05-16T13:57:05.911 INFO:teuthology.orchestra.run.smithi039.stdout:150 2023-05-16T13:57:05.911 INFO:teuthology.orchestra.run.smithi039.stdout:150.out 2023-05-16T13:57:05.911 INFO:teuthology.orchestra.run.smithi039.stdout:151 2023-05-16T13:57:05.911 INFO:teuthology.orchestra.run.smithi039.stdout:151.out 2023-05-16T13:57:05.911 INFO:teuthology.orchestra.run.smithi039.stdout:152 2023-05-16T13:57:05.911 INFO:teuthology.orchestra.run.smithi039.stdout:152.out 2023-05-16T13:57:05.911 INFO:teuthology.orchestra.run.smithi039.stdout:153 2023-05-16T13:57:05.911 INFO:teuthology.orchestra.run.smithi039.stdout:153.out 2023-05-16T13:57:05.912 INFO:teuthology.orchestra.run.smithi039.stdout:154 2023-05-16T13:57:05.912 INFO:teuthology.orchestra.run.smithi039.stdout:154.out 2023-05-16T13:57:05.912 INFO:teuthology.orchestra.run.smithi039.stdout:155 2023-05-16T13:57:05.912 INFO:teuthology.orchestra.run.smithi039.stdout:155.out 2023-05-16T13:57:05.912 INFO:teuthology.orchestra.run.smithi039.stdout:156 2023-05-16T13:57:05.912 INFO:teuthology.orchestra.run.smithi039.stdout:156.out 2023-05-16T13:57:05.912 INFO:teuthology.orchestra.run.smithi039.stdout:157 2023-05-16T13:57:05.912 INFO:teuthology.orchestra.run.smithi039.stdout:157.out 2023-05-16T13:57:05.913 INFO:teuthology.orchestra.run.smithi039.stdout:158 2023-05-16T13:57:05.913 INFO:teuthology.orchestra.run.smithi039.stdout:158.out 2023-05-16T13:57:05.913 INFO:teuthology.orchestra.run.smithi039.stdout:159 2023-05-16T13:57:05.913 INFO:teuthology.orchestra.run.smithi039.stdout:159.out 2023-05-16T13:57:05.913 INFO:teuthology.orchestra.run.smithi039.stdout:160 2023-05-16T13:57:05.913 INFO:teuthology.orchestra.run.smithi039.stdout:160.out 2023-05-16T13:57:05.913 INFO:teuthology.orchestra.run.smithi039.stdout:161 2023-05-16T13:57:05.913 INFO:teuthology.orchestra.run.smithi039.stdout:161.out 2023-05-16T13:57:05.914 INFO:teuthology.orchestra.run.smithi039.stdout:162 2023-05-16T13:57:05.914 INFO:teuthology.orchestra.run.smithi039.stdout:162.out 2023-05-16T13:57:05.914 INFO:teuthology.orchestra.run.smithi039.stdout:163 2023-05-16T13:57:05.914 INFO:teuthology.orchestra.run.smithi039.stdout:163.out 2023-05-16T13:57:05.914 INFO:teuthology.orchestra.run.smithi039.stdout:164 2023-05-16T13:57:05.914 INFO:teuthology.orchestra.run.smithi039.stdout:164.out 2023-05-16T13:57:05.914 INFO:teuthology.orchestra.run.smithi039.stdout:165 2023-05-16T13:57:05.914 INFO:teuthology.orchestra.run.smithi039.stdout:165.out 2023-05-16T13:57:05.915 INFO:teuthology.orchestra.run.smithi039.stdout:166 2023-05-16T13:57:05.915 INFO:teuthology.orchestra.run.smithi039.stdout:166.out 2023-05-16T13:57:05.915 INFO:teuthology.orchestra.run.smithi039.stdout:167 2023-05-16T13:57:05.915 INFO:teuthology.orchestra.run.smithi039.stdout:167.out 2023-05-16T13:57:05.915 INFO:teuthology.orchestra.run.smithi039.stdout:168 2023-05-16T13:57:05.915 INFO:teuthology.orchestra.run.smithi039.stdout:168.out 2023-05-16T13:57:05.915 INFO:teuthology.orchestra.run.smithi039.stdout:169 2023-05-16T13:57:05.915 INFO:teuthology.orchestra.run.smithi039.stdout:169.out 2023-05-16T13:57:05.916 INFO:teuthology.orchestra.run.smithi039.stdout:170 2023-05-16T13:57:05.916 INFO:teuthology.orchestra.run.smithi039.stdout:170.out 2023-05-16T13:57:05.916 INFO:teuthology.orchestra.run.smithi039.stdout:171 2023-05-16T13:57:05.916 INFO:teuthology.orchestra.run.smithi039.stdout:171.out 2023-05-16T13:57:05.916 INFO:teuthology.orchestra.run.smithi039.stdout:172 2023-05-16T13:57:05.916 INFO:teuthology.orchestra.run.smithi039.stdout:172.out 2023-05-16T13:57:05.916 INFO:teuthology.orchestra.run.smithi039.stdout:173 2023-05-16T13:57:05.916 INFO:teuthology.orchestra.run.smithi039.stdout:173.out 2023-05-16T13:57:05.917 INFO:teuthology.orchestra.run.smithi039.stdout:174 2023-05-16T13:57:05.917 INFO:teuthology.orchestra.run.smithi039.stdout:174.out 2023-05-16T13:57:05.917 INFO:teuthology.orchestra.run.smithi039.stdout:175 2023-05-16T13:57:05.917 INFO:teuthology.orchestra.run.smithi039.stdout:175.out 2023-05-16T13:57:05.917 INFO:teuthology.orchestra.run.smithi039.stdout:176 2023-05-16T13:57:05.917 INFO:teuthology.orchestra.run.smithi039.stdout:176.out 2023-05-16T13:57:05.917 INFO:teuthology.orchestra.run.smithi039.stdout:177 2023-05-16T13:57:05.917 INFO:teuthology.orchestra.run.smithi039.stdout:177.out 2023-05-16T13:57:05.918 INFO:teuthology.orchestra.run.smithi039.stdout:178 2023-05-16T13:57:05.918 INFO:teuthology.orchestra.run.smithi039.stdout:178.out 2023-05-16T13:57:05.918 INFO:teuthology.orchestra.run.smithi039.stdout:179 2023-05-16T13:57:05.918 INFO:teuthology.orchestra.run.smithi039.stdout:179.out 2023-05-16T13:57:05.918 INFO:teuthology.orchestra.run.smithi039.stdout:180 2023-05-16T13:57:05.918 INFO:teuthology.orchestra.run.smithi039.stdout:180.out 2023-05-16T13:57:05.918 INFO:teuthology.orchestra.run.smithi039.stdout:181 2023-05-16T13:57:05.918 INFO:teuthology.orchestra.run.smithi039.stdout:181.out 2023-05-16T13:57:05.919 INFO:teuthology.orchestra.run.smithi039.stdout:182 2023-05-16T13:57:05.919 INFO:teuthology.orchestra.run.smithi039.stdout:182.out 2023-05-16T13:57:05.919 INFO:teuthology.orchestra.run.smithi039.stdout:183 2023-05-16T13:57:05.919 INFO:teuthology.orchestra.run.smithi039.stdout:183.out 2023-05-16T13:57:05.919 INFO:teuthology.orchestra.run.smithi039.stdout:184 2023-05-16T13:57:05.919 INFO:teuthology.orchestra.run.smithi039.stdout:184.out 2023-05-16T13:57:05.919 INFO:teuthology.orchestra.run.smithi039.stdout:185 2023-05-16T13:57:05.919 INFO:teuthology.orchestra.run.smithi039.stdout:185.out 2023-05-16T13:57:05.920 INFO:teuthology.orchestra.run.smithi039.stdout:186 2023-05-16T13:57:05.920 INFO:teuthology.orchestra.run.smithi039.stdout:186.out 2023-05-16T13:57:05.920 INFO:teuthology.orchestra.run.smithi039.stdout:187 2023-05-16T13:57:05.920 INFO:teuthology.orchestra.run.smithi039.stdout:187.out 2023-05-16T13:57:05.920 INFO:teuthology.orchestra.run.smithi039.stdout:188 2023-05-16T13:57:05.920 INFO:teuthology.orchestra.run.smithi039.stdout:188.out 2023-05-16T13:57:05.920 INFO:teuthology.orchestra.run.smithi039.stdout:189 2023-05-16T13:57:05.920 INFO:teuthology.orchestra.run.smithi039.stdout:189.out 2023-05-16T13:57:05.921 INFO:teuthology.orchestra.run.smithi039.stdout:190 2023-05-16T13:57:05.921 INFO:teuthology.orchestra.run.smithi039.stdout:190.out 2023-05-16T13:57:05.921 INFO:teuthology.orchestra.run.smithi039.stdout:191 2023-05-16T13:57:05.921 INFO:teuthology.orchestra.run.smithi039.stdout:191.out 2023-05-16T13:57:05.921 INFO:teuthology.orchestra.run.smithi039.stdout:192 2023-05-16T13:57:05.921 INFO:teuthology.orchestra.run.smithi039.stdout:192.out 2023-05-16T13:57:05.921 INFO:teuthology.orchestra.run.smithi039.stdout:193 2023-05-16T13:57:05.921 INFO:teuthology.orchestra.run.smithi039.stdout:193.out 2023-05-16T13:57:05.922 INFO:teuthology.orchestra.run.smithi039.stdout:194 2023-05-16T13:57:05.922 INFO:teuthology.orchestra.run.smithi039.stdout:194.out 2023-05-16T13:57:05.922 INFO:teuthology.orchestra.run.smithi039.stdout:195 2023-05-16T13:57:05.922 INFO:teuthology.orchestra.run.smithi039.stdout:195.out 2023-05-16T13:57:05.922 INFO:teuthology.orchestra.run.smithi039.stdout:196 2023-05-16T13:57:05.922 INFO:teuthology.orchestra.run.smithi039.stdout:196.out 2023-05-16T13:57:05.922 INFO:teuthology.orchestra.run.smithi039.stdout:197 2023-05-16T13:57:05.922 INFO:teuthology.orchestra.run.smithi039.stdout:197.out 2023-05-16T13:57:05.923 INFO:teuthology.orchestra.run.smithi039.stdout:198 2023-05-16T13:57:05.923 INFO:teuthology.orchestra.run.smithi039.stdout:198.out 2023-05-16T13:57:05.923 INFO:teuthology.orchestra.run.smithi039.stdout:199 2023-05-16T13:57:05.923 INFO:teuthology.orchestra.run.smithi039.stdout:199.out 2023-05-16T13:57:05.923 INFO:teuthology.orchestra.run.smithi039.stdout:200 2023-05-16T13:57:05.923 INFO:teuthology.orchestra.run.smithi039.stdout:200.out 2023-05-16T13:57:05.923 INFO:teuthology.orchestra.run.smithi039.stdout:201 2023-05-16T13:57:05.923 INFO:teuthology.orchestra.run.smithi039.stdout:201.out 2023-05-16T13:57:05.924 INFO:teuthology.orchestra.run.smithi039.stdout:202 2023-05-16T13:57:05.924 INFO:teuthology.orchestra.run.smithi039.stdout:202.out 2023-05-16T13:57:05.924 INFO:teuthology.orchestra.run.smithi039.stdout:203 2023-05-16T13:57:05.924 INFO:teuthology.orchestra.run.smithi039.stdout:203.out 2023-05-16T13:57:05.924 INFO:teuthology.orchestra.run.smithi039.stdout:204 2023-05-16T13:57:05.924 INFO:teuthology.orchestra.run.smithi039.stdout:204.out 2023-05-16T13:57:05.924 INFO:teuthology.orchestra.run.smithi039.stdout:205 2023-05-16T13:57:05.924 INFO:teuthology.orchestra.run.smithi039.stdout:205.out 2023-05-16T13:57:05.925 INFO:teuthology.orchestra.run.smithi039.stdout:206 2023-05-16T13:57:05.925 INFO:teuthology.orchestra.run.smithi039.stdout:206.out 2023-05-16T13:57:05.925 INFO:teuthology.orchestra.run.smithi039.stdout:207 2023-05-16T13:57:05.925 INFO:teuthology.orchestra.run.smithi039.stdout:207.out 2023-05-16T13:57:05.925 INFO:teuthology.orchestra.run.smithi039.stdout:208 2023-05-16T13:57:05.925 INFO:teuthology.orchestra.run.smithi039.stdout:208.out 2023-05-16T13:57:05.925 INFO:teuthology.orchestra.run.smithi039.stdout:209 2023-05-16T13:57:05.925 INFO:teuthology.orchestra.run.smithi039.stdout:209.out 2023-05-16T13:57:05.926 INFO:teuthology.orchestra.run.smithi039.stdout:210 2023-05-16T13:57:05.926 INFO:teuthology.orchestra.run.smithi039.stdout:210.out 2023-05-16T13:57:05.926 INFO:teuthology.orchestra.run.smithi039.stdout:211 2023-05-16T13:57:05.926 INFO:teuthology.orchestra.run.smithi039.stdout:211.out 2023-05-16T13:57:05.926 INFO:teuthology.orchestra.run.smithi039.stdout:212 2023-05-16T13:57:05.926 INFO:teuthology.orchestra.run.smithi039.stdout:212.out 2023-05-16T13:57:05.926 INFO:teuthology.orchestra.run.smithi039.stdout:213 2023-05-16T13:57:05.926 INFO:teuthology.orchestra.run.smithi039.stdout:213.out 2023-05-16T13:57:05.927 INFO:teuthology.orchestra.run.smithi039.stdout:214 2023-05-16T13:57:05.927 INFO:teuthology.orchestra.run.smithi039.stdout:214.out 2023-05-16T13:57:05.927 INFO:teuthology.orchestra.run.smithi039.stdout:215 2023-05-16T13:57:05.927 INFO:teuthology.orchestra.run.smithi039.stdout:215.out 2023-05-16T13:57:05.927 INFO:teuthology.orchestra.run.smithi039.stdout:216 2023-05-16T13:57:05.927 INFO:teuthology.orchestra.run.smithi039.stdout:216.out 2023-05-16T13:57:05.927 INFO:teuthology.orchestra.run.smithi039.stdout:217 2023-05-16T13:57:05.927 INFO:teuthology.orchestra.run.smithi039.stdout:217.out 2023-05-16T13:57:05.928 INFO:teuthology.orchestra.run.smithi039.stdout:218 2023-05-16T13:57:05.928 INFO:teuthology.orchestra.run.smithi039.stdout:218.out 2023-05-16T13:57:05.928 INFO:teuthology.orchestra.run.smithi039.stdout:219 2023-05-16T13:57:05.928 INFO:teuthology.orchestra.run.smithi039.stdout:219.out 2023-05-16T13:57:05.928 INFO:teuthology.orchestra.run.smithi039.stdout:220 2023-05-16T13:57:05.928 INFO:teuthology.orchestra.run.smithi039.stdout:220.out 2023-05-16T13:57:05.928 INFO:teuthology.orchestra.run.smithi039.stdout:221 2023-05-16T13:57:05.928 INFO:teuthology.orchestra.run.smithi039.stdout:221.out 2023-05-16T13:57:05.929 INFO:teuthology.orchestra.run.smithi039.stdout:222 2023-05-16T13:57:05.929 INFO:teuthology.orchestra.run.smithi039.stdout:222.out 2023-05-16T13:57:05.929 INFO:teuthology.orchestra.run.smithi039.stdout:223 2023-05-16T13:57:05.929 INFO:teuthology.orchestra.run.smithi039.stdout:223.out 2023-05-16T13:57:05.929 INFO:teuthology.orchestra.run.smithi039.stdout:224 2023-05-16T13:57:05.929 INFO:teuthology.orchestra.run.smithi039.stdout:224.out 2023-05-16T13:57:05.929 INFO:teuthology.orchestra.run.smithi039.stdout:225 2023-05-16T13:57:05.929 INFO:teuthology.orchestra.run.smithi039.stdout:225.out 2023-05-16T13:57:05.930 INFO:teuthology.orchestra.run.smithi039.stdout:226 2023-05-16T13:57:05.930 INFO:teuthology.orchestra.run.smithi039.stdout:226.out 2023-05-16T13:57:05.930 INFO:teuthology.orchestra.run.smithi039.stdout:227 2023-05-16T13:57:05.930 INFO:teuthology.orchestra.run.smithi039.stdout:227.out 2023-05-16T13:57:05.930 INFO:teuthology.orchestra.run.smithi039.stdout:228 2023-05-16T13:57:05.930 INFO:teuthology.orchestra.run.smithi039.stdout:228.out 2023-05-16T13:57:05.930 INFO:teuthology.orchestra.run.smithi039.stdout:229 2023-05-16T13:57:05.930 INFO:teuthology.orchestra.run.smithi039.stdout:229.out 2023-05-16T13:57:05.931 INFO:teuthology.orchestra.run.smithi039.stdout:230 2023-05-16T13:57:05.931 INFO:teuthology.orchestra.run.smithi039.stdout:230.out 2023-05-16T13:57:05.931 INFO:teuthology.orchestra.run.smithi039.stdout:231 2023-05-16T13:57:05.931 INFO:teuthology.orchestra.run.smithi039.stdout:231.out 2023-05-16T13:57:05.931 INFO:teuthology.orchestra.run.smithi039.stdout:232 2023-05-16T13:57:05.931 INFO:teuthology.orchestra.run.smithi039.stdout:232.out 2023-05-16T13:57:05.931 INFO:teuthology.orchestra.run.smithi039.stdout:233 2023-05-16T13:57:05.931 INFO:teuthology.orchestra.run.smithi039.stdout:233.out 2023-05-16T13:57:05.932 INFO:teuthology.orchestra.run.smithi039.stdout:234 2023-05-16T13:57:05.932 INFO:teuthology.orchestra.run.smithi039.stdout:234.out 2023-05-16T13:57:05.932 INFO:teuthology.orchestra.run.smithi039.stdout:235 2023-05-16T13:57:05.932 INFO:teuthology.orchestra.run.smithi039.stdout:235.out 2023-05-16T13:57:05.932 INFO:teuthology.orchestra.run.smithi039.stdout:236 2023-05-16T13:57:05.932 INFO:teuthology.orchestra.run.smithi039.stdout:236.out 2023-05-16T13:57:05.932 INFO:teuthology.orchestra.run.smithi039.stdout:237 2023-05-16T13:57:05.932 INFO:teuthology.orchestra.run.smithi039.stdout:237.out 2023-05-16T13:57:05.933 INFO:teuthology.orchestra.run.smithi039.stdout:238 2023-05-16T13:57:05.933 INFO:teuthology.orchestra.run.smithi039.stdout:238.out 2023-05-16T13:57:05.933 INFO:teuthology.orchestra.run.smithi039.stdout:239 2023-05-16T13:57:05.933 INFO:teuthology.orchestra.run.smithi039.stdout:239.out 2023-05-16T13:57:05.933 INFO:teuthology.orchestra.run.smithi039.stdout:240 2023-05-16T13:57:05.933 INFO:teuthology.orchestra.run.smithi039.stdout:240.out 2023-05-16T13:57:05.933 INFO:teuthology.orchestra.run.smithi039.stdout:241 2023-05-16T13:57:05.933 INFO:teuthology.orchestra.run.smithi039.stdout:241.out 2023-05-16T13:57:05.934 INFO:teuthology.orchestra.run.smithi039.stdout:242 2023-05-16T13:57:05.934 INFO:teuthology.orchestra.run.smithi039.stdout:242.out 2023-05-16T13:57:05.934 INFO:teuthology.orchestra.run.smithi039.stdout:243 2023-05-16T13:57:05.934 INFO:teuthology.orchestra.run.smithi039.stdout:243.out 2023-05-16T13:57:05.934 INFO:teuthology.orchestra.run.smithi039.stdout:244 2023-05-16T13:57:05.934 INFO:teuthology.orchestra.run.smithi039.stdout:244.out 2023-05-16T13:57:05.934 INFO:teuthology.orchestra.run.smithi039.stdout:245 2023-05-16T13:57:05.934 INFO:teuthology.orchestra.run.smithi039.stdout:245.out 2023-05-16T13:57:05.935 INFO:teuthology.orchestra.run.smithi039.stdout:246 2023-05-16T13:57:05.935 INFO:teuthology.orchestra.run.smithi039.stdout:246.out 2023-05-16T13:57:05.935 INFO:teuthology.orchestra.run.smithi039.stdout:247 2023-05-16T13:57:05.935 INFO:teuthology.orchestra.run.smithi039.stdout:247.out 2023-05-16T13:57:05.935 INFO:teuthology.orchestra.run.smithi039.stdout:248 2023-05-16T13:57:05.935 INFO:teuthology.orchestra.run.smithi039.stdout:248.out 2023-05-16T13:57:05.935 INFO:teuthology.orchestra.run.smithi039.stdout:249 2023-05-16T13:57:05.935 INFO:teuthology.orchestra.run.smithi039.stdout:249.out 2023-05-16T13:57:05.936 INFO:teuthology.orchestra.run.smithi039.stdout:250 2023-05-16T13:57:05.936 INFO:teuthology.orchestra.run.smithi039.stdout:250.out 2023-05-16T13:57:05.936 INFO:teuthology.orchestra.run.smithi039.stdout:251 2023-05-16T13:57:05.936 INFO:teuthology.orchestra.run.smithi039.stdout:251.out 2023-05-16T13:57:05.936 INFO:teuthology.orchestra.run.smithi039.stdout:252 2023-05-16T13:57:05.936 INFO:teuthology.orchestra.run.smithi039.stdout:252.out 2023-05-16T13:57:05.936 INFO:teuthology.orchestra.run.smithi039.stdout:253 2023-05-16T13:57:05.936 INFO:teuthology.orchestra.run.smithi039.stdout:253.out 2023-05-16T13:57:05.937 INFO:teuthology.orchestra.run.smithi039.stdout:254 2023-05-16T13:57:05.937 INFO:teuthology.orchestra.run.smithi039.stdout:254.out 2023-05-16T13:57:05.937 INFO:teuthology.orchestra.run.smithi039.stdout:255 2023-05-16T13:57:05.937 INFO:teuthology.orchestra.run.smithi039.stdout:255.out 2023-05-16T13:57:05.937 INFO:teuthology.orchestra.run.smithi039.stdout:256 2023-05-16T13:57:05.937 INFO:teuthology.orchestra.run.smithi039.stdout:256.out 2023-05-16T13:57:05.937 INFO:teuthology.orchestra.run.smithi039.stdout:257 2023-05-16T13:57:05.937 INFO:teuthology.orchestra.run.smithi039.stdout:257.out 2023-05-16T13:57:05.938 INFO:teuthology.orchestra.run.smithi039.stdout:258 2023-05-16T13:57:05.938 INFO:teuthology.orchestra.run.smithi039.stdout:258.out 2023-05-16T13:57:05.938 INFO:teuthology.orchestra.run.smithi039.stdout:259 2023-05-16T13:57:05.938 INFO:teuthology.orchestra.run.smithi039.stdout:259.out 2023-05-16T13:57:05.938 INFO:teuthology.orchestra.run.smithi039.stdout:260 2023-05-16T13:57:05.938 INFO:teuthology.orchestra.run.smithi039.stdout:260.out 2023-05-16T13:57:05.938 INFO:teuthology.orchestra.run.smithi039.stdout:261 2023-05-16T13:57:05.938 INFO:teuthology.orchestra.run.smithi039.stdout:261.out 2023-05-16T13:57:05.939 INFO:teuthology.orchestra.run.smithi039.stdout:262 2023-05-16T13:57:05.939 INFO:teuthology.orchestra.run.smithi039.stdout:262.out 2023-05-16T13:57:05.939 INFO:teuthology.orchestra.run.smithi039.stdout:263 2023-05-16T13:57:05.939 INFO:teuthology.orchestra.run.smithi039.stdout:263.out 2023-05-16T13:57:05.939 INFO:teuthology.orchestra.run.smithi039.stdout:264 2023-05-16T13:57:05.939 INFO:teuthology.orchestra.run.smithi039.stdout:264.out 2023-05-16T13:57:05.939 INFO:teuthology.orchestra.run.smithi039.stdout:265 2023-05-16T13:57:05.939 INFO:teuthology.orchestra.run.smithi039.stdout:265.out 2023-05-16T13:57:05.940 INFO:teuthology.orchestra.run.smithi039.stdout:266 2023-05-16T13:57:05.940 INFO:teuthology.orchestra.run.smithi039.stdout:266.out 2023-05-16T13:57:05.940 INFO:teuthology.orchestra.run.smithi039.stdout:267 2023-05-16T13:57:05.940 INFO:teuthology.orchestra.run.smithi039.stdout:267.out 2023-05-16T13:57:05.940 INFO:teuthology.orchestra.run.smithi039.stdout:268 2023-05-16T13:57:05.940 INFO:teuthology.orchestra.run.smithi039.stdout:268.out 2023-05-16T13:57:05.940 INFO:teuthology.orchestra.run.smithi039.stdout:269 2023-05-16T13:57:05.940 INFO:teuthology.orchestra.run.smithi039.stdout:269.out 2023-05-16T13:57:05.941 INFO:teuthology.orchestra.run.smithi039.stdout:270 2023-05-16T13:57:05.941 INFO:teuthology.orchestra.run.smithi039.stdout:270.out 2023-05-16T13:57:05.941 INFO:teuthology.orchestra.run.smithi039.stdout:271 2023-05-16T13:57:05.941 INFO:teuthology.orchestra.run.smithi039.stdout:271.out 2023-05-16T13:57:05.941 INFO:teuthology.orchestra.run.smithi039.stdout:272 2023-05-16T13:57:05.941 INFO:teuthology.orchestra.run.smithi039.stdout:272.out 2023-05-16T13:57:05.941 INFO:teuthology.orchestra.run.smithi039.stdout:273 2023-05-16T13:57:05.941 INFO:teuthology.orchestra.run.smithi039.stdout:273.out 2023-05-16T13:57:05.942 INFO:teuthology.orchestra.run.smithi039.stdout:274 2023-05-16T13:57:05.942 INFO:teuthology.orchestra.run.smithi039.stdout:274.out 2023-05-16T13:57:05.942 INFO:teuthology.orchestra.run.smithi039.stdout:275 2023-05-16T13:57:05.942 INFO:teuthology.orchestra.run.smithi039.stdout:275.out 2023-05-16T13:57:05.942 INFO:teuthology.orchestra.run.smithi039.stdout:276 2023-05-16T13:57:05.942 INFO:teuthology.orchestra.run.smithi039.stdout:276.out 2023-05-16T13:57:05.942 INFO:teuthology.orchestra.run.smithi039.stdout:277 2023-05-16T13:57:05.942 INFO:teuthology.orchestra.run.smithi039.stdout:277.out 2023-05-16T13:57:05.943 INFO:teuthology.orchestra.run.smithi039.stdout:278 2023-05-16T13:57:05.943 INFO:teuthology.orchestra.run.smithi039.stdout:278.out 2023-05-16T13:57:05.943 INFO:teuthology.orchestra.run.smithi039.stdout:279 2023-05-16T13:57:05.943 INFO:teuthology.orchestra.run.smithi039.stdout:279.out 2023-05-16T13:57:05.943 INFO:teuthology.orchestra.run.smithi039.stdout:280 2023-05-16T13:57:05.943 INFO:teuthology.orchestra.run.smithi039.stdout:280.out 2023-05-16T13:57:05.943 INFO:teuthology.orchestra.run.smithi039.stdout:281 2023-05-16T13:57:05.943 INFO:teuthology.orchestra.run.smithi039.stdout:281.out 2023-05-16T13:57:05.944 INFO:teuthology.orchestra.run.smithi039.stdout:282 2023-05-16T13:57:05.944 INFO:teuthology.orchestra.run.smithi039.stdout:282.out 2023-05-16T13:57:05.944 INFO:teuthology.orchestra.run.smithi039.stdout:283 2023-05-16T13:57:05.944 INFO:teuthology.orchestra.run.smithi039.stdout:283.out 2023-05-16T13:57:05.944 INFO:teuthology.orchestra.run.smithi039.stdout:284 2023-05-16T13:57:05.944 INFO:teuthology.orchestra.run.smithi039.stdout:284.out 2023-05-16T13:57:05.944 INFO:teuthology.orchestra.run.smithi039.stdout:285 2023-05-16T13:57:05.944 INFO:teuthology.orchestra.run.smithi039.stdout:285.out 2023-05-16T13:57:05.945 INFO:teuthology.orchestra.run.smithi039.stdout:286 2023-05-16T13:57:05.945 INFO:teuthology.orchestra.run.smithi039.stdout:286.out 2023-05-16T13:57:05.945 INFO:teuthology.orchestra.run.smithi039.stdout:287 2023-05-16T13:57:05.945 INFO:teuthology.orchestra.run.smithi039.stdout:287.out 2023-05-16T13:57:05.945 INFO:teuthology.orchestra.run.smithi039.stdout:288 2023-05-16T13:57:05.945 INFO:teuthology.orchestra.run.smithi039.stdout:288.out 2023-05-16T13:57:05.945 INFO:teuthology.orchestra.run.smithi039.stdout:289 2023-05-16T13:57:05.945 INFO:teuthology.orchestra.run.smithi039.stdout:289.out 2023-05-16T13:57:05.946 INFO:teuthology.orchestra.run.smithi039.stdout:290 2023-05-16T13:57:05.946 INFO:teuthology.orchestra.run.smithi039.stdout:290.out 2023-05-16T13:57:05.946 INFO:teuthology.orchestra.run.smithi039.stdout:291 2023-05-16T13:57:05.946 INFO:teuthology.orchestra.run.smithi039.stdout:291.out 2023-05-16T13:57:05.946 INFO:teuthology.orchestra.run.smithi039.stdout:292 2023-05-16T13:57:05.946 INFO:teuthology.orchestra.run.smithi039.stdout:292.out 2023-05-16T13:57:05.946 INFO:teuthology.orchestra.run.smithi039.stdout:293 2023-05-16T13:57:05.946 INFO:teuthology.orchestra.run.smithi039.stdout:293.out 2023-05-16T13:57:05.946 INFO:teuthology.orchestra.run.smithi039.stdout:294 2023-05-16T13:57:05.947 INFO:teuthology.orchestra.run.smithi039.stdout:294.out 2023-05-16T13:57:05.947 INFO:teuthology.orchestra.run.smithi039.stdout:295 2023-05-16T13:57:05.947 INFO:teuthology.orchestra.run.smithi039.stdout:295.out 2023-05-16T13:57:05.947 INFO:teuthology.orchestra.run.smithi039.stdout:296 2023-05-16T13:57:05.947 INFO:teuthology.orchestra.run.smithi039.stdout:296.out 2023-05-16T13:57:05.947 INFO:teuthology.orchestra.run.smithi039.stdout:297 2023-05-16T13:57:05.947 INFO:teuthology.orchestra.run.smithi039.stdout:297.out 2023-05-16T13:57:05.948 INFO:teuthology.orchestra.run.smithi039.stdout:298 2023-05-16T13:57:05.948 INFO:teuthology.orchestra.run.smithi039.stdout:298.out 2023-05-16T13:57:05.948 INFO:teuthology.orchestra.run.smithi039.stdout:299 2023-05-16T13:57:05.948 INFO:teuthology.orchestra.run.smithi039.stdout:299.out 2023-05-16T13:57:05.948 INFO:teuthology.orchestra.run.smithi039.stdout:300 2023-05-16T13:57:05.948 INFO:teuthology.orchestra.run.smithi039.stdout:300.out 2023-05-16T13:57:05.948 INFO:teuthology.orchestra.run.smithi039.stdout:301 2023-05-16T13:57:05.948 INFO:teuthology.orchestra.run.smithi039.stdout:301.out 2023-05-16T13:57:05.949 INFO:teuthology.orchestra.run.smithi039.stdout:302 2023-05-16T13:57:05.949 INFO:teuthology.orchestra.run.smithi039.stdout:302.out 2023-05-16T13:57:05.949 INFO:teuthology.orchestra.run.smithi039.stdout:303 2023-05-16T13:57:05.949 INFO:teuthology.orchestra.run.smithi039.stdout:303.out 2023-05-16T13:57:05.949 INFO:teuthology.orchestra.run.smithi039.stdout:304 2023-05-16T13:57:05.949 INFO:teuthology.orchestra.run.smithi039.stdout:304.out 2023-05-16T13:57:05.949 INFO:teuthology.orchestra.run.smithi039.stdout:305 2023-05-16T13:57:05.949 INFO:teuthology.orchestra.run.smithi039.stdout:305.out 2023-05-16T13:57:05.950 INFO:teuthology.orchestra.run.smithi039.stdout:306 2023-05-16T13:57:05.950 INFO:teuthology.orchestra.run.smithi039.stdout:306.out 2023-05-16T13:57:05.950 INFO:teuthology.orchestra.run.smithi039.stdout:307 2023-05-16T13:57:05.950 INFO:teuthology.orchestra.run.smithi039.stdout:307.out 2023-05-16T13:57:05.950 INFO:teuthology.orchestra.run.smithi039.stdout:308 2023-05-16T13:57:05.950 INFO:teuthology.orchestra.run.smithi039.stdout:308.out 2023-05-16T13:57:05.950 INFO:teuthology.orchestra.run.smithi039.stdout:309 2023-05-16T13:57:05.950 INFO:teuthology.orchestra.run.smithi039.stdout:309.out 2023-05-16T13:57:05.951 INFO:teuthology.orchestra.run.smithi039.stdout:310 2023-05-16T13:57:05.951 INFO:teuthology.orchestra.run.smithi039.stdout:310.out 2023-05-16T13:57:05.951 INFO:teuthology.orchestra.run.smithi039.stdout:311 2023-05-16T13:57:05.951 INFO:teuthology.orchestra.run.smithi039.stdout:311.out 2023-05-16T13:57:05.951 INFO:teuthology.orchestra.run.smithi039.stdout:312 2023-05-16T13:57:05.951 INFO:teuthology.orchestra.run.smithi039.stdout:312.out 2023-05-16T13:57:05.951 INFO:teuthology.orchestra.run.smithi039.stdout:313 2023-05-16T13:57:05.951 INFO:teuthology.orchestra.run.smithi039.stdout:313.out 2023-05-16T13:57:05.952 INFO:teuthology.orchestra.run.smithi039.stdout:314 2023-05-16T13:57:05.952 INFO:teuthology.orchestra.run.smithi039.stdout:314.out 2023-05-16T13:57:05.952 INFO:teuthology.orchestra.run.smithi039.stdout:315 2023-05-16T13:57:05.952 INFO:teuthology.orchestra.run.smithi039.stdout:315.out 2023-05-16T13:57:05.952 INFO:teuthology.orchestra.run.smithi039.stdout:316 2023-05-16T13:57:05.952 INFO:teuthology.orchestra.run.smithi039.stdout:316.out 2023-05-16T13:57:05.952 INFO:teuthology.orchestra.run.smithi039.stdout:317 2023-05-16T13:57:05.952 INFO:teuthology.orchestra.run.smithi039.stdout:317.out 2023-05-16T13:57:05.953 INFO:teuthology.orchestra.run.smithi039.stdout:318 2023-05-16T13:57:05.953 INFO:teuthology.orchestra.run.smithi039.stdout:318.out 2023-05-16T13:57:05.953 INFO:teuthology.orchestra.run.smithi039.stdout:319 2023-05-16T13:57:05.953 INFO:teuthology.orchestra.run.smithi039.stdout:319.out 2023-05-16T13:57:05.953 INFO:teuthology.orchestra.run.smithi039.stdout:320 2023-05-16T13:57:05.953 INFO:teuthology.orchestra.run.smithi039.stdout:320.out 2023-05-16T13:57:05.953 INFO:teuthology.orchestra.run.smithi039.stdout:321 2023-05-16T13:57:05.953 INFO:teuthology.orchestra.run.smithi039.stdout:321.out 2023-05-16T13:57:05.954 INFO:teuthology.orchestra.run.smithi039.stdout:322 2023-05-16T13:57:05.954 INFO:teuthology.orchestra.run.smithi039.stdout:322.out 2023-05-16T13:57:05.954 INFO:teuthology.orchestra.run.smithi039.stdout:323 2023-05-16T13:57:05.954 INFO:teuthology.orchestra.run.smithi039.stdout:323.out 2023-05-16T13:57:05.954 INFO:teuthology.orchestra.run.smithi039.stdout:324 2023-05-16T13:57:05.954 INFO:teuthology.orchestra.run.smithi039.stdout:324.out 2023-05-16T13:57:05.954 INFO:teuthology.orchestra.run.smithi039.stdout:325 2023-05-16T13:57:05.954 INFO:teuthology.orchestra.run.smithi039.stdout:325.out 2023-05-16T13:57:05.955 INFO:teuthology.orchestra.run.smithi039.stdout:326 2023-05-16T13:57:05.955 INFO:teuthology.orchestra.run.smithi039.stdout:326.out 2023-05-16T13:57:05.955 INFO:teuthology.orchestra.run.smithi039.stdout:327 2023-05-16T13:57:05.955 INFO:teuthology.orchestra.run.smithi039.stdout:327.out 2023-05-16T13:57:05.955 INFO:teuthology.orchestra.run.smithi039.stdout:328 2023-05-16T13:57:05.955 INFO:teuthology.orchestra.run.smithi039.stdout:328.out 2023-05-16T13:57:05.955 INFO:teuthology.orchestra.run.smithi039.stdout:329 2023-05-16T13:57:05.955 INFO:teuthology.orchestra.run.smithi039.stdout:329.out 2023-05-16T13:57:05.956 INFO:teuthology.orchestra.run.smithi039.stdout:330 2023-05-16T13:57:05.956 INFO:teuthology.orchestra.run.smithi039.stdout:330.out 2023-05-16T13:57:05.956 INFO:teuthology.orchestra.run.smithi039.stdout:331 2023-05-16T13:57:05.956 INFO:teuthology.orchestra.run.smithi039.stdout:331.out 2023-05-16T13:57:05.956 INFO:teuthology.orchestra.run.smithi039.stdout:332 2023-05-16T13:57:05.956 INFO:teuthology.orchestra.run.smithi039.stdout:332.out 2023-05-16T13:57:05.956 INFO:teuthology.orchestra.run.smithi039.stdout:333 2023-05-16T13:57:05.957 INFO:teuthology.orchestra.run.smithi039.stdout:333.out 2023-05-16T13:57:05.957 INFO:teuthology.orchestra.run.smithi039.stdout:334 2023-05-16T13:57:05.957 INFO:teuthology.orchestra.run.smithi039.stdout:334.out 2023-05-16T13:57:05.957 INFO:teuthology.orchestra.run.smithi039.stdout:335 2023-05-16T13:57:05.957 INFO:teuthology.orchestra.run.smithi039.stdout:335.out 2023-05-16T13:57:05.957 INFO:teuthology.orchestra.run.smithi039.stdout:336 2023-05-16T13:57:05.957 INFO:teuthology.orchestra.run.smithi039.stdout:336.out 2023-05-16T13:57:05.957 INFO:teuthology.orchestra.run.smithi039.stdout:337 2023-05-16T13:57:05.957 INFO:teuthology.orchestra.run.smithi039.stdout:337.out 2023-05-16T13:57:05.958 INFO:teuthology.orchestra.run.smithi039.stdout:338 2023-05-16T13:57:05.958 INFO:teuthology.orchestra.run.smithi039.stdout:338.out 2023-05-16T13:57:05.958 INFO:teuthology.orchestra.run.smithi039.stdout:339 2023-05-16T13:57:05.958 INFO:teuthology.orchestra.run.smithi039.stdout:339.out 2023-05-16T13:57:05.958 INFO:teuthology.orchestra.run.smithi039.stdout:340 2023-05-16T13:57:05.958 INFO:teuthology.orchestra.run.smithi039.stdout:340.out 2023-05-16T13:57:05.958 INFO:teuthology.orchestra.run.smithi039.stdout:341 2023-05-16T13:57:05.958 INFO:teuthology.orchestra.run.smithi039.stdout:341.out 2023-05-16T13:57:05.959 INFO:teuthology.orchestra.run.smithi039.stdout:342 2023-05-16T13:57:05.959 INFO:teuthology.orchestra.run.smithi039.stdout:342.out 2023-05-16T13:57:05.959 INFO:teuthology.orchestra.run.smithi039.stdout:343 2023-05-16T13:57:05.959 INFO:teuthology.orchestra.run.smithi039.stdout:343.out 2023-05-16T13:57:05.959 INFO:teuthology.orchestra.run.smithi039.stdout:344 2023-05-16T13:57:05.959 INFO:teuthology.orchestra.run.smithi039.stdout:344.out 2023-05-16T13:57:05.959 INFO:teuthology.orchestra.run.smithi039.stdout:345 2023-05-16T13:57:05.959 INFO:teuthology.orchestra.run.smithi039.stdout:345.out 2023-05-16T13:57:05.960 INFO:teuthology.orchestra.run.smithi039.stdout:346 2023-05-16T13:57:05.960 INFO:teuthology.orchestra.run.smithi039.stdout:346.out 2023-05-16T13:57:05.960 INFO:teuthology.orchestra.run.smithi039.stdout:347 2023-05-16T13:57:05.960 INFO:teuthology.orchestra.run.smithi039.stdout:347.out 2023-05-16T13:57:05.960 INFO:teuthology.orchestra.run.smithi039.stdout:348 2023-05-16T13:57:05.960 INFO:teuthology.orchestra.run.smithi039.stdout:348.out 2023-05-16T13:57:05.960 INFO:teuthology.orchestra.run.smithi039.stdout:349 2023-05-16T13:57:05.960 INFO:teuthology.orchestra.run.smithi039.stdout:349.out 2023-05-16T13:57:05.961 INFO:teuthology.orchestra.run.smithi039.stdout:350 2023-05-16T13:57:05.961 INFO:teuthology.orchestra.run.smithi039.stdout:350.out 2023-05-16T13:57:05.961 INFO:teuthology.orchestra.run.smithi039.stdout:351 2023-05-16T13:57:05.961 INFO:teuthology.orchestra.run.smithi039.stdout:351.out 2023-05-16T13:57:05.961 INFO:teuthology.orchestra.run.smithi039.stdout:352 2023-05-16T13:57:05.961 INFO:teuthology.orchestra.run.smithi039.stdout:352.out 2023-05-16T13:57:05.961 INFO:teuthology.orchestra.run.smithi039.stdout:353 2023-05-16T13:57:05.961 INFO:teuthology.orchestra.run.smithi039.stdout:353.out 2023-05-16T13:57:05.962 INFO:teuthology.orchestra.run.smithi039.stdout:354 2023-05-16T13:57:05.962 INFO:teuthology.orchestra.run.smithi039.stdout:354.out 2023-05-16T13:57:05.962 INFO:teuthology.orchestra.run.smithi039.stdout:355 2023-05-16T13:57:05.962 INFO:teuthology.orchestra.run.smithi039.stdout:355.out 2023-05-16T13:57:05.962 INFO:teuthology.orchestra.run.smithi039.stdout:356 2023-05-16T13:57:05.962 INFO:teuthology.orchestra.run.smithi039.stdout:356.out 2023-05-16T13:57:05.962 INFO:teuthology.orchestra.run.smithi039.stdout:357 2023-05-16T13:57:05.962 INFO:teuthology.orchestra.run.smithi039.stdout:357.out 2023-05-16T13:57:05.963 INFO:teuthology.orchestra.run.smithi039.stdout:358 2023-05-16T13:57:05.963 INFO:teuthology.orchestra.run.smithi039.stdout:358.out 2023-05-16T13:57:05.963 INFO:teuthology.orchestra.run.smithi039.stdout:359 2023-05-16T13:57:05.963 INFO:teuthology.orchestra.run.smithi039.stdout:359.out 2023-05-16T13:57:05.963 INFO:teuthology.orchestra.run.smithi039.stdout:360 2023-05-16T13:57:05.963 INFO:teuthology.orchestra.run.smithi039.stdout:360.out 2023-05-16T13:57:05.963 INFO:teuthology.orchestra.run.smithi039.stdout:361 2023-05-16T13:57:05.963 INFO:teuthology.orchestra.run.smithi039.stdout:361.out 2023-05-16T13:57:05.964 INFO:teuthology.orchestra.run.smithi039.stdout:362 2023-05-16T13:57:05.964 INFO:teuthology.orchestra.run.smithi039.stdout:362.out 2023-05-16T13:57:05.964 INFO:teuthology.orchestra.run.smithi039.stdout:363 2023-05-16T13:57:05.964 INFO:teuthology.orchestra.run.smithi039.stdout:363.out 2023-05-16T13:57:05.964 INFO:teuthology.orchestra.run.smithi039.stdout:364 2023-05-16T13:57:05.964 INFO:teuthology.orchestra.run.smithi039.stdout:364.out 2023-05-16T13:57:05.964 INFO:teuthology.orchestra.run.smithi039.stdout:365 2023-05-16T13:57:05.964 INFO:teuthology.orchestra.run.smithi039.stdout:365.out 2023-05-16T13:57:05.965 INFO:teuthology.orchestra.run.smithi039.stdout:366 2023-05-16T13:57:05.965 INFO:teuthology.orchestra.run.smithi039.stdout:366.out 2023-05-16T13:57:05.965 INFO:teuthology.orchestra.run.smithi039.stdout:367 2023-05-16T13:57:05.965 INFO:teuthology.orchestra.run.smithi039.stdout:367.out 2023-05-16T13:57:05.965 INFO:teuthology.orchestra.run.smithi039.stdout:368 2023-05-16T13:57:05.965 INFO:teuthology.orchestra.run.smithi039.stdout:368.out 2023-05-16T13:57:05.965 INFO:teuthology.orchestra.run.smithi039.stdout:369 2023-05-16T13:57:05.965 INFO:teuthology.orchestra.run.smithi039.stdout:369.out 2023-05-16T13:57:05.966 INFO:teuthology.orchestra.run.smithi039.stdout:370 2023-05-16T13:57:05.966 INFO:teuthology.orchestra.run.smithi039.stdout:370.out 2023-05-16T13:57:05.966 INFO:teuthology.orchestra.run.smithi039.stdout:371 2023-05-16T13:57:05.966 INFO:teuthology.orchestra.run.smithi039.stdout:371.out 2023-05-16T13:57:05.966 INFO:teuthology.orchestra.run.smithi039.stdout:372 2023-05-16T13:57:05.966 INFO:teuthology.orchestra.run.smithi039.stdout:372.out 2023-05-16T13:57:05.966 INFO:teuthology.orchestra.run.smithi039.stdout:373 2023-05-16T13:57:05.966 INFO:teuthology.orchestra.run.smithi039.stdout:373.out 2023-05-16T13:57:05.967 INFO:teuthology.orchestra.run.smithi039.stdout:374 2023-05-16T13:57:05.967 INFO:teuthology.orchestra.run.smithi039.stdout:374.out 2023-05-16T13:57:05.967 INFO:teuthology.orchestra.run.smithi039.stdout:375 2023-05-16T13:57:05.967 INFO:teuthology.orchestra.run.smithi039.stdout:375.out 2023-05-16T13:57:05.967 INFO:teuthology.orchestra.run.smithi039.stdout:376 2023-05-16T13:57:05.967 INFO:teuthology.orchestra.run.smithi039.stdout:376.out 2023-05-16T13:57:05.967 INFO:teuthology.orchestra.run.smithi039.stdout:377 2023-05-16T13:57:05.967 INFO:teuthology.orchestra.run.smithi039.stdout:377.out 2023-05-16T13:57:05.968 INFO:teuthology.orchestra.run.smithi039.stdout:378 2023-05-16T13:57:05.968 INFO:teuthology.orchestra.run.smithi039.stdout:378.out 2023-05-16T13:57:05.968 INFO:teuthology.orchestra.run.smithi039.stdout:379 2023-05-16T13:57:05.968 INFO:teuthology.orchestra.run.smithi039.stdout:379.out 2023-05-16T13:57:05.968 INFO:teuthology.orchestra.run.smithi039.stdout:380 2023-05-16T13:57:05.968 INFO:teuthology.orchestra.run.smithi039.stdout:380.out 2023-05-16T13:57:05.968 INFO:teuthology.orchestra.run.smithi039.stdout:381 2023-05-16T13:57:05.968 INFO:teuthology.orchestra.run.smithi039.stdout:381.out 2023-05-16T13:57:05.969 INFO:teuthology.orchestra.run.smithi039.stdout:382 2023-05-16T13:57:05.969 INFO:teuthology.orchestra.run.smithi039.stdout:382.out 2023-05-16T13:57:05.969 INFO:teuthology.orchestra.run.smithi039.stdout:383 2023-05-16T13:57:05.969 INFO:teuthology.orchestra.run.smithi039.stdout:383.out 2023-05-16T13:57:05.969 INFO:teuthology.orchestra.run.smithi039.stdout:384 2023-05-16T13:57:05.969 INFO:teuthology.orchestra.run.smithi039.stdout:384.out 2023-05-16T13:57:05.969 INFO:teuthology.orchestra.run.smithi039.stdout:385 2023-05-16T13:57:05.969 INFO:teuthology.orchestra.run.smithi039.stdout:385.out 2023-05-16T13:57:05.970 INFO:teuthology.orchestra.run.smithi039.stdout:386 2023-05-16T13:57:05.970 INFO:teuthology.orchestra.run.smithi039.stdout:386.out 2023-05-16T13:57:05.970 INFO:teuthology.orchestra.run.smithi039.stdout:387 2023-05-16T13:57:05.970 INFO:teuthology.orchestra.run.smithi039.stdout:387.out 2023-05-16T13:57:05.970 INFO:teuthology.orchestra.run.smithi039.stdout:388 2023-05-16T13:57:05.970 INFO:teuthology.orchestra.run.smithi039.stdout:388.out 2023-05-16T13:57:05.970 INFO:teuthology.orchestra.run.smithi039.stdout:389 2023-05-16T13:57:05.970 INFO:teuthology.orchestra.run.smithi039.stdout:389.out 2023-05-16T13:57:05.971 INFO:teuthology.orchestra.run.smithi039.stdout:390 2023-05-16T13:57:05.971 INFO:teuthology.orchestra.run.smithi039.stdout:390.out 2023-05-16T13:57:05.971 INFO:teuthology.orchestra.run.smithi039.stdout:391 2023-05-16T13:57:05.971 INFO:teuthology.orchestra.run.smithi039.stdout:391.out 2023-05-16T13:57:05.971 INFO:teuthology.orchestra.run.smithi039.stdout:392 2023-05-16T13:57:05.971 INFO:teuthology.orchestra.run.smithi039.stdout:392.out 2023-05-16T13:57:05.971 INFO:teuthology.orchestra.run.smithi039.stdout:393 2023-05-16T13:57:05.971 INFO:teuthology.orchestra.run.smithi039.stdout:393.out 2023-05-16T13:57:05.972 INFO:teuthology.orchestra.run.smithi039.stdout:394 2023-05-16T13:57:05.972 INFO:teuthology.orchestra.run.smithi039.stdout:394.out 2023-05-16T13:57:05.972 INFO:teuthology.orchestra.run.smithi039.stdout:395 2023-05-16T13:57:05.972 INFO:teuthology.orchestra.run.smithi039.stdout:395.out 2023-05-16T13:57:05.972 INFO:teuthology.orchestra.run.smithi039.stdout:396 2023-05-16T13:57:05.972 INFO:teuthology.orchestra.run.smithi039.stdout:396.out 2023-05-16T13:57:05.972 INFO:teuthology.orchestra.run.smithi039.stdout:397 2023-05-16T13:57:05.972 INFO:teuthology.orchestra.run.smithi039.stdout:397.out 2023-05-16T13:57:05.973 INFO:teuthology.orchestra.run.smithi039.stdout:398 2023-05-16T13:57:05.973 INFO:teuthology.orchestra.run.smithi039.stdout:398.out 2023-05-16T13:57:05.973 INFO:teuthology.orchestra.run.smithi039.stdout:399 2023-05-16T13:57:05.973 INFO:teuthology.orchestra.run.smithi039.stdout:399.out 2023-05-16T13:57:05.973 INFO:teuthology.orchestra.run.smithi039.stdout:400 2023-05-16T13:57:05.973 INFO:teuthology.orchestra.run.smithi039.stdout:400.out 2023-05-16T13:57:05.973 INFO:teuthology.orchestra.run.smithi039.stdout:401 2023-05-16T13:57:05.973 INFO:teuthology.orchestra.run.smithi039.stdout:401.out 2023-05-16T13:57:05.974 INFO:teuthology.orchestra.run.smithi039.stdout:402 2023-05-16T13:57:05.974 INFO:teuthology.orchestra.run.smithi039.stdout:402.out 2023-05-16T13:57:05.974 INFO:teuthology.orchestra.run.smithi039.stdout:403 2023-05-16T13:57:05.974 INFO:teuthology.orchestra.run.smithi039.stdout:403.out 2023-05-16T13:57:05.974 INFO:teuthology.orchestra.run.smithi039.stdout:404 2023-05-16T13:57:05.974 INFO:teuthology.orchestra.run.smithi039.stdout:404.out 2023-05-16T13:57:05.974 INFO:teuthology.orchestra.run.smithi039.stdout:405 2023-05-16T13:57:05.974 INFO:teuthology.orchestra.run.smithi039.stdout:405.out 2023-05-16T13:57:05.975 INFO:teuthology.orchestra.run.smithi039.stdout:406 2023-05-16T13:57:05.975 INFO:teuthology.orchestra.run.smithi039.stdout:406.out 2023-05-16T13:57:05.975 INFO:teuthology.orchestra.run.smithi039.stdout:407 2023-05-16T13:57:05.975 INFO:teuthology.orchestra.run.smithi039.stdout:407.out 2023-05-16T13:57:05.975 INFO:teuthology.orchestra.run.smithi039.stdout:408 2023-05-16T13:57:05.975 INFO:teuthology.orchestra.run.smithi039.stdout:408.out 2023-05-16T13:57:05.975 INFO:teuthology.orchestra.run.smithi039.stdout:409 2023-05-16T13:57:05.975 INFO:teuthology.orchestra.run.smithi039.stdout:409.out 2023-05-16T13:57:05.976 INFO:teuthology.orchestra.run.smithi039.stdout:410 2023-05-16T13:57:05.976 INFO:teuthology.orchestra.run.smithi039.stdout:410.out 2023-05-16T13:57:05.976 INFO:teuthology.orchestra.run.smithi039.stdout:411 2023-05-16T13:57:05.976 INFO:teuthology.orchestra.run.smithi039.stdout:411.out 2023-05-16T13:57:05.976 INFO:teuthology.orchestra.run.smithi039.stdout:412 2023-05-16T13:57:05.976 INFO:teuthology.orchestra.run.smithi039.stdout:412.out 2023-05-16T13:57:05.976 INFO:teuthology.orchestra.run.smithi039.stdout:413 2023-05-16T13:57:05.976 INFO:teuthology.orchestra.run.smithi039.stdout:413.out 2023-05-16T13:57:05.977 INFO:teuthology.orchestra.run.smithi039.stdout:414 2023-05-16T13:57:05.977 INFO:teuthology.orchestra.run.smithi039.stdout:414.out 2023-05-16T13:57:05.977 INFO:teuthology.orchestra.run.smithi039.stdout:415 2023-05-16T13:57:05.977 INFO:teuthology.orchestra.run.smithi039.stdout:415.out 2023-05-16T13:57:05.977 INFO:teuthology.orchestra.run.smithi039.stdout:416 2023-05-16T13:57:05.977 INFO:teuthology.orchestra.run.smithi039.stdout:416.out 2023-05-16T13:57:05.977 INFO:teuthology.orchestra.run.smithi039.stdout:417 2023-05-16T13:57:05.977 INFO:teuthology.orchestra.run.smithi039.stdout:417.out 2023-05-16T13:57:05.978 INFO:teuthology.orchestra.run.smithi039.stdout:418 2023-05-16T13:57:05.978 INFO:teuthology.orchestra.run.smithi039.stdout:418.out 2023-05-16T13:57:05.978 INFO:teuthology.orchestra.run.smithi039.stdout:419 2023-05-16T13:57:05.978 INFO:teuthology.orchestra.run.smithi039.stdout:419.out 2023-05-16T13:57:05.978 INFO:teuthology.orchestra.run.smithi039.stdout:420 2023-05-16T13:57:05.978 INFO:teuthology.orchestra.run.smithi039.stdout:420.out 2023-05-16T13:57:05.978 INFO:teuthology.orchestra.run.smithi039.stdout:421 2023-05-16T13:57:05.978 INFO:teuthology.orchestra.run.smithi039.stdout:421.out 2023-05-16T13:57:05.978 INFO:teuthology.orchestra.run.smithi039.stdout:422 2023-05-16T13:57:05.979 INFO:teuthology.orchestra.run.smithi039.stdout:422.out 2023-05-16T13:57:05.979 INFO:teuthology.orchestra.run.smithi039.stdout:423 2023-05-16T13:57:05.979 INFO:teuthology.orchestra.run.smithi039.stdout:423.out 2023-05-16T13:57:05.979 INFO:teuthology.orchestra.run.smithi039.stdout:424 2023-05-16T13:57:05.979 INFO:teuthology.orchestra.run.smithi039.stdout:424.out 2023-05-16T13:57:05.979 INFO:teuthology.orchestra.run.smithi039.stdout:425 2023-05-16T13:57:05.979 INFO:teuthology.orchestra.run.smithi039.stdout:425.out 2023-05-16T13:57:05.980 INFO:teuthology.orchestra.run.smithi039.stdout:426 2023-05-16T13:57:05.980 INFO:teuthology.orchestra.run.smithi039.stdout:426.out 2023-05-16T13:57:05.980 INFO:teuthology.orchestra.run.smithi039.stdout:427 2023-05-16T13:57:05.980 INFO:teuthology.orchestra.run.smithi039.stdout:427.out 2023-05-16T13:57:05.980 INFO:teuthology.orchestra.run.smithi039.stdout:428 2023-05-16T13:57:05.980 INFO:teuthology.orchestra.run.smithi039.stdout:428.out 2023-05-16T13:57:05.980 INFO:teuthology.orchestra.run.smithi039.stdout:429 2023-05-16T13:57:05.980 INFO:teuthology.orchestra.run.smithi039.stdout:429.out 2023-05-16T13:57:05.981 INFO:teuthology.orchestra.run.smithi039.stdout:430 2023-05-16T13:57:05.981 INFO:teuthology.orchestra.run.smithi039.stdout:430.out 2023-05-16T13:57:05.981 INFO:teuthology.orchestra.run.smithi039.stdout:431 2023-05-16T13:57:05.981 INFO:teuthology.orchestra.run.smithi039.stdout:431.out 2023-05-16T13:57:05.981 INFO:teuthology.orchestra.run.smithi039.stdout:432 2023-05-16T13:57:05.981 INFO:teuthology.orchestra.run.smithi039.stdout:432.out 2023-05-16T13:57:05.981 INFO:teuthology.orchestra.run.smithi039.stdout:433 2023-05-16T13:57:05.981 INFO:teuthology.orchestra.run.smithi039.stdout:433.out 2023-05-16T13:57:05.982 INFO:teuthology.orchestra.run.smithi039.stdout:434 2023-05-16T13:57:05.982 INFO:teuthology.orchestra.run.smithi039.stdout:434.out 2023-05-16T13:57:05.982 INFO:teuthology.orchestra.run.smithi039.stdout:435 2023-05-16T13:57:05.982 INFO:teuthology.orchestra.run.smithi039.stdout:435.out 2023-05-16T13:57:05.982 INFO:teuthology.orchestra.run.smithi039.stdout:436 2023-05-16T13:57:05.982 INFO:teuthology.orchestra.run.smithi039.stdout:436.out 2023-05-16T13:57:05.982 INFO:teuthology.orchestra.run.smithi039.stdout:437 2023-05-16T13:57:05.982 INFO:teuthology.orchestra.run.smithi039.stdout:437.out 2023-05-16T13:57:05.983 INFO:teuthology.orchestra.run.smithi039.stdout:438 2023-05-16T13:57:05.983 INFO:teuthology.orchestra.run.smithi039.stdout:438.out 2023-05-16T13:57:05.983 INFO:teuthology.orchestra.run.smithi039.stdout:439 2023-05-16T13:57:05.983 INFO:teuthology.orchestra.run.smithi039.stdout:439.out 2023-05-16T13:57:05.983 INFO:teuthology.orchestra.run.smithi039.stdout:440 2023-05-16T13:57:05.983 INFO:teuthology.orchestra.run.smithi039.stdout:440.out 2023-05-16T13:57:05.983 INFO:teuthology.orchestra.run.smithi039.stdout:441 2023-05-16T13:57:05.983 INFO:teuthology.orchestra.run.smithi039.stdout:441.out 2023-05-16T13:57:05.983 INFO:teuthology.orchestra.run.smithi039.stdout:442 2023-05-16T13:57:05.984 INFO:teuthology.orchestra.run.smithi039.stdout:442.out 2023-05-16T13:57:05.984 INFO:teuthology.orchestra.run.smithi039.stdout:443 2023-05-16T13:57:05.984 INFO:teuthology.orchestra.run.smithi039.stdout:443.out 2023-05-16T13:57:05.984 INFO:teuthology.orchestra.run.smithi039.stdout:444 2023-05-16T13:57:05.984 INFO:teuthology.orchestra.run.smithi039.stdout:444.out 2023-05-16T13:57:05.984 INFO:teuthology.orchestra.run.smithi039.stdout:445 2023-05-16T13:57:05.984 INFO:teuthology.orchestra.run.smithi039.stdout:445.out 2023-05-16T13:57:05.984 INFO:teuthology.orchestra.run.smithi039.stdout:446 2023-05-16T13:57:05.985 INFO:teuthology.orchestra.run.smithi039.stdout:446.out 2023-05-16T13:57:05.985 INFO:teuthology.orchestra.run.smithi039.stdout:447 2023-05-16T13:57:05.985 INFO:teuthology.orchestra.run.smithi039.stdout:447.out 2023-05-16T13:57:05.985 INFO:teuthology.orchestra.run.smithi039.stdout:448 2023-05-16T13:57:05.985 INFO:teuthology.orchestra.run.smithi039.stdout:448.out 2023-05-16T13:57:05.985 INFO:teuthology.orchestra.run.smithi039.stdout:449 2023-05-16T13:57:05.985 INFO:teuthology.orchestra.run.smithi039.stdout:449.out 2023-05-16T13:57:05.985 INFO:teuthology.orchestra.run.smithi039.stdout:450 2023-05-16T13:57:05.986 INFO:teuthology.orchestra.run.smithi039.stdout:450.out 2023-05-16T13:57:05.986 INFO:teuthology.orchestra.run.smithi039.stdout:451 2023-05-16T13:57:05.986 INFO:teuthology.orchestra.run.smithi039.stdout:451.out 2023-05-16T13:57:05.986 INFO:teuthology.orchestra.run.smithi039.stdout:452 2023-05-16T13:57:05.986 INFO:teuthology.orchestra.run.smithi039.stdout:452.out 2023-05-16T13:57:05.986 INFO:teuthology.orchestra.run.smithi039.stdout:453 2023-05-16T13:57:05.986 INFO:teuthology.orchestra.run.smithi039.stdout:453.out 2023-05-16T13:57:05.986 INFO:teuthology.orchestra.run.smithi039.stdout:454 2023-05-16T13:57:05.987 INFO:teuthology.orchestra.run.smithi039.stdout:454.out 2023-05-16T13:57:05.987 INFO:teuthology.orchestra.run.smithi039.stdout:455 2023-05-16T13:57:05.987 INFO:teuthology.orchestra.run.smithi039.stdout:455.out 2023-05-16T13:57:05.987 INFO:teuthology.orchestra.run.smithi039.stdout:456 2023-05-16T13:57:05.987 INFO:teuthology.orchestra.run.smithi039.stdout:456.out 2023-05-16T13:57:05.987 INFO:teuthology.orchestra.run.smithi039.stdout:457 2023-05-16T13:57:05.987 INFO:teuthology.orchestra.run.smithi039.stdout:457.out 2023-05-16T13:57:05.987 INFO:teuthology.orchestra.run.smithi039.stdout:458 2023-05-16T13:57:05.988 INFO:teuthology.orchestra.run.smithi039.stdout:458.out 2023-05-16T13:57:05.988 INFO:teuthology.orchestra.run.smithi039.stdout:459 2023-05-16T13:57:05.988 INFO:teuthology.orchestra.run.smithi039.stdout:459.out 2023-05-16T13:57:05.988 INFO:teuthology.orchestra.run.smithi039.stdout:460 2023-05-16T13:57:05.988 INFO:teuthology.orchestra.run.smithi039.stdout:460.out 2023-05-16T13:57:05.988 INFO:teuthology.orchestra.run.smithi039.stdout:461 2023-05-16T13:57:05.988 INFO:teuthology.orchestra.run.smithi039.stdout:461.out 2023-05-16T13:57:05.988 INFO:teuthology.orchestra.run.smithi039.stdout:462 2023-05-16T13:57:05.989 INFO:teuthology.orchestra.run.smithi039.stdout:462.out 2023-05-16T13:57:05.989 INFO:teuthology.orchestra.run.smithi039.stdout:463 2023-05-16T13:57:05.989 INFO:teuthology.orchestra.run.smithi039.stdout:463.out 2023-05-16T13:57:05.989 INFO:teuthology.orchestra.run.smithi039.stdout:464 2023-05-16T13:57:05.989 INFO:teuthology.orchestra.run.smithi039.stdout:464.out 2023-05-16T13:57:05.989 INFO:teuthology.orchestra.run.smithi039.stdout:465 2023-05-16T13:57:05.989 INFO:teuthology.orchestra.run.smithi039.stdout:465.out 2023-05-16T13:57:05.989 INFO:teuthology.orchestra.run.smithi039.stdout:466 2023-05-16T13:57:05.990 INFO:teuthology.orchestra.run.smithi039.stdout:466.out 2023-05-16T13:57:05.990 INFO:teuthology.orchestra.run.smithi039.stdout:467 2023-05-16T13:57:05.990 INFO:teuthology.orchestra.run.smithi039.stdout:467.out 2023-05-16T13:57:05.990 INFO:teuthology.orchestra.run.smithi039.stdout:468 2023-05-16T13:57:05.990 INFO:teuthology.orchestra.run.smithi039.stdout:468.out 2023-05-16T13:57:05.990 INFO:teuthology.orchestra.run.smithi039.stdout:469 2023-05-16T13:57:05.990 INFO:teuthology.orchestra.run.smithi039.stdout:469.out 2023-05-16T13:57:05.990 INFO:teuthology.orchestra.run.smithi039.stdout:470 2023-05-16T13:57:05.991 INFO:teuthology.orchestra.run.smithi039.stdout:470.out 2023-05-16T13:57:05.991 INFO:teuthology.orchestra.run.smithi039.stdout:471 2023-05-16T13:57:05.991 INFO:teuthology.orchestra.run.smithi039.stdout:471.out 2023-05-16T13:57:05.991 INFO:teuthology.orchestra.run.smithi039.stdout:472 2023-05-16T13:57:05.991 INFO:teuthology.orchestra.run.smithi039.stdout:472.out 2023-05-16T13:57:05.991 INFO:teuthology.orchestra.run.smithi039.stdout:473 2023-05-16T13:57:05.991 INFO:teuthology.orchestra.run.smithi039.stdout:473.out 2023-05-16T13:57:05.991 INFO:teuthology.orchestra.run.smithi039.stdout:474 2023-05-16T13:57:05.992 INFO:teuthology.orchestra.run.smithi039.stdout:474.out 2023-05-16T13:57:05.992 INFO:teuthology.orchestra.run.smithi039.stdout:475 2023-05-16T13:57:05.992 INFO:teuthology.orchestra.run.smithi039.stdout:475.out 2023-05-16T13:57:05.992 INFO:teuthology.orchestra.run.smithi039.stdout:476 2023-05-16T13:57:05.992 INFO:teuthology.orchestra.run.smithi039.stdout:476.out 2023-05-16T13:57:05.992 INFO:teuthology.orchestra.run.smithi039.stdout:477 2023-05-16T13:57:05.992 INFO:teuthology.orchestra.run.smithi039.stdout:477.out 2023-05-16T13:57:05.992 INFO:teuthology.orchestra.run.smithi039.stdout:478 2023-05-16T13:57:05.993 INFO:teuthology.orchestra.run.smithi039.stdout:478.out 2023-05-16T13:57:05.993 INFO:teuthology.orchestra.run.smithi039.stdout:479 2023-05-16T13:57:05.993 INFO:teuthology.orchestra.run.smithi039.stdout:479.out 2023-05-16T13:57:05.993 INFO:teuthology.orchestra.run.smithi039.stdout:480 2023-05-16T13:57:05.993 INFO:teuthology.orchestra.run.smithi039.stdout:480.out 2023-05-16T13:57:05.993 INFO:teuthology.orchestra.run.smithi039.stdout:481 2023-05-16T13:57:05.993 INFO:teuthology.orchestra.run.smithi039.stdout:481.out 2023-05-16T13:57:05.993 INFO:teuthology.orchestra.run.smithi039.stdout:482 2023-05-16T13:57:05.994 INFO:teuthology.orchestra.run.smithi039.stdout:482.out 2023-05-16T13:57:05.994 INFO:teuthology.orchestra.run.smithi039.stdout:483 2023-05-16T13:57:05.994 INFO:teuthology.orchestra.run.smithi039.stdout:483.out 2023-05-16T13:57:05.994 INFO:teuthology.orchestra.run.smithi039.stdout:484 2023-05-16T13:57:05.994 INFO:teuthology.orchestra.run.smithi039.stdout:484.out 2023-05-16T13:57:05.994 INFO:teuthology.orchestra.run.smithi039.stdout:485 2023-05-16T13:57:05.994 INFO:teuthology.orchestra.run.smithi039.stdout:485.out 2023-05-16T13:57:05.995 INFO:teuthology.orchestra.run.smithi039.stdout:486 2023-05-16T13:57:05.995 INFO:teuthology.orchestra.run.smithi039.stdout:486.out 2023-05-16T13:57:05.995 INFO:teuthology.orchestra.run.smithi039.stdout:487 2023-05-16T13:57:05.995 INFO:teuthology.orchestra.run.smithi039.stdout:487.out 2023-05-16T13:57:05.995 INFO:teuthology.orchestra.run.smithi039.stdout:488 2023-05-16T13:57:05.995 INFO:teuthology.orchestra.run.smithi039.stdout:488.out 2023-05-16T13:57:05.995 INFO:teuthology.orchestra.run.smithi039.stdout:489 2023-05-16T13:57:05.995 INFO:teuthology.orchestra.run.smithi039.stdout:489.out 2023-05-16T13:57:05.996 INFO:teuthology.orchestra.run.smithi039.stdout:490 2023-05-16T13:57:05.996 INFO:teuthology.orchestra.run.smithi039.stdout:490.out 2023-05-16T13:57:05.996 INFO:teuthology.orchestra.run.smithi039.stdout:491 2023-05-16T13:57:05.996 INFO:teuthology.orchestra.run.smithi039.stdout:491.out 2023-05-16T13:57:05.996 INFO:teuthology.orchestra.run.smithi039.stdout:492 2023-05-16T13:57:05.996 INFO:teuthology.orchestra.run.smithi039.stdout:492.out 2023-05-16T13:57:05.996 INFO:teuthology.orchestra.run.smithi039.stdout:493 2023-05-16T13:57:05.996 INFO:teuthology.orchestra.run.smithi039.stdout:493.out 2023-05-16T13:57:05.997 INFO:teuthology.orchestra.run.smithi039.stdout:494 2023-05-16T13:57:05.997 INFO:teuthology.orchestra.run.smithi039.stdout:494.out 2023-05-16T13:57:05.997 INFO:teuthology.orchestra.run.smithi039.stdout:495 2023-05-16T13:57:05.997 INFO:teuthology.orchestra.run.smithi039.stdout:495.out 2023-05-16T13:57:05.997 INFO:teuthology.orchestra.run.smithi039.stdout:496 2023-05-16T13:57:05.997 INFO:teuthology.orchestra.run.smithi039.stdout:496.out 2023-05-16T13:57:05.997 INFO:teuthology.orchestra.run.smithi039.stdout:497 2023-05-16T13:57:05.998 INFO:teuthology.orchestra.run.smithi039.stdout:497.out 2023-05-16T13:57:05.998 INFO:teuthology.orchestra.run.smithi039.stdout:498 2023-05-16T13:57:05.998 INFO:teuthology.orchestra.run.smithi039.stdout:498.out 2023-05-16T13:57:05.998 INFO:teuthology.orchestra.run.smithi039.stdout:499 2023-05-16T13:57:05.998 INFO:teuthology.orchestra.run.smithi039.stdout:499.out 2023-05-16T13:57:05.998 INFO:teuthology.orchestra.run.smithi039.stdout:500 2023-05-16T13:57:05.998 INFO:teuthology.orchestra.run.smithi039.stdout:500.out 2023-05-16T13:57:05.998 INFO:teuthology.orchestra.run.smithi039.stdout:501 2023-05-16T13:57:05.999 INFO:teuthology.orchestra.run.smithi039.stdout:501.out 2023-05-16T13:57:05.999 INFO:teuthology.orchestra.run.smithi039.stdout:502 2023-05-16T13:57:05.999 INFO:teuthology.orchestra.run.smithi039.stdout:502.out 2023-05-16T13:57:05.999 INFO:teuthology.orchestra.run.smithi039.stdout:503 2023-05-16T13:57:05.999 INFO:teuthology.orchestra.run.smithi039.stdout:503.out 2023-05-16T13:57:05.999 INFO:teuthology.orchestra.run.smithi039.stdout:504 2023-05-16T13:57:05.999 INFO:teuthology.orchestra.run.smithi039.stdout:504.out 2023-05-16T13:57:05.999 INFO:teuthology.orchestra.run.smithi039.stdout:505 2023-05-16T13:57:06.000 INFO:teuthology.orchestra.run.smithi039.stdout:505.out 2023-05-16T13:57:06.000 INFO:teuthology.orchestra.run.smithi039.stdout:506 2023-05-16T13:57:06.000 INFO:teuthology.orchestra.run.smithi039.stdout:506.out 2023-05-16T13:57:06.000 INFO:teuthology.orchestra.run.smithi039.stdout:507 2023-05-16T13:57:06.000 INFO:teuthology.orchestra.run.smithi039.stdout:507.out 2023-05-16T13:57:06.000 INFO:teuthology.orchestra.run.smithi039.stdout:508 2023-05-16T13:57:06.000 INFO:teuthology.orchestra.run.smithi039.stdout:508.out 2023-05-16T13:57:06.000 INFO:teuthology.orchestra.run.smithi039.stdout:509 2023-05-16T13:57:06.001 INFO:teuthology.orchestra.run.smithi039.stdout:509.out 2023-05-16T13:57:06.001 INFO:teuthology.orchestra.run.smithi039.stdout:510 2023-05-16T13:57:06.001 INFO:teuthology.orchestra.run.smithi039.stdout:510.out 2023-05-16T13:57:06.001 INFO:teuthology.orchestra.run.smithi039.stdout:511 2023-05-16T13:57:06.001 INFO:teuthology.orchestra.run.smithi039.stdout:511.out 2023-05-16T13:57:06.001 INFO:teuthology.orchestra.run.smithi039.stdout:512 2023-05-16T13:57:06.001 INFO:teuthology.orchestra.run.smithi039.stdout:512.out 2023-05-16T13:57:06.001 INFO:teuthology.orchestra.run.smithi039.stdout:513 2023-05-16T13:57:06.002 INFO:teuthology.orchestra.run.smithi039.stdout:513.out 2023-05-16T13:57:06.002 INFO:teuthology.orchestra.run.smithi039.stdout:514 2023-05-16T13:57:06.002 INFO:teuthology.orchestra.run.smithi039.stdout:514.out 2023-05-16T13:57:06.002 INFO:teuthology.orchestra.run.smithi039.stdout:515 2023-05-16T13:57:06.002 INFO:teuthology.orchestra.run.smithi039.stdout:515.out 2023-05-16T13:57:06.002 INFO:teuthology.orchestra.run.smithi039.stdout:516 2023-05-16T13:57:06.002 INFO:teuthology.orchestra.run.smithi039.stdout:516.out 2023-05-16T13:57:06.002 INFO:teuthology.orchestra.run.smithi039.stdout:517 2023-05-16T13:57:06.002 INFO:teuthology.orchestra.run.smithi039.stdout:517.out 2023-05-16T13:57:06.003 INFO:teuthology.orchestra.run.smithi039.stdout:518 2023-05-16T13:57:06.003 INFO:teuthology.orchestra.run.smithi039.stdout:518.out 2023-05-16T13:57:06.003 INFO:teuthology.orchestra.run.smithi039.stdout:519 2023-05-16T13:57:06.003 INFO:teuthology.orchestra.run.smithi039.stdout:519.out 2023-05-16T13:57:06.003 INFO:teuthology.orchestra.run.smithi039.stdout:520 2023-05-16T13:57:06.003 INFO:teuthology.orchestra.run.smithi039.stdout:520.out 2023-05-16T13:57:06.003 INFO:teuthology.orchestra.run.smithi039.stdout:521 2023-05-16T13:57:06.004 INFO:teuthology.orchestra.run.smithi039.stdout:521.out 2023-05-16T13:57:06.004 INFO:teuthology.orchestra.run.smithi039.stdout:522 2023-05-16T13:57:06.004 INFO:teuthology.orchestra.run.smithi039.stdout:522.out 2023-05-16T13:57:06.004 INFO:teuthology.orchestra.run.smithi039.stdout:523 2023-05-16T13:57:06.004 INFO:teuthology.orchestra.run.smithi039.stdout:523.out 2023-05-16T13:57:06.004 INFO:teuthology.orchestra.run.smithi039.stdout:524 2023-05-16T13:57:06.004 INFO:teuthology.orchestra.run.smithi039.stdout:524.out 2023-05-16T13:57:06.004 INFO:teuthology.orchestra.run.smithi039.stdout:525 2023-05-16T13:57:06.005 INFO:teuthology.orchestra.run.smithi039.stdout:525.out 2023-05-16T13:57:06.005 INFO:teuthology.orchestra.run.smithi039.stdout:526 2023-05-16T13:57:06.005 INFO:teuthology.orchestra.run.smithi039.stdout:526.out 2023-05-16T13:57:06.005 INFO:teuthology.orchestra.run.smithi039.stdout:527 2023-05-16T13:57:06.005 INFO:teuthology.orchestra.run.smithi039.stdout:527.out 2023-05-16T13:57:06.005 INFO:teuthology.orchestra.run.smithi039.stdout:528 2023-05-16T13:57:06.005 INFO:teuthology.orchestra.run.smithi039.stdout:528.out 2023-05-16T13:57:06.005 INFO:teuthology.orchestra.run.smithi039.stdout:529 2023-05-16T13:57:06.006 INFO:teuthology.orchestra.run.smithi039.stdout:529.out 2023-05-16T13:57:06.006 INFO:teuthology.orchestra.run.smithi039.stdout:530 2023-05-16T13:57:06.006 INFO:teuthology.orchestra.run.smithi039.stdout:530.out 2023-05-16T13:57:06.006 INFO:teuthology.orchestra.run.smithi039.stdout:531 2023-05-16T13:57:06.006 INFO:teuthology.orchestra.run.smithi039.stdout:531.out 2023-05-16T13:57:06.006 INFO:teuthology.orchestra.run.smithi039.stdout:532 2023-05-16T13:57:06.006 INFO:teuthology.orchestra.run.smithi039.stdout:532.out 2023-05-16T13:57:06.006 INFO:teuthology.orchestra.run.smithi039.stdout:533 2023-05-16T13:57:06.007 INFO:teuthology.orchestra.run.smithi039.stdout:533.out 2023-05-16T13:57:06.007 INFO:teuthology.orchestra.run.smithi039.stdout:534 2023-05-16T13:57:06.007 INFO:teuthology.orchestra.run.smithi039.stdout:534.out 2023-05-16T13:57:06.007 INFO:teuthology.orchestra.run.smithi039.stdout:535 2023-05-16T13:57:06.007 INFO:teuthology.orchestra.run.smithi039.stdout:535.out 2023-05-16T13:57:06.007 INFO:teuthology.orchestra.run.smithi039.stdout:536 2023-05-16T13:57:06.007 INFO:teuthology.orchestra.run.smithi039.stdout:536.out 2023-05-16T13:57:06.007 INFO:teuthology.orchestra.run.smithi039.stdout:537 2023-05-16T13:57:06.008 INFO:teuthology.orchestra.run.smithi039.stdout:537.out 2023-05-16T13:57:06.008 INFO:teuthology.orchestra.run.smithi039.stdout:538 2023-05-16T13:57:06.008 INFO:teuthology.orchestra.run.smithi039.stdout:538.out 2023-05-16T13:57:06.008 INFO:teuthology.orchestra.run.smithi039.stdout:539 2023-05-16T13:57:06.008 INFO:teuthology.orchestra.run.smithi039.stdout:539.out 2023-05-16T13:57:06.008 INFO:teuthology.orchestra.run.smithi039.stdout:540 2023-05-16T13:57:06.008 INFO:teuthology.orchestra.run.smithi039.stdout:540.out 2023-05-16T13:57:06.008 INFO:teuthology.orchestra.run.smithi039.stdout:541 2023-05-16T13:57:06.009 INFO:teuthology.orchestra.run.smithi039.stdout:541.out 2023-05-16T13:57:06.009 INFO:teuthology.orchestra.run.smithi039.stdout:542 2023-05-16T13:57:06.009 INFO:teuthology.orchestra.run.smithi039.stdout:542.out 2023-05-16T13:57:06.009 INFO:teuthology.orchestra.run.smithi039.stdout:543 2023-05-16T13:57:06.009 INFO:teuthology.orchestra.run.smithi039.stdout:543.out 2023-05-16T13:57:06.009 INFO:teuthology.orchestra.run.smithi039.stdout:544 2023-05-16T13:57:06.009 INFO:teuthology.orchestra.run.smithi039.stdout:544.out 2023-05-16T13:57:06.009 INFO:teuthology.orchestra.run.smithi039.stdout:545 2023-05-16T13:57:06.010 INFO:teuthology.orchestra.run.smithi039.stdout:545.out 2023-05-16T13:57:06.010 INFO:teuthology.orchestra.run.smithi039.stdout:546 2023-05-16T13:57:06.010 INFO:teuthology.orchestra.run.smithi039.stdout:546.out 2023-05-16T13:57:06.010 INFO:teuthology.orchestra.run.smithi039.stdout:547 2023-05-16T13:57:06.010 INFO:teuthology.orchestra.run.smithi039.stdout:547.out 2023-05-16T13:57:06.010 INFO:teuthology.orchestra.run.smithi039.stdout:548 2023-05-16T13:57:06.010 INFO:teuthology.orchestra.run.smithi039.stdout:548.out 2023-05-16T13:57:06.010 INFO:teuthology.orchestra.run.smithi039.stdout:549 2023-05-16T13:57:06.011 INFO:teuthology.orchestra.run.smithi039.stdout:549.out 2023-05-16T13:57:06.011 INFO:teuthology.orchestra.run.smithi039.stdout:550 2023-05-16T13:57:06.011 INFO:teuthology.orchestra.run.smithi039.stdout:550.out 2023-05-16T13:57:06.011 INFO:teuthology.orchestra.run.smithi039.stdout:551 2023-05-16T13:57:06.011 INFO:teuthology.orchestra.run.smithi039.stdout:551.out 2023-05-16T13:57:06.011 INFO:teuthology.orchestra.run.smithi039.stdout:552 2023-05-16T13:57:06.011 INFO:teuthology.orchestra.run.smithi039.stdout:552.out 2023-05-16T13:57:06.011 INFO:teuthology.orchestra.run.smithi039.stdout:553 2023-05-16T13:57:06.012 INFO:teuthology.orchestra.run.smithi039.stdout:553.out 2023-05-16T13:57:06.012 INFO:teuthology.orchestra.run.smithi039.stdout:554 2023-05-16T13:57:06.012 INFO:teuthology.orchestra.run.smithi039.stdout:554.out 2023-05-16T13:57:06.012 INFO:teuthology.orchestra.run.smithi039.stdout:555 2023-05-16T13:57:06.012 INFO:teuthology.orchestra.run.smithi039.stdout:555.out 2023-05-16T13:57:06.012 INFO:teuthology.orchestra.run.smithi039.stdout:556 2023-05-16T13:57:06.012 INFO:teuthology.orchestra.run.smithi039.stdout:556.out 2023-05-16T13:57:06.012 INFO:teuthology.orchestra.run.smithi039.stdout:557 2023-05-16T13:57:06.013 INFO:teuthology.orchestra.run.smithi039.stdout:557.out 2023-05-16T13:57:06.013 INFO:teuthology.orchestra.run.smithi039.stdout:558 2023-05-16T13:57:06.013 INFO:teuthology.orchestra.run.smithi039.stdout:558.out 2023-05-16T13:57:06.013 INFO:teuthology.orchestra.run.smithi039.stdout:559 2023-05-16T13:57:06.013 INFO:teuthology.orchestra.run.smithi039.stdout:559.out 2023-05-16T13:57:06.013 INFO:teuthology.orchestra.run.smithi039.stdout:560 2023-05-16T13:57:06.013 INFO:teuthology.orchestra.run.smithi039.stdout:560.out 2023-05-16T13:57:06.013 INFO:teuthology.orchestra.run.smithi039.stdout:561 2023-05-16T13:57:06.014 INFO:teuthology.orchestra.run.smithi039.stdout:561.out 2023-05-16T13:57:06.014 INFO:teuthology.orchestra.run.smithi039.stdout:562 2023-05-16T13:57:06.014 INFO:teuthology.orchestra.run.smithi039.stdout:562.out 2023-05-16T13:57:06.014 INFO:teuthology.orchestra.run.smithi039.stdout:563 2023-05-16T13:57:06.014 INFO:teuthology.orchestra.run.smithi039.stdout:563.out 2023-05-16T13:57:06.014 INFO:teuthology.orchestra.run.smithi039.stdout:564 2023-05-16T13:57:06.014 INFO:teuthology.orchestra.run.smithi039.stdout:564.out 2023-05-16T13:57:06.014 INFO:teuthology.orchestra.run.smithi039.stdout:565 2023-05-16T13:57:06.015 INFO:teuthology.orchestra.run.smithi039.stdout:565.out 2023-05-16T13:57:06.015 INFO:teuthology.orchestra.run.smithi039.stdout:566 2023-05-16T13:57:06.015 INFO:teuthology.orchestra.run.smithi039.stdout:566.out 2023-05-16T13:57:06.015 INFO:teuthology.orchestra.run.smithi039.stdout:567 2023-05-16T13:57:06.015 INFO:teuthology.orchestra.run.smithi039.stdout:567.out 2023-05-16T13:57:06.015 INFO:teuthology.orchestra.run.smithi039.stdout:568 2023-05-16T13:57:06.015 INFO:teuthology.orchestra.run.smithi039.stdout:568.out 2023-05-16T13:57:06.015 INFO:teuthology.orchestra.run.smithi039.stdout:569 2023-05-16T13:57:06.016 INFO:teuthology.orchestra.run.smithi039.stdout:569.out 2023-05-16T13:57:06.016 INFO:teuthology.orchestra.run.smithi039.stdout:570 2023-05-16T13:57:06.016 INFO:teuthology.orchestra.run.smithi039.stdout:570.out 2023-05-16T13:57:06.016 INFO:teuthology.orchestra.run.smithi039.stdout:571 2023-05-16T13:57:06.016 INFO:teuthology.orchestra.run.smithi039.stdout:571.out 2023-05-16T13:57:06.016 INFO:teuthology.orchestra.run.smithi039.stdout:572 2023-05-16T13:57:06.016 INFO:teuthology.orchestra.run.smithi039.stdout:572.out 2023-05-16T13:57:06.016 INFO:teuthology.orchestra.run.smithi039.stdout:573 2023-05-16T13:57:06.017 INFO:teuthology.orchestra.run.smithi039.stdout:573.out 2023-05-16T13:57:06.017 INFO:teuthology.orchestra.run.smithi039.stdout:574 2023-05-16T13:57:06.017 INFO:teuthology.orchestra.run.smithi039.stdout:574.out 2023-05-16T13:57:06.017 INFO:teuthology.orchestra.run.smithi039.stdout:575 2023-05-16T13:57:06.017 INFO:teuthology.orchestra.run.smithi039.stdout:575.out 2023-05-16T13:57:06.017 INFO:teuthology.orchestra.run.smithi039.stdout:576 2023-05-16T13:57:06.017 INFO:teuthology.orchestra.run.smithi039.stdout:576.out 2023-05-16T13:57:06.017 INFO:teuthology.orchestra.run.smithi039.stdout:577 2023-05-16T13:57:06.018 INFO:teuthology.orchestra.run.smithi039.stdout:577.out 2023-05-16T13:57:06.018 INFO:teuthology.orchestra.run.smithi039.stdout:578 2023-05-16T13:57:06.018 INFO:teuthology.orchestra.run.smithi039.stdout:578.out 2023-05-16T13:57:06.018 INFO:teuthology.orchestra.run.smithi039.stdout:579 2023-05-16T13:57:06.018 INFO:teuthology.orchestra.run.smithi039.stdout:579.out 2023-05-16T13:57:06.018 INFO:teuthology.orchestra.run.smithi039.stdout:580 2023-05-16T13:57:06.018 INFO:teuthology.orchestra.run.smithi039.stdout:580.out 2023-05-16T13:57:06.018 INFO:teuthology.orchestra.run.smithi039.stdout:581 2023-05-16T13:57:06.019 INFO:teuthology.orchestra.run.smithi039.stdout:581.out 2023-05-16T13:57:06.019 INFO:teuthology.orchestra.run.smithi039.stdout:582 2023-05-16T13:57:06.019 INFO:teuthology.orchestra.run.smithi039.stdout:582.out 2023-05-16T13:57:06.019 INFO:teuthology.orchestra.run.smithi039.stdout:583 2023-05-16T13:57:06.019 INFO:teuthology.orchestra.run.smithi039.stdout:583.out 2023-05-16T13:57:06.019 INFO:teuthology.orchestra.run.smithi039.stdout:584 2023-05-16T13:57:06.019 INFO:teuthology.orchestra.run.smithi039.stdout:584.out 2023-05-16T13:57:06.019 INFO:teuthology.orchestra.run.smithi039.stdout:585 2023-05-16T13:57:06.020 INFO:teuthology.orchestra.run.smithi039.stdout:585.out 2023-05-16T13:57:06.020 INFO:teuthology.orchestra.run.smithi039.stdout:586 2023-05-16T13:57:06.020 INFO:teuthology.orchestra.run.smithi039.stdout:586.out 2023-05-16T13:57:06.020 INFO:teuthology.orchestra.run.smithi039.stdout:587 2023-05-16T13:57:06.020 INFO:teuthology.orchestra.run.smithi039.stdout:587.out 2023-05-16T13:57:06.020 INFO:teuthology.orchestra.run.smithi039.stdout:588 2023-05-16T13:57:06.020 INFO:teuthology.orchestra.run.smithi039.stdout:588.out 2023-05-16T13:57:06.020 INFO:teuthology.orchestra.run.smithi039.stdout:589 2023-05-16T13:57:06.021 INFO:teuthology.orchestra.run.smithi039.stdout:589.out 2023-05-16T13:57:06.021 INFO:teuthology.orchestra.run.smithi039.stdout:590 2023-05-16T13:57:06.021 INFO:teuthology.orchestra.run.smithi039.stdout:590.out 2023-05-16T13:57:06.021 INFO:teuthology.orchestra.run.smithi039.stdout:591 2023-05-16T13:57:06.021 INFO:teuthology.orchestra.run.smithi039.stdout:591.out 2023-05-16T13:57:06.021 INFO:teuthology.orchestra.run.smithi039.stdout:592 2023-05-16T13:57:06.021 INFO:teuthology.orchestra.run.smithi039.stdout:592.out 2023-05-16T13:57:06.021 INFO:teuthology.orchestra.run.smithi039.stdout:593 2023-05-16T13:57:06.022 INFO:teuthology.orchestra.run.smithi039.stdout:593.out 2023-05-16T13:57:06.022 INFO:teuthology.orchestra.run.smithi039.stdout:594 2023-05-16T13:57:06.022 INFO:teuthology.orchestra.run.smithi039.stdout:594.out 2023-05-16T13:57:06.022 INFO:teuthology.orchestra.run.smithi039.stdout:595 2023-05-16T13:57:06.022 INFO:teuthology.orchestra.run.smithi039.stdout:595.out 2023-05-16T13:57:06.022 INFO:teuthology.orchestra.run.smithi039.stdout:596 2023-05-16T13:57:06.022 INFO:teuthology.orchestra.run.smithi039.stdout:596.out 2023-05-16T13:57:06.022 INFO:teuthology.orchestra.run.smithi039.stdout:597 2023-05-16T13:57:06.023 INFO:teuthology.orchestra.run.smithi039.stdout:597.out 2023-05-16T13:57:06.023 INFO:teuthology.orchestra.run.smithi039.stdout:598 2023-05-16T13:57:06.023 INFO:teuthology.orchestra.run.smithi039.stdout:598.out 2023-05-16T13:57:06.023 INFO:teuthology.orchestra.run.smithi039.stdout:599 2023-05-16T13:57:06.023 INFO:teuthology.orchestra.run.smithi039.stdout:599.out 2023-05-16T13:57:06.023 INFO:teuthology.orchestra.run.smithi039.stdout:600 2023-05-16T13:57:06.023 INFO:teuthology.orchestra.run.smithi039.stdout:600.out 2023-05-16T13:57:06.023 INFO:teuthology.orchestra.run.smithi039.stdout:601 2023-05-16T13:57:06.024 INFO:teuthology.orchestra.run.smithi039.stdout:601.out 2023-05-16T13:57:06.024 INFO:teuthology.orchestra.run.smithi039.stdout:602 2023-05-16T13:57:06.024 INFO:teuthology.orchestra.run.smithi039.stdout:602.out 2023-05-16T13:57:06.024 INFO:teuthology.orchestra.run.smithi039.stdout:603 2023-05-16T13:57:06.024 INFO:teuthology.orchestra.run.smithi039.stdout:603.out 2023-05-16T13:57:06.024 INFO:teuthology.orchestra.run.smithi039.stdout:604 2023-05-16T13:57:06.024 INFO:teuthology.orchestra.run.smithi039.stdout:604.out 2023-05-16T13:57:06.024 INFO:teuthology.orchestra.run.smithi039.stdout:605 2023-05-16T13:57:06.025 INFO:teuthology.orchestra.run.smithi039.stdout:605.out 2023-05-16T13:57:06.025 INFO:teuthology.orchestra.run.smithi039.stdout:606 2023-05-16T13:57:06.025 INFO:teuthology.orchestra.run.smithi039.stdout:606.out 2023-05-16T13:57:06.025 INFO:teuthology.orchestra.run.smithi039.stdout:607 2023-05-16T13:57:06.025 INFO:teuthology.orchestra.run.smithi039.stdout:607.out 2023-05-16T13:57:06.025 INFO:teuthology.orchestra.run.smithi039.stdout:608 2023-05-16T13:57:06.025 INFO:teuthology.orchestra.run.smithi039.stdout:608.out 2023-05-16T13:57:06.025 INFO:teuthology.orchestra.run.smithi039.stdout:609 2023-05-16T13:57:06.026 INFO:teuthology.orchestra.run.smithi039.stdout:609.out 2023-05-16T13:57:06.026 INFO:teuthology.orchestra.run.smithi039.stdout:610 2023-05-16T13:57:06.026 INFO:teuthology.orchestra.run.smithi039.stdout:610.out 2023-05-16T13:57:06.026 INFO:teuthology.orchestra.run.smithi039.stdout:611 2023-05-16T13:57:06.026 INFO:teuthology.orchestra.run.smithi039.stdout:611.out 2023-05-16T13:57:06.026 INFO:teuthology.orchestra.run.smithi039.stdout:612 2023-05-16T13:57:06.026 INFO:teuthology.orchestra.run.smithi039.stdout:612.out 2023-05-16T13:57:06.026 INFO:teuthology.orchestra.run.smithi039.stdout:613 2023-05-16T13:57:06.027 INFO:teuthology.orchestra.run.smithi039.stdout:613.out 2023-05-16T13:57:06.027 INFO:teuthology.orchestra.run.smithi039.stdout:614 2023-05-16T13:57:06.027 INFO:teuthology.orchestra.run.smithi039.stdout:614.out 2023-05-16T13:57:06.027 INFO:teuthology.orchestra.run.smithi039.stdout:615 2023-05-16T13:57:06.027 INFO:teuthology.orchestra.run.smithi039.stdout:615.out 2023-05-16T13:57:06.027 INFO:teuthology.orchestra.run.smithi039.stdout:616 2023-05-16T13:57:06.027 INFO:teuthology.orchestra.run.smithi039.stdout:616.out 2023-05-16T13:57:06.027 INFO:teuthology.orchestra.run.smithi039.stdout:617 2023-05-16T13:57:06.028 INFO:teuthology.orchestra.run.smithi039.stdout:617.out 2023-05-16T13:57:06.028 INFO:teuthology.orchestra.run.smithi039.stdout:618 2023-05-16T13:57:06.028 INFO:teuthology.orchestra.run.smithi039.stdout:618.out 2023-05-16T13:57:06.028 INFO:teuthology.orchestra.run.smithi039.stdout:619 2023-05-16T13:57:06.028 INFO:teuthology.orchestra.run.smithi039.stdout:619.out 2023-05-16T13:57:06.028 INFO:teuthology.orchestra.run.smithi039.stdout:620 2023-05-16T13:57:06.028 INFO:teuthology.orchestra.run.smithi039.stdout:620.out 2023-05-16T13:57:06.028 INFO:teuthology.orchestra.run.smithi039.stdout:621 2023-05-16T13:57:06.029 INFO:teuthology.orchestra.run.smithi039.stdout:621.out 2023-05-16T13:57:06.029 INFO:teuthology.orchestra.run.smithi039.stdout:622 2023-05-16T13:57:06.029 INFO:teuthology.orchestra.run.smithi039.stdout:622.out 2023-05-16T13:57:06.029 INFO:teuthology.orchestra.run.smithi039.stdout:623 2023-05-16T13:57:06.029 INFO:teuthology.orchestra.run.smithi039.stdout:623.out 2023-05-16T13:57:06.029 INFO:teuthology.orchestra.run.smithi039.stdout:624 2023-05-16T13:57:06.029 INFO:teuthology.orchestra.run.smithi039.stdout:624.out 2023-05-16T13:57:06.029 INFO:teuthology.orchestra.run.smithi039.stdout:625 2023-05-16T13:57:06.030 INFO:teuthology.orchestra.run.smithi039.stdout:625.out 2023-05-16T13:57:06.030 INFO:teuthology.orchestra.run.smithi039.stdout:626 2023-05-16T13:57:06.030 INFO:teuthology.orchestra.run.smithi039.stdout:626.out 2023-05-16T13:57:06.030 INFO:teuthology.orchestra.run.smithi039.stdout:627 2023-05-16T13:57:06.030 INFO:teuthology.orchestra.run.smithi039.stdout:627.out 2023-05-16T13:57:06.030 INFO:teuthology.orchestra.run.smithi039.stdout:628 2023-05-16T13:57:06.030 INFO:teuthology.orchestra.run.smithi039.stdout:628.out 2023-05-16T13:57:06.030 INFO:teuthology.orchestra.run.smithi039.stdout:629 2023-05-16T13:57:06.031 INFO:teuthology.orchestra.run.smithi039.stdout:629.out 2023-05-16T13:57:06.031 INFO:teuthology.orchestra.run.smithi039.stdout:630 2023-05-16T13:57:06.031 INFO:teuthology.orchestra.run.smithi039.stdout:630.out 2023-05-16T13:57:06.031 INFO:teuthology.orchestra.run.smithi039.stdout:631 2023-05-16T13:57:06.031 INFO:teuthology.orchestra.run.smithi039.stdout:631.out 2023-05-16T13:57:06.031 INFO:teuthology.orchestra.run.smithi039.stdout:632 2023-05-16T13:57:06.031 INFO:teuthology.orchestra.run.smithi039.stdout:632.out 2023-05-16T13:57:06.031 INFO:teuthology.orchestra.run.smithi039.stdout:633 2023-05-16T13:57:06.032 INFO:teuthology.orchestra.run.smithi039.stdout:633.out 2023-05-16T13:57:06.032 INFO:teuthology.orchestra.run.smithi039.stdout:634 2023-05-16T13:57:06.032 INFO:teuthology.orchestra.run.smithi039.stdout:634.out 2023-05-16T13:57:06.032 INFO:teuthology.orchestra.run.smithi039.stdout:635 2023-05-16T13:57:06.032 INFO:teuthology.orchestra.run.smithi039.stdout:635.out 2023-05-16T13:57:06.032 INFO:teuthology.orchestra.run.smithi039.stdout:636 2023-05-16T13:57:06.032 INFO:teuthology.orchestra.run.smithi039.stdout:636.out 2023-05-16T13:57:06.032 INFO:teuthology.orchestra.run.smithi039.stdout:637 2023-05-16T13:57:06.033 INFO:teuthology.orchestra.run.smithi039.stdout:637.out 2023-05-16T13:57:06.033 INFO:teuthology.orchestra.run.smithi039.stdout:638 2023-05-16T13:57:06.033 INFO:teuthology.orchestra.run.smithi039.stdout:638.out 2023-05-16T13:57:06.033 INFO:teuthology.orchestra.run.smithi039.stdout:639 2023-05-16T13:57:06.033 INFO:teuthology.orchestra.run.smithi039.stdout:639.out 2023-05-16T13:57:06.033 INFO:teuthology.orchestra.run.smithi039.stdout:640 2023-05-16T13:57:06.033 INFO:teuthology.orchestra.run.smithi039.stdout:640.out 2023-05-16T13:57:06.033 INFO:teuthology.orchestra.run.smithi039.stdout:641 2023-05-16T13:57:06.034 INFO:teuthology.orchestra.run.smithi039.stdout:641.out 2023-05-16T13:57:06.034 INFO:teuthology.orchestra.run.smithi039.stdout:642 2023-05-16T13:57:06.034 INFO:teuthology.orchestra.run.smithi039.stdout:642.out 2023-05-16T13:57:06.034 INFO:teuthology.orchestra.run.smithi039.stdout:643 2023-05-16T13:57:06.034 INFO:teuthology.orchestra.run.smithi039.stdout:643.out 2023-05-16T13:57:06.034 INFO:teuthology.orchestra.run.smithi039.stdout:644 2023-05-16T13:57:06.034 INFO:teuthology.orchestra.run.smithi039.stdout:644.out 2023-05-16T13:57:06.034 INFO:teuthology.orchestra.run.smithi039.stdout:645 2023-05-16T13:57:06.035 INFO:teuthology.orchestra.run.smithi039.stdout:645.out 2023-05-16T13:57:06.035 INFO:teuthology.orchestra.run.smithi039.stdout:646 2023-05-16T13:57:06.035 INFO:teuthology.orchestra.run.smithi039.stdout:646.out 2023-05-16T13:57:06.035 INFO:teuthology.orchestra.run.smithi039.stdout:647 2023-05-16T13:57:06.035 INFO:teuthology.orchestra.run.smithi039.stdout:647.out 2023-05-16T13:57:06.035 INFO:teuthology.orchestra.run.smithi039.stdout:648 2023-05-16T13:57:06.035 INFO:teuthology.orchestra.run.smithi039.stdout:648.out 2023-05-16T13:57:06.035 INFO:teuthology.orchestra.run.smithi039.stdout:649 2023-05-16T13:57:06.036 INFO:teuthology.orchestra.run.smithi039.stdout:649.out 2023-05-16T13:57:06.036 INFO:teuthology.orchestra.run.smithi039.stdout:650 2023-05-16T13:57:06.036 INFO:teuthology.orchestra.run.smithi039.stdout:650.out 2023-05-16T13:57:06.036 INFO:teuthology.orchestra.run.smithi039.stdout:651 2023-05-16T13:57:06.036 INFO:teuthology.orchestra.run.smithi039.stdout:651.out 2023-05-16T13:57:06.036 INFO:teuthology.orchestra.run.smithi039.stdout:652 2023-05-16T13:57:06.036 INFO:teuthology.orchestra.run.smithi039.stdout:652.out 2023-05-16T13:57:06.036 INFO:teuthology.orchestra.run.smithi039.stdout:653 2023-05-16T13:57:06.037 INFO:teuthology.orchestra.run.smithi039.stdout:653.out 2023-05-16T13:57:06.037 INFO:teuthology.orchestra.run.smithi039.stdout:654 2023-05-16T13:57:06.037 INFO:teuthology.orchestra.run.smithi039.stdout:654.out 2023-05-16T13:57:06.037 INFO:teuthology.orchestra.run.smithi039.stdout:655 2023-05-16T13:57:06.037 INFO:teuthology.orchestra.run.smithi039.stdout:655.out 2023-05-16T13:57:06.037 INFO:teuthology.orchestra.run.smithi039.stdout:656 2023-05-16T13:57:06.037 INFO:teuthology.orchestra.run.smithi039.stdout:656.out 2023-05-16T13:57:06.037 INFO:teuthology.orchestra.run.smithi039.stdout:657 2023-05-16T13:57:06.038 INFO:teuthology.orchestra.run.smithi039.stdout:657.out 2023-05-16T13:57:06.038 INFO:teuthology.orchestra.run.smithi039.stdout:658 2023-05-16T13:57:06.038 INFO:teuthology.orchestra.run.smithi039.stdout:658.out 2023-05-16T13:57:06.038 INFO:teuthology.orchestra.run.smithi039.stdout:659 2023-05-16T13:57:06.038 INFO:teuthology.orchestra.run.smithi039.stdout:659.out 2023-05-16T13:57:06.038 INFO:teuthology.orchestra.run.smithi039.stdout:660 2023-05-16T13:57:06.038 INFO:teuthology.orchestra.run.smithi039.stdout:660.out 2023-05-16T13:57:06.038 INFO:teuthology.orchestra.run.smithi039.stdout:661 2023-05-16T13:57:06.039 INFO:teuthology.orchestra.run.smithi039.stdout:661.out 2023-05-16T13:57:06.039 INFO:teuthology.orchestra.run.smithi039.stdout:662 2023-05-16T13:57:06.039 INFO:teuthology.orchestra.run.smithi039.stdout:662.out 2023-05-16T13:57:06.039 INFO:teuthology.orchestra.run.smithi039.stdout:663 2023-05-16T13:57:06.039 INFO:teuthology.orchestra.run.smithi039.stdout:663.out 2023-05-16T13:57:06.039 INFO:teuthology.orchestra.run.smithi039.stdout:664 2023-05-16T13:57:06.039 INFO:teuthology.orchestra.run.smithi039.stdout:664.out 2023-05-16T13:57:06.039 INFO:teuthology.orchestra.run.smithi039.stdout:665 2023-05-16T13:57:06.040 INFO:teuthology.orchestra.run.smithi039.stdout:665.out 2023-05-16T13:57:06.040 INFO:teuthology.orchestra.run.smithi039.stdout:666 2023-05-16T13:57:06.040 INFO:teuthology.orchestra.run.smithi039.stdout:666.out 2023-05-16T13:57:06.040 INFO:teuthology.orchestra.run.smithi039.stdout:667 2023-05-16T13:57:06.040 INFO:teuthology.orchestra.run.smithi039.stdout:667.out 2023-05-16T13:57:06.040 INFO:teuthology.orchestra.run.smithi039.stdout:668 2023-05-16T13:57:06.040 INFO:teuthology.orchestra.run.smithi039.stdout:668.out 2023-05-16T13:57:06.041 INFO:teuthology.orchestra.run.smithi039.stdout:669 2023-05-16T13:57:06.041 INFO:teuthology.orchestra.run.smithi039.stdout:669.out 2023-05-16T13:57:06.041 INFO:teuthology.orchestra.run.smithi039.stdout:670 2023-05-16T13:57:06.041 INFO:teuthology.orchestra.run.smithi039.stdout:670.out 2023-05-16T13:57:06.041 INFO:teuthology.orchestra.run.smithi039.stdout:671 2023-05-16T13:57:06.041 INFO:teuthology.orchestra.run.smithi039.stdout:671.out 2023-05-16T13:57:06.041 INFO:teuthology.orchestra.run.smithi039.stdout:672 2023-05-16T13:57:06.041 INFO:teuthology.orchestra.run.smithi039.stdout:672.out 2023-05-16T13:57:06.042 INFO:teuthology.orchestra.run.smithi039.stdout:673 2023-05-16T13:57:06.042 INFO:teuthology.orchestra.run.smithi039.stdout:673.out 2023-05-16T13:57:06.042 INFO:teuthology.orchestra.run.smithi039.stdout:674 2023-05-16T13:57:06.042 INFO:teuthology.orchestra.run.smithi039.stdout:674.out 2023-05-16T13:57:06.042 INFO:teuthology.orchestra.run.smithi039.stdout:675 2023-05-16T13:57:06.042 INFO:teuthology.orchestra.run.smithi039.stdout:675.out 2023-05-16T13:57:06.042 INFO:teuthology.orchestra.run.smithi039.stdout:676 2023-05-16T13:57:06.042 INFO:teuthology.orchestra.run.smithi039.stdout:676.out 2023-05-16T13:57:06.043 INFO:teuthology.orchestra.run.smithi039.stdout:677 2023-05-16T13:57:06.043 INFO:teuthology.orchestra.run.smithi039.stdout:677.out 2023-05-16T13:57:06.043 INFO:teuthology.orchestra.run.smithi039.stdout:678 2023-05-16T13:57:06.043 INFO:teuthology.orchestra.run.smithi039.stdout:678.out 2023-05-16T13:57:06.043 INFO:teuthology.orchestra.run.smithi039.stdout:679 2023-05-16T13:57:06.043 INFO:teuthology.orchestra.run.smithi039.stdout:679.out 2023-05-16T13:57:06.043 INFO:teuthology.orchestra.run.smithi039.stdout:680 2023-05-16T13:57:06.043 INFO:teuthology.orchestra.run.smithi039.stdout:680.out 2023-05-16T13:57:06.044 INFO:teuthology.orchestra.run.smithi039.stdout:681 2023-05-16T13:57:06.044 INFO:teuthology.orchestra.run.smithi039.stdout:681.out 2023-05-16T13:57:06.044 INFO:teuthology.orchestra.run.smithi039.stdout:682 2023-05-16T13:57:06.044 INFO:teuthology.orchestra.run.smithi039.stdout:682.out 2023-05-16T13:57:06.044 INFO:teuthology.orchestra.run.smithi039.stdout:683 2023-05-16T13:57:06.044 INFO:teuthology.orchestra.run.smithi039.stdout:683.out 2023-05-16T13:57:06.044 INFO:teuthology.orchestra.run.smithi039.stdout:684 2023-05-16T13:57:06.044 INFO:teuthology.orchestra.run.smithi039.stdout:684.out 2023-05-16T13:57:06.045 INFO:teuthology.orchestra.run.smithi039.stdout:685 2023-05-16T13:57:06.045 INFO:teuthology.orchestra.run.smithi039.stdout:685.out 2023-05-16T13:57:06.045 INFO:teuthology.orchestra.run.smithi039.stdout:686 2023-05-16T13:57:06.045 INFO:teuthology.orchestra.run.smithi039.stdout:686.out 2023-05-16T13:57:06.045 INFO:teuthology.orchestra.run.smithi039.stdout:687 2023-05-16T13:57:06.045 INFO:teuthology.orchestra.run.smithi039.stdout:687.out 2023-05-16T13:57:06.045 INFO:teuthology.orchestra.run.smithi039.stdout:688 2023-05-16T13:57:06.045 INFO:teuthology.orchestra.run.smithi039.stdout:688.out 2023-05-16T13:57:06.046 INFO:teuthology.orchestra.run.smithi039.stdout:689 2023-05-16T13:57:06.046 INFO:teuthology.orchestra.run.smithi039.stdout:689.out 2023-05-16T13:57:06.046 INFO:teuthology.orchestra.run.smithi039.stdout:690 2023-05-16T13:57:06.046 INFO:teuthology.orchestra.run.smithi039.stdout:690.out 2023-05-16T13:57:06.046 INFO:teuthology.orchestra.run.smithi039.stdout:691 2023-05-16T13:57:06.046 INFO:teuthology.orchestra.run.smithi039.stdout:691.out 2023-05-16T13:57:06.046 INFO:teuthology.orchestra.run.smithi039.stdout:692 2023-05-16T13:57:06.046 INFO:teuthology.orchestra.run.smithi039.stdout:692.out 2023-05-16T13:57:06.047 INFO:teuthology.orchestra.run.smithi039.stdout:693 2023-05-16T13:57:06.047 INFO:teuthology.orchestra.run.smithi039.stdout:693.out 2023-05-16T13:57:06.047 INFO:teuthology.orchestra.run.smithi039.stdout:694 2023-05-16T13:57:06.047 INFO:teuthology.orchestra.run.smithi039.stdout:694.out 2023-05-16T13:57:06.047 INFO:teuthology.orchestra.run.smithi039.stdout:695 2023-05-16T13:57:06.047 INFO:teuthology.orchestra.run.smithi039.stdout:695.out 2023-05-16T13:57:06.047 INFO:teuthology.orchestra.run.smithi039.stdout:696 2023-05-16T13:57:06.047 INFO:teuthology.orchestra.run.smithi039.stdout:696.out 2023-05-16T13:57:06.048 INFO:teuthology.orchestra.run.smithi039.stdout:697 2023-05-16T13:57:06.048 INFO:teuthology.orchestra.run.smithi039.stdout:697.out 2023-05-16T13:57:06.048 INFO:teuthology.orchestra.run.smithi039.stdout:698 2023-05-16T13:57:06.048 INFO:teuthology.orchestra.run.smithi039.stdout:698.out 2023-05-16T13:57:06.048 INFO:teuthology.orchestra.run.smithi039.stdout:699 2023-05-16T13:57:06.048 INFO:teuthology.orchestra.run.smithi039.stdout:699.out 2023-05-16T13:57:06.048 INFO:teuthology.orchestra.run.smithi039.stdout:700 2023-05-16T13:57:06.048 INFO:teuthology.orchestra.run.smithi039.stdout:700.out 2023-05-16T13:57:06.049 INFO:teuthology.orchestra.run.smithi039.stdout:701 2023-05-16T13:57:06.049 INFO:teuthology.orchestra.run.smithi039.stdout:701.out 2023-05-16T13:57:06.049 INFO:teuthology.orchestra.run.smithi039.stdout:702 2023-05-16T13:57:06.049 INFO:teuthology.orchestra.run.smithi039.stdout:702.out 2023-05-16T13:57:06.049 INFO:teuthology.orchestra.run.smithi039.stdout:703 2023-05-16T13:57:06.049 INFO:teuthology.orchestra.run.smithi039.stdout:703.out 2023-05-16T13:57:06.049 INFO:teuthology.orchestra.run.smithi039.stdout:704 2023-05-16T13:57:06.049 INFO:teuthology.orchestra.run.smithi039.stdout:704.out 2023-05-16T13:57:06.050 INFO:teuthology.orchestra.run.smithi039.stdout:705 2023-05-16T13:57:06.050 INFO:teuthology.orchestra.run.smithi039.stdout:705.out 2023-05-16T13:57:06.050 INFO:teuthology.orchestra.run.smithi039.stdout:706 2023-05-16T13:57:06.050 INFO:teuthology.orchestra.run.smithi039.stdout:706.out 2023-05-16T13:57:06.050 INFO:teuthology.orchestra.run.smithi039.stdout:707 2023-05-16T13:57:06.050 INFO:teuthology.orchestra.run.smithi039.stdout:707.out 2023-05-16T13:57:06.050 INFO:teuthology.orchestra.run.smithi039.stdout:708 2023-05-16T13:57:06.050 INFO:teuthology.orchestra.run.smithi039.stdout:708.out 2023-05-16T13:57:06.051 INFO:teuthology.orchestra.run.smithi039.stdout:709 2023-05-16T13:57:06.051 INFO:teuthology.orchestra.run.smithi039.stdout:709.out 2023-05-16T13:57:06.051 INFO:teuthology.orchestra.run.smithi039.stdout:710 2023-05-16T13:57:06.051 INFO:teuthology.orchestra.run.smithi039.stdout:710.out 2023-05-16T13:57:06.051 INFO:teuthology.orchestra.run.smithi039.stdout:711 2023-05-16T13:57:06.051 INFO:teuthology.orchestra.run.smithi039.stdout:711.out 2023-05-16T13:57:06.051 INFO:teuthology.orchestra.run.smithi039.stdout:712 2023-05-16T13:57:06.051 INFO:teuthology.orchestra.run.smithi039.stdout:712.out 2023-05-16T13:57:06.052 INFO:teuthology.orchestra.run.smithi039.stdout:713 2023-05-16T13:57:06.052 INFO:teuthology.orchestra.run.smithi039.stdout:713.out 2023-05-16T13:57:06.052 INFO:teuthology.orchestra.run.smithi039.stdout:714 2023-05-16T13:57:06.052 INFO:teuthology.orchestra.run.smithi039.stdout:714.out 2023-05-16T13:57:06.052 INFO:teuthology.orchestra.run.smithi039.stdout:715 2023-05-16T13:57:06.052 INFO:teuthology.orchestra.run.smithi039.stdout:715.out 2023-05-16T13:57:06.052 INFO:teuthology.orchestra.run.smithi039.stdout:716 2023-05-16T13:57:06.052 INFO:teuthology.orchestra.run.smithi039.stdout:716.out 2023-05-16T13:57:06.053 INFO:teuthology.orchestra.run.smithi039.stdout:717 2023-05-16T13:57:06.053 INFO:teuthology.orchestra.run.smithi039.stdout:717.out 2023-05-16T13:57:06.053 INFO:teuthology.orchestra.run.smithi039.stdout:718 2023-05-16T13:57:06.053 INFO:teuthology.orchestra.run.smithi039.stdout:718.out 2023-05-16T13:57:06.053 INFO:teuthology.orchestra.run.smithi039.stdout:719 2023-05-16T13:57:06.053 INFO:teuthology.orchestra.run.smithi039.stdout:719.out 2023-05-16T13:57:06.053 INFO:teuthology.orchestra.run.smithi039.stdout:720 2023-05-16T13:57:06.053 INFO:teuthology.orchestra.run.smithi039.stdout:720.out 2023-05-16T13:57:06.054 INFO:teuthology.orchestra.run.smithi039.stdout:721 2023-05-16T13:57:06.054 INFO:teuthology.orchestra.run.smithi039.stdout:721.out 2023-05-16T13:57:06.054 INFO:teuthology.orchestra.run.smithi039.stdout:722 2023-05-16T13:57:06.054 INFO:teuthology.orchestra.run.smithi039.stdout:722.out 2023-05-16T13:57:06.054 INFO:teuthology.orchestra.run.smithi039.stdout:723 2023-05-16T13:57:06.054 INFO:teuthology.orchestra.run.smithi039.stdout:723.out 2023-05-16T13:57:06.054 INFO:teuthology.orchestra.run.smithi039.stdout:724 2023-05-16T13:57:06.054 INFO:teuthology.orchestra.run.smithi039.stdout:724.out 2023-05-16T13:57:06.055 INFO:teuthology.orchestra.run.smithi039.stdout:725 2023-05-16T13:57:06.055 INFO:teuthology.orchestra.run.smithi039.stdout:725.out 2023-05-16T13:57:06.055 INFO:teuthology.orchestra.run.smithi039.stdout:726 2023-05-16T13:57:06.055 INFO:teuthology.orchestra.run.smithi039.stdout:726.out 2023-05-16T13:57:06.055 INFO:teuthology.orchestra.run.smithi039.stdout:727 2023-05-16T13:57:06.055 INFO:teuthology.orchestra.run.smithi039.stdout:727.out 2023-05-16T13:57:06.055 INFO:teuthology.orchestra.run.smithi039.stdout:group.list 2023-05-16T13:57:06.055 INFO:teuthology.orchestra.run.smithi039.stdout:Makefile 2023-05-16T13:57:06.057 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.lZk1FbzUP3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2023-05-16T13:57:06.413 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T13:57:06.416 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T13:57:06.449 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph-fuse 2023-05-16T13:57:06.458 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 6.3.0-g7312ab6f53ec #1 SMP PREEMPT_DYNAMIC Mon May 15 02:27:28 UTC 2023 2023-05-16T13:57:06.458 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:57:10.481 INFO:teuthology.orchestra.run.smithi039.stdout:generic/001 4s 2023-05-16T13:57:10.492 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/001 2023-05-16T13:57:10.492 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2023-05-16T13:57:10.498 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:57:10.501 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi039.stderr:ceph-fuse[47263]: fuse finished with error 0 and tester_r 0 2023-05-16T13:57:10.517 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-16T13:57:10.518 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.lZk1FbzUP3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2023-05-16T13:57:10.940 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph-fuse 2023-05-16T13:57:10.950 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 6.3.0-g7312ab6f53ec #1 SMP PREEMPT_DYNAMIC Mon May 15 02:27:28 UTC 2023 2023-05-16T13:57:10.950 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:57:11.707 INFO:teuthology.orchestra.run.smithi039.stdout:generic/002 1s 2023-05-16T13:57:11.718 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/002 2023-05-16T13:57:11.719 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2023-05-16T13:57:11.724 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:57:11.743 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-16T13:57:11.744 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.lZk1FbzUP3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2023-05-16T13:57:12.148 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph-fuse 2023-05-16T13:57:12.157 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 6.3.0-g7312ab6f53ec #1 SMP PREEMPT_DYNAMIC Mon May 15 02:27:28 UTC 2023 2023-05-16T13:57:12.158 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:57:12.452 INFO:teuthology.orchestra.run.smithi039.stdout:generic/003 [not run] this test requires a valid $SCRATCH_DEV 2023-05-16T13:57:12.460 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/003 2023-05-16T13:57:12.460 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/003 2023-05-16T13:57:12.460 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2023-05-16T13:57:12.466 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:57:12.485 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-16T13:57:12.486 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.lZk1FbzUP3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2023-05-16T13:57:12.856 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph-fuse 2023-05-16T13:57:12.865 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 6.3.0-g7312ab6f53ec #1 SMP PREEMPT_DYNAMIC Mon May 15 02:27:28 UTC 2023 2023-05-16T13:57:12.866 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:57:13.135 INFO:teuthology.orchestra.run.smithi039.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-05-16T13:57:13.143 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/004 2023-05-16T13:57:13.143 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/004 2023-05-16T13:57:13.143 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2023-05-16T13:57:13.149 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:57:13.166 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-16T13:57:13.167 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.lZk1FbzUP3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2023-05-16T13:57:13.532 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph-fuse 2023-05-16T13:57:13.541 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 6.3.0-g7312ab6f53ec #1 SMP PREEMPT_DYNAMIC Mon May 15 02:27:28 UTC 2023 2023-05-16T13:57:13.541 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:57:14.423 INFO:teuthology.orchestra.run.smithi039.stdout:generic/005 1s 2023-05-16T13:57:14.435 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/005 2023-05-16T13:57:14.435 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2023-05-16T13:57:14.441 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:57:14.459 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-16T13:57:14.460 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.lZk1FbzUP3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2023-05-16T13:57:14.856 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph-fuse 2023-05-16T13:57:14.865 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 6.3.0-g7312ab6f53ec #1 SMP PREEMPT_DYNAMIC Mon May 15 02:27:28 UTC 2023 2023-05-16T13:57:14.866 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:57:36.471 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T13:57:36.475 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T13:57:48.420 INFO:teuthology.orchestra.run.smithi039.stdout:generic/006 34s 2023-05-16T13:57:48.432 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/006 2023-05-16T13:57:48.432 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2023-05-16T13:57:48.437 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:57:48.519 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-16T13:57:48.519 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.lZk1FbzUP3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2023-05-16T13:57:48.876 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph-fuse 2023-05-16T13:57:48.885 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 6.3.0-g7312ab6f53ec #1 SMP PREEMPT_DYNAMIC Mon May 15 02:27:28 UTC 2023 2023-05-16T13:57:48.886 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:58:06.527 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T13:58:06.530 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T13:58:37.725 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T13:58:37.729 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T13:59:07.779 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T13:59:07.783 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T13:59:10.475 INFO:teuthology.orchestra.run.smithi039.stdout:generic/007 82s 2023-05-16T13:59:12.022 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/007 2023-05-16T13:59:12.022 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2023-05-16T13:59:12.029 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:59:12.061 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-16T13:59:12.062 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.lZk1FbzUP3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2023-05-16T13:59:12.583 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph-fuse 2023-05-16T13:59:12.592 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 6.3.0-g7312ab6f53ec #1 SMP PREEMPT_DYNAMIC Mon May 15 02:27:28 UTC 2023 2023-05-16T13:59:12.592 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:59:14.080 INFO:teuthology.orchestra.run.smithi039.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-05-16T13:59:14.088 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/008 2023-05-16T13:59:14.088 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/008 2023-05-16T13:59:14.088 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2023-05-16T13:59:14.093 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:59:14.111 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-16T13:59:14.111 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.lZk1FbzUP3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2023-05-16T13:59:14.475 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph-fuse 2023-05-16T13:59:14.484 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 6.3.0-g7312ab6f53ec #1 SMP PREEMPT_DYNAMIC Mon May 15 02:27:28 UTC 2023 2023-05-16T13:59:14.484 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:59:15.981 INFO:teuthology.orchestra.run.smithi039.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-05-16T13:59:15.989 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/009 2023-05-16T13:59:15.989 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/009 2023-05-16T13:59:15.989 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2023-05-16T13:59:15.995 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:59:16.014 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-16T13:59:16.014 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.lZk1FbzUP3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2023-05-16T13:59:16.386 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph-fuse 2023-05-16T13:59:16.396 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 6.3.0-g7312ab6f53ec #1 SMP PREEMPT_DYNAMIC Mon May 15 02:27:28 UTC 2023 2023-05-16T13:59:16.396 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:59:16.654 INFO:teuthology.orchestra.run.smithi039.stdout:generic/010 [not run] /tmp/tmp.lZk1FbzUP3xfstests-dev/src/dbtest not built 2023-05-16T13:59:16.661 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/010 2023-05-16T13:59:16.661 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/010 2023-05-16T13:59:16.662 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2023-05-16T13:59:16.667 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:59:16.685 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-16T13:59:16.685 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.lZk1FbzUP3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2023-05-16T13:59:17.048 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph-fuse 2023-05-16T13:59:17.058 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 6.3.0-g7312ab6f53ec #1 SMP PREEMPT_DYNAMIC Mon May 15 02:27:28 UTC 2023 2023-05-16T13:59:17.058 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T13:59:39.256 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T13:59:39.260 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:00:00.077 INFO:teuthology.orchestra.run.smithi039.stdout:generic/011 43s 2023-05-16T14:00:05.228 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/011 2023-05-16T14:00:05.228 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2023-05-16T14:00:05.235 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T14:00:05.316 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-16T14:00:05.317 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.lZk1FbzUP3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2023-05-16T14:00:05.681 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph-fuse 2023-05-16T14:00:05.690 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 6.3.0-g7312ab6f53ec #1 SMP PREEMPT_DYNAMIC Mon May 15 02:27:28 UTC 2023 2023-05-16T14:00:05.691 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T14:00:07.251 INFO:teuthology.orchestra.run.smithi039.stdout:generic/012 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-05-16T14:00:07.259 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/012 2023-05-16T14:00:07.259 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/012 2023-05-16T14:00:07.259 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2023-05-16T14:00:07.265 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T14:00:07.287 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-16T14:00:07.288 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.lZk1FbzUP3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2023-05-16T14:00:07.682 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph-fuse 2023-05-16T14:00:07.692 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 6.3.0-g7312ab6f53ec #1 SMP PREEMPT_DYNAMIC Mon May 15 02:27:28 UTC 2023 2023-05-16T14:00:07.692 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T14:00:09.323 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:00:09.327 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:00:39.454 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:00:39.458 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:01:09.558 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:01:09.564 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:01:39.640 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:01:39.644 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:01:48.269 INFO:teuthology.orchestra.run.smithi039.stdout:generic/013 101s 2023-05-16T14:01:50.093 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/013 2023-05-16T14:01:50.093 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2023-05-16T14:01:50.103 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T14:01:50.133 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-16T14:01:50.133 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.lZk1FbzUP3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2023-05-16T14:01:50.767 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph-fuse 2023-05-16T14:01:50.783 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 6.3.0-g7312ab6f53ec #1 SMP PREEMPT_DYNAMIC Mon May 15 02:27:28 UTC 2023 2023-05-16T14:01:50.784 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T14:02:09.705 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:02:09.709 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:02:39.892 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:02:39.896 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:02:39.974 INFO:tasks.ceph.mds.a.smithi039.stderr:2023-05-16T14:02:39.971+0000 7f00d1579640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 86724) UID: 0 2023-05-16T14:02:39.974 INFO:tasks.ceph.mds.c.smithi039.stderr:2023-05-16T14:02:39.971+0000 7f12044af640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 86724) UID: 0 2023-05-16T14:06:35.688 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:06:35.694 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:06:39.535 INFO:teuthology.orchestra.run.smithi039.stdout:generic/014 289s 2023-05-16T14:06:39.553 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/014 2023-05-16T14:06:39.553 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2023-05-16T14:06:39.562 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T14:06:39.633 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-16T14:06:39.975 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.lZk1FbzUP3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2023-05-16T14:06:40.515 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph-fuse 2023-05-16T14:06:40.533 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 6.3.0-g7312ab6f53ec #1 SMP PREEMPT_DYNAMIC Mon May 15 02:27:28 UTC 2023 2023-05-16T14:06:40.533 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T14:06:40.949 INFO:teuthology.orchestra.run.smithi039.stdout:generic/015 [not run] this test requires a valid $SCRATCH_DEV 2023-05-16T14:06:40.960 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/015 2023-05-16T14:06:40.961 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/015 2023-05-16T14:06:40.961 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2023-05-16T14:06:40.967 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T14:06:40.995 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-16T14:06:40.996 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.lZk1FbzUP3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2023-05-16T14:06:41.558 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph-fuse 2023-05-16T14:06:41.571 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 6.3.0-g7312ab6f53ec #1 SMP PREEMPT_DYNAMIC Mon May 15 02:27:28 UTC 2023 2023-05-16T14:06:41.571 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T14:06:44.131 INFO:teuthology.orchestra.run.smithi039.stdout:generic/016 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-05-16T14:06:44.141 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/016 2023-05-16T14:06:44.141 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/016 2023-05-16T14:06:44.142 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2023-05-16T14:06:44.150 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T14:06:44.179 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-16T14:06:44.179 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.lZk1FbzUP3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2023-05-16T14:06:45.033 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph-fuse 2023-05-16T14:06:45.049 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 6.3.0-g7312ab6f53ec #1 SMP PREEMPT_DYNAMIC Mon May 15 02:27:28 UTC 2023 2023-05-16T14:06:45.050 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T14:06:45.469 INFO:teuthology.orchestra.run.smithi039.stdout:generic/017 [not run] this test requires a valid $SCRATCH_DEV 2023-05-16T14:06:45.480 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/017 2023-05-16T14:06:45.481 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/017 2023-05-16T14:06:45.481 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2023-05-16T14:06:45.490 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T14:06:45.517 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-16T14:06:45.518 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.lZk1FbzUP3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2023-05-16T14:06:46.087 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph-fuse 2023-05-16T14:06:46.101 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 6.3.0-g7312ab6f53ec #1 SMP PREEMPT_DYNAMIC Mon May 15 02:27:28 UTC 2023 2023-05-16T14:06:46.101 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T14:06:46.509 INFO:teuthology.orchestra.run.smithi039.stdout:generic/018 [not run] this test requires a valid $SCRATCH_DEV 2023-05-16T14:06:46.520 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/018 2023-05-16T14:06:46.521 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/018 2023-05-16T14:06:46.521 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2023-05-16T14:06:46.531 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T14:06:46.553 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-16T14:06:46.554 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.lZk1FbzUP3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2023-05-16T14:06:47.105 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph-fuse 2023-05-16T14:06:47.120 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 6.3.0-g7312ab6f53ec #1 SMP PREEMPT_DYNAMIC Mon May 15 02:27:28 UTC 2023 2023-05-16T14:06:47.120 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T14:06:47.519 INFO:teuthology.orchestra.run.smithi039.stdout:generic/019 [not run] this test requires a valid $SCRATCH_DEV 2023-05-16T14:06:47.530 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/019 2023-05-16T14:06:47.530 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/019 2023-05-16T14:06:47.530 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2023-05-16T14:06:47.539 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T14:06:47.570 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-16T14:06:47.571 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.lZk1FbzUP3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2023-05-16T14:06:48.143 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph-fuse 2023-05-16T14:06:48.155 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 6.3.0-g7312ab6f53ec #1 SMP PREEMPT_DYNAMIC Mon May 15 02:27:28 UTC 2023 2023-05-16T14:06:48.155 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T14:07:05.779 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:07:05.783 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:07:09.793 INFO:teuthology.orchestra.run.smithi039.stdout:generic/020 - output mismatch (see /tmp/tmp.lZk1FbzUP3xfstests-dev/results//generic/020.out.bad) 2023-05-16T14:07:09.802 INFO:teuthology.orchestra.run.smithi039.stdout: --- tests/generic/020.out 2023-05-16 13:55:36.239289304 +0000 2023-05-16T14:07:09.802 INFO:teuthology.orchestra.run.smithi039.stdout: +++ /tmp/tmp.lZk1FbzUP3xfstests-dev/results//generic/020.out.bad 2023-05-16 14:07:09.787558461 +0000 2023-05-16T14:07:09.802 INFO:teuthology.orchestra.run.smithi039.stdout: @@ -39,27 +39,6 @@ 2023-05-16T14:07:09.802 INFO:teuthology.orchestra.run.smithi039.stdout: user.snrub="fish2\012" 2023-05-16T14:07:09.802 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T14:07:09.802 INFO:teuthology.orchestra.run.smithi039.stdout: *** add lots of attributes 2023-05-16T14:07:09.803 INFO:teuthology.orchestra.run.smithi039.stdout: -*** check 2023-05-16T14:07:09.803 INFO:teuthology.orchestra.run.smithi039.stdout: - *** MAX_ATTRS attribute(s) 2023-05-16T14:07:09.803 INFO:teuthology.orchestra.run.smithi039.stdout: -*** remove lots of attributes 2023-05-16T14:07:09.803 INFO:teuthology.orchestra.run.smithi039.stdout: - *** print attributes 2023-05-16T14:07:09.803 INFO:teuthology.orchestra.run.smithi039.stdout: -# file: 2023-05-16T14:07:09.803 INFO:teuthology.orchestra.run.smithi039.stdout: -user.snrub="fish2\012" 2023-05-16T14:07:09.803 INFO:teuthology.orchestra.run.smithi039.stdout: - 2023-05-16T14:07:09.804 INFO:teuthology.orchestra.run.smithi039.stdout: -*** really long value 2023-05-16T14:07:09.804 INFO:teuthology.orchestra.run.smithi039.stdout: -0000000 00 2023-05-16T14:07:09.804 INFO:teuthology.orchestra.run.smithi039.stdout: -* 2023-05-16T14:07:09.804 INFO:teuthology.orchestra.run.smithi039.stdout: -ATTRSIZE 2023-05-16T14:07:09.804 INFO:teuthology.orchestra.run.smithi039.stdout: -*** set/get/remove really long names (expect failure) 2023-05-16T14:07:09.804 INFO:teuthology.orchestra.run.smithi039.stdout: -attr_set: Invalid argument 2023-05-16T14:07:09.804 INFO:teuthology.orchestra.run.smithi039.stdout: -Could not set "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX" for 2023-05-16T14:07:09.805 INFO:teuthology.orchestra.run.smithi039.stdout: -attr_get: Invalid argument 2023-05-16T14:07:09.805 INFO:teuthology.orchestra.run.smithi039.stdout: -Could not get "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX" for 2023-05-16T14:07:09.805 INFO:teuthology.orchestra.run.smithi039.stdout: -attr_remove: Invalid argument 2023-05-16T14:07:09.805 INFO:teuthology.orchestra.run.smithi039.stdout: -Could not remove "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX" for 2023-05-16T14:07:09.805 INFO:teuthology.orchestra.run.smithi039.stdout: -*** check final 2023-05-16T14:07:09.805 INFO:teuthology.orchestra.run.smithi039.stdout: - *** print attributes 2023-05-16T14:07:09.805 INFO:teuthology.orchestra.run.smithi039.stdout: -# file: 2023-05-16T14:07:09.805 INFO:teuthology.orchestra.run.smithi039.stdout: -user.snrub="fish2\012" 2023-05-16T14:07:09.806 INFO:teuthology.orchestra.run.smithi039.stdout: - 2023-05-16T14:07:09.806 INFO:teuthology.orchestra.run.smithi039.stdout: -*** delete 2023-05-16T14:07:09.806 INFO:teuthology.orchestra.run.smithi039.stdout: +attr_set: No space left on device 2023-05-16T14:07:09.806 INFO:teuthology.orchestra.run.smithi039.stdout: +Could not set "attribute_2335" for /tmp/tmp.Hue5pMxMSztest/attribute_89122 2023-05-16T14:07:09.806 INFO:teuthology.orchestra.run.smithi039.stdout: +!!! failed to add "attribute_2335" 2023-05-16T14:07:09.810 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/020 2023-05-16T14:07:09.810 INFO:teuthology.orchestra.run.smithi039.stdout:Failures: generic/020 2023-05-16T14:07:09.810 INFO:teuthology.orchestra.run.smithi039.stdout:Failed 1 of 1 tests 2023-05-16T14:07:09.819 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T14:07:09.969 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-16T14:07:09.970 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-16T14:07:09.970 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-16T14:07:09.970 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.lZk1FbzUP3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2023-05-16T14:07:10.714 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph-fuse 2023-05-16T14:07:10.729 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 6.3.0-g7312ab6f53ec #1 SMP PREEMPT_DYNAMIC Mon May 15 02:27:28 UTC 2023 2023-05-16T14:07:10.729 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T14:07:13.345 INFO:teuthology.orchestra.run.smithi039.stdout:generic/021 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-05-16T14:07:13.356 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/021 2023-05-16T14:07:13.356 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/021 2023-05-16T14:07:13.356 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2023-05-16T14:07:13.363 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T14:07:13.497 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-16T14:07:13.498 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.lZk1FbzUP3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2023-05-16T14:07:14.232 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph-fuse 2023-05-16T14:07:14.247 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 6.3.0-g7312ab6f53ec #1 SMP PREEMPT_DYNAMIC Mon May 15 02:27:28 UTC 2023 2023-05-16T14:07:14.248 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T14:07:16.703 INFO:teuthology.orchestra.run.smithi039.stdout:generic/022 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-05-16T14:07:16.713 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/022 2023-05-16T14:07:16.713 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/022 2023-05-16T14:07:16.713 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2023-05-16T14:07:16.721 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T14:07:16.749 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-16T14:07:16.749 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.lZk1FbzUP3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2023-05-16T14:07:17.586 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph-fuse 2023-05-16T14:07:17.600 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 6.3.0-g7312ab6f53ec #1 SMP PREEMPT_DYNAMIC Mon May 15 02:27:28 UTC 2023 2023-05-16T14:07:17.600 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-16T14:07:37.068 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:07:37.071 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:08:07.351 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:08:07.354 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:08:37.400 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:08:37.404 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:09:07.529 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:09:07.532 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:09:37.675 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:09:37.678 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:10:07.964 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:10:07.968 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:10:38.033 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:10:38.037 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:11:08.092 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:11:08.096 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:11:38.154 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:11:38.157 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:12:08.312 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:12:08.316 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:12:38.425 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:12:38.429 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:13:08.473 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:13:08.477 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:13:38.653 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:13:38.659 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:14:08.767 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:14:08.771 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:14:38.822 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:14:38.826 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:15:08.877 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:15:08.882 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:15:39.008 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:15:39.012 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:16:09.065 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:16:09.069 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:16:39.120 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:16:39.124 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:17:09.301 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:17:09.305 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:17:39.357 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:17:39.360 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:18:09.413 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:18:09.417 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:18:39.525 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:18:39.530 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:19:09.664 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:19:09.668 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:19:39.787 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:19:39.791 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:20:09.926 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:20:09.931 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:20:40.089 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:20:40.093 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:21:10.228 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:21:10.232 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:21:40.358 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:21:40.362 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:22:10.438 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:22:10.441 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:22:40.580 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:22:40.585 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:23:10.632 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:23:10.635 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:23:40.687 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:23:40.691 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:24:10.809 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:24:10.813 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:24:40.948 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:24:40.952 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:25:11.000 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:25:11.004 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:25:41.117 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:25:41.120 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:26:11.239 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:26:11.243 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:26:41.362 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:26:41.367 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:27:11.443 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:27:11.446 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:27:41.573 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:27:41.577 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:28:11.670 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:28:11.674 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:28:41.734 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:28:41.755 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:29:11.806 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:29:11.810 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:29:41.862 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:29:41.866 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:30:11.926 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:30:11.929 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:30:41.990 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:30:41.994 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:31:12.121 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:31:12.125 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:31:42.243 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:31:42.246 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:32:12.314 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:32:12.318 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:32:42.364 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:32:42.368 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:33:12.501 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:33:12.505 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:33:42.624 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:33:42.628 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:34:12.879 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:34:12.883 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:34:42.935 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:34:42.938 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:35:12.993 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:35:12.997 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:35:43.066 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:35:43.070 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:36:13.127 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:36:13.131 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:36:43.215 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:36:43.219 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:37:13.280 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:37:13.283 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:37:43.335 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:37:43.339 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:38:13.466 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:38:13.470 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:38:43.580 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:38:43.584 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:39:13.693 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:39:13.697 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:39:43.758 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:39:43.762 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:40:14.038 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:40:14.042 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:40:44.116 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:40:44.120 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:41:14.171 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:41:14.175 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:41:44.229 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:41:44.233 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:42:14.301 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:42:14.305 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:42:44.465 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:42:44.469 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:43:14.578 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:43:14.582 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:43:44.709 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:43:44.713 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:44:14.814 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:44:14.817 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:44:44.944 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:44:44.948 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:45:15.001 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:45:15.005 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:45:45.130 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:45:45.134 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:46:15.260 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:46:15.263 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:46:45.319 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:46:45.322 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:47:15.397 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:47:15.400 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:47:45.451 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:47:45.455 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:48:15.582 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:48:15.586 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:48:45.643 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:48:45.647 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:49:15.700 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:49:15.703 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:49:45.817 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:49:45.821 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:50:15.872 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:50:15.876 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:50:45.996 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:50:45.999 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:51:16.082 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:51:16.085 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:51:46.197 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:51:46.201 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:52:16.262 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:52:16.265 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:52:46.326 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:52:46.330 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:53:16.381 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:53:16.385 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:53:46.569 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:53:46.573 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:54:16.684 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:54:16.688 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:54:46.831 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:54:46.835 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:55:16.978 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:55:16.983 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:55:47.043 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:55:47.047 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:56:17.181 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:56:17.185 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:56:47.303 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:56:47.307 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:57:17.384 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:57:17.388 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:57:47.490 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:57:47.493 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:58:17.729 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:58:17.733 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:58:47.785 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:58:47.788 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:59:17.839 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:59:17.843 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:59:47.898 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T14:59:47.902 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:00:18.052 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:00:18.056 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:00:48.174 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:00:48.178 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:01:18.421 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:01:18.425 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:01:48.472 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:01:48.475 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:02:18.541 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:02:18.545 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:02:48.600 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:02:48.604 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:03:18.661 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:03:18.664 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:03:48.782 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:03:48.786 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:04:18.921 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:04:18.925 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:04:48.982 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:04:48.986 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:05:19.049 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:05:19.052 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:05:49.238 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:05:49.241 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:06:19.294 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:06:19.298 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:06:49.407 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:06:49.411 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:07:19.489 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:07:19.493 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:07:49.595 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:07:49.599 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:08:19.651 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:08:19.655 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:08:49.783 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:08:49.787 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:09:19.930 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:09:19.934 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:09:49.994 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:09:49.998 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:10:20.050 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:10:20.053 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:10:50.115 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:10:50.118 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:11:20.263 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:11:20.267 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:11:50.416 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:11:50.420 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:12:20.489 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:12:20.493 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:12:50.612 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:12:50.616 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:13:20.876 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:13:20.880 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:13:51.006 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:13:51.014 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:14:21.128 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:14:21.133 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:14:51.209 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:14:51.213 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:15:21.357 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:15:21.361 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:15:51.552 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:15:51.555 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:16:21.843 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:16:21.846 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:16:51.890 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:16:51.894 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:17:21.961 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:17:21.964 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:17:52.019 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:17:52.023 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:18:22.167 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:18:22.171 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:18:52.281 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:18:52.285 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:19:22.396 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:19:22.400 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:19:52.526 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:19:52.530 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:20:22.633 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:20:22.636 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:20:52.738 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:20:52.742 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:21:22.861 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:21:22.865 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:21:53.018 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:21:53.021 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:22:23.081 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:22:23.084 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:22:53.137 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:22:53.141 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:23:23.193 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:23:23.197 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:23:53.266 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:23:53.270 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:24:23.322 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:24:23.326 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:24:53.451 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:24:53.455 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:25:23.507 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:25:23.511 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:25:53.566 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:25:53.570 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:26:23.704 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:26:23.707 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:26:53.819 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:26:53.822 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:27:23.884 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:27:23.888 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:27:54.006 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:27:54.010 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:28:24.063 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:28:24.066 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:28:54.119 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:28:54.123 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:29:24.183 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:29:24.187 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:29:54.413 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:29:54.416 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:30:24.461 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:30:24.465 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:30:54.676 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:30:54.679 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:31:24.796 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:31:24.800 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:31:54.854 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:31:54.858 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:32:24.933 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:32:24.937 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:32:54.999 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:32:55.003 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:33:25.163 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:33:25.167 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:33:55.309 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:33:55.315 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:34:25.358 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:34:25.362 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:34:55.406 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:34:55.411 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:35:25.466 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:35:25.471 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:35:55.628 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:35:55.632 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:36:25.687 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:36:25.691 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:36:55.792 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:36:55.797 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:37:25.874 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:37:25.878 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:37:56.188 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:37:56.192 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:38:26.251 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:38:26.255 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:38:56.390 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:38:56.394 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:39:26.563 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:39:26.568 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:39:56.703 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:39:56.707 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:40:26.942 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:40:26.946 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:40:57.006 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:40:57.010 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:41:27.086 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:41:27.089 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:41:57.150 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:41:57.154 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:42:27.298 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:42:27.302 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:42:57.445 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:42:57.448 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:43:27.608 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:43:27.612 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:43:57.755 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:43:57.759 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:44:27.870 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:44:27.873 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:44:57.993 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:44:57.997 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:45:28.165 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:45:28.168 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:45:58.287 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:45:58.292 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:46:28.344 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:46:28.348 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:46:58.409 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:46:58.412 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:47:28.487 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:47:28.491 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:47:58.551 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:47:58.555 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:48:28.693 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:48:28.697 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:48:58.837 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:48:58.841 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:49:28.894 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:49:28.897 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:49:58.951 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:49:58.955 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:50:29.081 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:50:29.086 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:50:59.163 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:50:59.166 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:51:29.225 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:51:29.229 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:51:59.408 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:51:59.412 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:52:29.478 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:52:29.482 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:52:59.536 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:52:59.540 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:53:29.593 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:53:29.596 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:53:59.656 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:53:59.660 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:54:29.796 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:54:29.800 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:54:59.851 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:54:59.854 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:55:29.957 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:55:29.960 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:56:00.095 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:56:00.099 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:56:30.226 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:56:30.231 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:57:00.315 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:57:00.319 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:57:30.396 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:57:30.400 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:58:00.451 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:58:00.455 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:58:30.508 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:58:30.512 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:59:00.563 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:59:00.568 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:59:30.626 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T15:59:30.630 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:00:00.748 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:00:00.751 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:00:30.799 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:00:30.803 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:01:00.918 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:01:00.922 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:01:31.167 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:01:31.170 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:02:01.254 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:02:01.258 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:02:31.336 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:02:31.339 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:03:01.465 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:03:01.470 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:03:31.528 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:03:31.532 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:04:01.651 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:04:01.654 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:04:31.706 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:04:31.709 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:05:01.761 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:05:01.764 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:05:31.817 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:05:31.820 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:06:01.973 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:06:01.977 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:06:32.020 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:06:32.023 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:07:02.076 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:07:02.080 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:07:32.139 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:07:32.143 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:08:02.304 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:08:02.307 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:08:32.426 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:08:32.429 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:09:02.524 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:09:02.529 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:09:32.596 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:09:32.599 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:10:02.760 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:10:02.765 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:10:32.825 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:10:32.829 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:11:02.889 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:11:02.893 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:11:32.970 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:11:32.973 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:12:03.115 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:12:03.119 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:12:33.196 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:12:33.200 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:13:03.319 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:13:03.323 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:13:33.425 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:13:33.428 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:14:03.482 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:14:03.485 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:14:33.680 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:14:33.684 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:15:03.737 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:15:03.741 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:15:33.857 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:15:33.861 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:16:03.988 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:16:03.992 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:16:34.046 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:16:34.050 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:17:04.107 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:17:04.111 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:17:34.188 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:17:34.191 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:18:04.337 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:18:04.341 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:18:34.386 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:18:34.389 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:19:04.521 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:19:04.525 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:19:34.660 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:19:34.663 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:20:04.807 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:20:04.811 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:20:34.859 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:20:34.862 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:21:05.081 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:21:05.085 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:21:35.141 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:21:35.144 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:22:05.488 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:22:05.492 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:22:35.570 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:22:35.574 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:23:05.684 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:23:05.687 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:23:35.739 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:23:35.743 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:24:05.799 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:24:05.803 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:24:35.886 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:24:35.891 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:25:05.999 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:25:06.003 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:25:36.122 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:25:36.125 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:26:06.245 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:26:06.250 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:26:36.303 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:26:36.307 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:27:06.414 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:27:06.418 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:27:36.495 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:27:36.499 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:28:06.643 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:28:06.646 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:28:36.805 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:28:36.809 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:29:06.866 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:29:06.869 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:29:36.939 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:29:36.943 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:30:07.031 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:30:07.035 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:30:37.077 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:30:37.081 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:31:07.175 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:31:07.179 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:31:37.298 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:31:37.302 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:32:07.428 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:32:07.432 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:32:37.509 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:32:37.513 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:33:07.673 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:33:07.676 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:33:37.794 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:33:37.799 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:34:07.909 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:34:07.912 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:34:37.997 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:34:38.001 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:35:08.063 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:35:08.067 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:35:38.125 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:35:38.129 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:36:08.200 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:36:08.204 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:36:38.380 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:36:38.384 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:37:08.510 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:37:08.514 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:37:38.614 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:37:38.618 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:38:08.761 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:38:08.765 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:38:39.084 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:38:39.088 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:39:09.141 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:39:09.145 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:39:39.228 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:39:39.232 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:40:09.284 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:40:09.288 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:40:39.381 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:40:39.386 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:41:09.465 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:41:09.468 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:41:39.517 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:41:39.521 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:42:09.573 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:42:09.577 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:42:39.638 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:42:39.642 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:43:09.704 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:43:09.707 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:43:39.774 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:43:39.777 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:44:09.896 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:44:09.900 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:44:39.968 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:44:39.972 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:45:10.098 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:45:10.102 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:45:40.238 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:45:40.242 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:46:10.402 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:46:10.406 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:46:40.458 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:46:40.462 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:47:10.564 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:47:10.568 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:47:40.637 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:47:40.641 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:48:10.776 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:48:10.780 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:48:40.906 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:48:40.910 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:49:11.045 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:49:11.048 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:49:41.168 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:49:41.172 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:50:11.290 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:50:11.294 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:50:41.346 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:50:41.349 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:51:11.507 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:51:11.511 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:51:41.574 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:51:41.577 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:52:11.762 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:52:11.766 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:52:41.835 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:52:41.838 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:53:11.898 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:53:11.903 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:53:41.962 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:53:41.966 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:54:12.210 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:54:12.214 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:54:42.373 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:54:42.377 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:55:12.523 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:55:12.526 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:55:42.578 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:55:42.582 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:56:12.685 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:56:12.688 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:56:42.832 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:56:42.836 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:57:12.945 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:57:12.949 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:57:43.027 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:57:43.030 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:58:13.090 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:58:13.093 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:58:43.155 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:58:43.158 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:59:13.211 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:59:13.214 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:59:43.274 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T16:59:43.278 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:00:13.376 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:00:13.380 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:00:43.486 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:00:43.491 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:01:13.575 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:01:13.579 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:01:43.739 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:01:43.742 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:02:13.870 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:02:13.874 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:02:43.934 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:02:43.937 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:03:13.998 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:03:14.001 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:03:44.062 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:03:44.066 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:04:14.192 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:04:14.196 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:04:44.586 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:04:44.590 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:05:14.637 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:05:14.641 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:05:44.693 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:05:44.697 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:06:14.767 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:06:14.771 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:06:44.879 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:06:44.883 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:07:15.010 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:07:15.014 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:07:45.091 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:07:45.095 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:08:15.155 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:08:15.159 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:08:45.285 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:08:45.289 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:09:15.400 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:09:15.404 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:09:45.574 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:09:45.577 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:10:15.629 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:10:15.633 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:10:45.725 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:10:45.729 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:11:15.834 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:11:15.876 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:11:45.936 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:11:45.939 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:12:15.991 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:12:15.995 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:12:46.064 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:12:46.068 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:13:16.170 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:13:16.173 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:13:46.300 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:13:46.304 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:14:16.431 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:14:16.435 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:14:46.553 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:14:46.557 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:15:16.692 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:15:16.696 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:15:46.774 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:15:46.777 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:16:16.896 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:16:16.899 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:16:47.060 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:16:47.063 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:17:17.123 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:17:17.126 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:17:47.203 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:17:47.207 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:18:17.319 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:18:17.323 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:18:47.492 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:18:47.496 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:19:17.638 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:19:17.641 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:19:47.768 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:19:47.772 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:20:17.824 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:20:17.828 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:20:47.888 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:20:47.892 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:21:17.964 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:21:17.967 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:21:48.090 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:21:48.094 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:22:18.232 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:22:18.236 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:22:48.302 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:22:48.306 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:23:18.357 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:23:18.360 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:23:48.412 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:23:48.417 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:24:18.531 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:24:18.535 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:24:48.597 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:24:48.601 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:25:18.660 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:25:18.664 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:25:48.778 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:25:48.782 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:26:19.074 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:26:19.078 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:26:49.223 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:26:49.226 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:27:19.345 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:27:19.348 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:27:49.425 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:27:49.429 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:28:19.489 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:28:19.492 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:28:49.569 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:28:49.573 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:29:19.625 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:29:19.629 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:29:49.680 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:29:49.684 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:30:19.802 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:30:19.805 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:30:49.933 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:30:49.937 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:31:20.056 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:31:20.059 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:31:50.186 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:31:50.189 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:32:20.266 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:32:20.270 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:32:50.330 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:32:50.334 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:33:20.452 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:33:20.456 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:33:50.592 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:33:50.595 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:34:20.905 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:34:20.909 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:34:50.955 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:34:50.958 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:35:21.002 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:35:21.006 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:35:51.063 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:35:51.067 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:36:21.204 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:36:21.208 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:36:51.325 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:36:51.328 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:37:21.648 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:37:21.651 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:37:51.728 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:37:51.731 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:38:21.788 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:38:21.791 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:38:51.847 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:38:51.850 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:39:21.977 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:39:21.981 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:39:52.049 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:39:52.054 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:40:22.172 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:40:22.176 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:40:52.342 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:40:52.346 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:41:22.531 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:41:22.535 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:41:52.596 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:41:52.600 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:42:22.660 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:42:22.664 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:42:52.741 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:42:52.745 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:43:22.805 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:43:22.808 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:43:52.869 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:43:52.873 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:44:22.983 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:44:22.987 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:44:53.114 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:44:53.118 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:45:23.185 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:45:23.189 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:45:53.319 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:45:53.322 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:46:23.441 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:46:23.445 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:46:53.852 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:46:53.856 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:47:23.902 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:47:23.907 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:47:53.992 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:47:53.995 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:48:24.054 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:48:24.057 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:48:54.153 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:48:54.157 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:49:24.267 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:49:24.270 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:49:54.406 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:49:54.410 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:50:24.537 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:50:24.542 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:50:54.650 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:50:54.653 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:51:24.730 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:51:24.734 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:51:54.878 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:51:54.881 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:52:24.992 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:52:24.995 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:52:55.072 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:52:55.076 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:53:25.144 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:53:25.148 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:53:55.209 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:53:55.212 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:54:25.273 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:54:25.277 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:54:55.329 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:54:55.332 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:55:25.387 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:55:25.391 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:55:55.526 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:55:55.529 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:56:25.591 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:56:25.594 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:56:55.654 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:56:55.658 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:57:25.720 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:57:25.724 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:57:55.792 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:57:55.798 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:58:25.856 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:58:25.974 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:58:56.029 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:58:56.104 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:59:26.160 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:59:26.177 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:59:56.226 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T17:59:56.250 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:00:34.467 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:01:11.749 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:01:48.828 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:01:48.858 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:02:19.893 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:02:19.948 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:02:50.521 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:02:50.528 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:03:21.431 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:03:21.446 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:03:51.547 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:03:51.565 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:04:21.619 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:04:21.631 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:04:51.683 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:04:51.695 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:05:21.780 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:05:21.792 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:05:51.862 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:05:52.121 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:06:22.717 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:06:22.721 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:06:52.966 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:06:52.997 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:07:23.038 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:07:23.042 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:07:53.143 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:07:53.147 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:08:23.225 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:08:23.229 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:08:53.289 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:08:53.293 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:09:23.344 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:09:23.348 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:09:53.501 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:09:53.505 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:10:23.565 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:10:24.754 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:10:54.813 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:10:54.817 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:11:24.868 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:11:24.896 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:11:55.225 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:12:08.102 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:12:38.162 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:12:38.169 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:13:08.225 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:13:08.230 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:13:38.390 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:13:38.415 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:14:08.512 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:14:08.516 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:14:38.635 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:14:38.639 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:15:08.773 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:15:08.778 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:15:38.881 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:15:38.886 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:16:08.944 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:16:08.949 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:16:39.092 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:16:39.096 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:17:09.241 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:17:09.245 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:17:39.380 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:17:39.384 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:18:09.437 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:18:09.440 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:18:39.507 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:18:39.511 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:19:09.566 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:19:09.570 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:19:39.628 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:19:39.632 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:20:09.776 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:20:09.780 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:20:39.914 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:20:39.919 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:21:09.964 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:21:09.968 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:21:40.084 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:21:40.089 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:22:10.197 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:22:10.201 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:22:40.338 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:22:40.341 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:23:10.401 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:23:10.404 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:23:40.481 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:23:40.485 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:24:10.541 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:24:10.545 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:24:40.690 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:24:40.694 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:25:10.754 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:25:10.759 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:25:40.871 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:25:40.875 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:26:10.985 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:26:10.989 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:26:41.166 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:26:41.170 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:27:11.244 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:27:11.248 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:27:41.310 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:27:41.313 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:28:11.448 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:28:11.453 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:28:41.538 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:28:41.542 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:29:11.610 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:29:11.614 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:29:41.673 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:29:41.678 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:30:11.730 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:30:11.735 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:30:41.868 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:30:41.873 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:31:11.990 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:31:11.994 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:31:42.062 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:31:42.066 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:32:12.185 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:32:12.188 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:32:42.307 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:32:42.311 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:33:12.430 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:33:12.434 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:33:42.519 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:33:42.524 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:34:12.649 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:34:12.653 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:34:42.814 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:34:42.819 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:35:12.879 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:35:12.883 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:35:42.934 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:35:42.938 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:36:13.006 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:36:13.010 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:36:43.066 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:36:43.070 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:37:13.175 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:37:13.179 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:37:43.323 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:37:43.327 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:38:13.454 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:38:13.458 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:38:43.534 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:38:43.538 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:39:13.597 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:39:13.601 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:39:43.661 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:39:43.665 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:40:13.804 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:40:13.808 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:40:43.858 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:40:43.862 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:41:13.921 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:41:13.925 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:41:43.976 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:41:43.980 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:42:14.099 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:42:14.103 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:42:44.204 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:42:44.208 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:43:14.311 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:43:14.315 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:43:44.392 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:43:44.396 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:44:14.531 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:44:14.536 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:44:44.645 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:44:44.649 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:45:14.768 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:45:14.772 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:45:44.874 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:45:44.878 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:46:14.922 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:46:14.926 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:46:44.978 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:46:44.982 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:47:15.050 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:47:15.054 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:47:45.140 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:47:45.172 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:48:15.228 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:48:15.232 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:48:45.292 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:48:45.297 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:49:15.356 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:49:15.361 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:49:45.495 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:49:45.500 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:50:15.559 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:50:15.563 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:50:45.615 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:50:45.619 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:51:15.746 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:51:15.750 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:51:45.804 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:51:45.808 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:52:15.902 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:52:15.905 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:52:45.967 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:52:45.971 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:53:16.135 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:53:16.140 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:53:46.224 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:53:46.228 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:54:16.285 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:54:16.289 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:54:46.411 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:54:46.415 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:55:16.467 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:55:16.472 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:55:46.607 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:55:46.610 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:56:16.676 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:56:16.679 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:56:46.793 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:56:46.797 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:57:16.882 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:57:16.886 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:57:47.238 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:57:47.243 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:58:17.294 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:58:17.298 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:58:47.374 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:58:47.378 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:59:17.438 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:59:17.442 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:59:47.494 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T18:59:47.499 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:00:17.633 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:00:17.637 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:00:47.747 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:00:47.751 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:01:17.885 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:01:17.889 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:01:48.008 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:01:48.012 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:02:18.198 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:02:18.202 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:02:48.260 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:02:48.264 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:03:18.391 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:03:18.395 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:03:48.463 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:03:48.467 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:04:18.531 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:04:18.535 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:04:48.701 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:04:48.705 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:05:18.763 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:05:18.767 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:05:48.820 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:05:48.824 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:06:18.883 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:06:18.887 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:06:49.007 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:06:49.011 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:07:19.112 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:07:19.117 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:07:49.235 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:07:49.238 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:08:19.298 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:08:19.302 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:08:49.388 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:08:49.391 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:09:19.542 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:09:19.546 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:09:49.601 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:09:49.604 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:10:19.671 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:10:19.675 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:10:49.744 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:10:49.747 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:11:19.799 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:11:19.803 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:11:49.939 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:11:49.942 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:12:20.060 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:12:20.064 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:12:50.191 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:12:50.195 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:13:20.295 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:13:20.300 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:13:50.367 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:13:50.371 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:14:20.490 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:14:20.493 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:14:50.612 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:14:50.617 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:15:20.733 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:15:20.737 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:15:50.881 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:15:50.884 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:16:20.950 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:16:20.953 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:16:51.000 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:16:51.005 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:17:21.079 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:17:21.083 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:17:51.135 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:17:51.147 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:18:21.300 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:18:21.304 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:18:51.380 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:18:51.383 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:19:21.435 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:19:21.439 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:19:51.491 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:19:51.495 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:20:21.637 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:20:21.641 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:20:51.693 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:20:51.697 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:21:21.813 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:21:21.817 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:21:51.878 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:21:51.881 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:22:21.943 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:22:21.947 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:22:51.999 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:22:52.003 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:23:22.176 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:23:22.181 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:23:52.266 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:23:52.270 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:24:22.324 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:24:22.328 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:24:52.451 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:24:52.454 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:25:22.522 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:25:22.526 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:25:52.579 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:25:52.583 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:26:22.732 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:26:22.736 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:26:52.857 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:26:52.860 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:27:22.920 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:27:22.923 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:27:52.984 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:27:52.987 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:28:23.040 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:28:23.045 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:28:53.121 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:28:53.125 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:29:23.401 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:29:23.408 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:29:53.474 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:29:53.478 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:30:23.613 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:30:23.616 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:30:53.743 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:30:53.749 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:31:23.891 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:31:23.895 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:31:54.030 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:31:54.035 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:32:24.177 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:32:24.180 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:32:54.324 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:32:54.340 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:33:24.502 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:33:24.505 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:33:54.660 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:33:54.664 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:34:24.742 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:34:24.745 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:34:54.813 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:34:54.817 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:35:24.875 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:35:24.879 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:35:54.931 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:35:54.935 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:36:24.989 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:36:24.993 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:36:55.053 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:36:55.057 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:37:25.123 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:37:25.127 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:37:55.255 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:37:55.259 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:38:25.393 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:38:25.397 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:38:55.457 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:38:55.461 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:39:25.604 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:39:25.608 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:39:55.751 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:39:55.755 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:40:25.808 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:40:25.812 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:40:55.880 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:40:55.885 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:41:25.942 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:41:25.946 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:41:56.049 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:41:56.053 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:42:26.115 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:42:26.119 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:42:56.241 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:42:56.245 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:43:26.364 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:43:26.367 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:43:56.423 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:43:56.427 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:44:26.483 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:44:26.486 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:44:56.544 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:44:56.548 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:45:26.677 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:45:26.681 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:45:56.941 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:45:56.949 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:46:27.004 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:46:27.008 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:46:57.068 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:46:57.071 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:47:27.141 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:47:27.145 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:47:57.271 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:47:57.275 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:48:27.384 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:48:27.388 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:48:57.457 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:48:57.461 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:49:27.596 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:49:27.600 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:49:57.661 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:49:57.664 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:50:27.716 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:50:27.720 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:50:57.789 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:50:57.794 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:51:27.901 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:51:27.905 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:51:58.182 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:51:58.186 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:52:28.248 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:52:28.252 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:52:58.337 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:52:58.341 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:53:28.406 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:53:28.410 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:53:58.478 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:53:58.482 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:54:28.542 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:54:28.546 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:54:58.673 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:54:58.677 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:55:28.811 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:55:28.815 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:55:58.933 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:55:58.937 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:56:29.063 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:56:29.067 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:56:59.126 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:56:59.130 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:57:29.180 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:57:29.184 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:57:59.244 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:57:59.248 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:58:29.301 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:58:29.305 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:58:59.383 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:58:59.386 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:59:29.471 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:59:29.475 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:59:59.544 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T19:59:59.548 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:00:29.681 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:00:29.686 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:00:59.739 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:00:59.743 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:01:29.800 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:01:29.805 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:01:59.855 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:01:59.860 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:02:29.972 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:02:29.976 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:03:00.103 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:03:00.108 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:03:30.259 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:03:30.263 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:04:00.332 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:04:00.335 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:04:30.379 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:04:30.382 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:05:00.441 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:05:00.445 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:05:30.499 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:05:30.503 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:06:00.561 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:06:00.565 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:06:30.626 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:06:30.629 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:07:00.682 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:07:00.686 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:07:30.804 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:07:30.808 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:08:00.935 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:08:00.938 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:08:31.015 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:08:31.019 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:09:01.072 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:09:01.076 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:09:31.327 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:09:31.331 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:10:01.385 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:10:01.390 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:10:31.446 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:10:31.449 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:11:01.527 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:11:01.530 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:11:31.673 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:11:31.677 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:12:01.796 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:12:01.799 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:12:31.935 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:12:31.939 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:13:02.119 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:13:02.122 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:13:32.170 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:13:32.173 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:14:02.242 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:14:02.246 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:14:32.357 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:14:32.361 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:15:02.487 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:15:02.491 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:15:32.548 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:15:32.552 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:16:02.615 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:16:02.619 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:16:32.679 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:16:32.682 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:17:02.742 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:17:02.746 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:17:32.922 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:17:32.926 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:18:02.977 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:18:02.981 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:18:33.096 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:18:33.100 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:19:03.171 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:19:03.176 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:19:33.229 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:19:33.233 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:20:03.293 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:20:03.297 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:20:33.597 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:20:33.601 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:21:03.652 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:21:03.657 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:21:33.799 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:21:33.803 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:22:03.849 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:22:03.852 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:22:33.921 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:22:33.925 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:23:03.981 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:23:03.985 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:23:34.104 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:23:34.108 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:24:04.176 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:24:04.180 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:24:34.298 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:24:34.301 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:25:04.412 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:25:04.415 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:25:34.542 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:25:34.546 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:26:04.656 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:26:04.660 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:26:34.762 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:26:34.765 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:27:04.874 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:27:04.878 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:27:35.015 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:27:35.018 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:28:05.077 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:28:05.081 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:28:35.149 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:28:35.153 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:29:05.230 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:29:05.234 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:29:35.335 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:29:35.339 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:30:05.391 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:30:05.395 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:30:35.480 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:30:35.484 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:31:05.536 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:31:05.540 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:31:35.598 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:31:35.602 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:32:05.662 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:32:05.666 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:32:35.801 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:32:35.804 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:33:05.922 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:33:05.926 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:33:36.220 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:33:36.223 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:34:06.300 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:34:06.305 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:34:36.364 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:34:36.367 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:35:06.427 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:35:06.431 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:35:36.550 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:35:36.554 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:36:06.679 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:36:06.684 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:36:36.809 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:36:36.813 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:37:06.874 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:37:06.877 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:37:36.944 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:37:36.948 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:38:07.060 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:38:07.063 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:38:37.132 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:38:37.135 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:39:07.212 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:39:07.215 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:39:37.276 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:39:37.280 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:40:07.331 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:40:07.335 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:40:37.395 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:40:37.398 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:41:07.541 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:41:07.545 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:41:37.606 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:41:37.609 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:42:07.728 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:42:07.731 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:42:37.849 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:42:37.853 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:43:07.955 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:43:07.959 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:43:38.059 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:43:38.063 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:44:08.131 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:44:08.135 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:44:38.187 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:44:38.190 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:45:08.235 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:45:08.239 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:45:38.298 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:45:38.302 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:46:08.362 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:46:08.365 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:46:38.508 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:46:38.512 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:47:08.649 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:47:08.652 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:47:38.786 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:47:38.790 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:48:08.891 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:48:08.895 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:48:39.014 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:48:39.022 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:49:09.086 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:49:09.089 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:49:39.146 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:49:39.149 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:50:09.262 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:50:09.266 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:50:39.441 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:50:39.445 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:51:09.624 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:51:09.628 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:51:39.679 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:51:39.682 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:52:09.741 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:52:09.745 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:52:39.806 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:52:39.809 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:53:09.929 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:53:09.933 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:53:39.991 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:53:39.994 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:54:10.055 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:54:10.060 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:54:40.169 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:54:40.173 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:55:10.291 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:55:10.295 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:55:40.396 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:55:40.400 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:56:10.510 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:56:10.514 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:56:40.616 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:56:40.620 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:57:10.855 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:57:10.858 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:57:40.930 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:57:40.933 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:58:10.991 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:58:10.995 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:58:41.047 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:58:41.051 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:59:11.119 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:59:11.123 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:59:41.175 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T20:59:41.179 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:00:11.224 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:00:11.227 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:00:41.352 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:00:41.355 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:01:11.501 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:01:11.504 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:01:41.597 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:01:41.601 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:02:11.728 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:02:11.732 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:02:41.842 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:02:41.846 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:03:11.906 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:03:11.910 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:03:41.978 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:03:41.982 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:04:12.051 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:04:12.055 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:04:42.114 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:04:42.118 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:05:12.179 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:05:12.183 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:05:42.230 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:05:42.234 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:06:12.310 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:06:12.314 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:06:42.371 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:06:42.374 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:07:12.425 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:07:12.429 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:07:42.488 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:07:42.492 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:08:12.545 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:08:12.548 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:08:42.608 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:08:42.612 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:09:12.680 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:09:12.684 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:09:42.745 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:09:42.749 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:10:12.800 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:10:12.803 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:10:42.897 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:10:42.901 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:11:13.010 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:11:13.013 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:11:43.149 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:11:43.153 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:12:13.278 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:12:13.282 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:12:43.408 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:12:43.412 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:13:13.532 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:13:13.536 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:13:43.679 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:13:43.683 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:14:13.760 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:14:13.763 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:14:43.824 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:14:43.827 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:15:13.888 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:15:13.892 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:15:44.077 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:15:44.081 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:16:14.140 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:16:14.144 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:16:44.205 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:16:44.209 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:17:14.260 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:17:14.263 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:17:44.382 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:17:44.386 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:18:14.512 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:18:14.516 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:18:44.567 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:18:44.570 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:19:14.639 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:19:14.643 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:19:44.695 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:19:44.699 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:20:14.758 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:20:14.761 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:20:44.822 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:20:44.825 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:21:14.885 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:21:14.889 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:21:44.950 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:21:44.973 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:22:15.030 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:22:15.034 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:22:45.086 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:22:45.090 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:23:15.149 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:23:15.152 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:23:45.204 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:23:45.208 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:24:15.277 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:24:15.280 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:24:45.451 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:24:45.454 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:25:15.587 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:25:15.590 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:25:45.809 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:25:45.813 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:26:15.859 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:26:15.862 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:26:45.920 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:26:45.925 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:27:15.983 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:27:15.987 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:27:46.039 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:27:46.042 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:28:16.174 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:28:16.178 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:28:46.226 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:28:46.229 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:29:16.298 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:29:16.302 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:29:46.353 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:29:46.357 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:30:16.413 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:30:16.416 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:30:46.465 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:30:46.469 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:31:16.520 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:31:16.524 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:31:46.584 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:31:46.588 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:32:16.665 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:32:16.669 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:32:46.733 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:32:46.737 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:33:16.796 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:33:16.800 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:33:46.844 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:33:46.847 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:34:16.916 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:34:16.920 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:34:47.056 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:34:47.060 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:35:17.128 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:35:17.131 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:35:47.176 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:35:47.180 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:36:17.332 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:36:17.336 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:36:47.579 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:36:47.584 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:37:17.643 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:37:17.647 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:37:47.724 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:37:47.728 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:38:17.788 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:38:17.792 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:38:47.835 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:38:47.981 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:39:18.049 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:39:18.053 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:39:48.179 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:39:48.183 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:40:18.319 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:40:18.323 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:40:48.367 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:40:48.371 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:41:18.430 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:41:18.433 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:41:48.560 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:41:48.564 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:42:18.808 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:42:18.812 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:42:49.031 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:42:49.034 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:43:19.086 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:43:19.090 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:43:49.150 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:43:49.153 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:44:19.231 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:44:19.235 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:44:49.286 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:44:49.291 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:45:19.351 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:45:19.355 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:45:49.407 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:45:49.411 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:46:19.513 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:46:19.517 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:46:49.652 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:46:49.656 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:47:19.792 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:47:19.796 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:47:49.857 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:47:49.860 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:48:19.920 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:48:19.923 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:48:50.259 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:48:50.264 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:49:20.331 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:49:20.335 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:49:50.388 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:49:50.392 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:50:20.450 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:50:20.454 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:50:50.507 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:50:50.511 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:51:20.578 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:51:20.582 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:51:50.693 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:51:50.696 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:52:20.798 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:52:20.801 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:52:50.937 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:52:50.941 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:53:21.068 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:53:21.073 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:53:51.120 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:53:51.124 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:54:21.196 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:54:21.200 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:54:51.485 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:54:51.489 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:55:21.540 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:55:21.543 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:55:51.602 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:55:51.606 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:56:21.678 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:56:21.681 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:56:51.782 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:56:51.786 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:57:21.914 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:57:21.917 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:57:52.001 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:57:52.005 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:58:22.050 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:58:22.054 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:58:52.112 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:58:52.116 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:59:22.178 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:59:22.181 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:59:52.292 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T21:59:52.296 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:00:22.347 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:00:22.351 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:00:52.410 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:00:52.414 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:01:22.466 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:01:22.470 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:01:52.522 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:01:52.526 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:02:22.570 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:02:22.573 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:02:52.650 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:02:52.654 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:03:22.706 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:03:22.709 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:03:52.769 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:03:52.773 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:04:22.842 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:04:22.845 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:04:52.916 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:04:52.919 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:05:22.979 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:05:22.983 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:05:53.036 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:05:53.040 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:06:23.088 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:06:23.092 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:06:53.147 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:06:53.151 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:07:23.200 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:07:23.203 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:07:53.284 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:07:53.288 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:08:23.340 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:08:23.343 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:08:53.392 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:08:53.396 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:09:23.456 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:09:23.459 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:09:53.516 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:09:53.520 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:10:23.567 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:10:23.571 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:10:53.631 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:10:53.635 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:11:23.762 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:11:23.766 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:11:53.877 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:11:53.881 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:12:23.999 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:12:24.003 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:12:54.085 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:12:54.089 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:13:24.142 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:13:24.146 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:13:54.276 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:13:54.279 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:14:24.347 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:14:24.351 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:14:54.408 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:14:54.412 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:15:24.456 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:15:24.460 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:15:54.608 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:15:54.612 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:16:24.663 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:16:24.667 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:16:54.723 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:16:54.726 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:17:24.780 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:17:24.783 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:17:54.843 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:17:54.848 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:18:24.894 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:18:24.898 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:18:55.009 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:18:55.012 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:19:25.080 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:19:25.084 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:19:55.181 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:19:55.184 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:20:25.230 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:20:25.234 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:20:55.302 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:20:55.306 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:21:25.352 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:21:25.356 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:21:55.414 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:21:55.417 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:22:25.455 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:22:25.464 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:22:55.579 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:22:55.582 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:23:25.634 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:23:25.638 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:23:55.695 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:23:55.699 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:24:25.761 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:24:25.765 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:24:55.824 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:24:55.828 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:25:25.880 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:25:25.884 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:25:55.945 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:25:55.949 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:26:25.992 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:26:25.995 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:26:56.059 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:26:56.062 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:27:26.111 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:27:26.115 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:27:56.194 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:27:56.198 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:28:26.248 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:28:26.251 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:28:56.305 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:28:56.309 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:29:26.384 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:29:26.388 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:29:56.451 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:29:56.455 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:30:26.587 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:30:26.591 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:30:56.691 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:30:56.695 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:31:26.831 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:31:26.835 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:31:56.886 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:31:56.890 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:32:27.017 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:32:27.020 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:32:57.114 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:32:57.117 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:33:27.243 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:33:27.246 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:33:57.299 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:33:57.303 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:34:27.363 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:34:27.367 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:34:57.424 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:34:57.428 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:35:27.480 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:35:27.484 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:35:57.544 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:35:57.548 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:36:27.593 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:36:27.597 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:36:57.656 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:36:57.660 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:37:27.721 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:37:27.724 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:37:57.800 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:37:57.804 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:38:27.859 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:38:27.863 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:38:57.973 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:38:57.977 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:39:28.046 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:39:28.049 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:39:58.285 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:39:58.289 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:40:28.340 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:40:28.343 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:40:58.419 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:40:58.423 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:41:28.484 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:41:28.487 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:41:58.615 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:41:58.619 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:42:28.671 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:42:28.674 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:42:58.759 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:42:58.762 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:43:28.814 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:43:28.817 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:43:58.878 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:43:58.881 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:44:28.950 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:44:28.955 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:44:59.007 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:44:59.010 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:45:29.061 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:45:29.065 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:45:59.125 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:45:59.128 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:46:29.181 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:46:29.185 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:46:59.245 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:46:59.249 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:47:29.293 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:47:29.296 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:47:59.373 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:47:59.377 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:48:29.429 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:48:29.433 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:48:59.492 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:48:59.496 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:49:29.566 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:49:29.570 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:49:59.629 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:49:59.633 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:50:29.702 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:50:29.706 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:50:59.766 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:50:59.770 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:51:29.831 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:51:29.835 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:51:59.893 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:51:59.897 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:52:29.959 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:52:29.962 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:53:00.088 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:53:00.091 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:53:30.202 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:53:30.205 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:54:00.316 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:54:00.319 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:54:30.396 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:54:30.400 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:55:00.463 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:55:00.466 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:55:30.516 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:55:30.519 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:56:00.575 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:56:00.579 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:56:30.627 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:56:30.631 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:57:00.686 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:57:00.690 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:57:30.738 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:57:30.742 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:58:00.822 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:58:00.825 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:58:30.878 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:58:30.882 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:59:00.942 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:59:00.945 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:59:31.002 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T22:59:31.006 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:00:01.124 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:00:01.127 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:00:31.245 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:00:31.249 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:01:01.384 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:01:01.388 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:01:31.507 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:01:31.510 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:02:01.688 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:02:01.692 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:02:31.744 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:02:31.747 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:03:01.882 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:03:01.885 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:03:31.988 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:03:31.991 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:04:02.118 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:04:02.121 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:04:32.199 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:04:32.202 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:05:02.330 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:05:02.338 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:05:32.469 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:05:32.473 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:06:02.696 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:06:02.701 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:06:32.829 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:06:32.832 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:07:02.893 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:07:02.897 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:07:33.024 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:07:33.028 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:08:03.138 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:08:03.142 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:08:33.252 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:08:33.255 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:09:03.374 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:09:03.378 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:09:33.438 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:09:33.441 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:10:03.502 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:10:03.506 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:10:33.557 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:10:33.561 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:11:03.605 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:11:03.609 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:11:33.726 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:11:33.730 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:12:03.857 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:12:03.860 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:12:33.930 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:12:33.933 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:13:04.061 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:13:04.065 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:13:34.199 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:13:34.203 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:14:04.330 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:14:04.334 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:14:34.411 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:14:34.414 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:15:04.476 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:15:04.479 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:15:34.531 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:15:34.534 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:16:04.595 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:16:04.599 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:16:34.651 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:16:34.655 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:17:04.714 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:17:04.718 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:17:34.754 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:17:34.758 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:18:04.835 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:18:04.839 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:18:34.889 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:18:34.893 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:19:04.947 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:19:04.950 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:19:35.008 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:19:35.012 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:20:05.067 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:20:05.071 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:20:35.123 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:20:35.126 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:21:05.204 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:21:05.208 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:21:35.261 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:21:35.265 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:22:05.325 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:22:05.328 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:22:35.381 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:22:35.385 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:23:05.445 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:23:05.449 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:23:35.500 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:23:35.504 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:24:05.564 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:24:05.568 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:24:35.636 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:24:35.639 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:25:05.702 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:25:05.705 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:25:35.821 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:25:35.825 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:26:05.935 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:26:05.938 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:26:36.074 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:26:36.077 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:27:06.126 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:27:06.130 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:27:36.243 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:27:36.247 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:28:06.374 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:28:06.378 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:28:36.513 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:28:36.517 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:29:06.593 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:29:06.597 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:29:36.664 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:29:36.668 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:30:06.727 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:30:06.731 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:30:36.859 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:30:36.862 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:31:06.981 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:31:06.985 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:31:37.095 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:31:37.098 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:32:07.143 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:32:07.147 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:32:37.273 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:32:37.277 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:33:07.378 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:33:07.382 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:33:37.500 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:33:37.504 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:34:07.565 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:34:07.568 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:34:37.637 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:34:37.640 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:35:07.750 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:35:07.753 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:35:37.873 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:35:37.877 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:36:08.011 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:36:08.015 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:36:38.141 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:36:38.145 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:37:08.264 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:37:08.268 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:37:38.370 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:37:38.373 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:38:08.444 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:38:08.448 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:38:38.508 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:38:38.511 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:39:08.566 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:39:08.570 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:39:38.633 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:39:38.637 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:40:08.694 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:40:08.698 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:40:38.744 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:40:38.747 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:41:08.799 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:41:08.803 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:41:38.862 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:41:38.866 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:42:08.910 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:42:08.914 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:42:38.965 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:42:38.969 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:43:09.046 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:43:09.049 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:43:39.093 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:43:39.097 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:44:09.140 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:44:09.144 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:44:39.212 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:44:39.216 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:45:09.334 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:45:09.338 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:45:39.449 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:45:39.452 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:46:09.563 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:46:09.567 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:46:39.692 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:46:39.696 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:47:09.832 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:47:09.836 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:47:39.980 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:47:39.983 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:48:10.085 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:48:10.088 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:48:40.208 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:48:40.211 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:49:10.404 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:49:10.408 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:49:40.472 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:49:40.475 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:50:10.602 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:50:10.606 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:50:40.732 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:50:40.735 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:51:10.870 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:51:10.874 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:51:40.919 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:51:40.922 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:52:11.040 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:52:11.044 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:52:41.171 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:52:41.175 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:53:11.301 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:53:11.304 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:53:41.364 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:53:41.368 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:54:11.495 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:54:11.498 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:54:41.567 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:54:41.571 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:55:11.766 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:55:11.769 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:55:41.823 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:55:41.827 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:56:11.877 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:56:11.880 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:56:41.933 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:56:41.937 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:57:11.988 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:57:11.992 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:57:42.102 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:57:42.106 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:58:12.233 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:58:12.237 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:58:42.288 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:58:42.292 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:59:12.411 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:59:12.416 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:59:42.476 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-16T23:59:42.479 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T00:00:12.623 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T00:00:12.627 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T00:00:23.634 INFO:tasks.ceph.mon.a.smithi039.stderr:2023-05-17T00:00:23.012+0000 7fd574c80640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 99112) UID: 0 2023-05-17T00:00:23.771 INFO:tasks.ceph.mon.a.smithi039.stderr:2023-05-17T00:00:23.012+0000 7fd574c80640 -1 mon.a@0(leader) e1 *** Got Signal Hangup *** 2023-05-17T00:00:24.093 INFO:tasks.ceph.mgr.y.smithi039.stderr:2023-05-17T00:00:23.012+0000 7f09e4db9640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 99112) UID: 0 2023-05-17T00:00:24.187 INFO:tasks.ceph.osd.0.smithi039.stderr:2023-05-17T00:00:23.012+0000 7f2321db9640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 99112) UID: 0 2023-05-17T00:00:24.287 INFO:tasks.ceph.osd.1.smithi039.stderr:2023-05-17T00:00:23.012+0000 7f5fe9b82640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 99112) UID: 0 2023-05-17T00:00:24.354 INFO:tasks.ceph.osd.3.smithi039.stderr:2023-05-17T00:00:23.012+0000 7f0159e9e640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 99112) UID: 0 2023-05-17T00:00:24.431 INFO:tasks.ceph.osd.2.smithi039.stderr:2023-05-17T00:00:23.012+0000 7fa5952de640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 99112) UID: 0 2023-05-17T00:00:24.472 INFO:tasks.ceph.mds.a.smithi039.stderr:2023-05-17T00:00:23.012+0000 7f00d1579640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 99112) UID: 0 2023-05-17T00:00:24.556 INFO:tasks.ceph.mds.c.smithi039.stderr:2023-05-17T00:00:23.012+0000 7f12044af640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 99112) UID: 0 2023-05-17T00:00:24.558 INFO:tasks.ceph.mds.c.smithi039.stderr:2023-05-17T00:00:23.032+0000 7f12044af640 -1 Fail to open '/proc/99122/cmdline' error = (2) No such file or directory 2023-05-17T00:00:24.558 INFO:tasks.ceph.mds.c.smithi039.stderr:2023-05-17T00:00:23.032+0000 7f12044af640 -1 received signal: Hangup from (PID: 99122) UID: 0 2023-05-17T00:00:24.559 INFO:tasks.ceph.mgr.y.smithi039.stderr:2023-05-17T00:00:23.032+0000 7f09e4db9640 -1 Fail to read '/proc/99122/cmdline' error = (3) No such process 2023-05-17T00:00:24.578 INFO:tasks.ceph.mgr.y.smithi039.stderr:2023-05-17T00:00:23.032+0000 7f09e4db9640 -1 received signal: Hangup from (PID: 99122) UID: 0 2023-05-17T00:00:24.578 INFO:tasks.ceph.osd.0.smithi039.stderr:2023-05-17T00:00:23.032+0000 7f2321db9640 -1 Fail to open '/proc/99122/cmdline' error = (2) No such file or directory 2023-05-17T00:00:24.579 INFO:tasks.ceph.osd.0.smithi039.stderr:2023-05-17T00:00:23.032+0000 7f2321db9640 -1 received signal: Hangup from (PID: 99122) UID: 0 2023-05-17T00:00:24.579 INFO:tasks.ceph.osd.1.smithi039.stderr:2023-05-17T00:00:23.032+0000 7f5fe9b82640 -1 Fail to open '/proc/99122/cmdline' error = (2) No such file or directory 2023-05-17T00:00:24.579 INFO:tasks.ceph.osd.1.smithi039.stderr:2023-05-17T00:00:23.032+0000 7f5fe9b82640 -1 received signal: Hangup from (PID: 99122) UID: 0 2023-05-17T00:00:24.584 INFO:tasks.ceph.mds.a.smithi039.stderr:2023-05-17T00:00:23.032+0000 7f00d1579640 -1 Fail to open '/proc/99122/cmdline' error = (2) No such file or directory 2023-05-17T00:00:24.584 INFO:tasks.ceph.mds.a.smithi039.stderr:2023-05-17T00:00:23.032+0000 7f00d1579640 -1 received signal: Hangup from (PID: 99122) UID: 0 2023-05-17T00:00:24.584 INFO:tasks.ceph.mon.a.smithi039.stderr:2023-05-17T00:00:23.032+0000 7fd574c80640 -1 Fail to open '/proc/99122/cmdline' error = (2) No such file or directory 2023-05-17T00:00:24.584 INFO:tasks.ceph.mon.a.smithi039.stderr:2023-05-17T00:00:23.032+0000 7fd574c80640 -1 received signal: Hangup from (PID: 99122) UID: 0 2023-05-17T00:00:24.584 INFO:tasks.ceph.mon.a.smithi039.stderr:2023-05-17T00:00:23.032+0000 7fd574c80640 -1 mon.a@0(leader) e1 *** Got Signal Hangup *** 2023-05-17T00:00:24.605 INFO:tasks.ceph.osd.2.smithi039.stderr:2023-05-17T00:00:23.032+0000 7fa5952de640 -1 Fail to open '/proc/99122/cmdline' error = (2) No such file or directory 2023-05-17T00:00:24.606 INFO:tasks.ceph.osd.2.smithi039.stderr:2023-05-17T00:00:23.032+0000 7fa5952de640 -1 received signal: Hangup from (PID: 99122) UID: 0 2023-05-17T00:00:24.606 INFO:tasks.ceph.osd.3.smithi039.stderr:2023-05-17T00:00:23.032+0000 7f0159e9e640 -1 Fail to read '/proc/99122/cmdline' error = (3) No such process 2023-05-17T00:00:24.606 INFO:tasks.ceph.osd.3.smithi039.stderr:2023-05-17T00:00:23.032+0000 7f0159e9e640 -1 received signal: Hangup from (PID: 99122) UID: 0 2023-05-17T00:00:25.210 INFO:tasks.ceph.mon.c.smithi118.stderr:2023-05-17T00:00:25.061+0000 7f351a530640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 45261) UID: 0 2023-05-17T00:00:25.473 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-05-17T00:00:25.061+0000 7fd9f939e640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 45261) UID: 0 2023-05-17T00:00:25.564 INFO:tasks.ceph.mon.b.smithi118.stderr:2023-05-17T00:00:25.061+0000 7fa8dca93640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 45261) UID: 0 2023-05-17T00:00:25.577 INFO:tasks.ceph.mon.b.smithi118.stderr:2023-05-17T00:00:25.061+0000 7fa8dca93640 -1 mon.b@1(peon) e1 *** Got Signal Hangup *** 2023-05-17T00:00:25.577 INFO:tasks.ceph.mon.c.smithi118.stderr:2023-05-17T00:00:25.061+0000 7f351a530640 -1 mon.c@2(peon) e1 *** Got Signal Hangup *** 2023-05-17T00:00:25.645 INFO:tasks.ceph.osd.4.smithi118.stderr:2023-05-17T00:00:25.061+0000 7f3f526b5640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 45261) UID: 0 2023-05-17T00:00:25.692 INFO:tasks.ceph.osd.5.smithi118.stderr:2023-05-17T00:00:25.061+0000 7fec6fd33640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 45261) UID: 0 2023-05-17T00:00:25.698 INFO:tasks.ceph.osd.6.smithi118.stderr:2023-05-17T00:00:25.061+0000 7fd930d52640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 45261) UID: 0 2023-05-17T00:00:25.728 INFO:tasks.ceph.osd.7.smithi118.stderr:2023-05-17T00:00:25.061+0000 7fe14bc2c640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 45261) UID: 0 2023-05-17T00:00:25.781 INFO:tasks.ceph.mds.b.smithi118.stderr:2023-05-17T00:00:25.061+0000 7fa42c384640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 45261) UID: 0 2023-05-17T00:00:25.815 INFO:tasks.ceph.mds.d.smithi118.stderr:2023-05-17T00:00:25.061+0000 7f067383d640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 45261) UID: 0 2023-05-17T00:00:25.832 INFO:tasks.ceph.mon.b.smithi118.stderr:2023-05-17T00:00:25.081+0000 7fa8dca93640 -1 Fail to open '/proc/45275/cmdline' error = (2) No such file or directory 2023-05-17T00:00:25.833 INFO:tasks.ceph.mds.d.smithi118.stderr:2023-05-17T00:00:25.081+0000 7f067383d640 -1 Fail to open '/proc/45275/cmdline' error = (2) No such file or directory 2023-05-17T00:00:25.833 INFO:tasks.ceph.mds.d.smithi118.stderr:2023-05-17T00:00:25.081+0000 7f067383d640 -1 received signal: Hangup from (PID: 45275) UID: 0 2023-05-17T00:00:25.833 INFO:tasks.ceph.mon.c.smithi118.stderr:2023-05-17T00:00:25.081+0000 7f351a530640 -1 Fail to read '/proc/45275/cmdline' error = (3) No such process 2023-05-17T00:00:25.834 INFO:tasks.ceph.mon.c.smithi118.stderr:2023-05-17T00:00:25.081+0000 7f351a530640 -1 received signal: Hangup from (PID: 45275) UID: 0 2023-05-17T00:00:25.834 INFO:tasks.ceph.mon.c.smithi118.stderr:2023-05-17T00:00:25.081+0000 7f351a530640 -1 mon.c@2(peon) e1 *** Got Signal Hangup *** 2023-05-17T00:00:25.834 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-05-17T00:00:25.081+0000 7fd9f939e640 -1 Fail to open '/proc/45275/cmdline' error = (2) No such file or directory 2023-05-17T00:00:25.835 INFO:tasks.ceph.mgr.x.smithi118.stderr:2023-05-17T00:00:25.081+0000 7fd9f939e640 -1 received signal: Hangup from (PID: 45275) UID: 0 2023-05-17T00:00:25.835 INFO:tasks.ceph.mon.b.smithi118.stderr:2023-05-17T00:00:25.081+0000 7fa8dca93640 -1 received signal: Hangup from (PID: 45275) UID: 0 2023-05-17T00:00:25.835 INFO:tasks.ceph.mon.b.smithi118.stderr:2023-05-17T00:00:25.081+0000 7fa8dca93640 -1 mon.b@1(peon) e1 *** Got Signal Hangup *** 2023-05-17T00:00:25.837 INFO:tasks.ceph.osd.4.smithi118.stderr:2023-05-17T00:00:25.081+0000 7f3f526b5640 -1 Fail to open '/proc/45275/cmdline' error = (2) No such file or directory 2023-05-17T00:00:25.837 INFO:tasks.ceph.osd.4.smithi118.stderr:2023-05-17T00:00:25.081+0000 7f3f526b5640 -1 received signal: Hangup from (PID: 45275) UID: 0 2023-05-17T00:00:25.838 INFO:tasks.ceph.osd.5.smithi118.stderr:2023-05-17T00:00:25.081+0000 7fec6fd33640 -1 Fail to open '/proc/45275/cmdline' error = (2) No such file or directory 2023-05-17T00:00:25.838 INFO:tasks.ceph.osd.5.smithi118.stderr:2023-05-17T00:00:25.081+0000 7fec6fd33640 -1 received signal: Hangup from (PID: 45275) UID: 0 2023-05-17T00:00:25.839 INFO:tasks.ceph.osd.6.smithi118.stderr:2023-05-17T00:00:25.081+0000 7fd930d52640 -1 Fail to open '/proc/45275/cmdline' error = (2) No such file or directory 2023-05-17T00:00:25.839 INFO:tasks.ceph.osd.6.smithi118.stderr:2023-05-17T00:00:25.081+0000 7fd930d52640 -1 received signal: Hangup from (PID: 45275) UID: 0 2023-05-17T00:00:25.839 INFO:tasks.ceph.osd.7.smithi118.stderr:2023-05-17T00:00:25.081+0000 7fe14bc2c640 -1 Fail to open '/proc/45275/cmdline' error = (2) No such file or directory 2023-05-17T00:00:25.840 INFO:tasks.ceph.osd.7.smithi118.stderr:2023-05-17T00:00:25.081+0000 7fe14bc2c640 -1 received signal: Hangup from (PID: 45275) UID: 0 2023-05-17T00:00:25.840 INFO:tasks.ceph.mds.b.smithi118.stderr:2023-05-17T00:00:25.081+0000 7fa42c384640 -1 Fail to open '/proc/45275/cmdline' error = (2) No such file or directory 2023-05-17T00:00:25.840 INFO:tasks.ceph.mds.b.smithi118.stderr:2023-05-17T00:00:25.081+0000 7fa42c384640 -1 received signal: Hangup from (PID: 45275) UID: 0 2023-05-17T00:00:42.685 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T00:00:42.710 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T00:00:42.793 INFO:teuthology.orchestra.run.smithi039.stderr:error: state file /var/lib/logrotate/status is already locked 2023-05-17T00:00:42.817 INFO:teuthology.orchestra.run.smithi039.stderr:logrotate does not support parallel execution on the same set of logfiles. 2023-05-17T00:00:42.819 DEBUG:teuthology.orchestra.run:got remote process result: 3 2023-05-17T00:00:42.825 INFO:teuthology.orchestra.run.smithi118.stderr:error: state file /var/lib/logrotate/status is already locked 2023-05-17T00:00:42.825 INFO:teuthology.orchestra.run.smithi118.stderr:logrotate does not support parallel execution on the same set of logfiles. 2023-05-17T00:00:47.659 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_ceph-c_27be51263d3d0c721b6d1ca9f42550bf0ab3c97b/qa/tasks/ceph.py", line 188, in invoke_logrotate run.wait(procs) File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi039 with status 3: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' 2023-05-17T01:37:34.621 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-05-17T01:37:35.411 DEBUG:teuthology.task.console_log:Killing console logger for smithi039 2023-05-17T01:37:36.188 DEBUG:teuthology.task.console_log:Killing console logger for smithi118 2023-05-17T01:37:36.195 DEBUG:teuthology.exit:Finished running handlers